=== RUN TestStartStop/group/old-k8s-version/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run: out/minikube-linux-arm64 start -p old-k8s-version-584140 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=crio --kubernetes-version=v1.20.0
E0722 11:28:30.762214 7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/addons-578168/client.crt: no such file or directory
E0722 11:29:19.083454 7564 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/functional-430070/client.crt: no such file or directory
start_stop_delete_test.go:256: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p old-k8s-version-584140 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=crio --kubernetes-version=v1.20.0: exit status 102 (6m11.014876946s)
-- stdout --
* [old-k8s-version-584140] minikube v1.33.1 on Ubuntu 20.04 (arm64)
- MINIKUBE_LOCATION=19313
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/19313-2237/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/19313-2237/.minikube
- MINIKUBE_BIN=out/minikube-linux-arm64
- MINIKUBE_FORCE_SYSTEMD=
* Kubernetes 1.30.3 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.30.3
* Using the docker driver based on existing profile
* Starting "old-k8s-version-584140" primary control-plane node in "old-k8s-version-584140" cluster
* Pulling base image v0.0.44-1721324606-19298 ...
* Restarting existing docker container for "old-k8s-version-584140" ...
* Preparing Kubernetes v1.20.0 on CRI-O 1.24.6 ...
* Verifying Kubernetes components...
- Using image gcr.io/k8s-minikube/storage-provisioner:v5
- Using image fake.domain/registry.k8s.io/echoserver:1.4
- Using image docker.io/kubernetesui/dashboard:v2.7.0
- Using image registry.k8s.io/echoserver:1.4
* Some dashboard features require the metrics-server addon. To enable all features please run:
minikube -p old-k8s-version-584140 addons enable metrics-server
* Enabled addons: metrics-server, storage-provisioner, dashboard, default-storageclass
-- /stdout --
** stderr **
I0722 11:26:13.583198 210080 out.go:291] Setting OutFile to fd 1 ...
I0722 11:26:13.583425 210080 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0722 11:26:13.583438 210080 out.go:304] Setting ErrFile to fd 2...
I0722 11:26:13.583443 210080 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0722 11:26:13.583731 210080 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19313-2237/.minikube/bin
I0722 11:26:13.584184 210080 out.go:298] Setting JSON to false
I0722 11:26:13.585347 210080 start.go:129] hostinfo: {"hostname":"ip-172-31-21-244","uptime":4118,"bootTime":1721643455,"procs":210,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1064-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"da8ac1fd-6236-412a-a346-95873c98230d"}
I0722 11:26:13.585419 210080 start.go:139] virtualization:
I0722 11:26:13.589343 210080 out.go:177] * [old-k8s-version-584140] minikube v1.33.1 on Ubuntu 20.04 (arm64)
I0722 11:26:13.591205 210080 notify.go:220] Checking for updates...
I0722 11:26:13.596939 210080 out.go:177] - MINIKUBE_LOCATION=19313
I0722 11:26:13.598533 210080 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0722 11:26:13.600277 210080 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/19313-2237/kubeconfig
I0722 11:26:13.602332 210080 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/19313-2237/.minikube
I0722 11:26:13.604070 210080 out.go:177] - MINIKUBE_BIN=out/minikube-linux-arm64
I0722 11:26:13.606055 210080 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0722 11:26:13.608200 210080 config.go:182] Loaded profile config "old-k8s-version-584140": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0722 11:26:13.610698 210080 out.go:177] * Kubernetes 1.30.3 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.30.3
I0722 11:26:13.612496 210080 driver.go:392] Setting default libvirt URI to qemu:///system
I0722 11:26:13.641141 210080 docker.go:123] docker version: linux-27.0.3:Docker Engine - Community
I0722 11:26:13.641252 210080 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0722 11:26:13.724717 210080 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:39 OomKillDisable:true NGoroutines:53 SystemTime:2024-07-22 11:26:13.71528019 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1064-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aarc
h64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214896640 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:27.0.3 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41 Expected:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerError
s:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.15.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.28.1]] Warnings:<nil>}}
I0722 11:26:13.724830 210080 docker.go:307] overlay module found
I0722 11:26:13.727750 210080 out.go:177] * Using the docker driver based on existing profile
I0722 11:26:13.729447 210080 start.go:297] selected driver: docker
I0722 11:26:13.729468 210080 start.go:901] validating driver "docker" against &{Name:old-k8s-version-584140 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-584140 Namespace:default APIServerHAVIP: AP
IServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountStr
ing:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0722 11:26:13.729586 210080 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0722 11:26:13.730271 210080 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0722 11:26:13.817237 210080 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:39 OomKillDisable:true NGoroutines:53 SystemTime:2024-07-22 11:26:13.808328456 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1064-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214896640 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:27.0.3 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41 Expected:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.15.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.28.1]] Warnings:<nil>}}
I0722 11:26:13.817567 210080 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0722 11:26:13.817587 210080 cni.go:84] Creating CNI manager for ""
I0722 11:26:13.817596 210080 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
I0722 11:26:13.817643 210080 start.go:340] cluster config:
{Name:old-k8s-version-584140 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-584140 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local
ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP
: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0722 11:26:13.819906 210080 out.go:177] * Starting "old-k8s-version-584140" primary control-plane node in "old-k8s-version-584140" cluster
I0722 11:26:13.821751 210080 cache.go:121] Beginning downloading kic base image for docker with crio
I0722 11:26:13.823684 210080 out.go:177] * Pulling base image v0.0.44-1721324606-19298 ...
I0722 11:26:13.827204 210080 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0722 11:26:13.827271 210080 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19313-2237/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-arm64.tar.lz4
I0722 11:26:13.827293 210080 cache.go:56] Caching tarball of preloaded images
I0722 11:26:13.827379 210080 preload.go:172] Found /home/jenkins/minikube-integration/19313-2237/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-arm64.tar.lz4 in cache, skipping download
I0722 11:26:13.827388 210080 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on crio
I0722 11:26:13.827498 210080 profile.go:143] Saving config to /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/old-k8s-version-584140/config.json ...
I0722 11:26:13.827729 210080 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f in local docker daemon
W0722 11:26:13.848183 210080 image.go:95] image gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f is of wrong architecture
I0722 11:26:13.848202 210080 cache.go:149] Downloading gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f to local cache
I0722 11:26:13.848291 210080 image.go:63] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f in local cache directory
I0722 11:26:13.848309 210080 image.go:66] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f in local cache directory, skipping pull
I0722 11:26:13.848314 210080 image.go:135] gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f exists in cache, skipping pull
I0722 11:26:13.848322 210080 cache.go:152] successfully saved gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f as a tarball
I0722 11:26:13.848327 210080 cache.go:162] Loading gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f from local cache
I0722 11:26:13.976175 210080 cache.go:164] successfully loaded and using gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f from cached tarball
I0722 11:26:13.976221 210080 cache.go:194] Successfully downloaded all kic artifacts
I0722 11:26:13.976258 210080 start.go:360] acquireMachinesLock for old-k8s-version-584140: {Name:mkb562e2b9b0fb1f72dbe73cc5483758be061e7f Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0722 11:26:13.976342 210080 start.go:364] duration metric: took 54.993µs to acquireMachinesLock for "old-k8s-version-584140"
I0722 11:26:13.976368 210080 start.go:96] Skipping create...Using existing machine configuration
I0722 11:26:13.976377 210080 fix.go:54] fixHost starting:
I0722 11:26:13.976657 210080 cli_runner.go:164] Run: docker container inspect old-k8s-version-584140 --format={{.State.Status}}
I0722 11:26:13.994422 210080 fix.go:112] recreateIfNeeded on old-k8s-version-584140: state=Stopped err=<nil>
W0722 11:26:13.994452 210080 fix.go:138] unexpected machine state, will restart: <nil>
I0722 11:26:13.996999 210080 out.go:177] * Restarting existing docker container for "old-k8s-version-584140" ...
I0722 11:26:13.998767 210080 cli_runner.go:164] Run: docker start old-k8s-version-584140
I0722 11:26:14.335604 210080 cli_runner.go:164] Run: docker container inspect old-k8s-version-584140 --format={{.State.Status}}
I0722 11:26:14.367790 210080 kic.go:430] container "old-k8s-version-584140" state is running.
I0722 11:26:14.368188 210080 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-584140
I0722 11:26:14.394947 210080 profile.go:143] Saving config to /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/old-k8s-version-584140/config.json ...
I0722 11:26:14.395176 210080 machine.go:94] provisionDockerMachine start ...
I0722 11:26:14.395245 210080 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-584140
I0722 11:26:14.421396 210080 main.go:141] libmachine: Using SSH client type: native
I0722 11:26:14.421707 210080 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2cd0] 0x3e5530 <nil> [] 0s} 127.0.0.1 33063 <nil> <nil>}
I0722 11:26:14.421724 210080 main.go:141] libmachine: About to run SSH command:
hostname
I0722 11:26:14.422331 210080 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: EOF
I0722 11:26:17.569193 210080 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-584140
I0722 11:26:17.569218 210080 ubuntu.go:169] provisioning hostname "old-k8s-version-584140"
I0722 11:26:17.569288 210080 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-584140
I0722 11:26:17.589637 210080 main.go:141] libmachine: Using SSH client type: native
I0722 11:26:17.589976 210080 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2cd0] 0x3e5530 <nil> [] 0s} 127.0.0.1 33063 <nil> <nil>}
I0722 11:26:17.589997 210080 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-584140 && echo "old-k8s-version-584140" | sudo tee /etc/hostname
I0722 11:26:17.737837 210080 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-584140
I0722 11:26:17.737927 210080 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-584140
I0722 11:26:17.762830 210080 main.go:141] libmachine: Using SSH client type: native
I0722 11:26:17.763121 210080 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2cd0] 0x3e5530 <nil> [] 0s} 127.0.0.1 33063 <nil> <nil>}
I0722 11:26:17.763145 210080 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-584140' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-584140/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-584140' | sudo tee -a /etc/hosts;
fi
fi
I0722 11:26:17.908847 210080 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0722 11:26:17.908953 210080 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/19313-2237/.minikube CaCertPath:/home/jenkins/minikube-integration/19313-2237/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19313-2237/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19313-2237/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19313-2237/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19313-2237/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19313-2237/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19313-2237/.minikube}
I0722 11:26:17.909008 210080 ubuntu.go:177] setting up certificates
I0722 11:26:17.909036 210080 provision.go:84] configureAuth start
I0722 11:26:17.909124 210080 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-584140
I0722 11:26:17.938675 210080 provision.go:143] copyHostCerts
I0722 11:26:17.938755 210080 exec_runner.go:144] found /home/jenkins/minikube-integration/19313-2237/.minikube/key.pem, removing ...
I0722 11:26:17.938764 210080 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19313-2237/.minikube/key.pem
I0722 11:26:17.938835 210080 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19313-2237/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19313-2237/.minikube/key.pem (1679 bytes)
I0722 11:26:17.938930 210080 exec_runner.go:144] found /home/jenkins/minikube-integration/19313-2237/.minikube/ca.pem, removing ...
I0722 11:26:17.938936 210080 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19313-2237/.minikube/ca.pem
I0722 11:26:17.938962 210080 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19313-2237/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19313-2237/.minikube/ca.pem (1078 bytes)
I0722 11:26:17.939018 210080 exec_runner.go:144] found /home/jenkins/minikube-integration/19313-2237/.minikube/cert.pem, removing ...
I0722 11:26:17.939023 210080 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19313-2237/.minikube/cert.pem
I0722 11:26:17.939047 210080 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19313-2237/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19313-2237/.minikube/cert.pem (1123 bytes)
I0722 11:26:17.939091 210080 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19313-2237/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19313-2237/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19313-2237/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-584140 san=[127.0.0.1 192.168.76.2 localhost minikube old-k8s-version-584140]
I0722 11:26:18.209155 210080 provision.go:177] copyRemoteCerts
I0722 11:26:18.209273 210080 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0722 11:26:18.209346 210080 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-584140
I0722 11:26:18.227782 210080 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33063 SSHKeyPath:/home/jenkins/minikube-integration/19313-2237/.minikube/machines/old-k8s-version-584140/id_rsa Username:docker}
I0722 11:26:18.322344 210080 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19313-2237/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0722 11:26:18.365241 210080 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19313-2237/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0722 11:26:18.402267 210080 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19313-2237/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0722 11:26:18.429257 210080 provision.go:87] duration metric: took 520.195137ms to configureAuth
I0722 11:26:18.429330 210080 ubuntu.go:193] setting minikube options for container-runtime
I0722 11:26:18.429580 210080 config.go:182] Loaded profile config "old-k8s-version-584140": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0722 11:26:18.429729 210080 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-584140
I0722 11:26:18.449005 210080 main.go:141] libmachine: Using SSH client type: native
I0722 11:26:18.449254 210080 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2cd0] 0x3e5530 <nil> [] 0s} 127.0.0.1 33063 <nil> <nil>}
I0722 11:26:18.449275 210080 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0722 11:26:18.902432 210080 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0722 11:26:18.902464 210080 machine.go:97] duration metric: took 4.507271664s to provisionDockerMachine
I0722 11:26:18.902476 210080 start.go:293] postStartSetup for "old-k8s-version-584140" (driver="docker")
I0722 11:26:18.902488 210080 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0722 11:26:18.902561 210080 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0722 11:26:18.902622 210080 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-584140
I0722 11:26:18.927570 210080 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33063 SSHKeyPath:/home/jenkins/minikube-integration/19313-2237/.minikube/machines/old-k8s-version-584140/id_rsa Username:docker}
I0722 11:26:19.037857 210080 ssh_runner.go:195] Run: cat /etc/os-release
I0722 11:26:19.043285 210080 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0722 11:26:19.043323 210080 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0722 11:26:19.043334 210080 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0722 11:26:19.043341 210080 info.go:137] Remote host: Ubuntu 22.04.4 LTS
I0722 11:26:19.043355 210080 filesync.go:126] Scanning /home/jenkins/minikube-integration/19313-2237/.minikube/addons for local assets ...
I0722 11:26:19.043412 210080 filesync.go:126] Scanning /home/jenkins/minikube-integration/19313-2237/.minikube/files for local assets ...
I0722 11:26:19.043496 210080 filesync.go:149] local asset: /home/jenkins/minikube-integration/19313-2237/.minikube/files/etc/ssl/certs/75642.pem -> 75642.pem in /etc/ssl/certs
I0722 11:26:19.043600 210080 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0722 11:26:19.057047 210080 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19313-2237/.minikube/files/etc/ssl/certs/75642.pem --> /etc/ssl/certs/75642.pem (1708 bytes)
I0722 11:26:19.084426 210080 start.go:296] duration metric: took 181.934557ms for postStartSetup
I0722 11:26:19.084544 210080 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0722 11:26:19.084601 210080 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-584140
I0722 11:26:19.109323 210080 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33063 SSHKeyPath:/home/jenkins/minikube-integration/19313-2237/.minikube/machines/old-k8s-version-584140/id_rsa Username:docker}
I0722 11:26:19.210241 210080 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I0722 11:26:19.215827 210080 fix.go:56] duration metric: took 5.239442574s for fixHost
I0722 11:26:19.215854 210080 start.go:83] releasing machines lock for "old-k8s-version-584140", held for 5.239499724s
I0722 11:26:19.215928 210080 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-584140
I0722 11:26:19.239413 210080 ssh_runner.go:195] Run: cat /version.json
I0722 11:26:19.239476 210080 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-584140
I0722 11:26:19.239754 210080 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0722 11:26:19.239810 210080 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-584140
I0722 11:26:19.264062 210080 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33063 SSHKeyPath:/home/jenkins/minikube-integration/19313-2237/.minikube/machines/old-k8s-version-584140/id_rsa Username:docker}
I0722 11:26:19.274930 210080 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33063 SSHKeyPath:/home/jenkins/minikube-integration/19313-2237/.minikube/machines/old-k8s-version-584140/id_rsa Username:docker}
I0722 11:26:19.360909 210080 ssh_runner.go:195] Run: systemctl --version
I0722 11:26:19.500284 210080 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0722 11:26:19.661981 210080 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I0722 11:26:19.666238 210080 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0722 11:26:19.680158 210080 cni.go:221] loopback cni configuration disabled: "/etc/cni/net.d/*loopback.conf*" found
I0722 11:26:19.680229 210080 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0722 11:26:19.697801 210080 cni.go:259] no active bridge cni configs found in "/etc/cni/net.d" - nothing to disable
I0722 11:26:19.697823 210080 start.go:495] detecting cgroup driver to use...
I0722 11:26:19.697855 210080 detect.go:187] detected "cgroupfs" cgroup driver on host os
I0722 11:26:19.697908 210080 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0722 11:26:19.713967 210080 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0722 11:26:19.731454 210080 docker.go:217] disabling cri-docker service (if available) ...
I0722 11:26:19.731515 210080 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0722 11:26:19.747541 210080 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0722 11:26:19.760666 210080 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0722 11:26:19.877354 210080 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0722 11:26:19.999195 210080 docker.go:233] disabling docker service ...
I0722 11:26:19.999269 210080 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0722 11:26:20.015951 210080 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0722 11:26:20.043374 210080 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0722 11:26:20.191036 210080 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0722 11:26:20.342247 210080 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0722 11:26:20.355556 210080 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0722 11:26:20.374086 210080 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.2" pause image...
I0722 11:26:20.374166 210080 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.2"|' /etc/crio/crio.conf.d/02-crio.conf"
I0722 11:26:20.390271 210080 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0722 11:26:20.390393 210080 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0722 11:26:20.401167 210080 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0722 11:26:20.412024 210080 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0722 11:26:20.422553 210080 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0722 11:26:20.433429 210080 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0722 11:26:20.445498 210080 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0722 11:26:20.454793 210080 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0722 11:26:20.552437 210080 ssh_runner.go:195] Run: sudo systemctl restart crio
I0722 11:26:21.168329 210080 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
I0722 11:26:21.168448 210080 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0722 11:26:21.180625 210080 start.go:563] Will wait 60s for crictl version
I0722 11:26:21.180720 210080 ssh_runner.go:195] Run: which crictl
I0722 11:26:21.184010 210080 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0722 11:26:21.229362 210080 start.go:579] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.24.6
RuntimeApiVersion: v1
I0722 11:26:21.229471 210080 ssh_runner.go:195] Run: crio --version
I0722 11:26:21.275698 210080 ssh_runner.go:195] Run: crio --version
I0722 11:26:21.333595 210080 out.go:177] * Preparing Kubernetes v1.20.0 on CRI-O 1.24.6 ...
I0722 11:26:21.335545 210080 cli_runner.go:164] Run: docker network inspect old-k8s-version-584140 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0722 11:26:21.358615 210080 ssh_runner.go:195] Run: grep 192.168.76.1 host.minikube.internal$ /etc/hosts
I0722 11:26:21.363023 210080 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.76.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0722 11:26:21.375208 210080 kubeadm.go:883] updating cluster {Name:old-k8s-version-584140 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-584140 Namespace:default APIServerHAVIP: APIServerName:minik
ubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins
:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0722 11:26:21.375331 210080 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0722 11:26:21.375398 210080 ssh_runner.go:195] Run: sudo crictl images --output json
I0722 11:26:21.461248 210080 crio.go:514] all images are preloaded for cri-o runtime.
I0722 11:26:21.461274 210080 crio.go:433] Images already preloaded, skipping extraction
I0722 11:26:21.461331 210080 ssh_runner.go:195] Run: sudo crictl images --output json
I0722 11:26:21.559489 210080 crio.go:514] all images are preloaded for cri-o runtime.
I0722 11:26:21.559514 210080 cache_images.go:84] Images are preloaded, skipping loading
I0722 11:26:21.559546 210080 kubeadm.go:934] updating node { 192.168.76.2 8443 v1.20.0 crio true true} ...
I0722 11:26:21.559703 210080 kubeadm.go:946] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --cgroups-per-qos=false --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///var/run/crio/crio.sock --enforce-node-allocatable= --hostname-override=old-k8s-version-584140 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.76.2
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-584140 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0722 11:26:21.559821 210080 ssh_runner.go:195] Run: crio config
I0722 11:26:21.640691 210080 cni.go:84] Creating CNI manager for ""
I0722 11:26:21.640726 210080 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
I0722 11:26:21.640738 210080 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0722 11:26:21.640816 210080 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.76.2 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-584140 NodeName:old-k8s-version-584140 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.76.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.76.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPo
dPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0722 11:26:21.641022 210080 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.76.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/crio/crio.sock
name: "old-k8s-version-584140"
kubeletExtraArgs:
node-ip: 192.168.76.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.76.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0722 11:26:21.641137 210080 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0722 11:26:21.651925 210080 binaries.go:44] Found k8s binaries, skipping transfer
I0722 11:26:21.652050 210080 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0722 11:26:21.662802 210080 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (480 bytes)
I0722 11:26:21.684553 210080 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0722 11:26:21.715792 210080 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2117 bytes)
I0722 11:26:21.750745 210080 ssh_runner.go:195] Run: grep 192.168.76.2 control-plane.minikube.internal$ /etc/hosts
I0722 11:26:21.754656 210080 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.76.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0722 11:26:21.774576 210080 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0722 11:26:21.932688 210080 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0722 11:26:21.958384 210080 certs.go:68] Setting up /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/old-k8s-version-584140 for IP: 192.168.76.2
I0722 11:26:21.958420 210080 certs.go:194] generating shared ca certs ...
I0722 11:26:21.958454 210080 certs.go:226] acquiring lock for ca certs: {Name:mkc633027ec1393c6f58c3260e76c1b2d2250318 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0722 11:26:21.958624 210080 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19313-2237/.minikube/ca.key
I0722 11:26:21.958691 210080 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19313-2237/.minikube/proxy-client-ca.key
I0722 11:26:21.958706 210080 certs.go:256] generating profile certs ...
I0722 11:26:21.958823 210080 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/old-k8s-version-584140/client.key
I0722 11:26:21.958914 210080 certs.go:359] skipping valid signed profile cert regeneration for "minikube": /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/old-k8s-version-584140/apiserver.key.e5ed41e6
I0722 11:26:21.958987 210080 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/old-k8s-version-584140/proxy-client.key
I0722 11:26:21.959133 210080 certs.go:484] found cert: /home/jenkins/minikube-integration/19313-2237/.minikube/certs/7564.pem (1338 bytes)
W0722 11:26:21.959191 210080 certs.go:480] ignoring /home/jenkins/minikube-integration/19313-2237/.minikube/certs/7564_empty.pem, impossibly tiny 0 bytes
I0722 11:26:21.959206 210080 certs.go:484] found cert: /home/jenkins/minikube-integration/19313-2237/.minikube/certs/ca-key.pem (1675 bytes)
I0722 11:26:21.959234 210080 certs.go:484] found cert: /home/jenkins/minikube-integration/19313-2237/.minikube/certs/ca.pem (1078 bytes)
I0722 11:26:21.959285 210080 certs.go:484] found cert: /home/jenkins/minikube-integration/19313-2237/.minikube/certs/cert.pem (1123 bytes)
I0722 11:26:21.959336 210080 certs.go:484] found cert: /home/jenkins/minikube-integration/19313-2237/.minikube/certs/key.pem (1679 bytes)
I0722 11:26:21.959418 210080 certs.go:484] found cert: /home/jenkins/minikube-integration/19313-2237/.minikube/files/etc/ssl/certs/75642.pem (1708 bytes)
I0722 11:26:21.960184 210080 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19313-2237/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0722 11:26:22.054659 210080 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19313-2237/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0722 11:26:22.143845 210080 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19313-2237/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0722 11:26:22.222073 210080 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19313-2237/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0722 11:26:22.274535 210080 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/old-k8s-version-584140/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0722 11:26:22.316503 210080 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/old-k8s-version-584140/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0722 11:26:22.357456 210080 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/old-k8s-version-584140/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0722 11:26:22.384942 210080 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/old-k8s-version-584140/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0722 11:26:22.412377 210080 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19313-2237/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0722 11:26:22.439953 210080 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19313-2237/.minikube/certs/7564.pem --> /usr/share/ca-certificates/7564.pem (1338 bytes)
I0722 11:26:22.467640 210080 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19313-2237/.minikube/files/etc/ssl/certs/75642.pem --> /usr/share/ca-certificates/75642.pem (1708 bytes)
I0722 11:26:22.495311 210080 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0722 11:26:22.515650 210080 ssh_runner.go:195] Run: openssl version
I0722 11:26:22.529198 210080 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0722 11:26:22.541058 210080 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0722 11:26:22.545193 210080 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Jul 22 10:30 /usr/share/ca-certificates/minikubeCA.pem
I0722 11:26:22.545296 210080 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0722 11:26:22.553748 210080 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0722 11:26:22.573418 210080 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/7564.pem && ln -fs /usr/share/ca-certificates/7564.pem /etc/ssl/certs/7564.pem"
I0722 11:26:22.586682 210080 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/7564.pem
I0722 11:26:22.590738 210080 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Jul 22 10:41 /usr/share/ca-certificates/7564.pem
I0722 11:26:22.590845 210080 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/7564.pem
I0722 11:26:22.601172 210080 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/7564.pem /etc/ssl/certs/51391683.0"
I0722 11:26:22.613811 210080 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/75642.pem && ln -fs /usr/share/ca-certificates/75642.pem /etc/ssl/certs/75642.pem"
I0722 11:26:22.623971 210080 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/75642.pem
I0722 11:26:22.628585 210080 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Jul 22 10:41 /usr/share/ca-certificates/75642.pem
I0722 11:26:22.628700 210080 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/75642.pem
I0722 11:26:22.636296 210080 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/75642.pem /etc/ssl/certs/3ec20f2e.0"
I0722 11:26:22.654565 210080 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0722 11:26:22.658724 210080 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
I0722 11:26:22.670719 210080 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
I0722 11:26:22.681812 210080 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
I0722 11:26:22.689402 210080 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
I0722 11:26:22.701167 210080 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
I0722 11:26:22.708483 210080 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
I0722 11:26:22.717153 210080 kubeadm.go:392] StartCluster: {Name:old-k8s-version-584140 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-584140 Namespace:default APIServerHAVIP: APIServerName:minikube
CA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/m
inikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0722 11:26:22.717266 210080 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0722 11:26:22.717387 210080 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0722 11:26:22.790317 210080 cri.go:89] found id: ""
I0722 11:26:22.790434 210080 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0722 11:26:22.799869 210080 kubeadm.go:408] found existing configuration files, will attempt cluster restart
I0722 11:26:22.799915 210080 kubeadm.go:593] restartPrimaryControlPlane start ...
I0722 11:26:22.799998 210080 ssh_runner.go:195] Run: sudo test -d /data/minikube
I0722 11:26:22.809348 210080 kubeadm.go:130] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
stdout:
stderr:
I0722 11:26:22.810313 210080 kubeconfig.go:47] verify endpoint returned: get endpoint: "old-k8s-version-584140" does not appear in /home/jenkins/minikube-integration/19313-2237/kubeconfig
I0722 11:26:22.810925 210080 kubeconfig.go:62] /home/jenkins/minikube-integration/19313-2237/kubeconfig needs updating (will repair): [kubeconfig missing "old-k8s-version-584140" cluster setting kubeconfig missing "old-k8s-version-584140" context setting]
I0722 11:26:22.811937 210080 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19313-2237/kubeconfig: {Name:mkcc86b3f46ba469151bab0be6d762245d79cdb6 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0722 11:26:22.813879 210080 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
I0722 11:26:22.824865 210080 kubeadm.go:630] The running cluster does not require reconfiguration: 192.168.76.2
I0722 11:26:22.824913 210080 kubeadm.go:597] duration metric: took 24.990967ms to restartPrimaryControlPlane
I0722 11:26:22.824923 210080 kubeadm.go:394] duration metric: took 107.783105ms to StartCluster
I0722 11:26:22.824939 210080 settings.go:142] acquiring lock: {Name:mk5fbd205fde0f82abe2a5378554c5e9944b6110 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0722 11:26:22.825020 210080 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/19313-2237/kubeconfig
I0722 11:26:22.826671 210080 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19313-2237/kubeconfig: {Name:mkcc86b3f46ba469151bab0be6d762245d79cdb6 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0722 11:26:22.827073 210080 start.go:235] Will wait 6m0s for node &{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I0722 11:26:22.827499 210080 addons.go:507] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:true default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]
I0722 11:26:22.827588 210080 addons.go:69] Setting storage-provisioner=true in profile "old-k8s-version-584140"
I0722 11:26:22.827609 210080 addons.go:234] Setting addon storage-provisioner=true in "old-k8s-version-584140"
W0722 11:26:22.827620 210080 addons.go:243] addon storage-provisioner should already be in state true
I0722 11:26:22.827644 210080 host.go:66] Checking if "old-k8s-version-584140" exists ...
I0722 11:26:22.828095 210080 cli_runner.go:164] Run: docker container inspect old-k8s-version-584140 --format={{.State.Status}}
I0722 11:26:22.828488 210080 config.go:182] Loaded profile config "old-k8s-version-584140": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0722 11:26:22.828591 210080 addons.go:69] Setting metrics-server=true in profile "old-k8s-version-584140"
I0722 11:26:22.828635 210080 addons.go:234] Setting addon metrics-server=true in "old-k8s-version-584140"
W0722 11:26:22.828647 210080 addons.go:243] addon metrics-server should already be in state true
I0722 11:26:22.828681 210080 host.go:66] Checking if "old-k8s-version-584140" exists ...
I0722 11:26:22.829277 210080 cli_runner.go:164] Run: docker container inspect old-k8s-version-584140 --format={{.State.Status}}
I0722 11:26:22.829546 210080 addons.go:69] Setting dashboard=true in profile "old-k8s-version-584140"
I0722 11:26:22.829592 210080 addons.go:234] Setting addon dashboard=true in "old-k8s-version-584140"
W0722 11:26:22.829605 210080 addons.go:243] addon dashboard should already be in state true
I0722 11:26:22.829628 210080 host.go:66] Checking if "old-k8s-version-584140" exists ...
I0722 11:26:22.829961 210080 addons.go:69] Setting default-storageclass=true in profile "old-k8s-version-584140"
I0722 11:26:22.829988 210080 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "old-k8s-version-584140"
I0722 11:26:22.830204 210080 cli_runner.go:164] Run: docker container inspect old-k8s-version-584140 --format={{.State.Status}}
I0722 11:26:22.830697 210080 out.go:177] * Verifying Kubernetes components...
I0722 11:26:22.831119 210080 cli_runner.go:164] Run: docker container inspect old-k8s-version-584140 --format={{.State.Status}}
I0722 11:26:22.841546 210080 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0722 11:26:22.887478 210080 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0722 11:26:22.890326 210080 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0722 11:26:22.892942 210080 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0722 11:26:22.893033 210080 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-584140
I0722 11:26:22.908443 210080 addons.go:234] Setting addon default-storageclass=true in "old-k8s-version-584140"
W0722 11:26:22.908474 210080 addons.go:243] addon default-storageclass should already be in state true
I0722 11:26:22.908500 210080 host.go:66] Checking if "old-k8s-version-584140" exists ...
I0722 11:26:22.908970 210080 cli_runner.go:164] Run: docker container inspect old-k8s-version-584140 --format={{.State.Status}}
I0722 11:26:22.909018 210080 out.go:177] - Using image fake.domain/registry.k8s.io/echoserver:1.4
I0722 11:26:22.912765 210080 addons.go:431] installing /etc/kubernetes/addons/metrics-apiservice.yaml
I0722 11:26:22.912797 210080 ssh_runner.go:362] scp metrics-server/metrics-apiservice.yaml --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
I0722 11:26:22.912936 210080 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-584140
I0722 11:26:22.916184 210080 out.go:177] - Using image docker.io/kubernetesui/dashboard:v2.7.0
I0722 11:26:22.919121 210080 out.go:177] - Using image registry.k8s.io/echoserver:1.4
I0722 11:26:22.920970 210080 addons.go:431] installing /etc/kubernetes/addons/dashboard-ns.yaml
I0722 11:26:22.920999 210080 ssh_runner.go:362] scp dashboard/dashboard-ns.yaml --> /etc/kubernetes/addons/dashboard-ns.yaml (759 bytes)
I0722 11:26:22.921069 210080 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-584140
I0722 11:26:22.958668 210080 addons.go:431] installing /etc/kubernetes/addons/storageclass.yaml
I0722 11:26:22.958691 210080 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0722 11:26:22.958752 210080 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-584140
I0722 11:26:22.981534 210080 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33063 SSHKeyPath:/home/jenkins/minikube-integration/19313-2237/.minikube/machines/old-k8s-version-584140/id_rsa Username:docker}
I0722 11:26:22.982493 210080 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33063 SSHKeyPath:/home/jenkins/minikube-integration/19313-2237/.minikube/machines/old-k8s-version-584140/id_rsa Username:docker}
I0722 11:26:23.001654 210080 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33063 SSHKeyPath:/home/jenkins/minikube-integration/19313-2237/.minikube/machines/old-k8s-version-584140/id_rsa Username:docker}
I0722 11:26:23.017230 210080 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33063 SSHKeyPath:/home/jenkins/minikube-integration/19313-2237/.minikube/machines/old-k8s-version-584140/id_rsa Username:docker}
I0722 11:26:23.169361 210080 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0722 11:26:23.195478 210080 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0722 11:26:23.202279 210080 addons.go:431] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
I0722 11:26:23.202350 210080 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1825 bytes)
I0722 11:26:23.247980 210080 node_ready.go:35] waiting up to 6m0s for node "old-k8s-version-584140" to be "Ready" ...
I0722 11:26:23.250541 210080 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0722 11:26:23.254939 210080 addons.go:431] installing /etc/kubernetes/addons/dashboard-clusterrole.yaml
I0722 11:26:23.255012 210080 ssh_runner.go:362] scp dashboard/dashboard-clusterrole.yaml --> /etc/kubernetes/addons/dashboard-clusterrole.yaml (1001 bytes)
I0722 11:26:23.325071 210080 addons.go:431] installing /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml
I0722 11:26:23.325147 210080 ssh_runner.go:362] scp dashboard/dashboard-clusterrolebinding.yaml --> /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml (1018 bytes)
I0722 11:26:23.326875 210080 addons.go:431] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
I0722 11:26:23.326946 210080 ssh_runner.go:362] scp metrics-server/metrics-server-rbac.yaml --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
I0722 11:26:23.427495 210080 addons.go:431] installing /etc/kubernetes/addons/dashboard-configmap.yaml
I0722 11:26:23.427572 210080 ssh_runner.go:362] scp dashboard/dashboard-configmap.yaml --> /etc/kubernetes/addons/dashboard-configmap.yaml (837 bytes)
I0722 11:26:23.446954 210080 addons.go:431] installing /etc/kubernetes/addons/metrics-server-service.yaml
I0722 11:26:23.447034 210080 ssh_runner.go:362] scp metrics-server/metrics-server-service.yaml --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
I0722 11:26:23.494561 210080 addons.go:431] installing /etc/kubernetes/addons/dashboard-dp.yaml
I0722 11:26:23.494633 210080 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-dp.yaml (4201 bytes)
I0722 11:26:23.550596 210080 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0722 11:26:23.574199 210080 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0722 11:26:23.574291 210080 retry.go:31] will retry after 216.974056ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0722 11:26:23.594026 210080 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0722 11:26:23.594153 210080 retry.go:31] will retry after 129.282105ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0722 11:26:23.605941 210080 addons.go:431] installing /etc/kubernetes/addons/dashboard-role.yaml
I0722 11:26:23.606020 210080 ssh_runner.go:362] scp dashboard/dashboard-role.yaml --> /etc/kubernetes/addons/dashboard-role.yaml (1724 bytes)
I0722 11:26:23.689300 210080 addons.go:431] installing /etc/kubernetes/addons/dashboard-rolebinding.yaml
I0722 11:26:23.689380 210080 ssh_runner.go:362] scp dashboard/dashboard-rolebinding.yaml --> /etc/kubernetes/addons/dashboard-rolebinding.yaml (1046 bytes)
I0722 11:26:23.723718 210080 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0722 11:26:23.745973 210080 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0722 11:26:23.746053 210080 retry.go:31] will retry after 125.475262ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0722 11:26:23.751041 210080 addons.go:431] installing /etc/kubernetes/addons/dashboard-sa.yaml
I0722 11:26:23.751113 210080 ssh_runner.go:362] scp dashboard/dashboard-sa.yaml --> /etc/kubernetes/addons/dashboard-sa.yaml (837 bytes)
I0722 11:26:23.792347 210080 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I0722 11:26:23.816896 210080 addons.go:431] installing /etc/kubernetes/addons/dashboard-secret.yaml
I0722 11:26:23.816969 210080 ssh_runner.go:362] scp dashboard/dashboard-secret.yaml --> /etc/kubernetes/addons/dashboard-secret.yaml (1389 bytes)
I0722 11:26:23.872275 210080 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0722 11:26:23.914879 210080 addons.go:431] installing /etc/kubernetes/addons/dashboard-svc.yaml
I0722 11:26:23.914953 210080 ssh_runner.go:362] scp dashboard/dashboard-svc.yaml --> /etc/kubernetes/addons/dashboard-svc.yaml (1294 bytes)
W0722 11:26:24.061372 210080 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0722 11:26:24.061469 210080 retry.go:31] will retry after 552.016201ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0722 11:26:24.079071 210080 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0722 11:26:24.157151 210080 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0722 11:26:24.157251 210080 retry.go:31] will retry after 410.691769ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0722 11:26:24.260460 210080 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0722 11:26:24.260495 210080 retry.go:31] will retry after 355.743811ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0722 11:26:24.260518 210080 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0722 11:26:24.260530 210080 retry.go:31] will retry after 504.336946ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0722 11:26:24.569070 210080 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I0722 11:26:24.614416 210080 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I0722 11:26:24.616827 210080 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0722 11:26:24.741513 210080 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0722 11:26:24.741572 210080 retry.go:31] will retry after 464.879223ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0722 11:26:24.765251 210080 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0722 11:26:24.914492 210080 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0722 11:26:24.914560 210080 retry.go:31] will retry after 422.635115ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0722 11:26:24.914610 210080 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0722 11:26:24.914623 210080 retry.go:31] will retry after 214.87889ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0722 11:26:25.020044 210080 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0722 11:26:25.020083 210080 retry.go:31] will retry after 293.452781ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0722 11:26:25.130188 210080 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0722 11:26:25.207600 210080 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I0722 11:26:25.249288 210080 node_ready.go:53] error getting node "old-k8s-version-584140": Get "https://192.168.76.2:8443/api/v1/nodes/old-k8s-version-584140": dial tcp 192.168.76.2:8443: connect: connection refused
W0722 11:26:25.265135 210080 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0722 11:26:25.265180 210080 retry.go:31] will retry after 334.91173ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0722 11:26:25.314454 210080 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0722 11:26:25.338364 210080 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0722 11:26:25.362855 210080 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0722 11:26:25.362888 210080 retry.go:31] will retry after 894.559471ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0722 11:26:25.535786 210080 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0722 11:26:25.535823 210080 retry.go:31] will retry after 1.073827156s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0722 11:26:25.535873 210080 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0722 11:26:25.535896 210080 retry.go:31] will retry after 872.541815ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0722 11:26:25.601042 210080 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0722 11:26:25.704962 210080 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0722 11:26:25.705005 210080 retry.go:31] will retry after 511.889941ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0722 11:26:26.217124 210080 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0722 11:26:26.258182 210080 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0722 11:26:26.313953 210080 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0722 11:26:26.314053 210080 retry.go:31] will retry after 730.942457ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0722 11:26:26.356623 210080 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0722 11:26:26.356698 210080 retry.go:31] will retry after 1.434334313s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0722 11:26:26.408982 210080 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0722 11:26:26.478164 210080 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0722 11:26:26.478197 210080 retry.go:31] will retry after 1.521308895s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0722 11:26:26.610634 210080 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0722 11:26:26.692537 210080 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0722 11:26:26.692583 210080 retry.go:31] will retry after 1.592780676s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0722 11:26:27.045569 210080 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0722 11:26:27.125001 210080 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0722 11:26:27.125047 210080 retry.go:31] will retry after 1.234745247s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0722 11:26:27.749515 210080 node_ready.go:53] error getting node "old-k8s-version-584140": Get "https://192.168.76.2:8443/api/v1/nodes/old-k8s-version-584140": dial tcp 192.168.76.2:8443: connect: connection refused
I0722 11:26:27.791654 210080 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0722 11:26:27.866342 210080 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0722 11:26:27.866372 210080 retry.go:31] will retry after 1.849660889s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0722 11:26:27.999672 210080 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0722 11:26:28.069399 210080 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0722 11:26:28.069433 210080 retry.go:31] will retry after 1.347098407s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0722 11:26:28.286336 210080 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I0722 11:26:28.360736 210080 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0722 11:26:28.366486 210080 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0722 11:26:28.366515 210080 retry.go:31] will retry after 1.325777049s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0722 11:26:28.435995 210080 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0722 11:26:28.436029 210080 retry.go:31] will retry after 1.780416162s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0722 11:26:29.417234 210080 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0722 11:26:29.496185 210080 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0722 11:26:29.496219 210080 retry.go:31] will retry after 2.571047357s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0722 11:26:29.692518 210080 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I0722 11:26:29.717038 210080 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0722 11:26:29.797274 210080 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0722 11:26:29.797303 210080 retry.go:31] will retry after 1.479993802s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0722 11:26:29.821022 210080 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0722 11:26:29.821057 210080 retry.go:31] will retry after 3.493279527s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0722 11:26:30.217568 210080 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0722 11:26:30.250838 210080 node_ready.go:53] error getting node "old-k8s-version-584140": Get "https://192.168.76.2:8443/api/v1/nodes/old-k8s-version-584140": dial tcp 192.168.76.2:8443: connect: connection refused
W0722 11:26:30.294719 210080 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0722 11:26:30.294755 210080 retry.go:31] will retry after 3.971221443s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0722 11:26:31.277646 210080 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0722 11:26:31.433438 210080 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0722 11:26:31.433467 210080 retry.go:31] will retry after 5.9779828s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0722 11:26:32.068064 210080 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0722 11:26:33.315377 210080 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I0722 11:26:34.266973 210080 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0722 11:26:37.411665 210080 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I0722 11:26:39.183850 210080 node_ready.go:49] node "old-k8s-version-584140" has status "Ready":"True"
I0722 11:26:39.183880 210080 node_ready.go:38] duration metric: took 15.935822129s for node "old-k8s-version-584140" to be "Ready" ...
I0722 11:26:39.183890 210080 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0722 11:26:39.334341 210080 pod_ready.go:78] waiting up to 6m0s for pod "coredns-74ff55c5b-t7kln" in "kube-system" namespace to be "Ready" ...
I0722 11:26:39.652054 210080 pod_ready.go:92] pod "coredns-74ff55c5b-t7kln" in "kube-system" namespace has status "Ready":"True"
I0722 11:26:39.652099 210080 pod_ready.go:81] duration metric: took 317.722452ms for pod "coredns-74ff55c5b-t7kln" in "kube-system" namespace to be "Ready" ...
I0722 11:26:39.652112 210080 pod_ready.go:78] waiting up to 6m0s for pod "etcd-old-k8s-version-584140" in "kube-system" namespace to be "Ready" ...
I0722 11:26:39.804676 210080 pod_ready.go:92] pod "etcd-old-k8s-version-584140" in "kube-system" namespace has status "Ready":"True"
I0722 11:26:39.804702 210080 pod_ready.go:81] duration metric: took 152.572833ms for pod "etcd-old-k8s-version-584140" in "kube-system" namespace to be "Ready" ...
I0722 11:26:39.804716 210080 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-old-k8s-version-584140" in "kube-system" namespace to be "Ready" ...
I0722 11:26:40.028137 210080 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (7.960025211s)
I0722 11:26:40.028179 210080 addons.go:475] Verifying addon metrics-server=true in "old-k8s-version-584140"
I0722 11:26:40.028252 210080 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: (6.712846144s)
I0722 11:26:40.199485 210080 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: (5.932470206s)
I0722 11:26:40.199745 210080 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: (2.788052122s)
I0722 11:26:40.201519 210080 out.go:177] * Some dashboard features require the metrics-server addon. To enable all features please run:
minikube -p old-k8s-version-584140 addons enable metrics-server
I0722 11:26:40.242465 210080 out.go:177] * Enabled addons: metrics-server, storage-provisioner, dashboard, default-storageclass
I0722 11:26:40.244334 210080 addons.go:510] duration metric: took 17.416826577s for enable addons: enabled=[metrics-server storage-provisioner dashboard default-storageclass]
I0722 11:26:41.811170 210080 pod_ready.go:102] pod "kube-apiserver-old-k8s-version-584140" in "kube-system" namespace has status "Ready":"False"
I0722 11:26:43.813708 210080 pod_ready.go:102] pod "kube-apiserver-old-k8s-version-584140" in "kube-system" namespace has status "Ready":"False"
I0722 11:26:46.311063 210080 pod_ready.go:102] pod "kube-apiserver-old-k8s-version-584140" in "kube-system" namespace has status "Ready":"False"
I0722 11:26:48.311961 210080 pod_ready.go:102] pod "kube-apiserver-old-k8s-version-584140" in "kube-system" namespace has status "Ready":"False"
I0722 11:26:49.311687 210080 pod_ready.go:92] pod "kube-apiserver-old-k8s-version-584140" in "kube-system" namespace has status "Ready":"True"
I0722 11:26:49.311714 210080 pod_ready.go:81] duration metric: took 9.506989512s for pod "kube-apiserver-old-k8s-version-584140" in "kube-system" namespace to be "Ready" ...
I0722 11:26:49.311725 210080 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-old-k8s-version-584140" in "kube-system" namespace to be "Ready" ...
I0722 11:26:51.319290 210080 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-584140" in "kube-system" namespace has status "Ready":"False"
I0722 11:26:53.817661 210080 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-584140" in "kube-system" namespace has status "Ready":"False"
I0722 11:26:55.818214 210080 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-584140" in "kube-system" namespace has status "Ready":"False"
I0722 11:26:57.823039 210080 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-584140" in "kube-system" namespace has status "Ready":"False"
I0722 11:26:59.825738 210080 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-584140" in "kube-system" namespace has status "Ready":"False"
I0722 11:27:01.845166 210080 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-584140" in "kube-system" namespace has status "Ready":"False"
I0722 11:27:04.320128 210080 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-584140" in "kube-system" namespace has status "Ready":"False"
I0722 11:27:06.823358 210080 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-584140" in "kube-system" namespace has status "Ready":"False"
I0722 11:27:09.318476 210080 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-584140" in "kube-system" namespace has status "Ready":"False"
I0722 11:27:11.819545 210080 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-584140" in "kube-system" namespace has status "Ready":"False"
I0722 11:27:14.318323 210080 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-584140" in "kube-system" namespace has status "Ready":"False"
I0722 11:27:16.319386 210080 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-584140" in "kube-system" namespace has status "Ready":"False"
I0722 11:27:18.821118 210080 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-584140" in "kube-system" namespace has status "Ready":"False"
I0722 11:27:21.318228 210080 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-584140" in "kube-system" namespace has status "Ready":"False"
I0722 11:27:23.817953 210080 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-584140" in "kube-system" namespace has status "Ready":"False"
I0722 11:27:26.317951 210080 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-584140" in "kube-system" namespace has status "Ready":"False"
I0722 11:27:28.324255 210080 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-584140" in "kube-system" namespace has status "Ready":"False"
I0722 11:27:30.817333 210080 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-584140" in "kube-system" namespace has status "Ready":"False"
I0722 11:27:32.818440 210080 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-584140" in "kube-system" namespace has status "Ready":"False"
I0722 11:27:34.822199 210080 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-584140" in "kube-system" namespace has status "Ready":"False"
I0722 11:27:37.318055 210080 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-584140" in "kube-system" namespace has status "Ready":"False"
I0722 11:27:39.318483 210080 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-584140" in "kube-system" namespace has status "Ready":"False"
I0722 11:27:41.319323 210080 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-584140" in "kube-system" namespace has status "Ready":"False"
I0722 11:27:43.819274 210080 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-584140" in "kube-system" namespace has status "Ready":"False"
I0722 11:27:46.318488 210080 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-584140" in "kube-system" namespace has status "Ready":"False"
I0722 11:27:48.818841 210080 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-584140" in "kube-system" namespace has status "Ready":"False"
I0722 11:27:51.318878 210080 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-584140" in "kube-system" namespace has status "Ready":"False"
I0722 11:27:53.818196 210080 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-584140" in "kube-system" namespace has status "Ready":"False"
I0722 11:27:55.819450 210080 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-584140" in "kube-system" namespace has status "Ready":"False"
I0722 11:27:58.319051 210080 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-584140" in "kube-system" namespace has status "Ready":"False"
I0722 11:27:59.818283 210080 pod_ready.go:92] pod "kube-controller-manager-old-k8s-version-584140" in "kube-system" namespace has status "Ready":"True"
I0722 11:27:59.818306 210080 pod_ready.go:81] duration metric: took 1m10.506573165s for pod "kube-controller-manager-old-k8s-version-584140" in "kube-system" namespace to be "Ready" ...
I0722 11:27:59.818318 210080 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-xfm5t" in "kube-system" namespace to be "Ready" ...
I0722 11:27:59.823211 210080 pod_ready.go:92] pod "kube-proxy-xfm5t" in "kube-system" namespace has status "Ready":"True"
I0722 11:27:59.823233 210080 pod_ready.go:81] duration metric: took 4.90751ms for pod "kube-proxy-xfm5t" in "kube-system" namespace to be "Ready" ...
I0722 11:27:59.823244 210080 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-old-k8s-version-584140" in "kube-system" namespace to be "Ready" ...
I0722 11:27:59.833008 210080 pod_ready.go:92] pod "kube-scheduler-old-k8s-version-584140" in "kube-system" namespace has status "Ready":"True"
I0722 11:27:59.833035 210080 pod_ready.go:81] duration metric: took 9.782659ms for pod "kube-scheduler-old-k8s-version-584140" in "kube-system" namespace to be "Ready" ...
I0722 11:27:59.833047 210080 pod_ready.go:78] waiting up to 6m0s for pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace to be "Ready" ...
I0722 11:28:01.851100 210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
I0722 11:28:04.343376 210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
I0722 11:28:06.842663 210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
I0722 11:28:08.844596 210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
I0722 11:28:10.859536 210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
I0722 11:28:13.339582 210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
I0722 11:28:15.340713 210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
I0722 11:28:17.842659 210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
I0722 11:28:19.845825 210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
I0722 11:28:22.344369 210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
I0722 11:28:24.840644 210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
I0722 11:28:26.851632 210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
I0722 11:28:29.340133 210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
I0722 11:28:31.345096 210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
I0722 11:28:33.853318 210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
I0722 11:28:36.340963 210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
I0722 11:28:38.341543 210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
I0722 11:28:40.846170 210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
I0722 11:28:43.341346 210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
I0722 11:28:45.342439 210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
I0722 11:28:47.845840 210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
I0722 11:28:49.927380 210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
I0722 11:28:52.342262 210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
I0722 11:28:54.343206 210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
I0722 11:28:56.343483 210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
I0722 11:28:58.849142 210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
I0722 11:29:00.851630 210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
I0722 11:29:03.339643 210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
I0722 11:29:05.341047 210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
I0722 11:29:07.841414 210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
I0722 11:29:10.342265 210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
I0722 11:29:12.344293 210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
I0722 11:29:14.842021 210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
I0722 11:29:16.846485 210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
I0722 11:29:18.857924 210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
I0722 11:29:21.341689 210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
I0722 11:29:23.851410 210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
I0722 11:29:25.852505 210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
I0722 11:29:28.340931 210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
I0722 11:29:30.342845 210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
I0722 11:29:32.845252 210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
I0722 11:29:35.340507 210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
I0722 11:29:37.353042 210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
I0722 11:29:39.356521 210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
I0722 11:29:41.850218 210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
I0722 11:29:43.853399 210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
I0722 11:29:46.341023 210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
I0722 11:29:48.846198 210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
I0722 11:29:51.340346 210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
I0722 11:29:53.340731 210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
I0722 11:29:55.341344 210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
I0722 11:29:57.342794 210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
I0722 11:29:59.843530 210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
I0722 11:30:01.847469 210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
I0722 11:30:04.342535 210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
I0722 11:30:06.342738 210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
I0722 11:30:08.849016 210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
I0722 11:30:11.340051 210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
I0722 11:30:13.840316 210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
I0722 11:30:15.843443 210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
I0722 11:30:18.340155 210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
I0722 11:30:20.845290 210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
I0722 11:30:23.340036 210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
I0722 11:30:25.846244 210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
I0722 11:30:27.846998 210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
I0722 11:30:30.340185 210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
I0722 11:30:32.849212 210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
I0722 11:30:35.340221 210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
I0722 11:30:37.341246 210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
I0722 11:30:39.343176 210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
I0722 11:30:41.344030 210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
I0722 11:30:43.842816 210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
I0722 11:30:45.847417 210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
I0722 11:30:48.342459 210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
I0722 11:30:50.847956 210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
I0722 11:30:52.855771 210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
I0722 11:30:55.340307 210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
I0722 11:30:57.345989 210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
I0722 11:30:59.850453 210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
I0722 11:31:02.341215 210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
I0722 11:31:04.341496 210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
I0722 11:31:06.847997 210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
I0722 11:31:08.850639 210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
I0722 11:31:11.388361 210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
I0722 11:31:13.842183 210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
I0722 11:31:15.853421 210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
I0722 11:31:18.339864 210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
I0722 11:31:20.340050 210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
I0722 11:31:22.344482 210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
I0722 11:31:24.853179 210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
I0722 11:31:27.339795 210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
I0722 11:31:29.340179 210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
I0722 11:31:31.840513 210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
I0722 11:31:33.841987 210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
I0722 11:31:36.340593 210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
I0722 11:31:38.346722 210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
I0722 11:31:40.845171 210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
I0722 11:31:43.339987 210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
I0722 11:31:45.340367 210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
I0722 11:31:47.849494 210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
I0722 11:31:50.339967 210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
I0722 11:31:52.840216 210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
I0722 11:31:54.840912 210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
I0722 11:31:56.849216 210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
I0722 11:31:59.342888 210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
I0722 11:31:59.845379 210080 pod_ready.go:81] duration metric: took 4m0.012318488s for pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace to be "Ready" ...
E0722 11:31:59.845399 210080 pod_ready.go:66] WaitExtra: waitPodCondition: context deadline exceeded
I0722 11:31:59.845409 210080 pod_ready.go:38] duration metric: took 5m20.661509404s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0722 11:31:59.845424 210080 api_server.go:52] waiting for apiserver process to appear ...
I0722 11:31:59.845451 210080 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0722 11:31:59.845574 210080 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0722 11:31:59.920139 210080 cri.go:89] found id: "7b17da0e203acb0f33605e81ab92029743299c8b53e99bedad6247fb2e22336d"
I0722 11:31:59.920178 210080 cri.go:89] found id: ""
I0722 11:31:59.920186 210080 logs.go:276] 1 containers: [7b17da0e203acb0f33605e81ab92029743299c8b53e99bedad6247fb2e22336d]
I0722 11:31:59.920236 210080 ssh_runner.go:195] Run: which crictl
I0722 11:31:59.924556 210080 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0722 11:31:59.924629 210080 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0722 11:31:59.977812 210080 cri.go:89] found id: "b8f395f6e10fffc01d9db2971c2690affd63e1173ebe081a173b1df5e29b3eae"
I0722 11:31:59.977831 210080 cri.go:89] found id: ""
I0722 11:31:59.977840 210080 logs.go:276] 1 containers: [b8f395f6e10fffc01d9db2971c2690affd63e1173ebe081a173b1df5e29b3eae]
I0722 11:31:59.977895 210080 ssh_runner.go:195] Run: which crictl
I0722 11:31:59.982113 210080 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0722 11:31:59.982181 210080 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0722 11:32:00.089770 210080 cri.go:89] found id: "25b426692cff4a0ddaac80382d5fd8be373235953b017a1f2591adbc04fe5208"
I0722 11:32:00.089791 210080 cri.go:89] found id: ""
I0722 11:32:00.089799 210080 logs.go:276] 1 containers: [25b426692cff4a0ddaac80382d5fd8be373235953b017a1f2591adbc04fe5208]
I0722 11:32:00.089863 210080 ssh_runner.go:195] Run: which crictl
I0722 11:32:00.106635 210080 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0722 11:32:00.106733 210080 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0722 11:32:00.253185 210080 cri.go:89] found id: "a38f1a7f716723ae1738fc6d121fd5959ee9c40c5b1c46b537955d760c9f4290"
I0722 11:32:00.253208 210080 cri.go:89] found id: ""
I0722 11:32:00.253221 210080 logs.go:276] 1 containers: [a38f1a7f716723ae1738fc6d121fd5959ee9c40c5b1c46b537955d760c9f4290]
I0722 11:32:00.253285 210080 ssh_runner.go:195] Run: which crictl
I0722 11:32:00.269148 210080 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0722 11:32:00.269317 210080 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0722 11:32:00.378714 210080 cri.go:89] found id: "5191e613fc2d72706f1d776fe8a845ca8f4b3cec7ff3b0f9d18aee199e8d79c6"
I0722 11:32:00.378743 210080 cri.go:89] found id: ""
I0722 11:32:00.378751 210080 logs.go:276] 1 containers: [5191e613fc2d72706f1d776fe8a845ca8f4b3cec7ff3b0f9d18aee199e8d79c6]
I0722 11:32:00.378814 210080 ssh_runner.go:195] Run: which crictl
I0722 11:32:00.385279 210080 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0722 11:32:00.385366 210080 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0722 11:32:00.464157 210080 cri.go:89] found id: "460bdeec3bdfccab7101c9d13045f9bcf87734da1fb0f6f8b6a5c0111906ac43"
I0722 11:32:00.464207 210080 cri.go:89] found id: ""
I0722 11:32:00.464216 210080 logs.go:276] 1 containers: [460bdeec3bdfccab7101c9d13045f9bcf87734da1fb0f6f8b6a5c0111906ac43]
I0722 11:32:00.464285 210080 ssh_runner.go:195] Run: which crictl
I0722 11:32:00.468544 210080 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0722 11:32:00.468644 210080 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0722 11:32:00.528057 210080 cri.go:89] found id: "451ceb51fb176f2ab58c30c602fe7a8d8dcdde723f94ec75d058fd599561cfde"
I0722 11:32:00.528078 210080 cri.go:89] found id: ""
I0722 11:32:00.528086 210080 logs.go:276] 1 containers: [451ceb51fb176f2ab58c30c602fe7a8d8dcdde723f94ec75d058fd599561cfde]
I0722 11:32:00.528144 210080 ssh_runner.go:195] Run: which crictl
I0722 11:32:00.533504 210080 cri.go:54] listing CRI containers in root : {State:all Name:storage-provisioner Namespaces:[]}
I0722 11:32:00.533634 210080 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0722 11:32:00.595614 210080 cri.go:89] found id: "b64b9e0461292d72b7fc112215c86b2db789ed69b01b10063e3b4f24a2155a8a"
I0722 11:32:00.595635 210080 cri.go:89] found id: "48a74507ee5da0b4b62d92cb8fe64853426c4fcd088c4d455c7d827c4c514ab2"
I0722 11:32:00.595641 210080 cri.go:89] found id: ""
I0722 11:32:00.595649 210080 logs.go:276] 2 containers: [b64b9e0461292d72b7fc112215c86b2db789ed69b01b10063e3b4f24a2155a8a 48a74507ee5da0b4b62d92cb8fe64853426c4fcd088c4d455c7d827c4c514ab2]
I0722 11:32:00.595739 210080 ssh_runner.go:195] Run: which crictl
I0722 11:32:00.601448 210080 ssh_runner.go:195] Run: which crictl
I0722 11:32:00.605652 210080 cri.go:54] listing CRI containers in root : {State:all Name:kubernetes-dashboard Namespaces:[]}
I0722 11:32:00.605721 210080 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I0722 11:32:00.651274 210080 cri.go:89] found id: "0da5dde31a386001ac351514fcd5b733872eb5d92ec8b3579e32b0f14de7b1fc"
I0722 11:32:00.651297 210080 cri.go:89] found id: ""
I0722 11:32:00.651306 210080 logs.go:276] 1 containers: [0da5dde31a386001ac351514fcd5b733872eb5d92ec8b3579e32b0f14de7b1fc]
I0722 11:32:00.651361 210080 ssh_runner.go:195] Run: which crictl
I0722 11:32:00.654976 210080 logs.go:123] Gathering logs for dmesg ...
I0722 11:32:00.655002 210080 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0722 11:32:00.673970 210080 logs.go:123] Gathering logs for describe nodes ...
I0722 11:32:00.673997 210080 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0722 11:32:00.904292 210080 logs.go:123] Gathering logs for kube-scheduler [a38f1a7f716723ae1738fc6d121fd5959ee9c40c5b1c46b537955d760c9f4290] ...
I0722 11:32:00.904323 210080 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 a38f1a7f716723ae1738fc6d121fd5959ee9c40c5b1c46b537955d760c9f4290"
I0722 11:32:00.986854 210080 logs.go:123] Gathering logs for kube-proxy [5191e613fc2d72706f1d776fe8a845ca8f4b3cec7ff3b0f9d18aee199e8d79c6] ...
I0722 11:32:00.986888 210080 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 5191e613fc2d72706f1d776fe8a845ca8f4b3cec7ff3b0f9d18aee199e8d79c6"
I0722 11:32:01.042704 210080 logs.go:123] Gathering logs for storage-provisioner [b64b9e0461292d72b7fc112215c86b2db789ed69b01b10063e3b4f24a2155a8a] ...
I0722 11:32:01.042744 210080 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 b64b9e0461292d72b7fc112215c86b2db789ed69b01b10063e3b4f24a2155a8a"
I0722 11:32:01.152534 210080 logs.go:123] Gathering logs for CRI-O ...
I0722 11:32:01.152568 210080 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0722 11:32:01.294215 210080 logs.go:123] Gathering logs for kubelet ...
I0722 11:32:01.294250 210080 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0722 11:32:01.368159 210080 logs.go:138] Found kubelet problem: Jul 22 11:26:39 old-k8s-version-584140 kubelet[730]: E0722 11:26:39.204682 730 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:old-k8s-version-584140" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-584140' and this object
W0722 11:32:01.368517 210080 logs.go:138] Found kubelet problem: Jul 22 11:26:39 old-k8s-version-584140 kubelet[730]: E0722 11:26:39.205097 730 reflector.go:138] object-"kube-system"/"storage-provisioner-token-th5sl": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "storage-provisioner-token-th5sl" is forbidden: User "system:node:old-k8s-version-584140" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-584140' and this object
W0722 11:32:01.369028 210080 logs.go:138] Found kubelet problem: Jul 22 11:26:39 old-k8s-version-584140 kubelet[730]: E0722 11:26:39.205388 730 reflector.go:138] object-"default"/"default-token-gkskl": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "default-token-gkskl" is forbidden: User "system:node:old-k8s-version-584140" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'old-k8s-version-584140' and this object
W0722 11:32:01.369328 210080 logs.go:138] Found kubelet problem: Jul 22 11:26:39 old-k8s-version-584140 kubelet[730]: E0722 11:26:39.206223 730 reflector.go:138] object-"kube-system"/"coredns": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:old-k8s-version-584140" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-584140' and this object
W0722 11:32:01.369617 210080 logs.go:138] Found kubelet problem: Jul 22 11:26:39 old-k8s-version-584140 kubelet[730]: E0722 11:26:39.206544 730 reflector.go:138] object-"kube-system"/"kube-proxy-token-g9gsb": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kube-proxy-token-g9gsb" is forbidden: User "system:node:old-k8s-version-584140" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-584140' and this object
W0722 11:32:01.369927 210080 logs.go:138] Found kubelet problem: Jul 22 11:26:39 old-k8s-version-584140 kubelet[730]: E0722 11:26:39.206876 730 reflector.go:138] object-"kube-system"/"kindnet-token-tjmsp": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kindnet-token-tjmsp" is forbidden: User "system:node:old-k8s-version-584140" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-584140' and this object
W0722 11:32:01.370487 210080 logs.go:138] Found kubelet problem: Jul 22 11:26:39 old-k8s-version-584140 kubelet[730]: E0722 11:26:39.207130 730 reflector.go:138] object-"kube-system"/"metrics-server-token-btvqb": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "metrics-server-token-btvqb" is forbidden: User "system:node:old-k8s-version-584140" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-584140' and this object
W0722 11:32:01.370748 210080 logs.go:138] Found kubelet problem: Jul 22 11:26:39 old-k8s-version-584140 kubelet[730]: E0722 11:26:39.207456 730 reflector.go:138] object-"kube-system"/"coredns-token-7tqrc": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "coredns-token-7tqrc" is forbidden: User "system:node:old-k8s-version-584140" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-584140' and this object
W0722 11:32:01.387088 210080 logs.go:138] Found kubelet problem: Jul 22 11:26:43 old-k8s-version-584140 kubelet[730]: E0722 11:26:43.160558 730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0722 11:32:01.387435 210080 logs.go:138] Found kubelet problem: Jul 22 11:26:43 old-k8s-version-584140 kubelet[730]: E0722 11:26:43.632278 730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0722 11:32:01.389517 210080 logs.go:138] Found kubelet problem: Jul 22 11:26:54 old-k8s-version-584140 kubelet[730]: E0722 11:26:54.611909 730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0722 11:32:01.392146 210080 logs.go:138] Found kubelet problem: Jul 22 11:27:02 old-k8s-version-584140 kubelet[730]: E0722 11:27:02.738618 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
W0722 11:32:01.392634 210080 logs.go:138] Found kubelet problem: Jul 22 11:27:03 old-k8s-version-584140 kubelet[730]: E0722 11:27:03.741827 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
W0722 11:32:01.393033 210080 logs.go:138] Found kubelet problem: Jul 22 11:27:04 old-k8s-version-584140 kubelet[730]: E0722 11:27:04.838076 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
W0722 11:32:01.393237 210080 logs.go:138] Found kubelet problem: Jul 22 11:27:09 old-k8s-version-584140 kubelet[730]: E0722 11:27:09.598856 730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0722 11:32:01.394001 210080 logs.go:138] Found kubelet problem: Jul 22 11:27:18 old-k8s-version-584140 kubelet[730]: E0722 11:27:18.778810 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
W0722 11:32:01.396691 210080 logs.go:138] Found kubelet problem: Jul 22 11:27:23 old-k8s-version-584140 kubelet[730]: E0722 11:27:23.614499 730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0722 11:32:01.397145 210080 logs.go:138] Found kubelet problem: Jul 22 11:27:24 old-k8s-version-584140 kubelet[730]: E0722 11:27:24.838228 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
W0722 11:32:01.397548 210080 logs.go:138] Found kubelet problem: Jul 22 11:27:36 old-k8s-version-584140 kubelet[730]: E0722 11:27:36.599081 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
W0722 11:32:01.397788 210080 logs.go:138] Found kubelet problem: Jul 22 11:27:38 old-k8s-version-584140 kubelet[730]: E0722 11:27:38.598819 730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0722 11:32:01.398743 210080 logs.go:138] Found kubelet problem: Jul 22 11:27:50 old-k8s-version-584140 kubelet[730]: E0722 11:27:50.837672 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
W0722 11:32:01.398983 210080 logs.go:138] Found kubelet problem: Jul 22 11:27:53 old-k8s-version-584140 kubelet[730]: E0722 11:27:53.599749 730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0722 11:32:01.399344 210080 logs.go:138] Found kubelet problem: Jul 22 11:27:54 old-k8s-version-584140 kubelet[730]: E0722 11:27:54.838469 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
W0722 11:32:01.399885 210080 logs.go:138] Found kubelet problem: Jul 22 11:28:06 old-k8s-version-584140 kubelet[730]: E0722 11:28:06.598312 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
W0722 11:32:01.404193 210080 logs.go:138] Found kubelet problem: Jul 22 11:28:07 old-k8s-version-584140 kubelet[730]: E0722 11:28:07.619353 730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0722 11:32:01.404622 210080 logs.go:138] Found kubelet problem: Jul 22 11:28:20 old-k8s-version-584140 kubelet[730]: E0722 11:28:20.599140 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
W0722 11:32:01.404836 210080 logs.go:138] Found kubelet problem: Jul 22 11:28:20 old-k8s-version-584140 kubelet[730]: E0722 11:28:20.600438 730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0722 11:32:01.405520 210080 logs.go:138] Found kubelet problem: Jul 22 11:28:33 old-k8s-version-584140 kubelet[730]: E0722 11:28:33.909665 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
W0722 11:32:01.405900 210080 logs.go:138] Found kubelet problem: Jul 22 11:28:34 old-k8s-version-584140 kubelet[730]: E0722 11:28:34.912079 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
W0722 11:32:01.406112 210080 logs.go:138] Found kubelet problem: Jul 22 11:28:35 old-k8s-version-584140 kubelet[730]: E0722 11:28:35.599081 730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0722 11:32:01.406477 210080 logs.go:138] Found kubelet problem: Jul 22 11:28:46 old-k8s-version-584140 kubelet[730]: E0722 11:28:46.598307 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
W0722 11:32:01.406689 210080 logs.go:138] Found kubelet problem: Jul 22 11:28:50 old-k8s-version-584140 kubelet[730]: E0722 11:28:50.599499 730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0722 11:32:01.407045 210080 logs.go:138] Found kubelet problem: Jul 22 11:29:01 old-k8s-version-584140 kubelet[730]: E0722 11:29:01.598946 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
W0722 11:32:01.407255 210080 logs.go:138] Found kubelet problem: Jul 22 11:29:04 old-k8s-version-584140 kubelet[730]: E0722 11:29:04.598688 730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0722 11:32:01.407606 210080 logs.go:138] Found kubelet problem: Jul 22 11:29:12 old-k8s-version-584140 kubelet[730]: E0722 11:29:12.598338 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
W0722 11:32:01.407820 210080 logs.go:138] Found kubelet problem: Jul 22 11:29:19 old-k8s-version-584140 kubelet[730]: E0722 11:29:19.598946 730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0722 11:32:01.408172 210080 logs.go:138] Found kubelet problem: Jul 22 11:29:26 old-k8s-version-584140 kubelet[730]: E0722 11:29:26.598882 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
W0722 11:32:01.412144 210080 logs.go:138] Found kubelet problem: Jul 22 11:29:33 old-k8s-version-584140 kubelet[730]: E0722 11:29:33.611073 730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0722 11:32:01.412531 210080 logs.go:138] Found kubelet problem: Jul 22 11:29:37 old-k8s-version-584140 kubelet[730]: E0722 11:29:37.598186 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
W0722 11:32:01.412752 210080 logs.go:138] Found kubelet problem: Jul 22 11:29:46 old-k8s-version-584140 kubelet[730]: E0722 11:29:46.599495 730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0722 11:32:01.413134 210080 logs.go:138] Found kubelet problem: Jul 22 11:29:48 old-k8s-version-584140 kubelet[730]: E0722 11:29:48.598602 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
W0722 11:32:01.413352 210080 logs.go:138] Found kubelet problem: Jul 22 11:30:00 old-k8s-version-584140 kubelet[730]: E0722 11:30:00.599866 730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0722 11:32:01.413969 210080 logs.go:138] Found kubelet problem: Jul 22 11:30:03 old-k8s-version-584140 kubelet[730]: E0722 11:30:03.060169 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
W0722 11:32:01.414322 210080 logs.go:138] Found kubelet problem: Jul 22 11:30:04 old-k8s-version-584140 kubelet[730]: E0722 11:30:04.837656 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
W0722 11:32:01.414534 210080 logs.go:138] Found kubelet problem: Jul 22 11:30:13 old-k8s-version-584140 kubelet[730]: E0722 11:30:13.598674 730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0722 11:32:01.414890 210080 logs.go:138] Found kubelet problem: Jul 22 11:30:17 old-k8s-version-584140 kubelet[730]: E0722 11:30:17.598240 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
W0722 11:32:01.415098 210080 logs.go:138] Found kubelet problem: Jul 22 11:30:28 old-k8s-version-584140 kubelet[730]: E0722 11:30:28.598615 730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0722 11:32:01.416026 210080 logs.go:138] Found kubelet problem: Jul 22 11:30:31 old-k8s-version-584140 kubelet[730]: E0722 11:30:31.598312 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
W0722 11:32:01.416265 210080 logs.go:138] Found kubelet problem: Jul 22 11:30:43 old-k8s-version-584140 kubelet[730]: E0722 11:30:43.599168 730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0722 11:32:01.416704 210080 logs.go:138] Found kubelet problem: Jul 22 11:30:44 old-k8s-version-584140 kubelet[730]: E0722 11:30:44.598289 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
W0722 11:32:01.416965 210080 logs.go:138] Found kubelet problem: Jul 22 11:30:55 old-k8s-version-584140 kubelet[730]: E0722 11:30:55.599111 730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0722 11:32:01.417337 210080 logs.go:138] Found kubelet problem: Jul 22 11:30:58 old-k8s-version-584140 kubelet[730]: E0722 11:30:58.598266 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
W0722 11:32:01.417583 210080 logs.go:138] Found kubelet problem: Jul 22 11:31:08 old-k8s-version-584140 kubelet[730]: E0722 11:31:08.598772 730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0722 11:32:01.417938 210080 logs.go:138] Found kubelet problem: Jul 22 11:31:12 old-k8s-version-584140 kubelet[730]: E0722 11:31:12.598216 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
W0722 11:32:01.418299 210080 logs.go:138] Found kubelet problem: Jul 22 11:31:23 old-k8s-version-584140 kubelet[730]: E0722 11:31:23.598165 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
W0722 11:32:01.418509 210080 logs.go:138] Found kubelet problem: Jul 22 11:31:23 old-k8s-version-584140 kubelet[730]: E0722 11:31:23.599281 730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0722 11:32:01.419110 210080 logs.go:138] Found kubelet problem: Jul 22 11:31:36 old-k8s-version-584140 kubelet[730]: E0722 11:31:36.598285 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
W0722 11:32:01.419315 210080 logs.go:138] Found kubelet problem: Jul 22 11:31:37 old-k8s-version-584140 kubelet[730]: E0722 11:31:37.598777 730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0722 11:32:01.419668 210080 logs.go:138] Found kubelet problem: Jul 22 11:31:50 old-k8s-version-584140 kubelet[730]: E0722 11:31:50.598548 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
W0722 11:32:01.419879 210080 logs.go:138] Found kubelet problem: Jul 22 11:31:52 old-k8s-version-584140 kubelet[730]: E0722 11:31:52.598992 730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
I0722 11:32:01.419894 210080 logs.go:123] Gathering logs for etcd [b8f395f6e10fffc01d9db2971c2690affd63e1173ebe081a173b1df5e29b3eae] ...
I0722 11:32:01.419919 210080 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 b8f395f6e10fffc01d9db2971c2690affd63e1173ebe081a173b1df5e29b3eae"
I0722 11:32:01.511015 210080 logs.go:123] Gathering logs for storage-provisioner [48a74507ee5da0b4b62d92cb8fe64853426c4fcd088c4d455c7d827c4c514ab2] ...
I0722 11:32:01.511087 210080 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 48a74507ee5da0b4b62d92cb8fe64853426c4fcd088c4d455c7d827c4c514ab2"
I0722 11:32:01.574240 210080 logs.go:123] Gathering logs for kubernetes-dashboard [0da5dde31a386001ac351514fcd5b733872eb5d92ec8b3579e32b0f14de7b1fc] ...
I0722 11:32:01.574317 210080 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 0da5dde31a386001ac351514fcd5b733872eb5d92ec8b3579e32b0f14de7b1fc"
I0722 11:32:01.651394 210080 logs.go:123] Gathering logs for kindnet [451ceb51fb176f2ab58c30c602fe7a8d8dcdde723f94ec75d058fd599561cfde] ...
I0722 11:32:01.651472 210080 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 451ceb51fb176f2ab58c30c602fe7a8d8dcdde723f94ec75d058fd599561cfde"
I0722 11:32:01.753651 210080 logs.go:123] Gathering logs for container status ...
I0722 11:32:01.753699 210080 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0722 11:32:01.909399 210080 logs.go:123] Gathering logs for kube-apiserver [7b17da0e203acb0f33605e81ab92029743299c8b53e99bedad6247fb2e22336d] ...
I0722 11:32:01.909484 210080 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 7b17da0e203acb0f33605e81ab92029743299c8b53e99bedad6247fb2e22336d"
I0722 11:32:02.053113 210080 logs.go:123] Gathering logs for coredns [25b426692cff4a0ddaac80382d5fd8be373235953b017a1f2591adbc04fe5208] ...
I0722 11:32:02.053146 210080 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 25b426692cff4a0ddaac80382d5fd8be373235953b017a1f2591adbc04fe5208"
I0722 11:32:02.111073 210080 logs.go:123] Gathering logs for kube-controller-manager [460bdeec3bdfccab7101c9d13045f9bcf87734da1fb0f6f8b6a5c0111906ac43] ...
I0722 11:32:02.111101 210080 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 460bdeec3bdfccab7101c9d13045f9bcf87734da1fb0f6f8b6a5c0111906ac43"
I0722 11:32:02.182025 210080 out.go:304] Setting ErrFile to fd 2...
I0722 11:32:02.182054 210080 out.go:338] TERM=,COLORTERM=, which probably does not support color
W0722 11:32:02.182109 210080 out.go:239] X Problems detected in kubelet:
X Problems detected in kubelet:
W0722 11:32:02.182119 210080 out.go:239] Jul 22 11:31:23 old-k8s-version-584140 kubelet[730]: E0722 11:31:23.599281 730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jul 22 11:31:23 old-k8s-version-584140 kubelet[730]: E0722 11:31:23.599281 730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0722 11:32:02.182126 210080 out.go:239] Jul 22 11:31:36 old-k8s-version-584140 kubelet[730]: E0722 11:31:36.598285 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
Jul 22 11:31:36 old-k8s-version-584140 kubelet[730]: E0722 11:31:36.598285 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
W0722 11:32:02.182134 210080 out.go:239] Jul 22 11:31:37 old-k8s-version-584140 kubelet[730]: E0722 11:31:37.598777 730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jul 22 11:31:37 old-k8s-version-584140 kubelet[730]: E0722 11:31:37.598777 730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0722 11:32:02.182142 210080 out.go:239] Jul 22 11:31:50 old-k8s-version-584140 kubelet[730]: E0722 11:31:50.598548 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
Jul 22 11:31:50 old-k8s-version-584140 kubelet[730]: E0722 11:31:50.598548 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
W0722 11:32:02.182165 210080 out.go:239] Jul 22 11:31:52 old-k8s-version-584140 kubelet[730]: E0722 11:31:52.598992 730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jul 22 11:31:52 old-k8s-version-584140 kubelet[730]: E0722 11:31:52.598992 730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
I0722 11:32:02.182171 210080 out.go:304] Setting ErrFile to fd 2...
I0722 11:32:02.182177 210080 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0722 11:32:12.183203 210080 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0722 11:32:12.202803 210080 api_server.go:72] duration metric: took 5m49.375690109s to wait for apiserver process to appear ...
I0722 11:32:12.202845 210080 api_server.go:88] waiting for apiserver healthz status ...
I0722 11:32:12.202883 210080 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0722 11:32:12.202977 210080 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0722 11:32:12.281497 210080 cri.go:89] found id: "7b17da0e203acb0f33605e81ab92029743299c8b53e99bedad6247fb2e22336d"
I0722 11:32:12.281517 210080 cri.go:89] found id: ""
I0722 11:32:12.281525 210080 logs.go:276] 1 containers: [7b17da0e203acb0f33605e81ab92029743299c8b53e99bedad6247fb2e22336d]
I0722 11:32:12.281584 210080 ssh_runner.go:195] Run: which crictl
I0722 11:32:12.285928 210080 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0722 11:32:12.285996 210080 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0722 11:32:12.366847 210080 cri.go:89] found id: "b8f395f6e10fffc01d9db2971c2690affd63e1173ebe081a173b1df5e29b3eae"
I0722 11:32:12.366866 210080 cri.go:89] found id: ""
I0722 11:32:12.366873 210080 logs.go:276] 1 containers: [b8f395f6e10fffc01d9db2971c2690affd63e1173ebe081a173b1df5e29b3eae]
I0722 11:32:12.366925 210080 ssh_runner.go:195] Run: which crictl
I0722 11:32:12.377727 210080 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0722 11:32:12.377844 210080 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0722 11:32:12.489949 210080 cri.go:89] found id: "25b426692cff4a0ddaac80382d5fd8be373235953b017a1f2591adbc04fe5208"
I0722 11:32:12.489969 210080 cri.go:89] found id: ""
I0722 11:32:12.489976 210080 logs.go:276] 1 containers: [25b426692cff4a0ddaac80382d5fd8be373235953b017a1f2591adbc04fe5208]
I0722 11:32:12.490035 210080 ssh_runner.go:195] Run: which crictl
I0722 11:32:12.494239 210080 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0722 11:32:12.494312 210080 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0722 11:32:12.570563 210080 cri.go:89] found id: "a38f1a7f716723ae1738fc6d121fd5959ee9c40c5b1c46b537955d760c9f4290"
I0722 11:32:12.570583 210080 cri.go:89] found id: ""
I0722 11:32:12.570591 210080 logs.go:276] 1 containers: [a38f1a7f716723ae1738fc6d121fd5959ee9c40c5b1c46b537955d760c9f4290]
I0722 11:32:12.570644 210080 ssh_runner.go:195] Run: which crictl
I0722 11:32:12.577492 210080 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0722 11:32:12.577562 210080 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0722 11:32:12.639244 210080 cri.go:89] found id: "5191e613fc2d72706f1d776fe8a845ca8f4b3cec7ff3b0f9d18aee199e8d79c6"
I0722 11:32:12.639265 210080 cri.go:89] found id: ""
I0722 11:32:12.639272 210080 logs.go:276] 1 containers: [5191e613fc2d72706f1d776fe8a845ca8f4b3cec7ff3b0f9d18aee199e8d79c6]
I0722 11:32:12.639326 210080 ssh_runner.go:195] Run: which crictl
I0722 11:32:12.645464 210080 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0722 11:32:12.645532 210080 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0722 11:32:12.711129 210080 cri.go:89] found id: "460bdeec3bdfccab7101c9d13045f9bcf87734da1fb0f6f8b6a5c0111906ac43"
I0722 11:32:12.711207 210080 cri.go:89] found id: ""
I0722 11:32:12.711230 210080 logs.go:276] 1 containers: [460bdeec3bdfccab7101c9d13045f9bcf87734da1fb0f6f8b6a5c0111906ac43]
I0722 11:32:12.711316 210080 ssh_runner.go:195] Run: which crictl
I0722 11:32:12.719704 210080 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0722 11:32:12.719776 210080 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0722 11:32:12.806984 210080 cri.go:89] found id: "451ceb51fb176f2ab58c30c602fe7a8d8dcdde723f94ec75d058fd599561cfde"
I0722 11:32:12.807002 210080 cri.go:89] found id: ""
I0722 11:32:12.807009 210080 logs.go:276] 1 containers: [451ceb51fb176f2ab58c30c602fe7a8d8dcdde723f94ec75d058fd599561cfde]
I0722 11:32:12.807062 210080 ssh_runner.go:195] Run: which crictl
I0722 11:32:12.810945 210080 cri.go:54] listing CRI containers in root : {State:all Name:storage-provisioner Namespaces:[]}
I0722 11:32:12.811013 210080 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0722 11:32:12.904775 210080 cri.go:89] found id: "b64b9e0461292d72b7fc112215c86b2db789ed69b01b10063e3b4f24a2155a8a"
I0722 11:32:12.904794 210080 cri.go:89] found id: "48a74507ee5da0b4b62d92cb8fe64853426c4fcd088c4d455c7d827c4c514ab2"
I0722 11:32:12.904799 210080 cri.go:89] found id: ""
I0722 11:32:12.904805 210080 logs.go:276] 2 containers: [b64b9e0461292d72b7fc112215c86b2db789ed69b01b10063e3b4f24a2155a8a 48a74507ee5da0b4b62d92cb8fe64853426c4fcd088c4d455c7d827c4c514ab2]
I0722 11:32:12.904865 210080 ssh_runner.go:195] Run: which crictl
I0722 11:32:12.913119 210080 ssh_runner.go:195] Run: which crictl
I0722 11:32:12.916790 210080 cri.go:54] listing CRI containers in root : {State:all Name:kubernetes-dashboard Namespaces:[]}
I0722 11:32:12.916854 210080 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I0722 11:32:12.991388 210080 cri.go:89] found id: "0da5dde31a386001ac351514fcd5b733872eb5d92ec8b3579e32b0f14de7b1fc"
I0722 11:32:12.991462 210080 cri.go:89] found id: ""
I0722 11:32:12.991484 210080 logs.go:276] 1 containers: [0da5dde31a386001ac351514fcd5b733872eb5d92ec8b3579e32b0f14de7b1fc]
I0722 11:32:12.991583 210080 ssh_runner.go:195] Run: which crictl
I0722 11:32:12.997559 210080 logs.go:123] Gathering logs for kubelet ...
I0722 11:32:12.997645 210080 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0722 11:32:13.066644 210080 logs.go:138] Found kubelet problem: Jul 22 11:26:39 old-k8s-version-584140 kubelet[730]: E0722 11:26:39.204682 730 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:old-k8s-version-584140" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-584140' and this object
W0722 11:32:13.066947 210080 logs.go:138] Found kubelet problem: Jul 22 11:26:39 old-k8s-version-584140 kubelet[730]: E0722 11:26:39.205097 730 reflector.go:138] object-"kube-system"/"storage-provisioner-token-th5sl": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "storage-provisioner-token-th5sl" is forbidden: User "system:node:old-k8s-version-584140" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-584140' and this object
W0722 11:32:13.067193 210080 logs.go:138] Found kubelet problem: Jul 22 11:26:39 old-k8s-version-584140 kubelet[730]: E0722 11:26:39.205388 730 reflector.go:138] object-"default"/"default-token-gkskl": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "default-token-gkskl" is forbidden: User "system:node:old-k8s-version-584140" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'old-k8s-version-584140' and this object
W0722 11:32:13.067423 210080 logs.go:138] Found kubelet problem: Jul 22 11:26:39 old-k8s-version-584140 kubelet[730]: E0722 11:26:39.206223 730 reflector.go:138] object-"kube-system"/"coredns": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:old-k8s-version-584140" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-584140' and this object
W0722 11:32:13.067664 210080 logs.go:138] Found kubelet problem: Jul 22 11:26:39 old-k8s-version-584140 kubelet[730]: E0722 11:26:39.206544 730 reflector.go:138] object-"kube-system"/"kube-proxy-token-g9gsb": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kube-proxy-token-g9gsb" is forbidden: User "system:node:old-k8s-version-584140" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-584140' and this object
W0722 11:32:13.067913 210080 logs.go:138] Found kubelet problem: Jul 22 11:26:39 old-k8s-version-584140 kubelet[730]: E0722 11:26:39.206876 730 reflector.go:138] object-"kube-system"/"kindnet-token-tjmsp": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kindnet-token-tjmsp" is forbidden: User "system:node:old-k8s-version-584140" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-584140' and this object
W0722 11:32:13.068162 210080 logs.go:138] Found kubelet problem: Jul 22 11:26:39 old-k8s-version-584140 kubelet[730]: E0722 11:26:39.207130 730 reflector.go:138] object-"kube-system"/"metrics-server-token-btvqb": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "metrics-server-token-btvqb" is forbidden: User "system:node:old-k8s-version-584140" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-584140' and this object
W0722 11:32:13.068406 210080 logs.go:138] Found kubelet problem: Jul 22 11:26:39 old-k8s-version-584140 kubelet[730]: E0722 11:26:39.207456 730 reflector.go:138] object-"kube-system"/"coredns-token-7tqrc": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "coredns-token-7tqrc" is forbidden: User "system:node:old-k8s-version-584140" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-584140' and this object
W0722 11:32:13.091614 210080 logs.go:138] Found kubelet problem: Jul 22 11:26:43 old-k8s-version-584140 kubelet[730]: E0722 11:26:43.160558 730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0722 11:32:13.091891 210080 logs.go:138] Found kubelet problem: Jul 22 11:26:43 old-k8s-version-584140 kubelet[730]: E0722 11:26:43.632278 730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0722 11:32:13.096193 210080 logs.go:138] Found kubelet problem: Jul 22 11:26:54 old-k8s-version-584140 kubelet[730]: E0722 11:26:54.611909 730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0722 11:32:13.098728 210080 logs.go:138] Found kubelet problem: Jul 22 11:27:02 old-k8s-version-584140 kubelet[730]: E0722 11:27:02.738618 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
W0722 11:32:13.099226 210080 logs.go:138] Found kubelet problem: Jul 22 11:27:03 old-k8s-version-584140 kubelet[730]: E0722 11:27:03.741827 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
W0722 11:32:13.099583 210080 logs.go:138] Found kubelet problem: Jul 22 11:27:04 old-k8s-version-584140 kubelet[730]: E0722 11:27:04.838076 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
W0722 11:32:13.103114 210080 logs.go:138] Found kubelet problem: Jul 22 11:27:09 old-k8s-version-584140 kubelet[730]: E0722 11:27:09.598856 730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0722 11:32:13.103933 210080 logs.go:138] Found kubelet problem: Jul 22 11:27:18 old-k8s-version-584140 kubelet[730]: E0722 11:27:18.778810 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
W0722 11:32:13.106139 210080 logs.go:138] Found kubelet problem: Jul 22 11:27:23 old-k8s-version-584140 kubelet[730]: E0722 11:27:23.614499 730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0722 11:32:13.106475 210080 logs.go:138] Found kubelet problem: Jul 22 11:27:24 old-k8s-version-584140 kubelet[730]: E0722 11:27:24.838228 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
W0722 11:32:13.106803 210080 logs.go:138] Found kubelet problem: Jul 22 11:27:36 old-k8s-version-584140 kubelet[730]: E0722 11:27:36.599081 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
W0722 11:32:13.106986 210080 logs.go:138] Found kubelet problem: Jul 22 11:27:38 old-k8s-version-584140 kubelet[730]: E0722 11:27:38.598819 730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0722 11:32:13.107575 210080 logs.go:138] Found kubelet problem: Jul 22 11:27:50 old-k8s-version-584140 kubelet[730]: E0722 11:27:50.837672 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
W0722 11:32:13.107756 210080 logs.go:138] Found kubelet problem: Jul 22 11:27:53 old-k8s-version-584140 kubelet[730]: E0722 11:27:53.599749 730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0722 11:32:13.108087 210080 logs.go:138] Found kubelet problem: Jul 22 11:27:54 old-k8s-version-584140 kubelet[730]: E0722 11:27:54.838469 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
W0722 11:32:13.108413 210080 logs.go:138] Found kubelet problem: Jul 22 11:28:06 old-k8s-version-584140 kubelet[730]: E0722 11:28:06.598312 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
W0722 11:32:13.112031 210080 logs.go:138] Found kubelet problem: Jul 22 11:28:07 old-k8s-version-584140 kubelet[730]: E0722 11:28:07.619353 730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0722 11:32:13.112416 210080 logs.go:138] Found kubelet problem: Jul 22 11:28:20 old-k8s-version-584140 kubelet[730]: E0722 11:28:20.599140 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
W0722 11:32:13.112656 210080 logs.go:138] Found kubelet problem: Jul 22 11:28:20 old-k8s-version-584140 kubelet[730]: E0722 11:28:20.600438 730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0722 11:32:13.113300 210080 logs.go:138] Found kubelet problem: Jul 22 11:28:33 old-k8s-version-584140 kubelet[730]: E0722 11:28:33.909665 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
W0722 11:32:13.113656 210080 logs.go:138] Found kubelet problem: Jul 22 11:28:34 old-k8s-version-584140 kubelet[730]: E0722 11:28:34.912079 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
W0722 11:32:13.113873 210080 logs.go:138] Found kubelet problem: Jul 22 11:28:35 old-k8s-version-584140 kubelet[730]: E0722 11:28:35.599081 730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0722 11:32:13.114232 210080 logs.go:138] Found kubelet problem: Jul 22 11:28:46 old-k8s-version-584140 kubelet[730]: E0722 11:28:46.598307 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
W0722 11:32:13.114449 210080 logs.go:138] Found kubelet problem: Jul 22 11:28:50 old-k8s-version-584140 kubelet[730]: E0722 11:28:50.599499 730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0722 11:32:13.114814 210080 logs.go:138] Found kubelet problem: Jul 22 11:29:01 old-k8s-version-584140 kubelet[730]: E0722 11:29:01.598946 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
W0722 11:32:13.115037 210080 logs.go:138] Found kubelet problem: Jul 22 11:29:04 old-k8s-version-584140 kubelet[730]: E0722 11:29:04.598688 730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0722 11:32:13.115407 210080 logs.go:138] Found kubelet problem: Jul 22 11:29:12 old-k8s-version-584140 kubelet[730]: E0722 11:29:12.598338 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
W0722 11:32:13.115623 210080 logs.go:138] Found kubelet problem: Jul 22 11:29:19 old-k8s-version-584140 kubelet[730]: E0722 11:29:19.598946 730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0722 11:32:13.115987 210080 logs.go:138] Found kubelet problem: Jul 22 11:29:26 old-k8s-version-584140 kubelet[730]: E0722 11:29:26.598882 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
W0722 11:32:13.118742 210080 logs.go:138] Found kubelet problem: Jul 22 11:29:33 old-k8s-version-584140 kubelet[730]: E0722 11:29:33.611073 730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0722 11:32:13.119112 210080 logs.go:138] Found kubelet problem: Jul 22 11:29:37 old-k8s-version-584140 kubelet[730]: E0722 11:29:37.598186 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
W0722 11:32:13.119323 210080 logs.go:138] Found kubelet problem: Jul 22 11:29:46 old-k8s-version-584140 kubelet[730]: E0722 11:29:46.599495 730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0722 11:32:13.119677 210080 logs.go:138] Found kubelet problem: Jul 22 11:29:48 old-k8s-version-584140 kubelet[730]: E0722 11:29:48.598602 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
W0722 11:32:13.119896 210080 logs.go:138] Found kubelet problem: Jul 22 11:30:00 old-k8s-version-584140 kubelet[730]: E0722 11:30:00.599866 730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0722 11:32:13.120518 210080 logs.go:138] Found kubelet problem: Jul 22 11:30:03 old-k8s-version-584140 kubelet[730]: E0722 11:30:03.060169 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
W0722 11:32:13.120882 210080 logs.go:138] Found kubelet problem: Jul 22 11:30:04 old-k8s-version-584140 kubelet[730]: E0722 11:30:04.837656 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
W0722 11:32:13.121095 210080 logs.go:138] Found kubelet problem: Jul 22 11:30:13 old-k8s-version-584140 kubelet[730]: E0722 11:30:13.598674 730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0722 11:32:13.121455 210080 logs.go:138] Found kubelet problem: Jul 22 11:30:17 old-k8s-version-584140 kubelet[730]: E0722 11:30:17.598240 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
W0722 11:32:13.121671 210080 logs.go:138] Found kubelet problem: Jul 22 11:30:28 old-k8s-version-584140 kubelet[730]: E0722 11:30:28.598615 730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0722 11:32:13.122558 210080 logs.go:138] Found kubelet problem: Jul 22 11:30:31 old-k8s-version-584140 kubelet[730]: E0722 11:30:31.598312 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
W0722 11:32:13.122777 210080 logs.go:138] Found kubelet problem: Jul 22 11:30:43 old-k8s-version-584140 kubelet[730]: E0722 11:30:43.599168 730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0722 11:32:13.123140 210080 logs.go:138] Found kubelet problem: Jul 22 11:30:44 old-k8s-version-584140 kubelet[730]: E0722 11:30:44.598289 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
W0722 11:32:13.123361 210080 logs.go:138] Found kubelet problem: Jul 22 11:30:55 old-k8s-version-584140 kubelet[730]: E0722 11:30:55.599111 730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0722 11:32:13.123761 210080 logs.go:138] Found kubelet problem: Jul 22 11:30:58 old-k8s-version-584140 kubelet[730]: E0722 11:30:58.598266 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
W0722 11:32:13.123983 210080 logs.go:138] Found kubelet problem: Jul 22 11:31:08 old-k8s-version-584140 kubelet[730]: E0722 11:31:08.598772 730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0722 11:32:13.124338 210080 logs.go:138] Found kubelet problem: Jul 22 11:31:12 old-k8s-version-584140 kubelet[730]: E0722 11:31:12.598216 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
W0722 11:32:13.124695 210080 logs.go:138] Found kubelet problem: Jul 22 11:31:23 old-k8s-version-584140 kubelet[730]: E0722 11:31:23.598165 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
W0722 11:32:13.124915 210080 logs.go:138] Found kubelet problem: Jul 22 11:31:23 old-k8s-version-584140 kubelet[730]: E0722 11:31:23.599281 730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0722 11:32:13.125573 210080 logs.go:138] Found kubelet problem: Jul 22 11:31:36 old-k8s-version-584140 kubelet[730]: E0722 11:31:36.598285 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
W0722 11:32:13.125763 210080 logs.go:138] Found kubelet problem: Jul 22 11:31:37 old-k8s-version-584140 kubelet[730]: E0722 11:31:37.598777 730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0722 11:32:13.126093 210080 logs.go:138] Found kubelet problem: Jul 22 11:31:50 old-k8s-version-584140 kubelet[730]: E0722 11:31:50.598548 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
W0722 11:32:13.126277 210080 logs.go:138] Found kubelet problem: Jul 22 11:31:52 old-k8s-version-584140 kubelet[730]: E0722 11:31:52.598992 730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0722 11:32:13.126606 210080 logs.go:138] Found kubelet problem: Jul 22 11:32:04 old-k8s-version-584140 kubelet[730]: E0722 11:32:04.598313 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
W0722 11:32:13.126802 210080 logs.go:138] Found kubelet problem: Jul 22 11:32:07 old-k8s-version-584140 kubelet[730]: E0722 11:32:07.598569 730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
I0722 11:32:13.126810 210080 logs.go:123] Gathering logs for describe nodes ...
I0722 11:32:13.126824 210080 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0722 11:32:13.399039 210080 logs.go:123] Gathering logs for kindnet [451ceb51fb176f2ab58c30c602fe7a8d8dcdde723f94ec75d058fd599561cfde] ...
I0722 11:32:13.399119 210080 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 451ceb51fb176f2ab58c30c602fe7a8d8dcdde723f94ec75d058fd599561cfde"
I0722 11:32:13.526326 210080 logs.go:123] Gathering logs for storage-provisioner [b64b9e0461292d72b7fc112215c86b2db789ed69b01b10063e3b4f24a2155a8a] ...
I0722 11:32:13.526402 210080 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 b64b9e0461292d72b7fc112215c86b2db789ed69b01b10063e3b4f24a2155a8a"
I0722 11:32:13.598245 210080 logs.go:123] Gathering logs for storage-provisioner [48a74507ee5da0b4b62d92cb8fe64853426c4fcd088c4d455c7d827c4c514ab2] ...
I0722 11:32:13.598325 210080 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 48a74507ee5da0b4b62d92cb8fe64853426c4fcd088c4d455c7d827c4c514ab2"
I0722 11:32:13.663983 210080 logs.go:123] Gathering logs for CRI-O ...
I0722 11:32:13.664010 210080 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0722 11:32:13.774294 210080 logs.go:123] Gathering logs for kube-apiserver [7b17da0e203acb0f33605e81ab92029743299c8b53e99bedad6247fb2e22336d] ...
I0722 11:32:13.774368 210080 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 7b17da0e203acb0f33605e81ab92029743299c8b53e99bedad6247fb2e22336d"
I0722 11:32:13.916684 210080 logs.go:123] Gathering logs for etcd [b8f395f6e10fffc01d9db2971c2690affd63e1173ebe081a173b1df5e29b3eae] ...
I0722 11:32:13.916766 210080 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 b8f395f6e10fffc01d9db2971c2690affd63e1173ebe081a173b1df5e29b3eae"
I0722 11:32:13.987707 210080 logs.go:123] Gathering logs for coredns [25b426692cff4a0ddaac80382d5fd8be373235953b017a1f2591adbc04fe5208] ...
I0722 11:32:13.987784 210080 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 25b426692cff4a0ddaac80382d5fd8be373235953b017a1f2591adbc04fe5208"
I0722 11:32:14.058506 210080 logs.go:123] Gathering logs for kube-controller-manager [460bdeec3bdfccab7101c9d13045f9bcf87734da1fb0f6f8b6a5c0111906ac43] ...
I0722 11:32:14.058580 210080 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 460bdeec3bdfccab7101c9d13045f9bcf87734da1fb0f6f8b6a5c0111906ac43"
I0722 11:32:14.180422 210080 logs.go:123] Gathering logs for dmesg ...
I0722 11:32:14.180504 210080 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0722 11:32:14.206776 210080 logs.go:123] Gathering logs for kube-scheduler [a38f1a7f716723ae1738fc6d121fd5959ee9c40c5b1c46b537955d760c9f4290] ...
I0722 11:32:14.206809 210080 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 a38f1a7f716723ae1738fc6d121fd5959ee9c40c5b1c46b537955d760c9f4290"
I0722 11:32:14.284863 210080 logs.go:123] Gathering logs for kube-proxy [5191e613fc2d72706f1d776fe8a845ca8f4b3cec7ff3b0f9d18aee199e8d79c6] ...
I0722 11:32:14.284912 210080 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 5191e613fc2d72706f1d776fe8a845ca8f4b3cec7ff3b0f9d18aee199e8d79c6"
I0722 11:32:14.362593 210080 logs.go:123] Gathering logs for kubernetes-dashboard [0da5dde31a386001ac351514fcd5b733872eb5d92ec8b3579e32b0f14de7b1fc] ...
I0722 11:32:14.362628 210080 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 0da5dde31a386001ac351514fcd5b733872eb5d92ec8b3579e32b0f14de7b1fc"
I0722 11:32:14.443975 210080 logs.go:123] Gathering logs for container status ...
I0722 11:32:14.444089 210080 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0722 11:32:14.520662 210080 out.go:304] Setting ErrFile to fd 2...
I0722 11:32:14.520689 210080 out.go:338] TERM=,COLORTERM=, which probably does not support color
W0722 11:32:14.520820 210080 out.go:239] X Problems detected in kubelet:
X Problems detected in kubelet:
W0722 11:32:14.520838 210080 out.go:239] Jul 22 11:31:37 old-k8s-version-584140 kubelet[730]: E0722 11:31:37.598777 730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jul 22 11:31:37 old-k8s-version-584140 kubelet[730]: E0722 11:31:37.598777 730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0722 11:32:14.520846 210080 out.go:239] Jul 22 11:31:50 old-k8s-version-584140 kubelet[730]: E0722 11:31:50.598548 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
Jul 22 11:31:50 old-k8s-version-584140 kubelet[730]: E0722 11:31:50.598548 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
W0722 11:32:14.520996 210080 out.go:239] Jul 22 11:31:52 old-k8s-version-584140 kubelet[730]: E0722 11:31:52.598992 730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jul 22 11:31:52 old-k8s-version-584140 kubelet[730]: E0722 11:31:52.598992 730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0722 11:32:14.521011 210080 out.go:239] Jul 22 11:32:04 old-k8s-version-584140 kubelet[730]: E0722 11:32:04.598313 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
Jul 22 11:32:04 old-k8s-version-584140 kubelet[730]: E0722 11:32:04.598313 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
W0722 11:32:14.521018 210080 out.go:239] Jul 22 11:32:07 old-k8s-version-584140 kubelet[730]: E0722 11:32:07.598569 730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jul 22 11:32:07 old-k8s-version-584140 kubelet[730]: E0722 11:32:07.598569 730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
I0722 11:32:14.521025 210080 out.go:304] Setting ErrFile to fd 2...
I0722 11:32:14.521035 210080 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0722 11:32:24.521380 210080 api_server.go:253] Checking apiserver healthz at https://192.168.76.2:8443/healthz ...
I0722 11:32:24.532152 210080 api_server.go:279] https://192.168.76.2:8443/healthz returned 200:
ok
I0722 11:32:24.534362 210080 out.go:177]
W0722 11:32:24.536402 210080 out.go:239] X Exiting due to K8S_UNHEALTHY_CONTROL_PLANE: wait 6m0s for node: wait for healthy API server: controlPlane never updated to v1.20.0
X Exiting due to K8S_UNHEALTHY_CONTROL_PLANE: wait 6m0s for node: wait for healthy API server: controlPlane never updated to v1.20.0
W0722 11:32:24.536544 210080 out.go:239] * Suggestion: Control Plane could not update, try minikube delete --all --purge
* Suggestion: Control Plane could not update, try minikube delete --all --purge
W0722 11:32:24.536574 210080 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/11417
* Related issue: https://github.com/kubernetes/minikube/issues/11417
W0722 11:32:24.536587 210080 out.go:239] *
*
W0722 11:32:24.537591 210080 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0722 11:32:24.538987 210080 out.go:177]
** /stderr **
start_stop_delete_test.go:259: failed to start minikube post-stop. args "out/minikube-linux-arm64 start -p old-k8s-version-584140 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=crio --kubernetes-version=v1.20.0": exit status 102
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: docker inspect <======
helpers_test.go:231: (dbg) Run: docker inspect old-k8s-version-584140
helpers_test.go:235: (dbg) docker inspect old-k8s-version-584140:
-- stdout --
[
{
"Id": "9a47d5204824dea9de7e428feb7e5cba07dfecea49620ebac54e1ddc8586aed6",
"Created": "2024-07-22T11:23:13.644495933Z",
"Path": "/usr/local/bin/entrypoint",
"Args": [
"/sbin/init"
],
"State": {
"Status": "running",
"Running": true,
"Paused": false,
"Restarting": false,
"OOMKilled": false,
"Dead": false,
"Pid": 210290,
"ExitCode": 0,
"Error": "",
"StartedAt": "2024-07-22T11:26:14.128020685Z",
"FinishedAt": "2024-07-22T11:26:13.098347533Z"
},
"Image": "sha256:e2c91a2178aa1acdb3eade350c62303b0cf135b362b91c6aa21cd060c2dbfcac",
"ResolvConfPath": "/var/lib/docker/containers/9a47d5204824dea9de7e428feb7e5cba07dfecea49620ebac54e1ddc8586aed6/resolv.conf",
"HostnamePath": "/var/lib/docker/containers/9a47d5204824dea9de7e428feb7e5cba07dfecea49620ebac54e1ddc8586aed6/hostname",
"HostsPath": "/var/lib/docker/containers/9a47d5204824dea9de7e428feb7e5cba07dfecea49620ebac54e1ddc8586aed6/hosts",
"LogPath": "/var/lib/docker/containers/9a47d5204824dea9de7e428feb7e5cba07dfecea49620ebac54e1ddc8586aed6/9a47d5204824dea9de7e428feb7e5cba07dfecea49620ebac54e1ddc8586aed6-json.log",
"Name": "/old-k8s-version-584140",
"RestartCount": 0,
"Driver": "overlay2",
"Platform": "linux",
"MountLabel": "",
"ProcessLabel": "",
"AppArmorProfile": "unconfined",
"ExecIDs": null,
"HostConfig": {
"Binds": [
"/lib/modules:/lib/modules:ro",
"old-k8s-version-584140:/var"
],
"ContainerIDFile": "",
"LogConfig": {
"Type": "json-file",
"Config": {}
},
"NetworkMode": "old-k8s-version-584140",
"PortBindings": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
]
},
"RestartPolicy": {
"Name": "no",
"MaximumRetryCount": 0
},
"AutoRemove": false,
"VolumeDriver": "",
"VolumesFrom": null,
"ConsoleSize": [
0,
0
],
"CapAdd": null,
"CapDrop": null,
"CgroupnsMode": "host",
"Dns": [],
"DnsOptions": [],
"DnsSearch": [],
"ExtraHosts": null,
"GroupAdd": null,
"IpcMode": "private",
"Cgroup": "",
"Links": null,
"OomScoreAdj": 0,
"PidMode": "",
"Privileged": true,
"PublishAllPorts": false,
"ReadonlyRootfs": false,
"SecurityOpt": [
"seccomp=unconfined",
"apparmor=unconfined",
"label=disable"
],
"Tmpfs": {
"/run": "",
"/tmp": ""
},
"UTSMode": "",
"UsernsMode": "",
"ShmSize": 67108864,
"Runtime": "runc",
"Isolation": "",
"CpuShares": 0,
"Memory": 2306867200,
"NanoCpus": 2000000000,
"CgroupParent": "",
"BlkioWeight": 0,
"BlkioWeightDevice": [],
"BlkioDeviceReadBps": [],
"BlkioDeviceWriteBps": [],
"BlkioDeviceReadIOps": [],
"BlkioDeviceWriteIOps": [],
"CpuPeriod": 0,
"CpuQuota": 0,
"CpuRealtimePeriod": 0,
"CpuRealtimeRuntime": 0,
"CpusetCpus": "",
"CpusetMems": "",
"Devices": [],
"DeviceCgroupRules": null,
"DeviceRequests": null,
"MemoryReservation": 0,
"MemorySwap": 4613734400,
"MemorySwappiness": null,
"OomKillDisable": false,
"PidsLimit": null,
"Ulimits": [],
"CpuCount": 0,
"CpuPercent": 0,
"IOMaximumIOps": 0,
"IOMaximumBandwidth": 0,
"MaskedPaths": null,
"ReadonlyPaths": null
},
"GraphDriver": {
"Data": {
"LowerDir": "/var/lib/docker/overlay2/d6ed63b09ddf4e12631dda12d1b165645c0ba730a9444261c62990f07d84a024-init/diff:/var/lib/docker/overlay2/375eed0e332cee71fb41f23c3bebb2cf752289490317aab56b4bc0e86204dc16/diff",
"MergedDir": "/var/lib/docker/overlay2/d6ed63b09ddf4e12631dda12d1b165645c0ba730a9444261c62990f07d84a024/merged",
"UpperDir": "/var/lib/docker/overlay2/d6ed63b09ddf4e12631dda12d1b165645c0ba730a9444261c62990f07d84a024/diff",
"WorkDir": "/var/lib/docker/overlay2/d6ed63b09ddf4e12631dda12d1b165645c0ba730a9444261c62990f07d84a024/work"
},
"Name": "overlay2"
},
"Mounts": [
{
"Type": "bind",
"Source": "/lib/modules",
"Destination": "/lib/modules",
"Mode": "ro",
"RW": false,
"Propagation": "rprivate"
},
{
"Type": "volume",
"Name": "old-k8s-version-584140",
"Source": "/var/lib/docker/volumes/old-k8s-version-584140/_data",
"Destination": "/var",
"Driver": "local",
"Mode": "z",
"RW": true,
"Propagation": ""
}
],
"Config": {
"Hostname": "old-k8s-version-584140",
"Domainname": "",
"User": "",
"AttachStdin": false,
"AttachStdout": false,
"AttachStderr": false,
"ExposedPorts": {
"22/tcp": {},
"2376/tcp": {},
"32443/tcp": {},
"5000/tcp": {},
"8443/tcp": {}
},
"Tty": true,
"OpenStdin": false,
"StdinOnce": false,
"Env": [
"container=docker",
"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
],
"Cmd": null,
"Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f",
"Volumes": null,
"WorkingDir": "/",
"Entrypoint": [
"/usr/local/bin/entrypoint",
"/sbin/init"
],
"OnBuild": null,
"Labels": {
"created_by.minikube.sigs.k8s.io": "true",
"mode.minikube.sigs.k8s.io": "old-k8s-version-584140",
"name.minikube.sigs.k8s.io": "old-k8s-version-584140",
"role.minikube.sigs.k8s.io": ""
},
"StopSignal": "SIGRTMIN+3"
},
"NetworkSettings": {
"Bridge": "",
"SandboxID": "27d22519c61a6a832e6256fb15588bcc8315baa5bc7057397360403e6b3514af",
"SandboxKey": "/var/run/docker/netns/27d22519c61a",
"Ports": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33063"
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33064"
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33067"
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33065"
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33066"
}
]
},
"HairpinMode": false,
"LinkLocalIPv6Address": "",
"LinkLocalIPv6PrefixLen": 0,
"SecondaryIPAddresses": null,
"SecondaryIPv6Addresses": null,
"EndpointID": "",
"Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"IPAddress": "",
"IPPrefixLen": 0,
"IPv6Gateway": "",
"MacAddress": "",
"Networks": {
"old-k8s-version-584140": {
"IPAMConfig": {
"IPv4Address": "192.168.76.2"
},
"Links": null,
"Aliases": null,
"MacAddress": "02:42:c0:a8:4c:02",
"DriverOpts": null,
"NetworkID": "c3157009d922a10c8485390dc93c92f21af4d3fe17cf7b28a690ca73f749587f",
"EndpointID": "1e5f94a796870e9e9e892ddd201ad10ad013be3b533a9d9b6e97382cb239bfd7",
"Gateway": "192.168.76.1",
"IPAddress": "192.168.76.2",
"IPPrefixLen": 24,
"IPv6Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"DNSNames": [
"old-k8s-version-584140",
"9a47d5204824"
]
}
}
}
}
]
-- /stdout --
helpers_test.go:239: (dbg) Run: out/minikube-linux-arm64 status --format={{.Host}} -p old-k8s-version-584140 -n old-k8s-version-584140
helpers_test.go:244: <<< TestStartStop/group/old-k8s-version/serial/SecondStart FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: minikube logs <======
helpers_test.go:247: (dbg) Run: out/minikube-linux-arm64 -p old-k8s-version-584140 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-arm64 -p old-k8s-version-584140 logs -n 25: (2.244629518s)
helpers_test.go:252: TestStartStop/group/old-k8s-version/serial/SecondStart logs:
-- stdout --
==> Audit <==
|---------|--------------------------------------------------------|------------------------------|---------|---------|---------------------|---------------------|
| Command | Args | Profile | User | Version | Start Time | End Time |
|---------|--------------------------------------------------------|------------------------------|---------|---------|---------------------|---------------------|
| ssh | -p cert-options-708356 -- sudo | cert-options-708356 | jenkins | v1.33.1 | 22 Jul 24 11:23 UTC | 22 Jul 24 11:23 UTC |
| | cat /etc/kubernetes/admin.conf | | | | | |
| delete | -p cert-options-708356 | cert-options-708356 | jenkins | v1.33.1 | 22 Jul 24 11:23 UTC | 22 Jul 24 11:23 UTC |
| start | -p old-k8s-version-584140 | old-k8s-version-584140 | jenkins | v1.33.1 | 22 Jul 24 11:23 UTC | 22 Jul 24 11:25 UTC |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --kvm-network=default | | | | | |
| | --kvm-qemu-uri=qemu:///system | | | | | |
| | --disable-driver-mounts | | | | | |
| | --keep-context=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=crio | | | | | |
| | --kubernetes-version=v1.20.0 | | | | | |
| start | -p cert-expiration-208632 | cert-expiration-208632 | jenkins | v1.33.1 | 22 Jul 24 11:23 UTC | 22 Jul 24 11:24 UTC |
| | --memory=2048 | | | | | |
| | --cert-expiration=8760h | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=crio | | | | | |
| delete | -p cert-expiration-208632 | cert-expiration-208632 | jenkins | v1.33.1 | 22 Jul 24 11:24 UTC | 22 Jul 24 11:24 UTC |
| start | -p embed-certs-981687 | embed-certs-981687 | jenkins | v1.33.1 | 22 Jul 24 11:24 UTC | 22 Jul 24 11:25 UTC |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --embed-certs --driver=docker | | | | | |
| | --container-runtime=crio | | | | | |
| | --kubernetes-version=v1.30.3 | | | | | |
| addons | enable metrics-server -p embed-certs-981687 | embed-certs-981687 | jenkins | v1.33.1 | 22 Jul 24 11:25 UTC | 22 Jul 24 11:25 UTC |
| | --images=MetricsServer=registry.k8s.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| stop | -p embed-certs-981687 | embed-certs-981687 | jenkins | v1.33.1 | 22 Jul 24 11:25 UTC | 22 Jul 24 11:25 UTC |
| | --alsologtostderr -v=3 | | | | | |
| addons | enable dashboard -p embed-certs-981687 | embed-certs-981687 | jenkins | v1.33.1 | 22 Jul 24 11:25 UTC | 22 Jul 24 11:25 UTC |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| start | -p embed-certs-981687 | embed-certs-981687 | jenkins | v1.33.1 | 22 Jul 24 11:25 UTC | 22 Jul 24 11:30 UTC |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --embed-certs --driver=docker | | | | | |
| | --container-runtime=crio | | | | | |
| | --kubernetes-version=v1.30.3 | | | | | |
| addons | enable metrics-server -p old-k8s-version-584140 | old-k8s-version-584140 | jenkins | v1.33.1 | 22 Jul 24 11:25 UTC | 22 Jul 24 11:26 UTC |
| | --images=MetricsServer=registry.k8s.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| stop | -p old-k8s-version-584140 | old-k8s-version-584140 | jenkins | v1.33.1 | 22 Jul 24 11:26 UTC | 22 Jul 24 11:26 UTC |
| | --alsologtostderr -v=3 | | | | | |
| addons | enable dashboard -p old-k8s-version-584140 | old-k8s-version-584140 | jenkins | v1.33.1 | 22 Jul 24 11:26 UTC | 22 Jul 24 11:26 UTC |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| start | -p old-k8s-version-584140 | old-k8s-version-584140 | jenkins | v1.33.1 | 22 Jul 24 11:26 UTC | |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --kvm-network=default | | | | | |
| | --kvm-qemu-uri=qemu:///system | | | | | |
| | --disable-driver-mounts | | | | | |
| | --keep-context=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=crio | | | | | |
| | --kubernetes-version=v1.20.0 | | | | | |
| image | embed-certs-981687 image list | embed-certs-981687 | jenkins | v1.33.1 | 22 Jul 24 11:30 UTC | 22 Jul 24 11:30 UTC |
| | --format=json | | | | | |
| pause | -p embed-certs-981687 | embed-certs-981687 | jenkins | v1.33.1 | 22 Jul 24 11:30 UTC | 22 Jul 24 11:30 UTC |
| | --alsologtostderr -v=1 | | | | | |
| unpause | -p embed-certs-981687 | embed-certs-981687 | jenkins | v1.33.1 | 22 Jul 24 11:30 UTC | 22 Jul 24 11:30 UTC |
| | --alsologtostderr -v=1 | | | | | |
| delete | -p embed-certs-981687 | embed-certs-981687 | jenkins | v1.33.1 | 22 Jul 24 11:30 UTC | 22 Jul 24 11:30 UTC |
| delete | -p embed-certs-981687 | embed-certs-981687 | jenkins | v1.33.1 | 22 Jul 24 11:30 UTC | 22 Jul 24 11:30 UTC |
| delete | -p | disable-driver-mounts-498326 | jenkins | v1.33.1 | 22 Jul 24 11:30 UTC | 22 Jul 24 11:30 UTC |
| | disable-driver-mounts-498326 | | | | | |
| start | -p no-preload-076896 --memory=2200 | no-preload-076896 | jenkins | v1.33.1 | 22 Jul 24 11:30 UTC | 22 Jul 24 11:31 UTC |
| | --alsologtostderr --wait=true | | | | | |
| | --preload=false --driver=docker | | | | | |
| | --container-runtime=crio | | | | | |
| | --kubernetes-version=v1.31.0-beta.0 | | | | | |
| addons | enable metrics-server -p no-preload-076896 | no-preload-076896 | jenkins | v1.33.1 | 22 Jul 24 11:31 UTC | 22 Jul 24 11:31 UTC |
| | --images=MetricsServer=registry.k8s.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| stop | -p no-preload-076896 | no-preload-076896 | jenkins | v1.33.1 | 22 Jul 24 11:31 UTC | 22 Jul 24 11:31 UTC |
| | --alsologtostderr -v=3 | | | | | |
| addons | enable dashboard -p no-preload-076896 | no-preload-076896 | jenkins | v1.33.1 | 22 Jul 24 11:31 UTC | 22 Jul 24 11:32 UTC |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| start | -p no-preload-076896 --memory=2200 | no-preload-076896 | jenkins | v1.33.1 | 22 Jul 24 11:32 UTC | |
| | --alsologtostderr --wait=true | | | | | |
| | --preload=false --driver=docker | | | | | |
| | --container-runtime=crio | | | | | |
| | --kubernetes-version=v1.31.0-beta.0 | | | | | |
|---------|--------------------------------------------------------|------------------------------|---------|---------|---------------------|---------------------|
==> Last Start <==
Log file created at: 2024/07/22 11:32:00
Running on machine: ip-172-31-21-244
Binary: Built with gc go1.22.5 for linux/arm64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I0722 11:32:00.206013 218924 out.go:291] Setting OutFile to fd 1 ...
I0722 11:32:00.206253 218924 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0722 11:32:00.206281 218924 out.go:304] Setting ErrFile to fd 2...
I0722 11:32:00.206301 218924 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0722 11:32:00.206652 218924 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19313-2237/.minikube/bin
I0722 11:32:00.207133 218924 out.go:298] Setting JSON to false
I0722 11:32:00.208314 218924 start.go:129] hostinfo: {"hostname":"ip-172-31-21-244","uptime":4465,"bootTime":1721643455,"procs":207,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1064-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"da8ac1fd-6236-412a-a346-95873c98230d"}
I0722 11:32:00.208452 218924 start.go:139] virtualization:
I0722 11:32:00.231988 218924 out.go:177] * [no-preload-076896] minikube v1.33.1 on Ubuntu 20.04 (arm64)
I0722 11:32:00.234764 218924 notify.go:220] Checking for updates...
I0722 11:32:00.237596 218924 out.go:177] - MINIKUBE_LOCATION=19313
I0722 11:32:00.239823 218924 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0722 11:32:00.243194 218924 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/19313-2237/kubeconfig
I0722 11:32:00.245824 218924 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/19313-2237/.minikube
I0722 11:32:00.249984 218924 out.go:177] - MINIKUBE_BIN=out/minikube-linux-arm64
I0722 11:32:00.253479 218924 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0722 11:32:00.256254 218924 config.go:182] Loaded profile config "no-preload-076896": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.31.0-beta.0
I0722 11:32:00.257009 218924 driver.go:392] Setting default libvirt URI to qemu:///system
I0722 11:32:00.321171 218924 docker.go:123] docker version: linux-27.0.3:Docker Engine - Community
I0722 11:32:00.321315 218924 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0722 11:32:00.419213 218924 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:39 OomKillDisable:true NGoroutines:53 SystemTime:2024-07-22 11:32:00.407664694 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1064-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214896640 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:27.0.3 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41 Expected:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.15.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.28.1]] Warnings:<nil>}}
I0722 11:32:00.419342 218924 docker.go:307] overlay module found
I0722 11:32:00.421911 218924 out.go:177] * Using the docker driver based on existing profile
I0722 11:32:00.423460 218924 start.go:297] selected driver: docker
I0722 11:32:00.423489 218924 start.go:901] validating driver "docker" against &{Name:no-preload-076896 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0-beta.0 ClusterName:no-preload-076896 Namespace:default APIServerHAVIP: APIS
erverName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.94.2 Port:8443 KubernetesVersion:v1.31.0-beta.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false Mou
ntString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0722 11:32:00.423631 218924 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0722 11:32:00.424371 218924 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0722 11:32:00.529869 218924 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:39 OomKillDisable:true NGoroutines:53 SystemTime:2024-07-22 11:32:00.517324747 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1064-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214896640 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:27.0.3 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41 Expected:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.15.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.28.1]] Warnings:<nil>}}
I0722 11:32:00.530235 218924 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0722 11:32:00.530267 218924 cni.go:84] Creating CNI manager for ""
I0722 11:32:00.530277 218924 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
I0722 11:32:00.530329 218924 start.go:340] cluster config:
{Name:no-preload-076896 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0-beta.0 ClusterName:no-preload-076896 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local C
ontainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.94.2 Port:8443 KubernetesVersion:v1.31.0-beta.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker Mo
untIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0722 11:32:00.533722 218924 out.go:177] * Starting "no-preload-076896" primary control-plane node in "no-preload-076896" cluster
I0722 11:32:00.536404 218924 cache.go:121] Beginning downloading kic base image for docker with crio
I0722 11:32:00.538702 218924 out.go:177] * Pulling base image v0.0.44-1721324606-19298 ...
I0722 11:32:00.540976 218924 preload.go:131] Checking if preload exists for k8s version v1.31.0-beta.0 and runtime crio
I0722 11:32:00.541141 218924 profile.go:143] Saving config to /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/no-preload-076896/config.json ...
I0722 11:32:00.541499 218924 cache.go:107] acquiring lock: {Name:mk52d9a54b742f20dfa0755d303aba7c73694651 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0722 11:32:00.541591 218924 cache.go:115] /home/jenkins/minikube-integration/19313-2237/.minikube/cache/images/arm64/gcr.io/k8s-minikube/storage-provisioner_v5 exists
I0722 11:32:00.541605 218924 cache.go:96] cache image "gcr.io/k8s-minikube/storage-provisioner:v5" -> "/home/jenkins/minikube-integration/19313-2237/.minikube/cache/images/arm64/gcr.io/k8s-minikube/storage-provisioner_v5" took 112.142µs
I0722 11:32:00.541622 218924 cache.go:80] save to tar file gcr.io/k8s-minikube/storage-provisioner:v5 -> /home/jenkins/minikube-integration/19313-2237/.minikube/cache/images/arm64/gcr.io/k8s-minikube/storage-provisioner_v5 succeeded
I0722 11:32:00.541634 218924 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f in local docker daemon
I0722 11:32:00.542325 218924 cache.go:107] acquiring lock: {Name:mk6caa5d95978357841b98c0564993a3e6a35b2e Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0722 11:32:00.542429 218924 cache.go:115] /home/jenkins/minikube-integration/19313-2237/.minikube/cache/images/arm64/registry.k8s.io/kube-proxy_v1.31.0-beta.0 exists
I0722 11:32:00.542442 218924 cache.go:96] cache image "registry.k8s.io/kube-proxy:v1.31.0-beta.0" -> "/home/jenkins/minikube-integration/19313-2237/.minikube/cache/images/arm64/registry.k8s.io/kube-proxy_v1.31.0-beta.0" took 128.125µs
I0722 11:32:00.542451 218924 cache.go:80] save to tar file registry.k8s.io/kube-proxy:v1.31.0-beta.0 -> /home/jenkins/minikube-integration/19313-2237/.minikube/cache/images/arm64/registry.k8s.io/kube-proxy_v1.31.0-beta.0 succeeded
I0722 11:32:00.542469 218924 cache.go:107] acquiring lock: {Name:mkea964633adff168867fc8a371bf206fb5fa896 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0722 11:32:00.542503 218924 cache.go:115] /home/jenkins/minikube-integration/19313-2237/.minikube/cache/images/arm64/registry.k8s.io/kube-apiserver_v1.31.0-beta.0 exists
I0722 11:32:00.542514 218924 cache.go:96] cache image "registry.k8s.io/kube-apiserver:v1.31.0-beta.0" -> "/home/jenkins/minikube-integration/19313-2237/.minikube/cache/images/arm64/registry.k8s.io/kube-apiserver_v1.31.0-beta.0" took 47.566µs
I0722 11:32:00.542522 218924 cache.go:80] save to tar file registry.k8s.io/kube-apiserver:v1.31.0-beta.0 -> /home/jenkins/minikube-integration/19313-2237/.minikube/cache/images/arm64/registry.k8s.io/kube-apiserver_v1.31.0-beta.0 succeeded
I0722 11:32:00.542545 218924 cache.go:107] acquiring lock: {Name:mkdc6b938e43d6043dfb6754045d63e0959c9e2c Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0722 11:32:00.542577 218924 cache.go:115] /home/jenkins/minikube-integration/19313-2237/.minikube/cache/images/arm64/registry.k8s.io/kube-controller-manager_v1.31.0-beta.0 exists
I0722 11:32:00.542583 218924 cache.go:96] cache image "registry.k8s.io/kube-controller-manager:v1.31.0-beta.0" -> "/home/jenkins/minikube-integration/19313-2237/.minikube/cache/images/arm64/registry.k8s.io/kube-controller-manager_v1.31.0-beta.0" took 51.923µs
I0722 11:32:00.542593 218924 cache.go:80] save to tar file registry.k8s.io/kube-controller-manager:v1.31.0-beta.0 -> /home/jenkins/minikube-integration/19313-2237/.minikube/cache/images/arm64/registry.k8s.io/kube-controller-manager_v1.31.0-beta.0 succeeded
I0722 11:32:00.542606 218924 cache.go:107] acquiring lock: {Name:mka23aced99d41fc7736a08289b8d03b46f2a9fa Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0722 11:32:00.542642 218924 cache.go:115] /home/jenkins/minikube-integration/19313-2237/.minikube/cache/images/arm64/registry.k8s.io/kube-scheduler_v1.31.0-beta.0 exists
I0722 11:32:00.542653 218924 cache.go:96] cache image "registry.k8s.io/kube-scheduler:v1.31.0-beta.0" -> "/home/jenkins/minikube-integration/19313-2237/.minikube/cache/images/arm64/registry.k8s.io/kube-scheduler_v1.31.0-beta.0" took 48.403µs
I0722 11:32:00.542660 218924 cache.go:80] save to tar file registry.k8s.io/kube-scheduler:v1.31.0-beta.0 -> /home/jenkins/minikube-integration/19313-2237/.minikube/cache/images/arm64/registry.k8s.io/kube-scheduler_v1.31.0-beta.0 succeeded
I0722 11:32:00.542674 218924 cache.go:107] acquiring lock: {Name:mkae044ec7f059c6ba3b5067e8d317c2ca46ccd3 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0722 11:32:00.542714 218924 cache.go:115] /home/jenkins/minikube-integration/19313-2237/.minikube/cache/images/arm64/registry.k8s.io/etcd_3.5.14-0 exists
I0722 11:32:00.542725 218924 cache.go:96] cache image "registry.k8s.io/etcd:3.5.14-0" -> "/home/jenkins/minikube-integration/19313-2237/.minikube/cache/images/arm64/registry.k8s.io/etcd_3.5.14-0" took 52.481µs
I0722 11:32:00.542731 218924 cache.go:80] save to tar file registry.k8s.io/etcd:3.5.14-0 -> /home/jenkins/minikube-integration/19313-2237/.minikube/cache/images/arm64/registry.k8s.io/etcd_3.5.14-0 succeeded
I0722 11:32:00.542740 218924 cache.go:107] acquiring lock: {Name:mk5704b6c0aa84c87ead7fb21e5f65da27c2b6f9 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0722 11:32:00.542772 218924 cache.go:115] /home/jenkins/minikube-integration/19313-2237/.minikube/cache/images/arm64/registry.k8s.io/pause_3.10 exists
I0722 11:32:00.542790 218924 cache.go:96] cache image "registry.k8s.io/pause:3.10" -> "/home/jenkins/minikube-integration/19313-2237/.minikube/cache/images/arm64/registry.k8s.io/pause_3.10" took 50.282µs
I0722 11:32:00.542796 218924 cache.go:80] save to tar file registry.k8s.io/pause:3.10 -> /home/jenkins/minikube-integration/19313-2237/.minikube/cache/images/arm64/registry.k8s.io/pause_3.10 succeeded
I0722 11:32:00.542807 218924 cache.go:107] acquiring lock: {Name:mk47cae931dbe63403363e76622c92355553c9a1 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0722 11:32:00.542847 218924 cache.go:115] /home/jenkins/minikube-integration/19313-2237/.minikube/cache/images/arm64/registry.k8s.io/coredns/coredns_v1.11.1 exists
I0722 11:32:00.542857 218924 cache.go:96] cache image "registry.k8s.io/coredns/coredns:v1.11.1" -> "/home/jenkins/minikube-integration/19313-2237/.minikube/cache/images/arm64/registry.k8s.io/coredns/coredns_v1.11.1" took 51.349µs
I0722 11:32:00.542863 218924 cache.go:80] save to tar file registry.k8s.io/coredns/coredns:v1.11.1 -> /home/jenkins/minikube-integration/19313-2237/.minikube/cache/images/arm64/registry.k8s.io/coredns/coredns_v1.11.1 succeeded
I0722 11:32:00.542871 218924 cache.go:87] Successfully saved all images to host disk.
W0722 11:32:00.561347 218924 image.go:95] image gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f is of wrong architecture
I0722 11:32:00.561366 218924 cache.go:149] Downloading gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f to local cache
I0722 11:32:00.561438 218924 image.go:63] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f in local cache directory
I0722 11:32:00.561457 218924 image.go:66] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f in local cache directory, skipping pull
I0722 11:32:00.561461 218924 image.go:135] gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f exists in cache, skipping pull
I0722 11:32:00.561470 218924 cache.go:152] successfully saved gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f as a tarball
I0722 11:32:00.561475 218924 cache.go:162] Loading gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f from local cache
I0722 11:32:00.702238 218924 cache.go:164] successfully loaded and using gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f from cached tarball
I0722 11:32:00.702283 218924 cache.go:194] Successfully downloaded all kic artifacts
I0722 11:32:00.702319 218924 start.go:360] acquireMachinesLock for no-preload-076896: {Name:mked0c4aea1bde2c94a9c1b5fe3fd3b31787769d Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0722 11:32:00.702378 218924 start.go:364] duration metric: took 42.06µs to acquireMachinesLock for "no-preload-076896"
I0722 11:32:00.702398 218924 start.go:96] Skipping create...Using existing machine configuration
I0722 11:32:00.702403 218924 fix.go:54] fixHost starting:
I0722 11:32:00.702668 218924 cli_runner.go:164] Run: docker container inspect no-preload-076896 --format={{.State.Status}}
I0722 11:32:00.728331 218924 fix.go:112] recreateIfNeeded on no-preload-076896: state=Stopped err=<nil>
W0722 11:32:00.728368 218924 fix.go:138] unexpected machine state, will restart: <nil>
I0722 11:32:00.732969 218924 out.go:177] * Restarting existing docker container for "no-preload-076896" ...
I0722 11:31:59.342888 210080 pod_ready.go:102] pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace has status "Ready":"False"
I0722 11:31:59.845379 210080 pod_ready.go:81] duration metric: took 4m0.012318488s for pod "metrics-server-9975d5f86-4jcvm" in "kube-system" namespace to be "Ready" ...
E0722 11:31:59.845399 210080 pod_ready.go:66] WaitExtra: waitPodCondition: context deadline exceeded
I0722 11:31:59.845409 210080 pod_ready.go:38] duration metric: took 5m20.661509404s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0722 11:31:59.845424 210080 api_server.go:52] waiting for apiserver process to appear ...
I0722 11:31:59.845451 210080 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0722 11:31:59.845574 210080 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0722 11:31:59.920139 210080 cri.go:89] found id: "7b17da0e203acb0f33605e81ab92029743299c8b53e99bedad6247fb2e22336d"
I0722 11:31:59.920178 210080 cri.go:89] found id: ""
I0722 11:31:59.920186 210080 logs.go:276] 1 containers: [7b17da0e203acb0f33605e81ab92029743299c8b53e99bedad6247fb2e22336d]
I0722 11:31:59.920236 210080 ssh_runner.go:195] Run: which crictl
I0722 11:31:59.924556 210080 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0722 11:31:59.924629 210080 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0722 11:31:59.977812 210080 cri.go:89] found id: "b8f395f6e10fffc01d9db2971c2690affd63e1173ebe081a173b1df5e29b3eae"
I0722 11:31:59.977831 210080 cri.go:89] found id: ""
I0722 11:31:59.977840 210080 logs.go:276] 1 containers: [b8f395f6e10fffc01d9db2971c2690affd63e1173ebe081a173b1df5e29b3eae]
I0722 11:31:59.977895 210080 ssh_runner.go:195] Run: which crictl
I0722 11:31:59.982113 210080 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0722 11:31:59.982181 210080 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0722 11:32:00.089770 210080 cri.go:89] found id: "25b426692cff4a0ddaac80382d5fd8be373235953b017a1f2591adbc04fe5208"
I0722 11:32:00.089791 210080 cri.go:89] found id: ""
I0722 11:32:00.089799 210080 logs.go:276] 1 containers: [25b426692cff4a0ddaac80382d5fd8be373235953b017a1f2591adbc04fe5208]
I0722 11:32:00.089863 210080 ssh_runner.go:195] Run: which crictl
I0722 11:32:00.106635 210080 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0722 11:32:00.106733 210080 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0722 11:32:00.253185 210080 cri.go:89] found id: "a38f1a7f716723ae1738fc6d121fd5959ee9c40c5b1c46b537955d760c9f4290"
I0722 11:32:00.253208 210080 cri.go:89] found id: ""
I0722 11:32:00.253221 210080 logs.go:276] 1 containers: [a38f1a7f716723ae1738fc6d121fd5959ee9c40c5b1c46b537955d760c9f4290]
I0722 11:32:00.253285 210080 ssh_runner.go:195] Run: which crictl
I0722 11:32:00.269148 210080 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0722 11:32:00.269317 210080 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0722 11:32:00.378714 210080 cri.go:89] found id: "5191e613fc2d72706f1d776fe8a845ca8f4b3cec7ff3b0f9d18aee199e8d79c6"
I0722 11:32:00.378743 210080 cri.go:89] found id: ""
I0722 11:32:00.378751 210080 logs.go:276] 1 containers: [5191e613fc2d72706f1d776fe8a845ca8f4b3cec7ff3b0f9d18aee199e8d79c6]
I0722 11:32:00.378814 210080 ssh_runner.go:195] Run: which crictl
I0722 11:32:00.385279 210080 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0722 11:32:00.385366 210080 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0722 11:32:00.464157 210080 cri.go:89] found id: "460bdeec3bdfccab7101c9d13045f9bcf87734da1fb0f6f8b6a5c0111906ac43"
I0722 11:32:00.464207 210080 cri.go:89] found id: ""
I0722 11:32:00.464216 210080 logs.go:276] 1 containers: [460bdeec3bdfccab7101c9d13045f9bcf87734da1fb0f6f8b6a5c0111906ac43]
I0722 11:32:00.464285 210080 ssh_runner.go:195] Run: which crictl
I0722 11:32:00.468544 210080 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0722 11:32:00.468644 210080 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0722 11:32:00.528057 210080 cri.go:89] found id: "451ceb51fb176f2ab58c30c602fe7a8d8dcdde723f94ec75d058fd599561cfde"
I0722 11:32:00.528078 210080 cri.go:89] found id: ""
I0722 11:32:00.528086 210080 logs.go:276] 1 containers: [451ceb51fb176f2ab58c30c602fe7a8d8dcdde723f94ec75d058fd599561cfde]
I0722 11:32:00.528144 210080 ssh_runner.go:195] Run: which crictl
I0722 11:32:00.533504 210080 cri.go:54] listing CRI containers in root : {State:all Name:storage-provisioner Namespaces:[]}
I0722 11:32:00.533634 210080 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0722 11:32:00.595614 210080 cri.go:89] found id: "b64b9e0461292d72b7fc112215c86b2db789ed69b01b10063e3b4f24a2155a8a"
I0722 11:32:00.595635 210080 cri.go:89] found id: "48a74507ee5da0b4b62d92cb8fe64853426c4fcd088c4d455c7d827c4c514ab2"
I0722 11:32:00.595641 210080 cri.go:89] found id: ""
I0722 11:32:00.595649 210080 logs.go:276] 2 containers: [b64b9e0461292d72b7fc112215c86b2db789ed69b01b10063e3b4f24a2155a8a 48a74507ee5da0b4b62d92cb8fe64853426c4fcd088c4d455c7d827c4c514ab2]
I0722 11:32:00.595739 210080 ssh_runner.go:195] Run: which crictl
I0722 11:32:00.601448 210080 ssh_runner.go:195] Run: which crictl
I0722 11:32:00.605652 210080 cri.go:54] listing CRI containers in root : {State:all Name:kubernetes-dashboard Namespaces:[]}
I0722 11:32:00.605721 210080 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I0722 11:32:00.651274 210080 cri.go:89] found id: "0da5dde31a386001ac351514fcd5b733872eb5d92ec8b3579e32b0f14de7b1fc"
I0722 11:32:00.651297 210080 cri.go:89] found id: ""
I0722 11:32:00.651306 210080 logs.go:276] 1 containers: [0da5dde31a386001ac351514fcd5b733872eb5d92ec8b3579e32b0f14de7b1fc]
I0722 11:32:00.651361 210080 ssh_runner.go:195] Run: which crictl
I0722 11:32:00.654976 210080 logs.go:123] Gathering logs for dmesg ...
I0722 11:32:00.655002 210080 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0722 11:32:00.673970 210080 logs.go:123] Gathering logs for describe nodes ...
I0722 11:32:00.673997 210080 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0722 11:32:00.904292 210080 logs.go:123] Gathering logs for kube-scheduler [a38f1a7f716723ae1738fc6d121fd5959ee9c40c5b1c46b537955d760c9f4290] ...
I0722 11:32:00.904323 210080 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 a38f1a7f716723ae1738fc6d121fd5959ee9c40c5b1c46b537955d760c9f4290"
I0722 11:32:00.986854 210080 logs.go:123] Gathering logs for kube-proxy [5191e613fc2d72706f1d776fe8a845ca8f4b3cec7ff3b0f9d18aee199e8d79c6] ...
I0722 11:32:00.986888 210080 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 5191e613fc2d72706f1d776fe8a845ca8f4b3cec7ff3b0f9d18aee199e8d79c6"
I0722 11:32:01.042704 210080 logs.go:123] Gathering logs for storage-provisioner [b64b9e0461292d72b7fc112215c86b2db789ed69b01b10063e3b4f24a2155a8a] ...
I0722 11:32:01.042744 210080 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 b64b9e0461292d72b7fc112215c86b2db789ed69b01b10063e3b4f24a2155a8a"
I0722 11:32:01.152534 210080 logs.go:123] Gathering logs for CRI-O ...
I0722 11:32:01.152568 210080 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0722 11:32:01.294215 210080 logs.go:123] Gathering logs for kubelet ...
I0722 11:32:01.294250 210080 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0722 11:32:01.368159 210080 logs.go:138] Found kubelet problem: Jul 22 11:26:39 old-k8s-version-584140 kubelet[730]: E0722 11:26:39.204682 730 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:old-k8s-version-584140" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-584140' and this object
W0722 11:32:01.368517 210080 logs.go:138] Found kubelet problem: Jul 22 11:26:39 old-k8s-version-584140 kubelet[730]: E0722 11:26:39.205097 730 reflector.go:138] object-"kube-system"/"storage-provisioner-token-th5sl": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "storage-provisioner-token-th5sl" is forbidden: User "system:node:old-k8s-version-584140" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-584140' and this object
W0722 11:32:01.369028 210080 logs.go:138] Found kubelet problem: Jul 22 11:26:39 old-k8s-version-584140 kubelet[730]: E0722 11:26:39.205388 730 reflector.go:138] object-"default"/"default-token-gkskl": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "default-token-gkskl" is forbidden: User "system:node:old-k8s-version-584140" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'old-k8s-version-584140' and this object
W0722 11:32:01.369328 210080 logs.go:138] Found kubelet problem: Jul 22 11:26:39 old-k8s-version-584140 kubelet[730]: E0722 11:26:39.206223 730 reflector.go:138] object-"kube-system"/"coredns": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:old-k8s-version-584140" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-584140' and this object
W0722 11:32:01.369617 210080 logs.go:138] Found kubelet problem: Jul 22 11:26:39 old-k8s-version-584140 kubelet[730]: E0722 11:26:39.206544 730 reflector.go:138] object-"kube-system"/"kube-proxy-token-g9gsb": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kube-proxy-token-g9gsb" is forbidden: User "system:node:old-k8s-version-584140" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-584140' and this object
W0722 11:32:01.369927 210080 logs.go:138] Found kubelet problem: Jul 22 11:26:39 old-k8s-version-584140 kubelet[730]: E0722 11:26:39.206876 730 reflector.go:138] object-"kube-system"/"kindnet-token-tjmsp": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kindnet-token-tjmsp" is forbidden: User "system:node:old-k8s-version-584140" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-584140' and this object
W0722 11:32:01.370487 210080 logs.go:138] Found kubelet problem: Jul 22 11:26:39 old-k8s-version-584140 kubelet[730]: E0722 11:26:39.207130 730 reflector.go:138] object-"kube-system"/"metrics-server-token-btvqb": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "metrics-server-token-btvqb" is forbidden: User "system:node:old-k8s-version-584140" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-584140' and this object
W0722 11:32:01.370748 210080 logs.go:138] Found kubelet problem: Jul 22 11:26:39 old-k8s-version-584140 kubelet[730]: E0722 11:26:39.207456 730 reflector.go:138] object-"kube-system"/"coredns-token-7tqrc": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "coredns-token-7tqrc" is forbidden: User "system:node:old-k8s-version-584140" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-584140' and this object
W0722 11:32:01.387088 210080 logs.go:138] Found kubelet problem: Jul 22 11:26:43 old-k8s-version-584140 kubelet[730]: E0722 11:26:43.160558 730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0722 11:32:01.387435 210080 logs.go:138] Found kubelet problem: Jul 22 11:26:43 old-k8s-version-584140 kubelet[730]: E0722 11:26:43.632278 730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0722 11:32:01.389517 210080 logs.go:138] Found kubelet problem: Jul 22 11:26:54 old-k8s-version-584140 kubelet[730]: E0722 11:26:54.611909 730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0722 11:32:01.392146 210080 logs.go:138] Found kubelet problem: Jul 22 11:27:02 old-k8s-version-584140 kubelet[730]: E0722 11:27:02.738618 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
W0722 11:32:01.392634 210080 logs.go:138] Found kubelet problem: Jul 22 11:27:03 old-k8s-version-584140 kubelet[730]: E0722 11:27:03.741827 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
W0722 11:32:01.393033 210080 logs.go:138] Found kubelet problem: Jul 22 11:27:04 old-k8s-version-584140 kubelet[730]: E0722 11:27:04.838076 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
W0722 11:32:01.393237 210080 logs.go:138] Found kubelet problem: Jul 22 11:27:09 old-k8s-version-584140 kubelet[730]: E0722 11:27:09.598856 730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0722 11:32:01.394001 210080 logs.go:138] Found kubelet problem: Jul 22 11:27:18 old-k8s-version-584140 kubelet[730]: E0722 11:27:18.778810 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
W0722 11:32:01.396691 210080 logs.go:138] Found kubelet problem: Jul 22 11:27:23 old-k8s-version-584140 kubelet[730]: E0722 11:27:23.614499 730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0722 11:32:01.397145 210080 logs.go:138] Found kubelet problem: Jul 22 11:27:24 old-k8s-version-584140 kubelet[730]: E0722 11:27:24.838228 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
W0722 11:32:01.397548 210080 logs.go:138] Found kubelet problem: Jul 22 11:27:36 old-k8s-version-584140 kubelet[730]: E0722 11:27:36.599081 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
W0722 11:32:01.397788 210080 logs.go:138] Found kubelet problem: Jul 22 11:27:38 old-k8s-version-584140 kubelet[730]: E0722 11:27:38.598819 730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0722 11:32:01.398743 210080 logs.go:138] Found kubelet problem: Jul 22 11:27:50 old-k8s-version-584140 kubelet[730]: E0722 11:27:50.837672 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
W0722 11:32:01.398983 210080 logs.go:138] Found kubelet problem: Jul 22 11:27:53 old-k8s-version-584140 kubelet[730]: E0722 11:27:53.599749 730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0722 11:32:01.399344 210080 logs.go:138] Found kubelet problem: Jul 22 11:27:54 old-k8s-version-584140 kubelet[730]: E0722 11:27:54.838469 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
W0722 11:32:01.399885 210080 logs.go:138] Found kubelet problem: Jul 22 11:28:06 old-k8s-version-584140 kubelet[730]: E0722 11:28:06.598312 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
W0722 11:32:01.404193 210080 logs.go:138] Found kubelet problem: Jul 22 11:28:07 old-k8s-version-584140 kubelet[730]: E0722 11:28:07.619353 730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0722 11:32:01.404622 210080 logs.go:138] Found kubelet problem: Jul 22 11:28:20 old-k8s-version-584140 kubelet[730]: E0722 11:28:20.599140 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
W0722 11:32:01.404836 210080 logs.go:138] Found kubelet problem: Jul 22 11:28:20 old-k8s-version-584140 kubelet[730]: E0722 11:28:20.600438 730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0722 11:32:01.405520 210080 logs.go:138] Found kubelet problem: Jul 22 11:28:33 old-k8s-version-584140 kubelet[730]: E0722 11:28:33.909665 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
W0722 11:32:01.405900 210080 logs.go:138] Found kubelet problem: Jul 22 11:28:34 old-k8s-version-584140 kubelet[730]: E0722 11:28:34.912079 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
W0722 11:32:01.406112 210080 logs.go:138] Found kubelet problem: Jul 22 11:28:35 old-k8s-version-584140 kubelet[730]: E0722 11:28:35.599081 730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0722 11:32:01.406477 210080 logs.go:138] Found kubelet problem: Jul 22 11:28:46 old-k8s-version-584140 kubelet[730]: E0722 11:28:46.598307 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
W0722 11:32:01.406689 210080 logs.go:138] Found kubelet problem: Jul 22 11:28:50 old-k8s-version-584140 kubelet[730]: E0722 11:28:50.599499 730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0722 11:32:01.407045 210080 logs.go:138] Found kubelet problem: Jul 22 11:29:01 old-k8s-version-584140 kubelet[730]: E0722 11:29:01.598946 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
W0722 11:32:01.407255 210080 logs.go:138] Found kubelet problem: Jul 22 11:29:04 old-k8s-version-584140 kubelet[730]: E0722 11:29:04.598688 730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0722 11:32:01.407606 210080 logs.go:138] Found kubelet problem: Jul 22 11:29:12 old-k8s-version-584140 kubelet[730]: E0722 11:29:12.598338 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
W0722 11:32:01.407820 210080 logs.go:138] Found kubelet problem: Jul 22 11:29:19 old-k8s-version-584140 kubelet[730]: E0722 11:29:19.598946 730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0722 11:32:01.408172 210080 logs.go:138] Found kubelet problem: Jul 22 11:29:26 old-k8s-version-584140 kubelet[730]: E0722 11:29:26.598882 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
W0722 11:32:01.412144 210080 logs.go:138] Found kubelet problem: Jul 22 11:29:33 old-k8s-version-584140 kubelet[730]: E0722 11:29:33.611073 730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0722 11:32:01.412531 210080 logs.go:138] Found kubelet problem: Jul 22 11:29:37 old-k8s-version-584140 kubelet[730]: E0722 11:29:37.598186 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
W0722 11:32:01.412752 210080 logs.go:138] Found kubelet problem: Jul 22 11:29:46 old-k8s-version-584140 kubelet[730]: E0722 11:29:46.599495 730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0722 11:32:01.413134 210080 logs.go:138] Found kubelet problem: Jul 22 11:29:48 old-k8s-version-584140 kubelet[730]: E0722 11:29:48.598602 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
W0722 11:32:01.413352 210080 logs.go:138] Found kubelet problem: Jul 22 11:30:00 old-k8s-version-584140 kubelet[730]: E0722 11:30:00.599866 730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0722 11:32:01.413969 210080 logs.go:138] Found kubelet problem: Jul 22 11:30:03 old-k8s-version-584140 kubelet[730]: E0722 11:30:03.060169 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
W0722 11:32:01.414322 210080 logs.go:138] Found kubelet problem: Jul 22 11:30:04 old-k8s-version-584140 kubelet[730]: E0722 11:30:04.837656 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
W0722 11:32:01.414534 210080 logs.go:138] Found kubelet problem: Jul 22 11:30:13 old-k8s-version-584140 kubelet[730]: E0722 11:30:13.598674 730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0722 11:32:01.414890 210080 logs.go:138] Found kubelet problem: Jul 22 11:30:17 old-k8s-version-584140 kubelet[730]: E0722 11:30:17.598240 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
W0722 11:32:01.415098 210080 logs.go:138] Found kubelet problem: Jul 22 11:30:28 old-k8s-version-584140 kubelet[730]: E0722 11:30:28.598615 730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0722 11:32:01.416026 210080 logs.go:138] Found kubelet problem: Jul 22 11:30:31 old-k8s-version-584140 kubelet[730]: E0722 11:30:31.598312 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
W0722 11:32:01.416265 210080 logs.go:138] Found kubelet problem: Jul 22 11:30:43 old-k8s-version-584140 kubelet[730]: E0722 11:30:43.599168 730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0722 11:32:01.416704 210080 logs.go:138] Found kubelet problem: Jul 22 11:30:44 old-k8s-version-584140 kubelet[730]: E0722 11:30:44.598289 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
W0722 11:32:01.416965 210080 logs.go:138] Found kubelet problem: Jul 22 11:30:55 old-k8s-version-584140 kubelet[730]: E0722 11:30:55.599111 730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0722 11:32:01.417337 210080 logs.go:138] Found kubelet problem: Jul 22 11:30:58 old-k8s-version-584140 kubelet[730]: E0722 11:30:58.598266 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
W0722 11:32:01.417583 210080 logs.go:138] Found kubelet problem: Jul 22 11:31:08 old-k8s-version-584140 kubelet[730]: E0722 11:31:08.598772 730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0722 11:32:01.417938 210080 logs.go:138] Found kubelet problem: Jul 22 11:31:12 old-k8s-version-584140 kubelet[730]: E0722 11:31:12.598216 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
W0722 11:32:01.418299 210080 logs.go:138] Found kubelet problem: Jul 22 11:31:23 old-k8s-version-584140 kubelet[730]: E0722 11:31:23.598165 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
W0722 11:32:01.418509 210080 logs.go:138] Found kubelet problem: Jul 22 11:31:23 old-k8s-version-584140 kubelet[730]: E0722 11:31:23.599281 730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0722 11:32:01.419110 210080 logs.go:138] Found kubelet problem: Jul 22 11:31:36 old-k8s-version-584140 kubelet[730]: E0722 11:31:36.598285 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
W0722 11:32:01.419315 210080 logs.go:138] Found kubelet problem: Jul 22 11:31:37 old-k8s-version-584140 kubelet[730]: E0722 11:31:37.598777 730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0722 11:32:01.419668 210080 logs.go:138] Found kubelet problem: Jul 22 11:31:50 old-k8s-version-584140 kubelet[730]: E0722 11:31:50.598548 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
W0722 11:32:01.419879 210080 logs.go:138] Found kubelet problem: Jul 22 11:31:52 old-k8s-version-584140 kubelet[730]: E0722 11:31:52.598992 730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
I0722 11:32:01.419894 210080 logs.go:123] Gathering logs for etcd [b8f395f6e10fffc01d9db2971c2690affd63e1173ebe081a173b1df5e29b3eae] ...
I0722 11:32:01.419919 210080 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 b8f395f6e10fffc01d9db2971c2690affd63e1173ebe081a173b1df5e29b3eae"
I0722 11:32:01.511015 210080 logs.go:123] Gathering logs for storage-provisioner [48a74507ee5da0b4b62d92cb8fe64853426c4fcd088c4d455c7d827c4c514ab2] ...
I0722 11:32:01.511087 210080 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 48a74507ee5da0b4b62d92cb8fe64853426c4fcd088c4d455c7d827c4c514ab2"
I0722 11:32:01.574240 210080 logs.go:123] Gathering logs for kubernetes-dashboard [0da5dde31a386001ac351514fcd5b733872eb5d92ec8b3579e32b0f14de7b1fc] ...
I0722 11:32:01.574317 210080 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 0da5dde31a386001ac351514fcd5b733872eb5d92ec8b3579e32b0f14de7b1fc"
I0722 11:32:01.651394 210080 logs.go:123] Gathering logs for kindnet [451ceb51fb176f2ab58c30c602fe7a8d8dcdde723f94ec75d058fd599561cfde] ...
I0722 11:32:01.651472 210080 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 451ceb51fb176f2ab58c30c602fe7a8d8dcdde723f94ec75d058fd599561cfde"
I0722 11:32:01.753651 210080 logs.go:123] Gathering logs for container status ...
I0722 11:32:01.753699 210080 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0722 11:32:01.909399 210080 logs.go:123] Gathering logs for kube-apiserver [7b17da0e203acb0f33605e81ab92029743299c8b53e99bedad6247fb2e22336d] ...
I0722 11:32:01.909484 210080 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 7b17da0e203acb0f33605e81ab92029743299c8b53e99bedad6247fb2e22336d"
I0722 11:32:02.053113 210080 logs.go:123] Gathering logs for coredns [25b426692cff4a0ddaac80382d5fd8be373235953b017a1f2591adbc04fe5208] ...
I0722 11:32:02.053146 210080 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 25b426692cff4a0ddaac80382d5fd8be373235953b017a1f2591adbc04fe5208"
I0722 11:32:02.111073 210080 logs.go:123] Gathering logs for kube-controller-manager [460bdeec3bdfccab7101c9d13045f9bcf87734da1fb0f6f8b6a5c0111906ac43] ...
I0722 11:32:02.111101 210080 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 460bdeec3bdfccab7101c9d13045f9bcf87734da1fb0f6f8b6a5c0111906ac43"
I0722 11:32:02.182025 210080 out.go:304] Setting ErrFile to fd 2...
I0722 11:32:02.182054 210080 out.go:338] TERM=,COLORTERM=, which probably does not support color
W0722 11:32:02.182109 210080 out.go:239] X Problems detected in kubelet:
W0722 11:32:02.182119 210080 out.go:239] Jul 22 11:31:23 old-k8s-version-584140 kubelet[730]: E0722 11:31:23.599281 730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0722 11:32:02.182126 210080 out.go:239] Jul 22 11:31:36 old-k8s-version-584140 kubelet[730]: E0722 11:31:36.598285 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
W0722 11:32:02.182134 210080 out.go:239] Jul 22 11:31:37 old-k8s-version-584140 kubelet[730]: E0722 11:31:37.598777 730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0722 11:32:02.182142 210080 out.go:239] Jul 22 11:31:50 old-k8s-version-584140 kubelet[730]: E0722 11:31:50.598548 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
W0722 11:32:02.182165 210080 out.go:239] Jul 22 11:31:52 old-k8s-version-584140 kubelet[730]: E0722 11:31:52.598992 730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
I0722 11:32:02.182171 210080 out.go:304] Setting ErrFile to fd 2...
I0722 11:32:02.182177 210080 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0722 11:32:00.734677 218924 cli_runner.go:164] Run: docker start no-preload-076896
I0722 11:32:01.119685 218924 cli_runner.go:164] Run: docker container inspect no-preload-076896 --format={{.State.Status}}
I0722 11:32:01.154050 218924 kic.go:430] container "no-preload-076896" state is running.
I0722 11:32:01.154659 218924 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" no-preload-076896
I0722 11:32:01.193483 218924 profile.go:143] Saving config to /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/no-preload-076896/config.json ...
I0722 11:32:01.194423 218924 machine.go:94] provisionDockerMachine start ...
I0722 11:32:01.194502 218924 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-076896
I0722 11:32:01.258261 218924 main.go:141] libmachine: Using SSH client type: native
I0722 11:32:01.258540 218924 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2cd0] 0x3e5530 <nil> [] 0s} 127.0.0.1 33073 <nil> <nil>}
I0722 11:32:01.258551 218924 main.go:141] libmachine: About to run SSH command:
hostname
I0722 11:32:01.259286 218924 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:55036->127.0.0.1:33073: read: connection reset by peer
I0722 11:32:04.384655 218924 main.go:141] libmachine: SSH cmd err, output: <nil>: no-preload-076896
I0722 11:32:04.384681 218924 ubuntu.go:169] provisioning hostname "no-preload-076896"
I0722 11:32:04.384746 218924 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-076896
I0722 11:32:04.402673 218924 main.go:141] libmachine: Using SSH client type: native
I0722 11:32:04.402924 218924 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2cd0] 0x3e5530 <nil> [] 0s} 127.0.0.1 33073 <nil> <nil>}
I0722 11:32:04.402941 218924 main.go:141] libmachine: About to run SSH command:
sudo hostname no-preload-076896 && echo "no-preload-076896" | sudo tee /etc/hostname
I0722 11:32:04.538198 218924 main.go:141] libmachine: SSH cmd err, output: <nil>: no-preload-076896
I0722 11:32:04.538321 218924 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-076896
I0722 11:32:04.557165 218924 main.go:141] libmachine: Using SSH client type: native
I0722 11:32:04.557409 218924 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2cd0] 0x3e5530 <nil> [] 0s} 127.0.0.1 33073 <nil> <nil>}
I0722 11:32:04.557437 218924 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sno-preload-076896' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 no-preload-076896/g' /etc/hosts;
else
echo '127.0.1.1 no-preload-076896' | sudo tee -a /etc/hosts;
fi
fi
I0722 11:32:04.689240 218924 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0722 11:32:04.689333 218924 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/19313-2237/.minikube CaCertPath:/home/jenkins/minikube-integration/19313-2237/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19313-2237/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19313-2237/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19313-2237/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19313-2237/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19313-2237/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19313-2237/.minikube}
I0722 11:32:04.689385 218924 ubuntu.go:177] setting up certificates
I0722 11:32:04.689417 218924 provision.go:84] configureAuth start
I0722 11:32:04.689540 218924 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" no-preload-076896
I0722 11:32:04.712238 218924 provision.go:143] copyHostCerts
I0722 11:32:04.712304 218924 exec_runner.go:144] found /home/jenkins/minikube-integration/19313-2237/.minikube/ca.pem, removing ...
I0722 11:32:04.712313 218924 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19313-2237/.minikube/ca.pem
I0722 11:32:04.712391 218924 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19313-2237/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19313-2237/.minikube/ca.pem (1078 bytes)
I0722 11:32:04.712499 218924 exec_runner.go:144] found /home/jenkins/minikube-integration/19313-2237/.minikube/cert.pem, removing ...
I0722 11:32:04.712504 218924 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19313-2237/.minikube/cert.pem
I0722 11:32:04.712533 218924 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19313-2237/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19313-2237/.minikube/cert.pem (1123 bytes)
I0722 11:32:04.712594 218924 exec_runner.go:144] found /home/jenkins/minikube-integration/19313-2237/.minikube/key.pem, removing ...
I0722 11:32:04.712599 218924 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19313-2237/.minikube/key.pem
I0722 11:32:04.712622 218924 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19313-2237/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19313-2237/.minikube/key.pem (1679 bytes)
I0722 11:32:04.712679 218924 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19313-2237/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19313-2237/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19313-2237/.minikube/certs/ca-key.pem org=jenkins.no-preload-076896 san=[127.0.0.1 192.168.94.2 localhost minikube no-preload-076896]
I0722 11:32:05.209681 218924 provision.go:177] copyRemoteCerts
I0722 11:32:05.209750 218924 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0722 11:32:05.209803 218924 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-076896
I0722 11:32:05.228407 218924 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33073 SSHKeyPath:/home/jenkins/minikube-integration/19313-2237/.minikube/machines/no-preload-076896/id_rsa Username:docker}
I0722 11:32:05.322382 218924 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19313-2237/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0722 11:32:05.350072 218924 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19313-2237/.minikube/machines/server.pem --> /etc/docker/server.pem (1220 bytes)
I0722 11:32:05.375478 218924 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19313-2237/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0722 11:32:05.400853 218924 provision.go:87] duration metric: took 711.408117ms to configureAuth
I0722 11:32:05.401012 218924 ubuntu.go:193] setting minikube options for container-runtime
I0722 11:32:05.401247 218924 config.go:182] Loaded profile config "no-preload-076896": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.31.0-beta.0
I0722 11:32:05.401373 218924 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-076896
I0722 11:32:05.419733 218924 main.go:141] libmachine: Using SSH client type: native
I0722 11:32:05.419990 218924 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2cd0] 0x3e5530 <nil> [] 0s} 127.0.0.1 33073 <nil> <nil>}
I0722 11:32:05.420011 218924 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %!s(MISSING) "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0722 11:32:05.782905 218924 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0722 11:32:05.782933 218924 machine.go:97] duration metric: took 4.588495467s to provisionDockerMachine
I0722 11:32:05.782945 218924 start.go:293] postStartSetup for "no-preload-076896" (driver="docker")
I0722 11:32:05.782967 218924 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0722 11:32:05.783038 218924 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0722 11:32:05.783091 218924 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-076896
I0722 11:32:05.807739 218924 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33073 SSHKeyPath:/home/jenkins/minikube-integration/19313-2237/.minikube/machines/no-preload-076896/id_rsa Username:docker}
I0722 11:32:05.906886 218924 ssh_runner.go:195] Run: cat /etc/os-release
I0722 11:32:05.910456 218924 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0722 11:32:05.910491 218924 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0722 11:32:05.910503 218924 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0722 11:32:05.910517 218924 info.go:137] Remote host: Ubuntu 22.04.4 LTS
I0722 11:32:05.910528 218924 filesync.go:126] Scanning /home/jenkins/minikube-integration/19313-2237/.minikube/addons for local assets ...
I0722 11:32:05.910583 218924 filesync.go:126] Scanning /home/jenkins/minikube-integration/19313-2237/.minikube/files for local assets ...
I0722 11:32:05.910680 218924 filesync.go:149] local asset: /home/jenkins/minikube-integration/19313-2237/.minikube/files/etc/ssl/certs/75642.pem -> 75642.pem in /etc/ssl/certs
I0722 11:32:05.910834 218924 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0722 11:32:05.921002 218924 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19313-2237/.minikube/files/etc/ssl/certs/75642.pem --> /etc/ssl/certs/75642.pem (1708 bytes)
I0722 11:32:05.946811 218924 start.go:296] duration metric: took 163.84998ms for postStartSetup
I0722 11:32:05.946960 218924 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0722 11:32:05.947038 218924 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-076896
I0722 11:32:05.963482 218924 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33073 SSHKeyPath:/home/jenkins/minikube-integration/19313-2237/.minikube/machines/no-preload-076896/id_rsa Username:docker}
I0722 11:32:06.065654 218924 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I0722 11:32:06.073579 218924 fix.go:56] duration metric: took 5.371167083s for fixHost
I0722 11:32:06.073604 218924 start.go:83] releasing machines lock for "no-preload-076896", held for 5.371215962s
I0722 11:32:06.073686 218924 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" no-preload-076896
I0722 11:32:06.092199 218924 ssh_runner.go:195] Run: cat /version.json
I0722 11:32:06.092254 218924 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-076896
I0722 11:32:06.092257 218924 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0722 11:32:06.092449 218924 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-076896
I0722 11:32:06.114846 218924 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33073 SSHKeyPath:/home/jenkins/minikube-integration/19313-2237/.minikube/machines/no-preload-076896/id_rsa Username:docker}
I0722 11:32:06.134898 218924 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33073 SSHKeyPath:/home/jenkins/minikube-integration/19313-2237/.minikube/machines/no-preload-076896/id_rsa Username:docker}
I0722 11:32:06.212393 218924 ssh_runner.go:195] Run: systemctl --version
I0722 11:32:06.359698 218924 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0722 11:32:06.501414 218924 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I0722 11:32:06.505855 218924 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0722 11:32:06.515394 218924 cni.go:221] loopback cni configuration disabled: "/etc/cni/net.d/*loopback.conf*" found
I0722 11:32:06.515515 218924 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0722 11:32:06.524830 218924 cni.go:259] no active bridge cni configs found in "/etc/cni/net.d" - nothing to disable
I0722 11:32:06.524854 218924 start.go:495] detecting cgroup driver to use...
I0722 11:32:06.524919 218924 detect.go:187] detected "cgroupfs" cgroup driver on host os
I0722 11:32:06.524969 218924 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0722 11:32:06.537199 218924 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0722 11:32:06.551209 218924 docker.go:217] disabling cri-docker service (if available) ...
I0722 11:32:06.551273 218924 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0722 11:32:06.564829 218924 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0722 11:32:06.579366 218924 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0722 11:32:06.670142 218924 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0722 11:32:06.765705 218924 docker.go:233] disabling docker service ...
I0722 11:32:06.765770 218924 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0722 11:32:06.779530 218924 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0722 11:32:06.791823 218924 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0722 11:32:06.896159 218924 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0722 11:32:06.997472 218924 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0722 11:32:07.010141 218924 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0722 11:32:07.027109 218924 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.10" pause image...
I0722 11:32:07.027218 218924 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.10"|' /etc/crio/crio.conf.d/02-crio.conf"
I0722 11:32:07.038312 218924 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0722 11:32:07.038459 218924 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0722 11:32:07.048311 218924 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0722 11:32:07.058808 218924 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0722 11:32:07.068731 218924 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0722 11:32:07.078011 218924 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"
I0722 11:32:07.087863 218924 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"
I0722 11:32:07.097494 218924 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"
I0722 11:32:07.107627 218924 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0722 11:32:07.116544 218924 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0722 11:32:07.125321 218924 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0722 11:32:07.213215 218924 ssh_runner.go:195] Run: sudo systemctl restart crio
I0722 11:32:07.336441 218924 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
I0722 11:32:07.336600 218924 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0722 11:32:07.340554 218924 start.go:563] Will wait 60s for crictl version
I0722 11:32:07.340646 218924 ssh_runner.go:195] Run: which crictl
I0722 11:32:07.344472 218924 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0722 11:32:07.393404 218924 start.go:579] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.24.6
RuntimeApiVersion: v1
I0722 11:32:07.393535 218924 ssh_runner.go:195] Run: crio --version
I0722 11:32:07.431797 218924 ssh_runner.go:195] Run: crio --version
I0722 11:32:07.474425 218924 out.go:177] * Preparing Kubernetes v1.31.0-beta.0 on CRI-O 1.24.6 ...
I0722 11:32:07.476587 218924 cli_runner.go:164] Run: docker network inspect no-preload-076896 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0722 11:32:07.492544 218924 ssh_runner.go:195] Run: grep 192.168.94.1 host.minikube.internal$ /etc/hosts
I0722 11:32:07.496407 218924 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.94.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0722 11:32:07.507234 218924 kubeadm.go:883] updating cluster {Name:no-preload-076896 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0-beta.0 ClusterName:no-preload-076896 Namespace:default APIServerHAVIP: APIServerName:minikub
eCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.94.2 Port:8443 KubernetesVersion:v1.31.0-beta.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/je
nkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0722 11:32:07.507355 218924 preload.go:131] Checking if preload exists for k8s version v1.31.0-beta.0 and runtime crio
I0722 11:32:07.507399 218924 ssh_runner.go:195] Run: sudo crictl images --output json
I0722 11:32:07.558302 218924 crio.go:514] all images are preloaded for cri-o runtime.
I0722 11:32:07.558324 218924 cache_images.go:84] Images are preloaded, skipping loading
I0722 11:32:07.558333 218924 kubeadm.go:934] updating node { 192.168.94.2 8443 v1.31.0-beta.0 crio true true} ...
I0722 11:32:07.558436 218924 kubeadm.go:946] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.31.0-beta.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --cgroups-per-qos=false --config=/var/lib/kubelet/config.yaml --enforce-node-allocatable= --hostname-override=no-preload-076896 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.94.2
[Install]
config:
{KubernetesVersion:v1.31.0-beta.0 ClusterName:no-preload-076896 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0722 11:32:07.558526 218924 ssh_runner.go:195] Run: crio config
I0722 11:32:07.610998 218924 cni.go:84] Creating CNI manager for ""
I0722 11:32:07.611023 218924 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
I0722 11:32:07.611037 218924 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0722 11:32:07.611061 218924 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.94.2 APIServerPort:8443 KubernetesVersion:v1.31.0-beta.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:no-preload-076896 NodeName:no-preload-076896 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.94.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.94.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPa
th:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/crio/crio.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I0722 11:32:07.611212 218924 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta3
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.94.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///var/run/crio/crio.sock
name: "no-preload-076896"
kubeletExtraArgs:
node-ip: 192.168.94.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta3
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.94.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.31.0-beta.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
containerRuntimeEndpoint: unix:///var/run/crio/crio.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%!"(MISSING)
nodefs.inodesFree: "0%!"(MISSING)
imagefs.available: "0%!"(MISSING)
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0722 11:32:07.611283 218924 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.31.0-beta.0
I0722 11:32:07.620272 218924 binaries.go:44] Found k8s binaries, skipping transfer
I0722 11:32:07.620394 218924 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0722 11:32:07.629570 218924 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (374 bytes)
I0722 11:32:07.647878 218924 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (359 bytes)
I0722 11:32:07.666701 218924 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2162 bytes)
I0722 11:32:07.684842 218924 ssh_runner.go:195] Run: grep 192.168.94.2 control-plane.minikube.internal$ /etc/hosts
I0722 11:32:07.688256 218924 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.94.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0722 11:32:07.699344 218924 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0722 11:32:07.778511 218924 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0722 11:32:07.791806 218924 certs.go:68] Setting up /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/no-preload-076896 for IP: 192.168.94.2
I0722 11:32:07.791828 218924 certs.go:194] generating shared ca certs ...
I0722 11:32:07.791844 218924 certs.go:226] acquiring lock for ca certs: {Name:mkc633027ec1393c6f58c3260e76c1b2d2250318 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0722 11:32:07.792006 218924 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19313-2237/.minikube/ca.key
I0722 11:32:07.792065 218924 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19313-2237/.minikube/proxy-client-ca.key
I0722 11:32:07.792077 218924 certs.go:256] generating profile certs ...
I0722 11:32:07.792177 218924 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/no-preload-076896/client.key
I0722 11:32:07.792255 218924 certs.go:359] skipping valid signed profile cert regeneration for "minikube": /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/no-preload-076896/apiserver.key.f9e177d4
I0722 11:32:07.792310 218924 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/no-preload-076896/proxy-client.key
I0722 11:32:07.792450 218924 certs.go:484] found cert: /home/jenkins/minikube-integration/19313-2237/.minikube/certs/7564.pem (1338 bytes)
W0722 11:32:07.792485 218924 certs.go:480] ignoring /home/jenkins/minikube-integration/19313-2237/.minikube/certs/7564_empty.pem, impossibly tiny 0 bytes
I0722 11:32:07.792504 218924 certs.go:484] found cert: /home/jenkins/minikube-integration/19313-2237/.minikube/certs/ca-key.pem (1675 bytes)
I0722 11:32:07.792534 218924 certs.go:484] found cert: /home/jenkins/minikube-integration/19313-2237/.minikube/certs/ca.pem (1078 bytes)
I0722 11:32:07.792561 218924 certs.go:484] found cert: /home/jenkins/minikube-integration/19313-2237/.minikube/certs/cert.pem (1123 bytes)
I0722 11:32:07.792593 218924 certs.go:484] found cert: /home/jenkins/minikube-integration/19313-2237/.minikube/certs/key.pem (1679 bytes)
I0722 11:32:07.792640 218924 certs.go:484] found cert: /home/jenkins/minikube-integration/19313-2237/.minikube/files/etc/ssl/certs/75642.pem (1708 bytes)
I0722 11:32:07.793384 218924 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19313-2237/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0722 11:32:07.832068 218924 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19313-2237/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0722 11:32:07.881247 218924 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19313-2237/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0722 11:32:07.907144 218924 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19313-2237/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0722 11:32:07.969322 218924 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/no-preload-076896/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1424 bytes)
I0722 11:32:07.998596 218924 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/no-preload-076896/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0722 11:32:08.025696 218924 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/no-preload-076896/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0722 11:32:08.050229 218924 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19313-2237/.minikube/profiles/no-preload-076896/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0722 11:32:08.074821 218924 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19313-2237/.minikube/certs/7564.pem --> /usr/share/ca-certificates/7564.pem (1338 bytes)
I0722 11:32:08.107709 218924 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19313-2237/.minikube/files/etc/ssl/certs/75642.pem --> /usr/share/ca-certificates/75642.pem (1708 bytes)
I0722 11:32:08.136262 218924 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19313-2237/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0722 11:32:08.160311 218924 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0722 11:32:08.177904 218924 ssh_runner.go:195] Run: openssl version
I0722 11:32:08.183309 218924 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/7564.pem && ln -fs /usr/share/ca-certificates/7564.pem /etc/ssl/certs/7564.pem"
I0722 11:32:08.192635 218924 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/7564.pem
I0722 11:32:08.196235 218924 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Jul 22 10:41 /usr/share/ca-certificates/7564.pem
I0722 11:32:08.196338 218924 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/7564.pem
I0722 11:32:08.203179 218924 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/7564.pem /etc/ssl/certs/51391683.0"
I0722 11:32:08.212743 218924 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/75642.pem && ln -fs /usr/share/ca-certificates/75642.pem /etc/ssl/certs/75642.pem"
I0722 11:32:08.222381 218924 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/75642.pem
I0722 11:32:08.226251 218924 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Jul 22 10:41 /usr/share/ca-certificates/75642.pem
I0722 11:32:08.226312 218924 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/75642.pem
I0722 11:32:08.234160 218924 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/75642.pem /etc/ssl/certs/3ec20f2e.0"
I0722 11:32:08.243933 218924 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0722 11:32:08.254101 218924 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0722 11:32:08.258043 218924 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Jul 22 10:30 /usr/share/ca-certificates/minikubeCA.pem
I0722 11:32:08.258141 218924 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0722 11:32:08.265424 218924 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0722 11:32:08.274966 218924 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0722 11:32:08.278690 218924 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
I0722 11:32:08.285788 218924 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
I0722 11:32:08.292708 218924 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
I0722 11:32:08.299820 218924 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
I0722 11:32:08.306727 218924 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
I0722 11:32:08.313977 218924 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
I0722 11:32:08.322240 218924 kubeadm.go:392] StartCluster: {Name:no-preload-076896 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0-beta.0 ClusterName:no-preload-076896 Namespace:default APIServerHAVIP: APIServerName:minikubeCA
APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.94.2 Port:8443 KubernetesVersion:v1.31.0-beta.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenki
ns:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0722 11:32:08.322400 218924 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0722 11:32:08.322591 218924 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0722 11:32:08.363920 218924 cri.go:89] found id: ""
I0722 11:32:08.364024 218924 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0722 11:32:08.373206 218924 kubeadm.go:408] found existing configuration files, will attempt cluster restart
I0722 11:32:08.373276 218924 kubeadm.go:593] restartPrimaryControlPlane start ...
I0722 11:32:08.373343 218924 ssh_runner.go:195] Run: sudo test -d /data/minikube
I0722 11:32:08.383930 218924 kubeadm.go:130] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
stdout:
stderr:
I0722 11:32:08.384566 218924 kubeconfig.go:47] verify endpoint returned: get endpoint: "no-preload-076896" does not appear in /home/jenkins/minikube-integration/19313-2237/kubeconfig
I0722 11:32:08.384831 218924 kubeconfig.go:62] /home/jenkins/minikube-integration/19313-2237/kubeconfig needs updating (will repair): [kubeconfig missing "no-preload-076896" cluster setting kubeconfig missing "no-preload-076896" context setting]
I0722 11:32:08.385319 218924 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19313-2237/kubeconfig: {Name:mkcc86b3f46ba469151bab0be6d762245d79cdb6 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0722 11:32:08.386723 218924 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
I0722 11:32:08.398255 218924 kubeadm.go:630] The running cluster does not require reconfiguration: 192.168.94.2
I0722 11:32:08.398326 218924 kubeadm.go:597] duration metric: took 25.029015ms to restartPrimaryControlPlane
I0722 11:32:08.398358 218924 kubeadm.go:394] duration metric: took 76.126805ms to StartCluster
I0722 11:32:08.398377 218924 settings.go:142] acquiring lock: {Name:mk5fbd205fde0f82abe2a5378554c5e9944b6110 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0722 11:32:08.398434 218924 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/19313-2237/kubeconfig
I0722 11:32:08.399356 218924 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19313-2237/kubeconfig: {Name:mkcc86b3f46ba469151bab0be6d762245d79cdb6 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0722 11:32:08.399545 218924 start.go:235] Will wait 6m0s for node &{Name: IP:192.168.94.2 Port:8443 KubernetesVersion:v1.31.0-beta.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I0722 11:32:08.399899 218924 config.go:182] Loaded profile config "no-preload-076896": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.31.0-beta.0
I0722 11:32:08.399946 218924 addons.go:507] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:true default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]
I0722 11:32:08.400044 218924 addons.go:69] Setting storage-provisioner=true in profile "no-preload-076896"
I0722 11:32:08.400077 218924 addons.go:234] Setting addon storage-provisioner=true in "no-preload-076896"
I0722 11:32:08.400096 218924 addons.go:69] Setting default-storageclass=true in profile "no-preload-076896"
I0722 11:32:08.400117 218924 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "no-preload-076896"
I0722 11:32:08.400420 218924 cli_runner.go:164] Run: docker container inspect no-preload-076896 --format={{.State.Status}}
W0722 11:32:08.400544 218924 addons.go:243] addon storage-provisioner should already be in state true
I0722 11:32:08.400574 218924 host.go:66] Checking if "no-preload-076896" exists ...
I0722 11:32:08.401315 218924 cli_runner.go:164] Run: docker container inspect no-preload-076896 --format={{.State.Status}}
I0722 11:32:08.401656 218924 addons.go:69] Setting dashboard=true in profile "no-preload-076896"
I0722 11:32:08.401687 218924 addons.go:234] Setting addon dashboard=true in "no-preload-076896"
W0722 11:32:08.401697 218924 addons.go:243] addon dashboard should already be in state true
I0722 11:32:08.401722 218924 host.go:66] Checking if "no-preload-076896" exists ...
I0722 11:32:08.402125 218924 cli_runner.go:164] Run: docker container inspect no-preload-076896 --format={{.State.Status}}
I0722 11:32:08.403385 218924 addons.go:69] Setting metrics-server=true in profile "no-preload-076896"
I0722 11:32:08.403422 218924 addons.go:234] Setting addon metrics-server=true in "no-preload-076896"
W0722 11:32:08.403430 218924 addons.go:243] addon metrics-server should already be in state true
I0722 11:32:08.403456 218924 host.go:66] Checking if "no-preload-076896" exists ...
I0722 11:32:08.403841 218924 cli_runner.go:164] Run: docker container inspect no-preload-076896 --format={{.State.Status}}
I0722 11:32:08.404590 218924 out.go:177] * Verifying Kubernetes components...
I0722 11:32:08.408300 218924 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0722 11:32:08.455326 218924 addons.go:234] Setting addon default-storageclass=true in "no-preload-076896"
W0722 11:32:08.455346 218924 addons.go:243] addon default-storageclass should already be in state true
I0722 11:32:08.455372 218924 host.go:66] Checking if "no-preload-076896" exists ...
I0722 11:32:08.455765 218924 cli_runner.go:164] Run: docker container inspect no-preload-076896 --format={{.State.Status}}
I0722 11:32:08.467986 218924 out.go:177] - Using image docker.io/kubernetesui/dashboard:v2.7.0
I0722 11:32:08.467989 218924 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0722 11:32:08.470249 218924 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0722 11:32:08.470267 218924 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0722 11:32:08.470332 218924 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-076896
I0722 11:32:08.477813 218924 out.go:177] - Using image registry.k8s.io/echoserver:1.4
I0722 11:32:08.483270 218924 addons.go:431] installing /etc/kubernetes/addons/dashboard-ns.yaml
I0722 11:32:08.483303 218924 ssh_runner.go:362] scp dashboard/dashboard-ns.yaml --> /etc/kubernetes/addons/dashboard-ns.yaml (759 bytes)
I0722 11:32:08.483386 218924 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-076896
I0722 11:32:08.504983 218924 out.go:177] - Using image fake.domain/registry.k8s.io/echoserver:1.4
I0722 11:32:08.507287 218924 addons.go:431] installing /etc/kubernetes/addons/metrics-apiservice.yaml
I0722 11:32:08.507312 218924 ssh_runner.go:362] scp metrics-server/metrics-apiservice.yaml --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
I0722 11:32:08.507380 218924 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-076896
I0722 11:32:08.530407 218924 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33073 SSHKeyPath:/home/jenkins/minikube-integration/19313-2237/.minikube/machines/no-preload-076896/id_rsa Username:docker}
I0722 11:32:08.559438 218924 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33073 SSHKeyPath:/home/jenkins/minikube-integration/19313-2237/.minikube/machines/no-preload-076896/id_rsa Username:docker}
I0722 11:32:08.560252 218924 addons.go:431] installing /etc/kubernetes/addons/storageclass.yaml
I0722 11:32:08.560267 218924 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0722 11:32:08.560321 218924 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-076896
I0722 11:32:08.572235 218924 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33073 SSHKeyPath:/home/jenkins/minikube-integration/19313-2237/.minikube/machines/no-preload-076896/id_rsa Username:docker}
I0722 11:32:08.598200 218924 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33073 SSHKeyPath:/home/jenkins/minikube-integration/19313-2237/.minikube/machines/no-preload-076896/id_rsa Username:docker}
I0722 11:32:08.785542 218924 addons.go:431] installing /etc/kubernetes/addons/dashboard-clusterrole.yaml
I0722 11:32:08.785615 218924 ssh_runner.go:362] scp dashboard/dashboard-clusterrole.yaml --> /etc/kubernetes/addons/dashboard-clusterrole.yaml (1001 bytes)
I0722 11:32:08.795384 218924 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0722 11:32:08.864517 218924 addons.go:431] installing /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml
I0722 11:32:08.864546 218924 ssh_runner.go:362] scp dashboard/dashboard-clusterrolebinding.yaml --> /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml (1018 bytes)
I0722 11:32:08.867647 218924 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0-beta.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0722 11:32:08.869541 218924 node_ready.go:35] waiting up to 6m0s for node "no-preload-076896" to be "Ready" ...
I0722 11:32:08.875434 218924 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0-beta.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0722 11:32:08.932050 218924 addons.go:431] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
I0722 11:32:08.932079 218924 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1825 bytes)
I0722 11:32:08.965079 218924 addons.go:431] installing /etc/kubernetes/addons/dashboard-configmap.yaml
I0722 11:32:08.965156 218924 ssh_runner.go:362] scp dashboard/dashboard-configmap.yaml --> /etc/kubernetes/addons/dashboard-configmap.yaml (837 bytes)
I0722 11:32:09.021152 218924 addons.go:431] installing /etc/kubernetes/addons/dashboard-dp.yaml
I0722 11:32:09.021216 218924 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-dp.yaml (4201 bytes)
I0722 11:32:09.026475 218924 addons.go:431] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
I0722 11:32:09.026548 218924 ssh_runner.go:362] scp metrics-server/metrics-server-rbac.yaml --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
I0722 11:32:09.080298 218924 addons.go:431] installing /etc/kubernetes/addons/dashboard-role.yaml
I0722 11:32:09.080370 218924 ssh_runner.go:362] scp dashboard/dashboard-role.yaml --> /etc/kubernetes/addons/dashboard-role.yaml (1724 bytes)
I0722 11:32:09.086740 218924 addons.go:431] installing /etc/kubernetes/addons/metrics-server-service.yaml
I0722 11:32:09.086820 218924 ssh_runner.go:362] scp metrics-server/metrics-server-service.yaml --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
I0722 11:32:09.117964 218924 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0-beta.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0722 11:32:09.147254 218924 addons.go:431] installing /etc/kubernetes/addons/dashboard-rolebinding.yaml
I0722 11:32:09.147329 218924 ssh_runner.go:362] scp dashboard/dashboard-rolebinding.yaml --> /etc/kubernetes/addons/dashboard-rolebinding.yaml (1046 bytes)
W0722 11:32:09.226448 218924 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0-beta.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storageclass.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
I0722 11:32:09.226546 218924 retry.go:31] will retry after 298.569055ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0-beta.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storageclass.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
W0722 11:32:09.228282 218924 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0-beta.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storage-provisioner.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
I0722 11:32:09.228337 218924 retry.go:31] will retry after 322.955864ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0-beta.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storage-provisioner.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
I0722 11:32:09.257018 218924 addons.go:431] installing /etc/kubernetes/addons/dashboard-sa.yaml
I0722 11:32:09.257095 218924 ssh_runner.go:362] scp dashboard/dashboard-sa.yaml --> /etc/kubernetes/addons/dashboard-sa.yaml (837 bytes)
W0722 11:32:09.306075 218924 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0-beta.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
error validating "/etc/kubernetes/addons/metrics-apiservice.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
error validating "/etc/kubernetes/addons/metrics-server-deployment.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
error validating "/etc/kubernetes/addons/metrics-server-rbac.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
error validating "/etc/kubernetes/addons/metrics-server-service.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
I0722 11:32:09.306158 218924 retry.go:31] will retry after 152.889845ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0-beta.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
error validating "/etc/kubernetes/addons/metrics-apiservice.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
error validating "/etc/kubernetes/addons/metrics-server-deployment.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
error validating "/etc/kubernetes/addons/metrics-server-rbac.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
error validating "/etc/kubernetes/addons/metrics-server-service.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
I0722 11:32:09.312391 218924 addons.go:431] installing /etc/kubernetes/addons/dashboard-secret.yaml
I0722 11:32:09.312466 218924 ssh_runner.go:362] scp dashboard/dashboard-secret.yaml --> /etc/kubernetes/addons/dashboard-secret.yaml (1389 bytes)
I0722 11:32:09.335095 218924 addons.go:431] installing /etc/kubernetes/addons/dashboard-svc.yaml
I0722 11:32:09.335202 218924 ssh_runner.go:362] scp dashboard/dashboard-svc.yaml --> /etc/kubernetes/addons/dashboard-svc.yaml (1294 bytes)
I0722 11:32:09.374333 218924 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0-beta.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0722 11:32:09.459639 218924 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0-beta.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0722 11:32:09.526108 218924 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0-beta.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I0722 11:32:09.552422 218924 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0-beta.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I0722 11:32:12.183203 210080 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0722 11:32:12.202803 210080 api_server.go:72] duration metric: took 5m49.375690109s to wait for apiserver process to appear ...
I0722 11:32:12.202845 210080 api_server.go:88] waiting for apiserver healthz status ...
I0722 11:32:12.202883 210080 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0722 11:32:12.202977 210080 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0722 11:32:12.281497 210080 cri.go:89] found id: "7b17da0e203acb0f33605e81ab92029743299c8b53e99bedad6247fb2e22336d"
I0722 11:32:12.281517 210080 cri.go:89] found id: ""
I0722 11:32:12.281525 210080 logs.go:276] 1 containers: [7b17da0e203acb0f33605e81ab92029743299c8b53e99bedad6247fb2e22336d]
I0722 11:32:12.281584 210080 ssh_runner.go:195] Run: which crictl
I0722 11:32:12.285928 210080 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0722 11:32:12.285996 210080 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0722 11:32:12.366847 210080 cri.go:89] found id: "b8f395f6e10fffc01d9db2971c2690affd63e1173ebe081a173b1df5e29b3eae"
I0722 11:32:12.366866 210080 cri.go:89] found id: ""
I0722 11:32:12.366873 210080 logs.go:276] 1 containers: [b8f395f6e10fffc01d9db2971c2690affd63e1173ebe081a173b1df5e29b3eae]
I0722 11:32:12.366925 210080 ssh_runner.go:195] Run: which crictl
I0722 11:32:12.377727 210080 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0722 11:32:12.377844 210080 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0722 11:32:12.489949 210080 cri.go:89] found id: "25b426692cff4a0ddaac80382d5fd8be373235953b017a1f2591adbc04fe5208"
I0722 11:32:12.489969 210080 cri.go:89] found id: ""
I0722 11:32:12.489976 210080 logs.go:276] 1 containers: [25b426692cff4a0ddaac80382d5fd8be373235953b017a1f2591adbc04fe5208]
I0722 11:32:12.490035 210080 ssh_runner.go:195] Run: which crictl
I0722 11:32:12.494239 210080 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0722 11:32:12.494312 210080 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0722 11:32:12.570563 210080 cri.go:89] found id: "a38f1a7f716723ae1738fc6d121fd5959ee9c40c5b1c46b537955d760c9f4290"
I0722 11:32:12.570583 210080 cri.go:89] found id: ""
I0722 11:32:12.570591 210080 logs.go:276] 1 containers: [a38f1a7f716723ae1738fc6d121fd5959ee9c40c5b1c46b537955d760c9f4290]
I0722 11:32:12.570644 210080 ssh_runner.go:195] Run: which crictl
I0722 11:32:12.577492 210080 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0722 11:32:12.577562 210080 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0722 11:32:12.639244 210080 cri.go:89] found id: "5191e613fc2d72706f1d776fe8a845ca8f4b3cec7ff3b0f9d18aee199e8d79c6"
I0722 11:32:12.639265 210080 cri.go:89] found id: ""
I0722 11:32:12.639272 210080 logs.go:276] 1 containers: [5191e613fc2d72706f1d776fe8a845ca8f4b3cec7ff3b0f9d18aee199e8d79c6]
I0722 11:32:12.639326 210080 ssh_runner.go:195] Run: which crictl
I0722 11:32:12.645464 210080 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0722 11:32:12.645532 210080 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0722 11:32:12.711129 210080 cri.go:89] found id: "460bdeec3bdfccab7101c9d13045f9bcf87734da1fb0f6f8b6a5c0111906ac43"
I0722 11:32:12.711207 210080 cri.go:89] found id: ""
I0722 11:32:12.711230 210080 logs.go:276] 1 containers: [460bdeec3bdfccab7101c9d13045f9bcf87734da1fb0f6f8b6a5c0111906ac43]
I0722 11:32:12.711316 210080 ssh_runner.go:195] Run: which crictl
I0722 11:32:12.719704 210080 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0722 11:32:12.719776 210080 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0722 11:32:12.806984 210080 cri.go:89] found id: "451ceb51fb176f2ab58c30c602fe7a8d8dcdde723f94ec75d058fd599561cfde"
I0722 11:32:12.807002 210080 cri.go:89] found id: ""
I0722 11:32:12.807009 210080 logs.go:276] 1 containers: [451ceb51fb176f2ab58c30c602fe7a8d8dcdde723f94ec75d058fd599561cfde]
I0722 11:32:12.807062 210080 ssh_runner.go:195] Run: which crictl
I0722 11:32:12.810945 210080 cri.go:54] listing CRI containers in root : {State:all Name:storage-provisioner Namespaces:[]}
I0722 11:32:12.811013 210080 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0722 11:32:12.904775 210080 cri.go:89] found id: "b64b9e0461292d72b7fc112215c86b2db789ed69b01b10063e3b4f24a2155a8a"
I0722 11:32:12.904794 210080 cri.go:89] found id: "48a74507ee5da0b4b62d92cb8fe64853426c4fcd088c4d455c7d827c4c514ab2"
I0722 11:32:12.904799 210080 cri.go:89] found id: ""
I0722 11:32:12.904805 210080 logs.go:276] 2 containers: [b64b9e0461292d72b7fc112215c86b2db789ed69b01b10063e3b4f24a2155a8a 48a74507ee5da0b4b62d92cb8fe64853426c4fcd088c4d455c7d827c4c514ab2]
I0722 11:32:12.904865 210080 ssh_runner.go:195] Run: which crictl
I0722 11:32:12.913119 210080 ssh_runner.go:195] Run: which crictl
I0722 11:32:12.916790 210080 cri.go:54] listing CRI containers in root : {State:all Name:kubernetes-dashboard Namespaces:[]}
I0722 11:32:12.916854 210080 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I0722 11:32:12.991388 210080 cri.go:89] found id: "0da5dde31a386001ac351514fcd5b733872eb5d92ec8b3579e32b0f14de7b1fc"
I0722 11:32:12.991462 210080 cri.go:89] found id: ""
I0722 11:32:12.991484 210080 logs.go:276] 1 containers: [0da5dde31a386001ac351514fcd5b733872eb5d92ec8b3579e32b0f14de7b1fc]
I0722 11:32:12.991583 210080 ssh_runner.go:195] Run: which crictl
I0722 11:32:12.997559 210080 logs.go:123] Gathering logs for kubelet ...
I0722 11:32:12.997645 210080 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0722 11:32:13.066644 210080 logs.go:138] Found kubelet problem: Jul 22 11:26:39 old-k8s-version-584140 kubelet[730]: E0722 11:26:39.204682 730 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:old-k8s-version-584140" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-584140' and this object
W0722 11:32:13.066947 210080 logs.go:138] Found kubelet problem: Jul 22 11:26:39 old-k8s-version-584140 kubelet[730]: E0722 11:26:39.205097 730 reflector.go:138] object-"kube-system"/"storage-provisioner-token-th5sl": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "storage-provisioner-token-th5sl" is forbidden: User "system:node:old-k8s-version-584140" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-584140' and this object
W0722 11:32:13.067193 210080 logs.go:138] Found kubelet problem: Jul 22 11:26:39 old-k8s-version-584140 kubelet[730]: E0722 11:26:39.205388 730 reflector.go:138] object-"default"/"default-token-gkskl": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "default-token-gkskl" is forbidden: User "system:node:old-k8s-version-584140" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'old-k8s-version-584140' and this object
W0722 11:32:13.067423 210080 logs.go:138] Found kubelet problem: Jul 22 11:26:39 old-k8s-version-584140 kubelet[730]: E0722 11:26:39.206223 730 reflector.go:138] object-"kube-system"/"coredns": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:old-k8s-version-584140" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-584140' and this object
W0722 11:32:13.067664 210080 logs.go:138] Found kubelet problem: Jul 22 11:26:39 old-k8s-version-584140 kubelet[730]: E0722 11:26:39.206544 730 reflector.go:138] object-"kube-system"/"kube-proxy-token-g9gsb": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kube-proxy-token-g9gsb" is forbidden: User "system:node:old-k8s-version-584140" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-584140' and this object
W0722 11:32:13.067913 210080 logs.go:138] Found kubelet problem: Jul 22 11:26:39 old-k8s-version-584140 kubelet[730]: E0722 11:26:39.206876 730 reflector.go:138] object-"kube-system"/"kindnet-token-tjmsp": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kindnet-token-tjmsp" is forbidden: User "system:node:old-k8s-version-584140" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-584140' and this object
W0722 11:32:13.068162 210080 logs.go:138] Found kubelet problem: Jul 22 11:26:39 old-k8s-version-584140 kubelet[730]: E0722 11:26:39.207130 730 reflector.go:138] object-"kube-system"/"metrics-server-token-btvqb": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "metrics-server-token-btvqb" is forbidden: User "system:node:old-k8s-version-584140" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-584140' and this object
W0722 11:32:13.068406 210080 logs.go:138] Found kubelet problem: Jul 22 11:26:39 old-k8s-version-584140 kubelet[730]: E0722 11:26:39.207456 730 reflector.go:138] object-"kube-system"/"coredns-token-7tqrc": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "coredns-token-7tqrc" is forbidden: User "system:node:old-k8s-version-584140" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-584140' and this object
W0722 11:32:13.091614 210080 logs.go:138] Found kubelet problem: Jul 22 11:26:43 old-k8s-version-584140 kubelet[730]: E0722 11:26:43.160558 730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0722 11:32:13.091891 210080 logs.go:138] Found kubelet problem: Jul 22 11:26:43 old-k8s-version-584140 kubelet[730]: E0722 11:26:43.632278 730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0722 11:32:13.096193 210080 logs.go:138] Found kubelet problem: Jul 22 11:26:54 old-k8s-version-584140 kubelet[730]: E0722 11:26:54.611909 730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0722 11:32:13.098728 210080 logs.go:138] Found kubelet problem: Jul 22 11:27:02 old-k8s-version-584140 kubelet[730]: E0722 11:27:02.738618 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
W0722 11:32:13.099226 210080 logs.go:138] Found kubelet problem: Jul 22 11:27:03 old-k8s-version-584140 kubelet[730]: E0722 11:27:03.741827 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
W0722 11:32:13.099583 210080 logs.go:138] Found kubelet problem: Jul 22 11:27:04 old-k8s-version-584140 kubelet[730]: E0722 11:27:04.838076 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
W0722 11:32:13.103114 210080 logs.go:138] Found kubelet problem: Jul 22 11:27:09 old-k8s-version-584140 kubelet[730]: E0722 11:27:09.598856 730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0722 11:32:13.103933 210080 logs.go:138] Found kubelet problem: Jul 22 11:27:18 old-k8s-version-584140 kubelet[730]: E0722 11:27:18.778810 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
W0722 11:32:13.106139 210080 logs.go:138] Found kubelet problem: Jul 22 11:27:23 old-k8s-version-584140 kubelet[730]: E0722 11:27:23.614499 730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0722 11:32:13.106475 210080 logs.go:138] Found kubelet problem: Jul 22 11:27:24 old-k8s-version-584140 kubelet[730]: E0722 11:27:24.838228 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
W0722 11:32:13.106803 210080 logs.go:138] Found kubelet problem: Jul 22 11:27:36 old-k8s-version-584140 kubelet[730]: E0722 11:27:36.599081 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
W0722 11:32:13.106986 210080 logs.go:138] Found kubelet problem: Jul 22 11:27:38 old-k8s-version-584140 kubelet[730]: E0722 11:27:38.598819 730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0722 11:32:13.107575 210080 logs.go:138] Found kubelet problem: Jul 22 11:27:50 old-k8s-version-584140 kubelet[730]: E0722 11:27:50.837672 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
W0722 11:32:13.107756 210080 logs.go:138] Found kubelet problem: Jul 22 11:27:53 old-k8s-version-584140 kubelet[730]: E0722 11:27:53.599749 730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0722 11:32:13.108087 210080 logs.go:138] Found kubelet problem: Jul 22 11:27:54 old-k8s-version-584140 kubelet[730]: E0722 11:27:54.838469 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
W0722 11:32:13.108413 210080 logs.go:138] Found kubelet problem: Jul 22 11:28:06 old-k8s-version-584140 kubelet[730]: E0722 11:28:06.598312 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
W0722 11:32:13.112031 210080 logs.go:138] Found kubelet problem: Jul 22 11:28:07 old-k8s-version-584140 kubelet[730]: E0722 11:28:07.619353 730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0722 11:32:13.112416 210080 logs.go:138] Found kubelet problem: Jul 22 11:28:20 old-k8s-version-584140 kubelet[730]: E0722 11:28:20.599140 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
W0722 11:32:13.112656 210080 logs.go:138] Found kubelet problem: Jul 22 11:28:20 old-k8s-version-584140 kubelet[730]: E0722 11:28:20.600438 730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0722 11:32:13.113300 210080 logs.go:138] Found kubelet problem: Jul 22 11:28:33 old-k8s-version-584140 kubelet[730]: E0722 11:28:33.909665 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
W0722 11:32:13.113656 210080 logs.go:138] Found kubelet problem: Jul 22 11:28:34 old-k8s-version-584140 kubelet[730]: E0722 11:28:34.912079 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
W0722 11:32:13.113873 210080 logs.go:138] Found kubelet problem: Jul 22 11:28:35 old-k8s-version-584140 kubelet[730]: E0722 11:28:35.599081 730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0722 11:32:13.114232 210080 logs.go:138] Found kubelet problem: Jul 22 11:28:46 old-k8s-version-584140 kubelet[730]: E0722 11:28:46.598307 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
W0722 11:32:13.114449 210080 logs.go:138] Found kubelet problem: Jul 22 11:28:50 old-k8s-version-584140 kubelet[730]: E0722 11:28:50.599499 730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0722 11:32:13.114814 210080 logs.go:138] Found kubelet problem: Jul 22 11:29:01 old-k8s-version-584140 kubelet[730]: E0722 11:29:01.598946 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
W0722 11:32:13.115037 210080 logs.go:138] Found kubelet problem: Jul 22 11:29:04 old-k8s-version-584140 kubelet[730]: E0722 11:29:04.598688 730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0722 11:32:13.115407 210080 logs.go:138] Found kubelet problem: Jul 22 11:29:12 old-k8s-version-584140 kubelet[730]: E0722 11:29:12.598338 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
W0722 11:32:13.115623 210080 logs.go:138] Found kubelet problem: Jul 22 11:29:19 old-k8s-version-584140 kubelet[730]: E0722 11:29:19.598946 730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0722 11:32:13.115987 210080 logs.go:138] Found kubelet problem: Jul 22 11:29:26 old-k8s-version-584140 kubelet[730]: E0722 11:29:26.598882 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
W0722 11:32:13.118742 210080 logs.go:138] Found kubelet problem: Jul 22 11:29:33 old-k8s-version-584140 kubelet[730]: E0722 11:29:33.611073 730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0722 11:32:13.119112 210080 logs.go:138] Found kubelet problem: Jul 22 11:29:37 old-k8s-version-584140 kubelet[730]: E0722 11:29:37.598186 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
W0722 11:32:13.119323 210080 logs.go:138] Found kubelet problem: Jul 22 11:29:46 old-k8s-version-584140 kubelet[730]: E0722 11:29:46.599495 730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0722 11:32:13.119677 210080 logs.go:138] Found kubelet problem: Jul 22 11:29:48 old-k8s-version-584140 kubelet[730]: E0722 11:29:48.598602 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
W0722 11:32:13.119896 210080 logs.go:138] Found kubelet problem: Jul 22 11:30:00 old-k8s-version-584140 kubelet[730]: E0722 11:30:00.599866 730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0722 11:32:13.120518 210080 logs.go:138] Found kubelet problem: Jul 22 11:30:03 old-k8s-version-584140 kubelet[730]: E0722 11:30:03.060169 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
W0722 11:32:13.120882 210080 logs.go:138] Found kubelet problem: Jul 22 11:30:04 old-k8s-version-584140 kubelet[730]: E0722 11:30:04.837656 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
W0722 11:32:13.121095 210080 logs.go:138] Found kubelet problem: Jul 22 11:30:13 old-k8s-version-584140 kubelet[730]: E0722 11:30:13.598674 730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0722 11:32:13.121455 210080 logs.go:138] Found kubelet problem: Jul 22 11:30:17 old-k8s-version-584140 kubelet[730]: E0722 11:30:17.598240 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
W0722 11:32:13.121671 210080 logs.go:138] Found kubelet problem: Jul 22 11:30:28 old-k8s-version-584140 kubelet[730]: E0722 11:30:28.598615 730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0722 11:32:13.122558 210080 logs.go:138] Found kubelet problem: Jul 22 11:30:31 old-k8s-version-584140 kubelet[730]: E0722 11:30:31.598312 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
W0722 11:32:13.122777 210080 logs.go:138] Found kubelet problem: Jul 22 11:30:43 old-k8s-version-584140 kubelet[730]: E0722 11:30:43.599168 730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0722 11:32:13.123140 210080 logs.go:138] Found kubelet problem: Jul 22 11:30:44 old-k8s-version-584140 kubelet[730]: E0722 11:30:44.598289 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
W0722 11:32:13.123361 210080 logs.go:138] Found kubelet problem: Jul 22 11:30:55 old-k8s-version-584140 kubelet[730]: E0722 11:30:55.599111 730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0722 11:32:13.123761 210080 logs.go:138] Found kubelet problem: Jul 22 11:30:58 old-k8s-version-584140 kubelet[730]: E0722 11:30:58.598266 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
W0722 11:32:13.123983 210080 logs.go:138] Found kubelet problem: Jul 22 11:31:08 old-k8s-version-584140 kubelet[730]: E0722 11:31:08.598772 730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0722 11:32:13.124338 210080 logs.go:138] Found kubelet problem: Jul 22 11:31:12 old-k8s-version-584140 kubelet[730]: E0722 11:31:12.598216 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
W0722 11:32:13.124695 210080 logs.go:138] Found kubelet problem: Jul 22 11:31:23 old-k8s-version-584140 kubelet[730]: E0722 11:31:23.598165 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
W0722 11:32:13.124915 210080 logs.go:138] Found kubelet problem: Jul 22 11:31:23 old-k8s-version-584140 kubelet[730]: E0722 11:31:23.599281 730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0722 11:32:13.125573 210080 logs.go:138] Found kubelet problem: Jul 22 11:31:36 old-k8s-version-584140 kubelet[730]: E0722 11:31:36.598285 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
W0722 11:32:13.125763 210080 logs.go:138] Found kubelet problem: Jul 22 11:31:37 old-k8s-version-584140 kubelet[730]: E0722 11:31:37.598777 730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0722 11:32:13.126093 210080 logs.go:138] Found kubelet problem: Jul 22 11:31:50 old-k8s-version-584140 kubelet[730]: E0722 11:31:50.598548 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
W0722 11:32:13.126277 210080 logs.go:138] Found kubelet problem: Jul 22 11:31:52 old-k8s-version-584140 kubelet[730]: E0722 11:31:52.598992 730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0722 11:32:13.126606 210080 logs.go:138] Found kubelet problem: Jul 22 11:32:04 old-k8s-version-584140 kubelet[730]: E0722 11:32:04.598313 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
W0722 11:32:13.126802 210080 logs.go:138] Found kubelet problem: Jul 22 11:32:07 old-k8s-version-584140 kubelet[730]: E0722 11:32:07.598569 730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
I0722 11:32:13.126810 210080 logs.go:123] Gathering logs for describe nodes ...
I0722 11:32:13.126824 210080 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0722 11:32:13.399039 210080 logs.go:123] Gathering logs for kindnet [451ceb51fb176f2ab58c30c602fe7a8d8dcdde723f94ec75d058fd599561cfde] ...
I0722 11:32:13.399119 210080 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 451ceb51fb176f2ab58c30c602fe7a8d8dcdde723f94ec75d058fd599561cfde"
I0722 11:32:13.526326 210080 logs.go:123] Gathering logs for storage-provisioner [b64b9e0461292d72b7fc112215c86b2db789ed69b01b10063e3b4f24a2155a8a] ...
I0722 11:32:13.526402 210080 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 b64b9e0461292d72b7fc112215c86b2db789ed69b01b10063e3b4f24a2155a8a"
I0722 11:32:15.156649 218924 node_ready.go:49] node "no-preload-076896" has status "Ready":"True"
I0722 11:32:15.156672 218924 node_ready.go:38] duration metric: took 6.287102501s for node "no-preload-076896" to be "Ready" ...
I0722 11:32:15.156682 218924 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0722 11:32:15.312694 218924 pod_ready.go:78] waiting up to 6m0s for pod "coredns-5cfdc65f69-qj9x7" in "kube-system" namespace to be "Ready" ...
I0722 11:32:15.575807 218924 pod_ready.go:92] pod "coredns-5cfdc65f69-qj9x7" in "kube-system" namespace has status "Ready":"True"
I0722 11:32:15.575879 218924 pod_ready.go:81] duration metric: took 263.110944ms for pod "coredns-5cfdc65f69-qj9x7" in "kube-system" namespace to be "Ready" ...
I0722 11:32:15.575904 218924 pod_ready.go:78] waiting up to 6m0s for pod "etcd-no-preload-076896" in "kube-system" namespace to be "Ready" ...
I0722 11:32:15.656032 218924 pod_ready.go:92] pod "etcd-no-preload-076896" in "kube-system" namespace has status "Ready":"True"
I0722 11:32:15.656106 218924 pod_ready.go:81] duration metric: took 80.155596ms for pod "etcd-no-preload-076896" in "kube-system" namespace to be "Ready" ...
I0722 11:32:15.656148 218924 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-no-preload-076896" in "kube-system" namespace to be "Ready" ...
I0722 11:32:15.702712 218924 pod_ready.go:92] pod "kube-apiserver-no-preload-076896" in "kube-system" namespace has status "Ready":"True"
I0722 11:32:15.702785 218924 pod_ready.go:81] duration metric: took 46.611265ms for pod "kube-apiserver-no-preload-076896" in "kube-system" namespace to be "Ready" ...
I0722 11:32:15.702812 218924 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-no-preload-076896" in "kube-system" namespace to be "Ready" ...
I0722 11:32:16.849556 218924 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0-beta.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: (7.475131434s)
I0722 11:32:16.850020 218924 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0-beta.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (7.390288488s)
I0722 11:32:16.850086 218924 addons.go:475] Verifying addon metrics-server=true in "no-preload-076896"
I0722 11:32:16.850160 218924 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0-beta.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: (7.323967145s)
I0722 11:32:16.850439 218924 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0-beta.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: (7.297943108s)
I0722 11:32:16.853157 218924 out.go:177] * Some dashboard features require the metrics-server addon. To enable all features please run:
minikube -p no-preload-076896 addons enable metrics-server
I0722 11:32:16.873013 218924 out.go:177] * Enabled addons: metrics-server, storage-provisioner, dashboard, default-storageclass
I0722 11:32:13.598245 210080 logs.go:123] Gathering logs for storage-provisioner [48a74507ee5da0b4b62d92cb8fe64853426c4fcd088c4d455c7d827c4c514ab2] ...
I0722 11:32:13.598325 210080 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 48a74507ee5da0b4b62d92cb8fe64853426c4fcd088c4d455c7d827c4c514ab2"
I0722 11:32:13.663983 210080 logs.go:123] Gathering logs for CRI-O ...
I0722 11:32:13.664010 210080 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0722 11:32:13.774294 210080 logs.go:123] Gathering logs for kube-apiserver [7b17da0e203acb0f33605e81ab92029743299c8b53e99bedad6247fb2e22336d] ...
I0722 11:32:13.774368 210080 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 7b17da0e203acb0f33605e81ab92029743299c8b53e99bedad6247fb2e22336d"
I0722 11:32:13.916684 210080 logs.go:123] Gathering logs for etcd [b8f395f6e10fffc01d9db2971c2690affd63e1173ebe081a173b1df5e29b3eae] ...
I0722 11:32:13.916766 210080 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 b8f395f6e10fffc01d9db2971c2690affd63e1173ebe081a173b1df5e29b3eae"
I0722 11:32:13.987707 210080 logs.go:123] Gathering logs for coredns [25b426692cff4a0ddaac80382d5fd8be373235953b017a1f2591adbc04fe5208] ...
I0722 11:32:13.987784 210080 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 25b426692cff4a0ddaac80382d5fd8be373235953b017a1f2591adbc04fe5208"
I0722 11:32:14.058506 210080 logs.go:123] Gathering logs for kube-controller-manager [460bdeec3bdfccab7101c9d13045f9bcf87734da1fb0f6f8b6a5c0111906ac43] ...
I0722 11:32:14.058580 210080 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 460bdeec3bdfccab7101c9d13045f9bcf87734da1fb0f6f8b6a5c0111906ac43"
I0722 11:32:14.180422 210080 logs.go:123] Gathering logs for dmesg ...
I0722 11:32:14.180504 210080 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0722 11:32:14.206776 210080 logs.go:123] Gathering logs for kube-scheduler [a38f1a7f716723ae1738fc6d121fd5959ee9c40c5b1c46b537955d760c9f4290] ...
I0722 11:32:14.206809 210080 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 a38f1a7f716723ae1738fc6d121fd5959ee9c40c5b1c46b537955d760c9f4290"
I0722 11:32:14.284863 210080 logs.go:123] Gathering logs for kube-proxy [5191e613fc2d72706f1d776fe8a845ca8f4b3cec7ff3b0f9d18aee199e8d79c6] ...
I0722 11:32:14.284912 210080 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 5191e613fc2d72706f1d776fe8a845ca8f4b3cec7ff3b0f9d18aee199e8d79c6"
I0722 11:32:14.362593 210080 logs.go:123] Gathering logs for kubernetes-dashboard [0da5dde31a386001ac351514fcd5b733872eb5d92ec8b3579e32b0f14de7b1fc] ...
I0722 11:32:14.362628 210080 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 0da5dde31a386001ac351514fcd5b733872eb5d92ec8b3579e32b0f14de7b1fc"
I0722 11:32:14.443975 210080 logs.go:123] Gathering logs for container status ...
I0722 11:32:14.444089 210080 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0722 11:32:14.520662 210080 out.go:304] Setting ErrFile to fd 2...
I0722 11:32:14.520689 210080 out.go:338] TERM=,COLORTERM=, which probably does not support color
W0722 11:32:14.520820 210080 out.go:239] X Problems detected in kubelet:
W0722 11:32:14.520838 210080 out.go:239] Jul 22 11:31:37 old-k8s-version-584140 kubelet[730]: E0722 11:31:37.598777 730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0722 11:32:14.520846 210080 out.go:239] Jul 22 11:31:50 old-k8s-version-584140 kubelet[730]: E0722 11:31:50.598548 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
W0722 11:32:14.520996 210080 out.go:239] Jul 22 11:31:52 old-k8s-version-584140 kubelet[730]: E0722 11:31:52.598992 730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0722 11:32:14.521011 210080 out.go:239] Jul 22 11:32:04 old-k8s-version-584140 kubelet[730]: E0722 11:32:04.598313 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
W0722 11:32:14.521018 210080 out.go:239] Jul 22 11:32:07 old-k8s-version-584140 kubelet[730]: E0722 11:32:07.598569 730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
I0722 11:32:14.521025 210080 out.go:304] Setting ErrFile to fd 2...
I0722 11:32:14.521035 210080 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0722 11:32:16.876234 218924 addons.go:510] duration metric: took 8.47627919s for enable addons: enabled=[metrics-server storage-provisioner dashboard default-storageclass]
I0722 11:32:17.714217 218924 pod_ready.go:102] pod "kube-controller-manager-no-preload-076896" in "kube-system" namespace has status "Ready":"False"
I0722 11:32:19.720521 218924 pod_ready.go:102] pod "kube-controller-manager-no-preload-076896" in "kube-system" namespace has status "Ready":"False"
I0722 11:32:24.521380 210080 api_server.go:253] Checking apiserver healthz at https://192.168.76.2:8443/healthz ...
I0722 11:32:24.532152 210080 api_server.go:279] https://192.168.76.2:8443/healthz returned 200:
ok
I0722 11:32:24.534362 210080 out.go:177]
W0722 11:32:24.536402 210080 out.go:239] X Exiting due to K8S_UNHEALTHY_CONTROL_PLANE: wait 6m0s for node: wait for healthy API server: controlPlane never updated to v1.20.0
W0722 11:32:24.536544 210080 out.go:239] * Suggestion: Control Plane could not update, try minikube delete --all --purge
W0722 11:32:24.536574 210080 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/11417
W0722 11:32:24.536587 210080 out.go:239] *
W0722 11:32:24.537591 210080 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0722 11:32:24.538987 210080 out.go:177]
I0722 11:32:21.712058 218924 pod_ready.go:92] pod "kube-controller-manager-no-preload-076896" in "kube-system" namespace has status "Ready":"True"
I0722 11:32:21.712129 218924 pod_ready.go:81] duration metric: took 6.009293891s for pod "kube-controller-manager-no-preload-076896" in "kube-system" namespace to be "Ready" ...
I0722 11:32:21.712155 218924 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-z6tdn" in "kube-system" namespace to be "Ready" ...
I0722 11:32:21.729751 218924 pod_ready.go:92] pod "kube-proxy-z6tdn" in "kube-system" namespace has status "Ready":"True"
I0722 11:32:21.729823 218924 pod_ready.go:81] duration metric: took 17.647803ms for pod "kube-proxy-z6tdn" in "kube-system" namespace to be "Ready" ...
I0722 11:32:21.729849 218924 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-no-preload-076896" in "kube-system" namespace to be "Ready" ...
I0722 11:32:23.737178 218924 pod_ready.go:102] pod "kube-scheduler-no-preload-076896" in "kube-system" namespace has status "Ready":"False"
I0722 11:32:24.237206 218924 pod_ready.go:92] pod "kube-scheduler-no-preload-076896" in "kube-system" namespace has status "Ready":"True"
I0722 11:32:24.237276 218924 pod_ready.go:81] duration metric: took 2.507405374s for pod "kube-scheduler-no-preload-076896" in "kube-system" namespace to be "Ready" ...
I0722 11:32:24.237302 218924 pod_ready.go:78] waiting up to 6m0s for pod "metrics-server-78fcd8795b-spn8p" in "kube-system" namespace to be "Ready" ...
==> CRI-O <==
Jul 22 11:30:03 old-k8s-version-584140 crio[621]: time="2024-07-22 11:30:03.088414113Z" level=info msg="Removed container 8e03b1490598f83b5b1472f498efb487a90d9724b033d75af25d55b449dd11c3: kubernetes-dashboard/dashboard-metrics-scraper-8d5bb5db8-4ttjq/dashboard-metrics-scraper" id=f911e3e8-9549-49cd-8ee3-b5c81b446b8e name=/runtime.v1alpha2.RuntimeService/RemoveContainer
Jul 22 11:30:13 old-k8s-version-584140 crio[621]: time="2024-07-22 11:30:13.598209308Z" level=info msg="Checking image status: fake.domain/registry.k8s.io/echoserver:1.4" id=16e20e9d-d26b-4f2c-8a89-dfaa0657d2c5 name=/runtime.v1alpha2.ImageService/ImageStatus
Jul 22 11:30:13 old-k8s-version-584140 crio[621]: time="2024-07-22 11:30:13.598442314Z" level=info msg="Image fake.domain/registry.k8s.io/echoserver:1.4 not found" id=16e20e9d-d26b-4f2c-8a89-dfaa0657d2c5 name=/runtime.v1alpha2.ImageService/ImageStatus
Jul 22 11:30:28 old-k8s-version-584140 crio[621]: time="2024-07-22 11:30:28.598123898Z" level=info msg="Checking image status: fake.domain/registry.k8s.io/echoserver:1.4" id=9d9bb423-e57b-48f7-808f-1b85aa2e10ef name=/runtime.v1alpha2.ImageService/ImageStatus
Jul 22 11:30:28 old-k8s-version-584140 crio[621]: time="2024-07-22 11:30:28.598353942Z" level=info msg="Image fake.domain/registry.k8s.io/echoserver:1.4 not found" id=9d9bb423-e57b-48f7-808f-1b85aa2e10ef name=/runtime.v1alpha2.ImageService/ImageStatus
Jul 22 11:30:43 old-k8s-version-584140 crio[621]: time="2024-07-22 11:30:43.598674249Z" level=info msg="Checking image status: fake.domain/registry.k8s.io/echoserver:1.4" id=3e011f3e-9449-419c-b8db-0f4882a2c328 name=/runtime.v1alpha2.ImageService/ImageStatus
Jul 22 11:30:43 old-k8s-version-584140 crio[621]: time="2024-07-22 11:30:43.598913696Z" level=info msg="Image fake.domain/registry.k8s.io/echoserver:1.4 not found" id=3e011f3e-9449-419c-b8db-0f4882a2c328 name=/runtime.v1alpha2.ImageService/ImageStatus
Jul 22 11:30:55 old-k8s-version-584140 crio[621]: time="2024-07-22 11:30:55.598191432Z" level=info msg="Checking image status: fake.domain/registry.k8s.io/echoserver:1.4" id=625e3bfb-5788-4057-b93e-90b5b658f55f name=/runtime.v1alpha2.ImageService/ImageStatus
Jul 22 11:30:55 old-k8s-version-584140 crio[621]: time="2024-07-22 11:30:55.598420146Z" level=info msg="Image fake.domain/registry.k8s.io/echoserver:1.4 not found" id=625e3bfb-5788-4057-b93e-90b5b658f55f name=/runtime.v1alpha2.ImageService/ImageStatus
Jul 22 11:31:08 old-k8s-version-584140 crio[621]: time="2024-07-22 11:31:08.598334176Z" level=info msg="Checking image status: fake.domain/registry.k8s.io/echoserver:1.4" id=447e3e65-299d-4963-80a6-e2bca0b01f10 name=/runtime.v1alpha2.ImageService/ImageStatus
Jul 22 11:31:08 old-k8s-version-584140 crio[621]: time="2024-07-22 11:31:08.598563637Z" level=info msg="Image fake.domain/registry.k8s.io/echoserver:1.4 not found" id=447e3e65-299d-4963-80a6-e2bca0b01f10 name=/runtime.v1alpha2.ImageService/ImageStatus
Jul 22 11:31:23 old-k8s-version-584140 crio[621]: time="2024-07-22 11:31:23.598792727Z" level=info msg="Checking image status: fake.domain/registry.k8s.io/echoserver:1.4" id=3db05b77-6625-41e4-bdbc-b48fc516310c name=/runtime.v1alpha2.ImageService/ImageStatus
Jul 22 11:31:23 old-k8s-version-584140 crio[621]: time="2024-07-22 11:31:23.599029499Z" level=info msg="Image fake.domain/registry.k8s.io/echoserver:1.4 not found" id=3db05b77-6625-41e4-bdbc-b48fc516310c name=/runtime.v1alpha2.ImageService/ImageStatus
Jul 22 11:31:30 old-k8s-version-584140 crio[621]: time="2024-07-22 11:31:30.564260665Z" level=info msg="Checking image status: k8s.gcr.io/pause:3.2" id=8026ae4e-d7e7-4ec8-ab4a-083b09784ea5 name=/runtime.v1alpha2.ImageService/ImageStatus
Jul 22 11:31:30 old-k8s-version-584140 crio[621]: time="2024-07-22 11:31:30.564496018Z" level=info msg="Image status: &ImageStatusResponse{Image:&Image{Id:2a060e2e7101d419352bf82c613158587400be743482d9a537ec4a9d1b4eb93c,RepoTags:[k8s.gcr.io/pause:3.2 registry.k8s.io/pause:3.2],RepoDigests:[k8s.gcr.io/pause@sha256:31d3efd12022ffeffb3146bc10ae8beb890c80ed2f07363515580add7ed47636 k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f registry.k8s.io/pause@sha256:31d3efd12022ffeffb3146bc10ae8beb890c80ed2f07363515580add7ed47636 registry.k8s.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f],Size_:489397,Uid:nil,Username:,Spec:nil,},Info:map[string]string{},}" id=8026ae4e-d7e7-4ec8-ab4a-083b09784ea5 name=/runtime.v1alpha2.ImageService/ImageStatus
Jul 22 11:31:37 old-k8s-version-584140 crio[621]: time="2024-07-22 11:31:37.598326677Z" level=info msg="Checking image status: fake.domain/registry.k8s.io/echoserver:1.4" id=3bbce1c2-2865-453a-94f2-b8545790e8ec name=/runtime.v1alpha2.ImageService/ImageStatus
Jul 22 11:31:37 old-k8s-version-584140 crio[621]: time="2024-07-22 11:31:37.598563318Z" level=info msg="Image fake.domain/registry.k8s.io/echoserver:1.4 not found" id=3bbce1c2-2865-453a-94f2-b8545790e8ec name=/runtime.v1alpha2.ImageService/ImageStatus
Jul 22 11:31:52 old-k8s-version-584140 crio[621]: time="2024-07-22 11:31:52.598241090Z" level=info msg="Checking image status: fake.domain/registry.k8s.io/echoserver:1.4" id=a5c3ea2c-70d0-4e27-bb06-933ed5485443 name=/runtime.v1alpha2.ImageService/ImageStatus
Jul 22 11:31:52 old-k8s-version-584140 crio[621]: time="2024-07-22 11:31:52.598473455Z" level=info msg="Image fake.domain/registry.k8s.io/echoserver:1.4 not found" id=a5c3ea2c-70d0-4e27-bb06-933ed5485443 name=/runtime.v1alpha2.ImageService/ImageStatus
Jul 22 11:32:07 old-k8s-version-584140 crio[621]: time="2024-07-22 11:32:07.598127506Z" level=info msg="Checking image status: fake.domain/registry.k8s.io/echoserver:1.4" id=47fdcaef-657e-49d1-b46a-059bc236865b name=/runtime.v1alpha2.ImageService/ImageStatus
Jul 22 11:32:07 old-k8s-version-584140 crio[621]: time="2024-07-22 11:32:07.598359912Z" level=info msg="Image fake.domain/registry.k8s.io/echoserver:1.4 not found" id=47fdcaef-657e-49d1-b46a-059bc236865b name=/runtime.v1alpha2.ImageService/ImageStatus
Jul 22 11:32:19 old-k8s-version-584140 crio[621]: time="2024-07-22 11:32:19.598229483Z" level=info msg="Checking image status: fake.domain/registry.k8s.io/echoserver:1.4" id=5d0df1f5-ef18-47a4-8513-dbe991cea400 name=/runtime.v1alpha2.ImageService/ImageStatus
Jul 22 11:32:19 old-k8s-version-584140 crio[621]: time="2024-07-22 11:32:19.598472966Z" level=info msg="Image fake.domain/registry.k8s.io/echoserver:1.4 not found" id=5d0df1f5-ef18-47a4-8513-dbe991cea400 name=/runtime.v1alpha2.ImageService/ImageStatus
Jul 22 11:32:19 old-k8s-version-584140 crio[621]: time="2024-07-22 11:32:19.599204959Z" level=info msg="Pulling image: fake.domain/registry.k8s.io/echoserver:1.4" id=b9af2326-f093-4591-b5f7-348ddb72a1dd name=/runtime.v1alpha2.ImageService/PullImage
Jul 22 11:32:19 old-k8s-version-584140 crio[621]: time="2024-07-22 11:32:19.602368407Z" level=info msg="Trying to access \"fake.domain/registry.k8s.io/echoserver:1.4\""
==> container status <==
CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID POD
295412dcfe2d0 a90209bb39e3d7b5fc9daf60c17044ea969aaca0333d672d8c7a34c7446e7ff7 2 minutes ago Exited dashboard-metrics-scraper 5 ba28f9a9e226b dashboard-metrics-scraper-8d5bb5db8-4ttjq
b64b9e0461292 ba04bb24b95753201135cbc420b233c1b0b9fa2e1fd21d28319c348c33fbcde6 5 minutes ago Running storage-provisioner 1 d492c2839ec7c storage-provisioner
0da5dde31a386 docker.io/kubernetesui/dashboard@sha256:2e500d29e9d5f4a086b908eb8dfe7ecac57d2ab09d65b24f588b1d449841ef93 5 minutes ago Running kubernetes-dashboard 0 da4e69e9d4772 kubernetes-dashboard-cd95d586-pmxh6
498f3af1ac323 1611cd07b61d57dbbfebe6db242513fd51e1c02d20ba08af17a45837d86a8a8c 5 minutes ago Running busybox 0 4140fdf29c882 busybox
5191e613fc2d7 25a5233254979d0678a2db1d15b76b73dc380d81bc5eed93916ba5638b3cd894 5 minutes ago Running kube-proxy 0 e0cb503ad3e7d kube-proxy-xfm5t
25b426692cff4 db91994f4ee8f894a1e8a6c1a76f615da8fc3c019300a3686291ce6fcbc57895 5 minutes ago Running coredns 0 306a1c03a73f9 coredns-74ff55c5b-t7kln
48a74507ee5da ba04bb24b95753201135cbc420b233c1b0b9fa2e1fd21d28319c348c33fbcde6 5 minutes ago Exited storage-provisioner 0 d492c2839ec7c storage-provisioner
451ceb51fb176 f42786f8afd2214fc59fbf9a26531806f562488d4a7d7a31e8b5e9ff6289b800 5 minutes ago Running kindnet-cni 0 22979cdf3749a kindnet-bj725
460bdeec3bdfc 1df8a2b116bd16f7070fd383a6769c8d644b365575e8ffa3e492b84e4f05fc74 5 minutes ago Running kube-controller-manager 0 1d81e2979e2dd kube-controller-manager-old-k8s-version-584140
7b17da0e203ac 2c08bbbc02d3aa5dfbf4e79f15c0a61424049288917aa10364464ca1f7de7157 5 minutes ago Running kube-apiserver 0 f068fc18bd3fd kube-apiserver-old-k8s-version-584140
a38f1a7f71672 e7605f88f17d6a4c3f083ef9c6f5f19b39f87e4d4406a05a8612b54a6ea57051 5 minutes ago Running kube-scheduler 0 cad7c49ea9136 kube-scheduler-old-k8s-version-584140
b8f395f6e10ff 05b738aa1bc6355db8a2ee8639f3631b908286e43f584a3d2ee0c472de033c28 5 minutes ago Running etcd 0 be93636e3a2f7 etcd-old-k8s-version-584140
==> coredns [25b426692cff4a0ddaac80382d5fd8be373235953b017a1f2591adbc04fe5208] <==
I0722 11:27:12.036817 1 trace.go:116] Trace[2019727887]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125 (started: 2024-07-22 11:26:42.035688352 +0000 UTC m=+0.037827147) (total time: 30.001014863s):
Trace[2019727887]: [30.001014863s] [30.001014863s] END
E0722 11:27:12.036856 1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to list *v1.Namespace: Get "https://10.96.0.1:443/api/v1/namespaces?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
I0722 11:27:12.036978 1 trace.go:116] Trace[939984059]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125 (started: 2024-07-22 11:26:42.036130744 +0000 UTC m=+0.038269539) (total time: 30.000835362s):
Trace[939984059]: [30.000835362s] [30.000835362s] END
E0722 11:27:12.036992 1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to list *v1.Service: Get "https://10.96.0.1:443/api/v1/services?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
I0722 11:27:12.037054 1 trace.go:116] Trace[911902081]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125 (started: 2024-07-22 11:26:42.036330454 +0000 UTC m=+0.038469240) (total time: 30.000714252s):
Trace[911902081]: [30.000714252s] [30.000714252s] END
E0722 11:27:12.037064 1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to list *v1.Endpoints: Get "https://10.96.0.1:443/api/v1/endpoints?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
.:53
[INFO] plugin/reload: Running configuration MD5 = b494d968e357ba1b925cee838fbd78ed
CoreDNS-1.7.0
linux/arm64, go1.14.4, f59c03d
[INFO] 127.0.0.1:56865 - 61839 "HINFO IN 3909309752743002820.4240139172506480183. udp 57 false 512" NXDOMAIN qr,rd,ra 57 0.012449009s
[INFO] SIGTERM: Shutting down servers then terminating
[INFO] plugin/health: Going into lameduck mode for 5s
[INFO] plugin/ready: Still waiting on: "kubernetes"
.:53
[INFO] plugin/reload: Running configuration MD5 = b494d968e357ba1b925cee838fbd78ed
CoreDNS-1.7.0
linux/arm64, go1.14.4, f59c03d
[INFO] 127.0.0.1:43574 - 516 "HINFO IN 4717583635586907074.1732186825014459720. udp 57 false 512" NXDOMAIN qr,rd,ra 57 0.032421611s
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/ready: Still waiting on: "kubernetes"
==> describe nodes <==
Name: old-k8s-version-584140
Roles: control-plane,master
Labels: beta.kubernetes.io/arch=arm64
beta.kubernetes.io/os=linux
kubernetes.io/arch=arm64
kubernetes.io/hostname=old-k8s-version-584140
kubernetes.io/os=linux
minikube.k8s.io/commit=8e5b1d22910d5d447b525af478862a848159d7b7
minikube.k8s.io/name=old-k8s-version-584140
minikube.k8s.io/primary=true
minikube.k8s.io/updated_at=2024_07_22T11_24_01_0700
minikube.k8s.io/version=v1.33.1
node-role.kubernetes.io/control-plane=
node-role.kubernetes.io/master=
Annotations: kubeadm.alpha.kubernetes.io/cri-socket: /var/run/crio/crio.sock
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Mon, 22 Jul 2024 11:23:57 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: old-k8s-version-584140
AcquireTime: <unset>
RenewTime: Mon, 22 Jul 2024 11:32:22 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Mon, 22 Jul 2024 11:27:39 +0000 Mon, 22 Jul 2024 11:23:51 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Mon, 22 Jul 2024 11:27:39 +0000 Mon, 22 Jul 2024 11:23:51 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Mon, 22 Jul 2024 11:27:39 +0000 Mon, 22 Jul 2024 11:23:51 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Mon, 22 Jul 2024 11:27:39 +0000 Mon, 22 Jul 2024 11:24:39 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.76.2
Hostname: old-k8s-version-584140
Capacity:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022360Ki
pods: 110
Allocatable:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022360Ki
pods: 110
System Info:
Machine ID: ff918d69c24a4f2e96124dfffb1c1bf2
System UUID: 0db99f0b-924e-49ea-8ac8-9987f942b727
Boot ID: 0ef69867-e3da-4d6a-b5e0-eebac57ce510
Kernel Version: 5.15.0-1064-aws
OS Image: Ubuntu 22.04.4 LTS
Operating System: linux
Architecture: arm64
Container Runtime Version: cri-o://1.24.6
Kubelet Version: v1.20.0
Kube-Proxy Version: v1.20.0
PodCIDR: 10.244.0.0/24
PodCIDRs: 10.244.0.0/24
Non-terminated Pods: (12 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits AGE
--------- ---- ------------ ---------- --------------- ------------- ---
default busybox 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 6m36s
kube-system coredns-74ff55c5b-t7kln 100m (5%!)(MISSING) 0 (0%!)(MISSING) 70Mi (0%!)(MISSING) 170Mi (2%!)(MISSING) 8m10s
kube-system etcd-old-k8s-version-584140 100m (5%!)(MISSING) 0 (0%!)(MISSING) 100Mi (1%!)(MISSING) 0 (0%!)(MISSING) 8m17s
kube-system kindnet-bj725 100m (5%!)(MISSING) 100m (5%!)(MISSING) 50Mi (0%!)(MISSING) 50Mi (0%!)(MISSING) 8m10s
kube-system kube-apiserver-old-k8s-version-584140 250m (12%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 8m17s
kube-system kube-controller-manager-old-k8s-version-584140 200m (10%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 8m17s
kube-system kube-proxy-xfm5t 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 8m10s
kube-system kube-scheduler-old-k8s-version-584140 100m (5%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 8m17s
kube-system metrics-server-9975d5f86-4jcvm 100m (5%!)(MISSING) 0 (0%!)(MISSING) 200Mi (2%!)(MISSING) 0 (0%!)(MISSING) 6m25s
kube-system storage-provisioner 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 8m8s
kubernetes-dashboard dashboard-metrics-scraper-8d5bb5db8-4ttjq 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 5m30s
kubernetes-dashboard kubernetes-dashboard-cd95d586-pmxh6 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 5m30s
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 950m (47%!)(MISSING) 100m (5%!)(MISSING)
memory 420Mi (5%!)(MISSING) 220Mi (2%!)(MISSING)
ephemeral-storage 100Mi (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-1Gi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-2Mi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-32Mi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-64Ki 0 (0%!)(MISSING) 0 (0%!)(MISSING)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal NodeHasSufficientMemory 8m36s (x5 over 8m36s) kubelet Node old-k8s-version-584140 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 8m36s (x5 over 8m36s) kubelet Node old-k8s-version-584140 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 8m36s (x4 over 8m36s) kubelet Node old-k8s-version-584140 status is now: NodeHasSufficientPID
Normal Starting 8m17s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 8m17s kubelet Node old-k8s-version-584140 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 8m17s kubelet Node old-k8s-version-584140 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 8m17s kubelet Node old-k8s-version-584140 status is now: NodeHasSufficientPID
Normal Starting 8m8s kube-proxy Starting kube-proxy.
Normal NodeReady 7m47s kubelet Node old-k8s-version-584140 status is now: NodeReady
Normal Starting 5m56s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 5m56s (x8 over 5m56s) kubelet Node old-k8s-version-584140 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 5m56s (x8 over 5m56s) kubelet Node old-k8s-version-584140 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 5m56s (x8 over 5m56s) kubelet Node old-k8s-version-584140 status is now: NodeHasSufficientPID
Normal Starting 5m44s kube-proxy Starting kube-proxy.
==> dmesg <==
[ +0.000708] FS-Cache: O-cookie c=00000006 [p=00000003 fl=226 nc=0 na=1]
[ +0.000991] FS-Cache: O-cookie d=0000000062e998fb{9p.inode} n=0000000024046ae0
[ +0.001097] FS-Cache: O-key=[8] '9c5b3b0000000000'
[ +0.000733] FS-Cache: N-cookie c=0000000d [p=00000003 fl=2 nc=0 na=1]
[ +0.001003] FS-Cache: N-cookie d=0000000062e998fb{9p.inode} n=0000000009fa42d1
[ +0.001089] FS-Cache: N-key=[8] '9c5b3b0000000000'
[ +2.390529] FS-Cache: Duplicate cookie detected
[ +0.000712] FS-Cache: O-cookie c=00000004 [p=00000003 fl=226 nc=0 na=1]
[ +0.000976] FS-Cache: O-cookie d=0000000062e998fb{9p.inode} n=00000000f0862bba
[ +0.001062] FS-Cache: O-key=[8] '9b5b3b0000000000'
[ +0.000716] FS-Cache: N-cookie c=0000000f [p=00000003 fl=2 nc=0 na=1]
[ +0.000969] FS-Cache: N-cookie d=0000000062e998fb{9p.inode} n=00000000cce8ae65
[ +0.001060] FS-Cache: N-key=[8] '9b5b3b0000000000'
[ +0.246555] FS-Cache: Duplicate cookie detected
[ +0.000727] FS-Cache: O-cookie c=00000009 [p=00000003 fl=226 nc=0 na=1]
[ +0.000987] FS-Cache: O-cookie d=0000000062e998fb{9p.inode} n=000000005f76430b
[ +0.001068] FS-Cache: O-key=[8] 'a35b3b0000000000'
[ +0.000722] FS-Cache: N-cookie c=00000010 [p=00000003 fl=2 nc=0 na=1]
[ +0.000979] FS-Cache: N-cookie d=0000000062e998fb{9p.inode} n=000000002c67b7f0
[ +0.001062] FS-Cache: N-key=[8] 'a35b3b0000000000'
[Jul22 10:45] kmem.limit_in_bytes is deprecated and will be removed. Please report your usecase to linux-mm@kvack.org if you depend on this functionality.
[ +3.236788] systemd-journald[222]: Failed to send WATCHDOG=1 notification message: Connection refused
[Jul22 11:18] overlayfs: '/var/lib/containers/storage/overlay/l/7FOWQIVXOWACA56BLQVF4JJOLY' not a directory
[ +0.706503] overlayfs: '/var/lib/containers/storage/overlay/l/7FOWQIVXOWACA56BLQVF4JJOLY' not a directory
[ +0.109197] overlayfs: '/var/lib/containers/storage/overlay/l/7FOWQIVXOWACA56BLQVF4JJOLY' not a directory
==> etcd [b8f395f6e10fffc01d9db2971c2690affd63e1173ebe081a173b1df5e29b3eae] <==
2024-07-22 11:28:25.872228 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-22 11:28:35.872192 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-22 11:28:45.872314 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-22 11:28:55.872303 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-22 11:29:05.872310 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-22 11:29:15.872283 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-22 11:29:25.872331 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-22 11:29:35.872291 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-22 11:29:45.872307 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-22 11:29:55.872199 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-22 11:30:05.872306 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-22 11:30:15.877526 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-22 11:30:25.872229 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-22 11:30:35.872495 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-22 11:30:45.873009 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-22 11:30:55.872301 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-22 11:31:05.872503 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-22 11:31:15.872316 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-22 11:31:25.872290 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-22 11:31:35.872279 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-22 11:31:45.872418 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-22 11:31:55.872317 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-22 11:32:05.872215 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-22 11:32:15.872211 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-22 11:32:25.872941 I | etcdserver/api/etcdhttp: /health OK (status code 200)
==> kernel <==
11:32:26 up 1:14, 0 users, load average: 2.57, 2.01, 2.21
Linux old-k8s-version-584140 5.15.0-1064-aws #70~20.04.1-Ubuntu SMP Thu Jun 27 14:52:48 UTC 2024 aarch64 aarch64 aarch64 GNU/Linux
PRETTY_NAME="Ubuntu 22.04.4 LTS"
==> kindnet [451ceb51fb176f2ab58c30c602fe7a8d8dcdde723f94ec75d058fd599561cfde] <==
I0722 11:31:21.822935 1 main.go:299] handling current node
W0722 11:31:26.374547 1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
E0722 11:31:26.374602 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: Failed to watch *v1.NetworkPolicy: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
I0722 11:31:31.822629 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I0722 11:31:31.822665 1 main.go:299] handling current node
I0722 11:31:41.822810 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I0722 11:31:41.822849 1 main.go:299] handling current node
W0722 11:31:44.005810 1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: failed to list *v1.Pod: pods is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "pods" in API group "" at the cluster scope
E0722 11:31:44.005934 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "pods" in API group "" at the cluster scope
W0722 11:31:49.779981 1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: failed to list *v1.Namespace: namespaces is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "namespaces" in API group "" at the cluster scope
E0722 11:31:49.780017 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "namespaces" in API group "" at the cluster scope
I0722 11:31:51.822226 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I0722 11:31:51.822754 1 main.go:299] handling current node
I0722 11:32:01.824708 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I0722 11:32:01.824751 1 main.go:299] handling current node
W0722 11:32:09.369763 1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
E0722 11:32:09.369814 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: Failed to watch *v1.NetworkPolicy: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
I0722 11:32:11.822616 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I0722 11:32:11.822660 1 main.go:299] handling current node
W0722 11:32:15.596629 1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: failed to list *v1.Pod: pods is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "pods" in API group "" at the cluster scope
E0722 11:32:15.596671 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "pods" in API group "" at the cluster scope
I0722 11:32:21.821812 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I0722 11:32:21.821914 1 main.go:299] handling current node
W0722 11:32:25.478340 1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: failed to list *v1.Namespace: namespaces is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "namespaces" in API group "" at the cluster scope
E0722 11:32:25.478375 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "namespaces" in API group "" at the cluster scope
==> kube-apiserver [7b17da0e203acb0f33605e81ab92029743299c8b53e99bedad6247fb2e22336d] <==
I0722 11:29:10.069803 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0722 11:29:10.069812 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0722 11:29:40.894072 1 client.go:360] parsed scheme: "passthrough"
I0722 11:29:40.894225 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0722 11:29:40.894264 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
W0722 11:29:41.849740 1 handler_proxy.go:102] no RequestInfo found in the context
E0722 11:29:41.849908 1 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I0722 11:29:41.849943 1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
I0722 11:30:21.641845 1 client.go:360] parsed scheme: "passthrough"
I0722 11:30:21.641888 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0722 11:30:21.641897 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0722 11:31:02.006758 1 client.go:360] parsed scheme: "passthrough"
I0722 11:31:02.007001 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0722 11:31:02.007069 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0722 11:31:40.197515 1 client.go:360] parsed scheme: "passthrough"
I0722 11:31:40.197576 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0722 11:31:40.197587 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
W0722 11:31:40.255389 1 handler_proxy.go:102] no RequestInfo found in the context
E0722 11:31:40.255465 1 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I0722 11:31:40.255473 1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
I0722 11:32:16.991550 1 client.go:360] parsed scheme: "passthrough"
I0722 11:32:16.991684 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0722 11:32:16.991735 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
==> kube-controller-manager [460bdeec3bdfccab7101c9d13045f9bcf87734da1fb0f6f8b6a5c0111906ac43] <==
W0722 11:28:02.325421 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0722 11:28:28.273298 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0722 11:28:33.975821 1 request.go:655] Throttling request took 1.048431646s, request: GET:https://192.168.76.2:8443/apis/autoscaling/v1?timeout=32s
W0722 11:28:34.827358 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0722 11:28:58.775222 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0722 11:29:06.477800 1 request.go:655] Throttling request took 1.048497351s, request: GET:https://192.168.76.2:8443/apis/extensions/v1beta1?timeout=32s
W0722 11:29:07.329465 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0722 11:29:29.277258 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0722 11:29:38.979870 1 request.go:655] Throttling request took 1.048519224s, request: GET:https://192.168.76.2:8443/apis/scheduling.k8s.io/v1?timeout=32s
W0722 11:29:39.831297 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0722 11:29:59.779139 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0722 11:30:11.481691 1 request.go:655] Throttling request took 1.048328281s, request: GET:https://192.168.76.2:8443/apis/extensions/v1beta1?timeout=32s
W0722 11:30:12.333476 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0722 11:30:30.281136 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0722 11:30:43.983890 1 request.go:655] Throttling request took 1.048196851s, request: GET:https://192.168.76.2:8443/apis/extensions/v1beta1?timeout=32s
W0722 11:30:44.837265 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0722 11:31:00.793317 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0722 11:31:16.487632 1 request.go:655] Throttling request took 1.048367744s, request: GET:https://192.168.76.2:8443/apis/extensions/v1beta1?timeout=32s
W0722 11:31:17.339497 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0722 11:31:31.295232 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0722 11:31:48.989894 1 request.go:655] Throttling request took 1.048218142s, request: GET:https://192.168.76.2:8443/apis/extensions/v1beta1?timeout=32s
W0722 11:31:49.843547 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0722 11:32:01.802411 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0722 11:32:21.495116 1 request.go:655] Throttling request took 1.048595557s, request: GET:https://192.168.76.2:8443/apis/admissionregistration.k8s.io/v1beta1?timeout=32s
W0722 11:32:22.346704 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
==> kube-proxy [5191e613fc2d72706f1d776fe8a845ca8f4b3cec7ff3b0f9d18aee199e8d79c6] <==
I0722 11:24:18.285617 1 node.go:172] Successfully retrieved node IP: 192.168.76.2
I0722 11:24:18.285956 1 server_others.go:142] kube-proxy node IP is an IPv4 address (192.168.76.2), assume IPv4 operation
W0722 11:24:18.343605 1 server_others.go:578] Unknown proxy mode "", assuming iptables proxy
I0722 11:24:18.343818 1 server_others.go:185] Using iptables Proxier.
I0722 11:24:18.344287 1 server.go:650] Version: v1.20.0
I0722 11:24:18.346216 1 config.go:315] Starting service config controller
I0722 11:24:18.346417 1 shared_informer.go:240] Waiting for caches to sync for service config
I0722 11:24:18.348997 1 config.go:224] Starting endpoint slice config controller
I0722 11:24:18.350852 1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config
I0722 11:24:18.540330 1 shared_informer.go:247] Caches are synced for endpoint slice config
I0722 11:24:18.540523 1 shared_informer.go:247] Caches are synced for service config
I0722 11:26:42.107881 1 node.go:172] Successfully retrieved node IP: 192.168.76.2
I0722 11:26:42.107968 1 server_others.go:142] kube-proxy node IP is an IPv4 address (192.168.76.2), assume IPv4 operation
W0722 11:26:42.120546 1 server_others.go:578] Unknown proxy mode "", assuming iptables proxy
I0722 11:26:42.120661 1 server_others.go:185] Using iptables Proxier.
I0722 11:26:42.120964 1 server.go:650] Version: v1.20.0
I0722 11:26:42.121632 1 config.go:315] Starting service config controller
I0722 11:26:42.121650 1 shared_informer.go:240] Waiting for caches to sync for service config
I0722 11:26:42.121671 1 config.go:224] Starting endpoint slice config controller
I0722 11:26:42.121675 1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config
I0722 11:26:42.221789 1 shared_informer.go:247] Caches are synced for endpoint slice config
I0722 11:26:42.221790 1 shared_informer.go:247] Caches are synced for service config
==> kube-scheduler [a38f1a7f716723ae1738fc6d121fd5959ee9c40c5b1c46b537955d760c9f4290] <==
I0722 11:23:57.848563 1 tlsconfig.go:240] Starting DynamicServingCertificateController
E0722 11:23:57.849879 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
E0722 11:23:57.854085 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
E0722 11:23:57.854280 1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
E0722 11:23:57.854371 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
E0722 11:23:57.856556 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
E0722 11:23:57.856857 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
E0722 11:23:57.857005 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1beta1.PodDisruptionBudget: failed to list *v1beta1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
E0722 11:23:57.857074 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
E0722 11:23:57.857143 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
E0722 11:23:57.857203 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
E0722 11:23:57.857258 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
E0722 11:23:57.860089 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
E0722 11:23:58.684148 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
I0722 11:23:59.349144 1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0722 11:26:33.596096 1 serving.go:331] Generated self-signed cert in-memory
W0722 11:26:39.008349 1 requestheader_controller.go:193] Unable to get configmap/extension-apiserver-authentication in kube-system. Usually fixed by 'kubectl create rolebinding -n kube-system ROLEBINDING_NAME --role=extension-apiserver-authentication-reader --serviceaccount=YOUR_NS:YOUR_SA'
W0722 11:26:39.008583 1 authentication.go:332] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"
W0722 11:26:39.008600 1 authentication.go:333] Continuing without authentication configuration. This may treat all requests as anonymous.
W0722 11:26:39.008608 1 authentication.go:334] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false
I0722 11:26:39.257007 1 secure_serving.go:197] Serving securely on 127.0.0.1:10259
I0722 11:26:39.258098 1 configmap_cafile_content.go:202] Starting client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0722 11:26:39.258173 1 shared_informer.go:240] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0722 11:26:39.261394 1 tlsconfig.go:240] Starting DynamicServingCertificateController
I0722 11:26:39.562404 1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
==> kubelet <==
Jul 22 11:30:55 old-k8s-version-584140 kubelet[730]: E0722 11:30:55.599111 730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jul 22 11:30:58 old-k8s-version-584140 kubelet[730]: I0722 11:30:58.597918 730 scope.go:95] [topologymanager] RemoveContainer - Container ID: 295412dcfe2d0314a43f65a22d5205a0c0415f89404e85fe2dafdbe709fd4d41
Jul 22 11:30:58 old-k8s-version-584140 kubelet[730]: E0722 11:30:58.598266 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
Jul 22 11:31:08 old-k8s-version-584140 kubelet[730]: E0722 11:31:08.598772 730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jul 22 11:31:12 old-k8s-version-584140 kubelet[730]: I0722 11:31:12.597891 730 scope.go:95] [topologymanager] RemoveContainer - Container ID: 295412dcfe2d0314a43f65a22d5205a0c0415f89404e85fe2dafdbe709fd4d41
Jul 22 11:31:12 old-k8s-version-584140 kubelet[730]: E0722 11:31:12.598216 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
Jul 22 11:31:23 old-k8s-version-584140 kubelet[730]: I0722 11:31:23.597826 730 scope.go:95] [topologymanager] RemoveContainer - Container ID: 295412dcfe2d0314a43f65a22d5205a0c0415f89404e85fe2dafdbe709fd4d41
Jul 22 11:31:23 old-k8s-version-584140 kubelet[730]: E0722 11:31:23.598165 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
Jul 22 11:31:23 old-k8s-version-584140 kubelet[730]: E0722 11:31:23.599281 730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jul 22 11:31:30 old-k8s-version-584140 kubelet[730]: E0722 11:31:30.568933 730 container_manager_linux.go:533] failed to find cgroups of kubelet - cpu and memory cgroup hierarchy not unified. cpu: /docker/9a47d5204824dea9de7e428feb7e5cba07dfecea49620ebac54e1ddc8586aed6, memory: /docker/9a47d5204824dea9de7e428feb7e5cba07dfecea49620ebac54e1ddc8586aed6/system.slice/kubelet.service
Jul 22 11:31:36 old-k8s-version-584140 kubelet[730]: I0722 11:31:36.597896 730 scope.go:95] [topologymanager] RemoveContainer - Container ID: 295412dcfe2d0314a43f65a22d5205a0c0415f89404e85fe2dafdbe709fd4d41
Jul 22 11:31:36 old-k8s-version-584140 kubelet[730]: E0722 11:31:36.598285 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
Jul 22 11:31:37 old-k8s-version-584140 kubelet[730]: E0722 11:31:37.598777 730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jul 22 11:31:50 old-k8s-version-584140 kubelet[730]: I0722 11:31:50.598228 730 scope.go:95] [topologymanager] RemoveContainer - Container ID: 295412dcfe2d0314a43f65a22d5205a0c0415f89404e85fe2dafdbe709fd4d41
Jul 22 11:31:50 old-k8s-version-584140 kubelet[730]: E0722 11:31:50.598548 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
Jul 22 11:31:52 old-k8s-version-584140 kubelet[730]: E0722 11:31:52.598992 730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jul 22 11:32:04 old-k8s-version-584140 kubelet[730]: I0722 11:32:04.597985 730 scope.go:95] [topologymanager] RemoveContainer - Container ID: 295412dcfe2d0314a43f65a22d5205a0c0415f89404e85fe2dafdbe709fd4d41
Jul 22 11:32:04 old-k8s-version-584140 kubelet[730]: E0722 11:32:04.598313 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
Jul 22 11:32:07 old-k8s-version-584140 kubelet[730]: E0722 11:32:07.598569 730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jul 22 11:32:18 old-k8s-version-584140 kubelet[730]: I0722 11:32:18.597895 730 scope.go:95] [topologymanager] RemoveContainer - Container ID: 295412dcfe2d0314a43f65a22d5205a0c0415f89404e85fe2dafdbe709fd4d41
Jul 22 11:32:18 old-k8s-version-584140 kubelet[730]: E0722 11:32:18.598235 730 pod_workers.go:191] Error syncing pod b728f80c-1116-4ef9-b36b-6d05d11b72a1 ("dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4ttjq_kubernetes-dashboard(b728f80c-1116-4ef9-b36b-6d05d11b72a1)"
Jul 22 11:32:19 old-k8s-version-584140 kubelet[730]: E0722 11:32:19.609262 730 remote_image.go:113] PullImage "fake.domain/registry.k8s.io/echoserver:1.4" from image service failed: rpc error: code = Unknown desc = pinging container registry fake.domain: Get "https://fake.domain/v2/": dial tcp: lookup fake.domain: no such host
Jul 22 11:32:19 old-k8s-version-584140 kubelet[730]: E0722 11:32:19.609321 730 kuberuntime_image.go:51] Pull image "fake.domain/registry.k8s.io/echoserver:1.4" failed: rpc error: code = Unknown desc = pinging container registry fake.domain: Get "https://fake.domain/v2/": dial tcp: lookup fake.domain: no such host
Jul 22 11:32:19 old-k8s-version-584140 kubelet[730]: E0722 11:32:19.609475 730 kuberuntime_manager.go:829] container &Container{Name:metrics-server,Image:fake.domain/registry.k8s.io/echoserver:1.4,Command:[],Args:[--cert-dir=/tmp --secure-port=4443 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --kubelet-use-node-status-port --metric-resolution=60s --kubelet-insecure-tls],WorkingDir:,Ports:[]ContainerPort{ContainerPort{Name:https,HostPort:0,ContainerPort:4443,Protocol:TCP,HostIP:,},},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{cpu: {{100 -3} {<nil>} 100m DecimalSI},memory: {{209715200 0} {<nil>} BinarySI},},},VolumeMounts:[]VolumeMount{VolumeMount{Name:tmp-dir,ReadOnly:false,MountPath:/tmp,SubPath:,MountPropagation:nil,SubPathExpr:,},VolumeMount{Name:metrics-server-token-btvqb,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:&Probe{Handler:Handler{Exec
:nil,HTTPGet:&HTTPGetAction{Path:/livez,Port:{1 0 https},Host:,Scheme:HTTPS,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,},InitialDelaySeconds:0,TimeoutSeconds:1,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,},ReadinessProbe:&Probe{Handler:Handler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/readyz,Port:{1 0 https},Host:,Scheme:HTTPS,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,},InitialDelaySeconds:0,TimeoutSeconds:1,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:*1000,RunAsNonRoot:*true,ReadOnlyRootFilesystem:*true,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,} start failed in pod metrics-server-9975d5f86-4jcvm_kube-system(5a4606c
4-b596-44df-a930-60179facf4e9): ErrImagePull: rpc error: code = Unknown desc = pinging container registry fake.domain: Get "https://fake.domain/v2/": dial tcp: lookup fake.domain: no such host
Jul 22 11:32:19 old-k8s-version-584140 kubelet[730]: E0722 11:32:19.609505 730 pod_workers.go:191] Error syncing pod 5a4606c4-b596-44df-a930-60179facf4e9 ("metrics-server-9975d5f86-4jcvm_kube-system(5a4606c4-b596-44df-a930-60179facf4e9)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
==> kubernetes-dashboard [0da5dde31a386001ac351514fcd5b733872eb5d92ec8b3579e32b0f14de7b1fc] <==
2024/07/22 11:27:06 Using namespace: kubernetes-dashboard
2024/07/22 11:27:06 Using in-cluster config to connect to apiserver
2024/07/22 11:27:06 Using secret token for csrf signing
2024/07/22 11:27:06 Initializing csrf token from kubernetes-dashboard-csrf secret
2024/07/22 11:27:06 Empty token. Generating and storing in a secret kubernetes-dashboard-csrf
2024/07/22 11:27:06 Successful initial request to the apiserver, version: v1.20.0
2024/07/22 11:27:06 Generating JWE encryption key
2024/07/22 11:27:06 New synchronizer has been registered: kubernetes-dashboard-key-holder-kubernetes-dashboard. Starting
2024/07/22 11:27:06 Starting secret synchronizer for kubernetes-dashboard-key-holder in namespace kubernetes-dashboard
2024/07/22 11:27:07 Initializing JWE encryption key from synchronized object
2024/07/22 11:27:07 Creating in-cluster Sidecar client
2024/07/22 11:27:07 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/07/22 11:27:07 Serving insecurely on HTTP port: 9090
2024/07/22 11:27:37 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/07/22 11:28:07 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/07/22 11:28:37 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/07/22 11:29:07 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/07/22 11:29:37 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/07/22 11:30:07 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/07/22 11:30:37 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/07/22 11:31:07 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/07/22 11:31:37 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/07/22 11:32:07 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/07/22 11:27:06 Starting overwatch
==> storage-provisioner [48a74507ee5da0b4b62d92cb8fe64853426c4fcd088c4d455c7d827c4c514ab2] <==
I0722 11:24:44.697836 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
I0722 11:24:44.827232 1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
I0722 11:24:44.827351 1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
I0722 11:24:44.889504 1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
I0722 11:24:44.889964 1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"8378c591-9d5a-428f-8e2c-0723ef4a23b8", APIVersion:"v1", ResourceVersion:"487", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' old-k8s-version-584140_51c7adf2-2a98-4bc0-a750-3dc81dfa034e became leader
I0722 11:24:44.890073 1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_old-k8s-version-584140_51c7adf2-2a98-4bc0-a750-3dc81dfa034e!
I0722 11:24:44.990213 1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_old-k8s-version-584140_51c7adf2-2a98-4bc0-a750-3dc81dfa034e!
I0722 11:26:41.413927 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
F0722 11:27:11.416249 1 main.go:39] error getting server version: Get "https://10.96.0.1:443/version?timeout=32s": dial tcp 10.96.0.1:443: i/o timeout
==> storage-provisioner [b64b9e0461292d72b7fc112215c86b2db789ed69b01b10063e3b4f24a2155a8a] <==
I0722 11:27:11.877737 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
I0722 11:27:11.899766 1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
I0722 11:27:11.899903 1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
I0722 11:27:29.328780 1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
I0722 11:27:29.329039 1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_old-k8s-version-584140_3d7a0f6b-1d10-4604-858e-065de689c7bb!
I0722 11:27:29.329658 1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"8378c591-9d5a-428f-8e2c-0723ef4a23b8", APIVersion:"v1", ResourceVersion:"814", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' old-k8s-version-584140_3d7a0f6b-1d10-4604-858e-065de689c7bb became leader
I0722 11:27:29.430096 1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_old-k8s-version-584140_3d7a0f6b-1d10-4604-858e-065de689c7bb!
-- /stdout --
helpers_test.go:254: (dbg) Run: out/minikube-linux-arm64 status --format={{.APIServer}} -p old-k8s-version-584140 -n old-k8s-version-584140
helpers_test.go:261: (dbg) Run: kubectl --context old-k8s-version-584140 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:272: non-running pods: metrics-server-9975d5f86-4jcvm
helpers_test.go:274: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: describe non-running pods <======
helpers_test.go:277: (dbg) Run: kubectl --context old-k8s-version-584140 describe pod metrics-server-9975d5f86-4jcvm
helpers_test.go:277: (dbg) Non-zero exit: kubectl --context old-k8s-version-584140 describe pod metrics-server-9975d5f86-4jcvm: exit status 1 (114.611441ms)
** stderr **
Error from server (NotFound): pods "metrics-server-9975d5f86-4jcvm" not found
** /stderr **
helpers_test.go:279: kubectl --context old-k8s-version-584140 describe pod metrics-server-9975d5f86-4jcvm: exit status 1
--- FAIL: TestStartStop/group/old-k8s-version/serial/SecondStart (374.83s)