=== RUN TestStartStop/group/old-k8s-version/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run: out/minikube-linux-arm64 start -p old-k8s-version-776336 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=crio --kubernetes-version=v1.20.0
start_stop_delete_test.go:256: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p old-k8s-version-776336 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=crio --kubernetes-version=v1.20.0: exit status 102 (6m17.359824919s)
-- stdout --
* [old-k8s-version-776336] minikube v1.33.1 on Ubuntu 20.04 (arm64)
- MINIKUBE_LOCATION=18925
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/18925-1463640/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/18925-1463640/.minikube
- MINIKUBE_BIN=out/minikube-linux-arm64
- MINIKUBE_FORCE_SYSTEMD=
* Kubernetes 1.30.1 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.30.1
* Using the docker driver based on existing profile
* Starting "old-k8s-version-776336" primary control-plane node in "old-k8s-version-776336" cluster
* Pulling base image v0.0.44-1715707529-18887 ...
* Restarting existing docker container for "old-k8s-version-776336" ...
* Preparing Kubernetes v1.20.0 on CRI-O 1.24.6 ...
* Verifying Kubernetes components...
- Using image registry.k8s.io/echoserver:1.4
- Using image docker.io/kubernetesui/dashboard:v2.7.0
- Using image gcr.io/k8s-minikube/storage-provisioner:v5
- Using image fake.domain/registry.k8s.io/echoserver:1.4
* Some dashboard features require the metrics-server addon. To enable all features please run:
minikube -p old-k8s-version-776336 addons enable metrics-server
* Enabled addons: metrics-server, storage-provisioner, dashboard, default-storageclass
-- /stdout --
** stderr **
I0520 11:20:59.501776 1657011 out.go:291] Setting OutFile to fd 1 ...
I0520 11:20:59.502001 1657011 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0520 11:20:59.502043 1657011 out.go:304] Setting ErrFile to fd 2...
I0520 11:20:59.502065 1657011 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0520 11:20:59.502376 1657011 root.go:338] Updating PATH: /home/jenkins/minikube-integration/18925-1463640/.minikube/bin
I0520 11:20:59.502876 1657011 out.go:298] Setting JSON to false
I0520 11:20:59.504019 1657011 start.go:129] hostinfo: {"hostname":"ip-172-31-21-244","uptime":155007,"bootTime":1716049053,"procs":209,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1058-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"da8ac1fd-6236-412a-a346-95873c98230d"}
I0520 11:20:59.504139 1657011 start.go:139] virtualization:
I0520 11:20:59.511466 1657011 out.go:177] * [old-k8s-version-776336] minikube v1.33.1 on Ubuntu 20.04 (arm64)
I0520 11:20:59.514053 1657011 out.go:177] - MINIKUBE_LOCATION=18925
I0520 11:20:59.515856 1657011 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0520 11:20:59.514205 1657011 notify.go:220] Checking for updates...
I0520 11:20:59.519741 1657011 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/18925-1463640/kubeconfig
I0520 11:20:59.521809 1657011 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/18925-1463640/.minikube
I0520 11:20:59.523553 1657011 out.go:177] - MINIKUBE_BIN=out/minikube-linux-arm64
I0520 11:20:59.525236 1657011 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0520 11:20:59.527328 1657011 config.go:182] Loaded profile config "old-k8s-version-776336": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0520 11:20:59.529400 1657011 out.go:177] * Kubernetes 1.30.1 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.30.1
I0520 11:20:59.530917 1657011 driver.go:392] Setting default libvirt URI to qemu:///system
I0520 11:20:59.558982 1657011 docker.go:122] docker version: linux-26.1.3:Docker Engine - Community
I0520 11:20:59.559115 1657011 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0520 11:20:59.687958 1657011 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:55 OomKillDisable:true NGoroutines:67 SystemTime:2024-05-20 11:20:59.666769161 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1058-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215035904 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:26.1.3 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:e377cd56a71523140ca6ae87e30244719194a521 Expected:e377cd56a71523140ca6ae87e30244719194a521} RuncCommit:{ID:v1.1.12-0-g51d5e94 Expected:v1.1.12-0-g51d5e94} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.14.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.27.0]] Warnings:<nil>}}
I0520 11:20:59.688076 1657011 docker.go:295] overlay module found
I0520 11:20:59.689869 1657011 out.go:177] * Using the docker driver based on existing profile
I0520 11:20:59.691321 1657011 start.go:297] selected driver: docker
I0520 11:20:59.691337 1657011 start.go:901] validating driver "docker" against &{Name:old-k8s-version-776336 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1715707529-18887@sha256:734a2adad159415bd51b0392bc8976bd7e3e543e9165c2374d6e59bac37aed3a Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-776336 Namespace:default APIServerHAVIP: AP
IServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountStr
ing:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0520 11:20:59.691456 1657011 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0520 11:20:59.692074 1657011 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0520 11:20:59.805785 1657011 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:55 OomKillDisable:true NGoroutines:67 SystemTime:2024-05-20 11:20:59.793744162 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1058-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215035904 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:26.1.3 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:e377cd56a71523140ca6ae87e30244719194a521 Expected:e377cd56a71523140ca6ae87e30244719194a521} RuncCommit:{ID:v1.1.12-0-g51d5e94 Expected:v1.1.12-0-g51d5e94} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.14.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.27.0]] Warnings:<nil>}}
I0520 11:20:59.806160 1657011 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0520 11:20:59.806188 1657011 cni.go:84] Creating CNI manager for ""
I0520 11:20:59.806196 1657011 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
I0520 11:20:59.806242 1657011 start.go:340] cluster config:
{Name:old-k8s-version-776336 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1715707529-18887@sha256:734a2adad159415bd51b0392bc8976bd7e3e543e9165c2374d6e59bac37aed3a Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-776336 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local
ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP
: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0520 11:20:59.808237 1657011 out.go:177] * Starting "old-k8s-version-776336" primary control-plane node in "old-k8s-version-776336" cluster
I0520 11:20:59.809888 1657011 cache.go:121] Beginning downloading kic base image for docker with crio
I0520 11:20:59.811449 1657011 out.go:177] * Pulling base image v0.0.44-1715707529-18887 ...
I0520 11:20:59.812791 1657011 preload.go:132] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0520 11:20:59.812849 1657011 preload.go:147] Found local preload: /home/jenkins/minikube-integration/18925-1463640/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-arm64.tar.lz4
I0520 11:20:59.812874 1657011 cache.go:56] Caching tarball of preloaded images
I0520 11:20:59.812963 1657011 preload.go:173] Found /home/jenkins/minikube-integration/18925-1463640/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-arm64.tar.lz4 in cache, skipping download
I0520 11:20:59.812978 1657011 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on crio
I0520 11:20:59.813077 1657011 profile.go:143] Saving config to /home/jenkins/minikube-integration/18925-1463640/.minikube/profiles/old-k8s-version-776336/config.json ...
I0520 11:20:59.813296 1657011 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1715707529-18887@sha256:734a2adad159415bd51b0392bc8976bd7e3e543e9165c2374d6e59bac37aed3a in local docker daemon
I0520 11:20:59.841322 1657011 image.go:83] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1715707529-18887@sha256:734a2adad159415bd51b0392bc8976bd7e3e543e9165c2374d6e59bac37aed3a in local docker daemon, skipping pull
I0520 11:20:59.841350 1657011 cache.go:144] gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1715707529-18887@sha256:734a2adad159415bd51b0392bc8976bd7e3e543e9165c2374d6e59bac37aed3a exists in daemon, skipping load
I0520 11:20:59.841370 1657011 cache.go:194] Successfully downloaded all kic artifacts
I0520 11:20:59.841401 1657011 start.go:360] acquireMachinesLock for old-k8s-version-776336: {Name:mk61f513d62fdb2fc362410fc475e1f2742de7cc Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0520 11:20:59.841469 1657011 start.go:364] duration metric: took 43.133µs to acquireMachinesLock for "old-k8s-version-776336"
I0520 11:20:59.841498 1657011 start.go:96] Skipping create...Using existing machine configuration
I0520 11:20:59.841508 1657011 fix.go:54] fixHost starting:
I0520 11:20:59.841803 1657011 cli_runner.go:164] Run: docker container inspect old-k8s-version-776336 --format={{.State.Status}}
I0520 11:20:59.865911 1657011 fix.go:112] recreateIfNeeded on old-k8s-version-776336: state=Stopped err=<nil>
W0520 11:20:59.865944 1657011 fix.go:138] unexpected machine state, will restart: <nil>
I0520 11:20:59.867882 1657011 out.go:177] * Restarting existing docker container for "old-k8s-version-776336" ...
I0520 11:20:59.869501 1657011 cli_runner.go:164] Run: docker start old-k8s-version-776336
I0520 11:21:00.399644 1657011 cli_runner.go:164] Run: docker container inspect old-k8s-version-776336 --format={{.State.Status}}
I0520 11:21:00.427192 1657011 kic.go:430] container "old-k8s-version-776336" state is running.
I0520 11:21:00.427625 1657011 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-776336
I0520 11:21:00.458797 1657011 profile.go:143] Saving config to /home/jenkins/minikube-integration/18925-1463640/.minikube/profiles/old-k8s-version-776336/config.json ...
I0520 11:21:00.459043 1657011 machine.go:94] provisionDockerMachine start ...
I0520 11:21:00.459171 1657011 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-776336
I0520 11:21:00.489435 1657011 main.go:141] libmachine: Using SSH client type: native
I0520 11:21:00.489738 1657011 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2b30] 0x3e5390 <nil> [] 0s} 127.0.0.1 40787 <nil> <nil>}
I0520 11:21:00.489749 1657011 main.go:141] libmachine: About to run SSH command:
hostname
I0520 11:21:00.490364 1657011 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:41200->127.0.0.1:40787: read: connection reset by peer
I0520 11:21:03.633375 1657011 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-776336
I0520 11:21:03.633441 1657011 ubuntu.go:169] provisioning hostname "old-k8s-version-776336"
I0520 11:21:03.633537 1657011 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-776336
I0520 11:21:03.651274 1657011 main.go:141] libmachine: Using SSH client type: native
I0520 11:21:03.651521 1657011 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2b30] 0x3e5390 <nil> [] 0s} 127.0.0.1 40787 <nil> <nil>}
I0520 11:21:03.651531 1657011 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-776336 && echo "old-k8s-version-776336" | sudo tee /etc/hostname
I0520 11:21:03.799420 1657011 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-776336
I0520 11:21:03.799566 1657011 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-776336
I0520 11:21:03.819376 1657011 main.go:141] libmachine: Using SSH client type: native
I0520 11:21:03.819622 1657011 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2b30] 0x3e5390 <nil> [] 0s} 127.0.0.1 40787 <nil> <nil>}
I0520 11:21:03.819639 1657011 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-776336' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-776336/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-776336' | sudo tee -a /etc/hosts;
fi
fi
I0520 11:21:03.954278 1657011 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0520 11:21:03.954304 1657011 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/18925-1463640/.minikube CaCertPath:/home/jenkins/minikube-integration/18925-1463640/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/18925-1463640/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/18925-1463640/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/18925-1463640/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/18925-1463640/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/18925-1463640/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/18925-1463640/.minikube}
I0520 11:21:03.954344 1657011 ubuntu.go:177] setting up certificates
I0520 11:21:03.954354 1657011 provision.go:84] configureAuth start
I0520 11:21:03.954435 1657011 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-776336
I0520 11:21:03.973957 1657011 provision.go:143] copyHostCerts
I0520 11:21:03.974024 1657011 exec_runner.go:144] found /home/jenkins/minikube-integration/18925-1463640/.minikube/key.pem, removing ...
I0520 11:21:03.974043 1657011 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18925-1463640/.minikube/key.pem
I0520 11:21:03.974118 1657011 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18925-1463640/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/18925-1463640/.minikube/key.pem (1679 bytes)
I0520 11:21:03.974224 1657011 exec_runner.go:144] found /home/jenkins/minikube-integration/18925-1463640/.minikube/ca.pem, removing ...
I0520 11:21:03.974235 1657011 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18925-1463640/.minikube/ca.pem
I0520 11:21:03.974263 1657011 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18925-1463640/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/18925-1463640/.minikube/ca.pem (1082 bytes)
I0520 11:21:03.974323 1657011 exec_runner.go:144] found /home/jenkins/minikube-integration/18925-1463640/.minikube/cert.pem, removing ...
I0520 11:21:03.974328 1657011 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18925-1463640/.minikube/cert.pem
I0520 11:21:03.974352 1657011 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18925-1463640/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/18925-1463640/.minikube/cert.pem (1123 bytes)
I0520 11:21:03.974406 1657011 provision.go:117] generating server cert: /home/jenkins/minikube-integration/18925-1463640/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/18925-1463640/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/18925-1463640/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-776336 san=[127.0.0.1 192.168.76.2 localhost minikube old-k8s-version-776336]
I0520 11:21:04.671150 1657011 provision.go:177] copyRemoteCerts
I0520 11:21:04.671307 1657011 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0520 11:21:04.671376 1657011 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-776336
I0520 11:21:04.688503 1657011 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:40787 SSHKeyPath:/home/jenkins/minikube-integration/18925-1463640/.minikube/machines/old-k8s-version-776336/id_rsa Username:docker}
I0520 11:21:04.785006 1657011 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18925-1463640/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0520 11:21:04.819844 1657011 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18925-1463640/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
I0520 11:21:04.852995 1657011 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18925-1463640/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0520 11:21:04.880157 1657011 provision.go:87] duration metric: took 925.781994ms to configureAuth
I0520 11:21:04.880188 1657011 ubuntu.go:193] setting minikube options for container-runtime
I0520 11:21:04.880386 1657011 config.go:182] Loaded profile config "old-k8s-version-776336": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0520 11:21:04.880509 1657011 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-776336
I0520 11:21:04.900477 1657011 main.go:141] libmachine: Using SSH client type: native
I0520 11:21:04.900743 1657011 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2b30] 0x3e5390 <nil> [] 0s} 127.0.0.1 40787 <nil> <nil>}
I0520 11:21:04.900762 1657011 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0520 11:21:05.357367 1657011 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0520 11:21:05.357450 1657011 machine.go:97] duration metric: took 4.89839625s to provisionDockerMachine
I0520 11:21:05.357476 1657011 start.go:293] postStartSetup for "old-k8s-version-776336" (driver="docker")
I0520 11:21:05.357516 1657011 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0520 11:21:05.357598 1657011 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0520 11:21:05.357695 1657011 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-776336
I0520 11:21:05.382575 1657011 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:40787 SSHKeyPath:/home/jenkins/minikube-integration/18925-1463640/.minikube/machines/old-k8s-version-776336/id_rsa Username:docker}
I0520 11:21:05.479282 1657011 ssh_runner.go:195] Run: cat /etc/os-release
I0520 11:21:05.482585 1657011 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0520 11:21:05.482625 1657011 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0520 11:21:05.482636 1657011 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0520 11:21:05.482644 1657011 info.go:137] Remote host: Ubuntu 22.04.4 LTS
I0520 11:21:05.482655 1657011 filesync.go:126] Scanning /home/jenkins/minikube-integration/18925-1463640/.minikube/addons for local assets ...
I0520 11:21:05.482718 1657011 filesync.go:126] Scanning /home/jenkins/minikube-integration/18925-1463640/.minikube/files for local assets ...
I0520 11:21:05.482809 1657011 filesync.go:149] local asset: /home/jenkins/minikube-integration/18925-1463640/.minikube/files/etc/ssl/certs/14690782.pem -> 14690782.pem in /etc/ssl/certs
I0520 11:21:05.482921 1657011 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0520 11:21:05.492684 1657011 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18925-1463640/.minikube/files/etc/ssl/certs/14690782.pem --> /etc/ssl/certs/14690782.pem (1708 bytes)
I0520 11:21:05.520297 1657011 start.go:296] duration metric: took 162.778335ms for postStartSetup
I0520 11:21:05.520379 1657011 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0520 11:21:05.520435 1657011 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-776336
I0520 11:21:05.541391 1657011 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:40787 SSHKeyPath:/home/jenkins/minikube-integration/18925-1463640/.minikube/machines/old-k8s-version-776336/id_rsa Username:docker}
I0520 11:21:05.631280 1657011 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I0520 11:21:05.636912 1657011 fix.go:56] duration metric: took 5.795394558s for fixHost
I0520 11:21:05.636941 1657011 start.go:83] releasing machines lock for "old-k8s-version-776336", held for 5.795457408s
I0520 11:21:05.637025 1657011 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-776336
I0520 11:21:05.656581 1657011 ssh_runner.go:195] Run: cat /version.json
I0520 11:21:05.656614 1657011 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0520 11:21:05.656640 1657011 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-776336
I0520 11:21:05.656704 1657011 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-776336
I0520 11:21:05.695045 1657011 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:40787 SSHKeyPath:/home/jenkins/minikube-integration/18925-1463640/.minikube/machines/old-k8s-version-776336/id_rsa Username:docker}
I0520 11:21:05.702675 1657011 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:40787 SSHKeyPath:/home/jenkins/minikube-integration/18925-1463640/.minikube/machines/old-k8s-version-776336/id_rsa Username:docker}
I0520 11:21:05.797610 1657011 ssh_runner.go:195] Run: systemctl --version
I0520 11:21:05.927879 1657011 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0520 11:21:06.085285 1657011 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I0520 11:21:06.091325 1657011 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0520 11:21:06.102209 1657011 cni.go:221] loopback cni configuration disabled: "/etc/cni/net.d/*loopback.conf*" found
I0520 11:21:06.102353 1657011 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0520 11:21:06.112655 1657011 cni.go:259] no active bridge cni configs found in "/etc/cni/net.d" - nothing to disable
I0520 11:21:06.112723 1657011 start.go:494] detecting cgroup driver to use...
I0520 11:21:06.112782 1657011 detect.go:196] detected "cgroupfs" cgroup driver on host os
I0520 11:21:06.112849 1657011 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0520 11:21:06.129063 1657011 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0520 11:21:06.142765 1657011 docker.go:217] disabling cri-docker service (if available) ...
I0520 11:21:06.142914 1657011 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0520 11:21:06.160946 1657011 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0520 11:21:06.178041 1657011 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0520 11:21:06.285244 1657011 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0520 11:21:06.396250 1657011 docker.go:233] disabling docker service ...
I0520 11:21:06.396398 1657011 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0520 11:21:06.415889 1657011 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0520 11:21:06.428579 1657011 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0520 11:21:06.520055 1657011 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0520 11:21:06.650626 1657011 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0520 11:21:06.664246 1657011 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0520 11:21:06.689910 1657011 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.2" pause image...
I0520 11:21:06.689993 1657011 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.2"|' /etc/crio/crio.conf.d/02-crio.conf"
I0520 11:21:06.700749 1657011 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0520 11:21:06.700888 1657011 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0520 11:21:06.710732 1657011 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0520 11:21:06.722785 1657011 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0520 11:21:06.734897 1657011 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0520 11:21:06.744826 1657011 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0520 11:21:06.754423 1657011 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0520 11:21:06.764403 1657011 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0520 11:21:06.863732 1657011 ssh_runner.go:195] Run: sudo systemctl restart crio
I0520 11:21:07.035589 1657011 start.go:541] Will wait 60s for socket path /var/run/crio/crio.sock
I0520 11:21:07.035680 1657011 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0520 11:21:07.040886 1657011 start.go:562] Will wait 60s for crictl version
I0520 11:21:07.040959 1657011 ssh_runner.go:195] Run: which crictl
I0520 11:21:07.045046 1657011 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0520 11:21:07.084778 1657011 start.go:578] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.24.6
RuntimeApiVersion: v1
I0520 11:21:07.084870 1657011 ssh_runner.go:195] Run: crio --version
I0520 11:21:07.133380 1657011 ssh_runner.go:195] Run: crio --version
I0520 11:21:07.192987 1657011 out.go:177] * Preparing Kubernetes v1.20.0 on CRI-O 1.24.6 ...
I0520 11:21:07.194489 1657011 cli_runner.go:164] Run: docker network inspect old-k8s-version-776336 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0520 11:21:07.210305 1657011 ssh_runner.go:195] Run: grep 192.168.76.1 host.minikube.internal$ /etc/hosts
I0520 11:21:07.213980 1657011 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.76.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0520 11:21:07.225326 1657011 kubeadm.go:877] updating cluster {Name:old-k8s-version-776336 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1715707529-18887@sha256:734a2adad159415bd51b0392bc8976bd7e3e543e9165c2374d6e59bac37aed3a Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-776336 Namespace:default APIServerHAVIP: APIServerName:minik
ubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins
:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0520 11:21:07.225463 1657011 preload.go:132] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0520 11:21:07.225522 1657011 ssh_runner.go:195] Run: sudo crictl images --output json
I0520 11:21:07.280525 1657011 crio.go:514] all images are preloaded for cri-o runtime.
I0520 11:21:07.280547 1657011 crio.go:433] Images already preloaded, skipping extraction
I0520 11:21:07.280609 1657011 ssh_runner.go:195] Run: sudo crictl images --output json
I0520 11:21:07.331602 1657011 crio.go:514] all images are preloaded for cri-o runtime.
I0520 11:21:07.331676 1657011 cache_images.go:84] Images are preloaded, skipping loading
I0520 11:21:07.331702 1657011 kubeadm.go:928] updating node { 192.168.76.2 8443 v1.20.0 crio true true} ...
I0520 11:21:07.331835 1657011 kubeadm.go:940] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --cgroups-per-qos=false --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///var/run/crio/crio.sock --enforce-node-allocatable= --hostname-override=old-k8s-version-776336 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.76.2
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-776336 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0520 11:21:07.331950 1657011 ssh_runner.go:195] Run: crio config
I0520 11:21:07.410949 1657011 cni.go:84] Creating CNI manager for ""
I0520 11:21:07.410983 1657011 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
I0520 11:21:07.411011 1657011 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0520 11:21:07.411042 1657011 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.76.2 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-776336 NodeName:old-k8s-version-776336 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.76.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.76.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPo
dPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0520 11:21:07.411258 1657011 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.76.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/crio/crio.sock
name: "old-k8s-version-776336"
kubeletExtraArgs:
node-ip: 192.168.76.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.76.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0520 11:21:07.411359 1657011 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0520 11:21:07.421969 1657011 binaries.go:44] Found k8s binaries, skipping transfer
I0520 11:21:07.422100 1657011 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0520 11:21:07.432274 1657011 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (480 bytes)
I0520 11:21:07.455808 1657011 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0520 11:21:07.478739 1657011 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2117 bytes)
I0520 11:21:07.500505 1657011 ssh_runner.go:195] Run: grep 192.168.76.2 control-plane.minikube.internal$ /etc/hosts
I0520 11:21:07.504330 1657011 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.76.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0520 11:21:07.517902 1657011 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0520 11:21:07.648696 1657011 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0520 11:21:07.665058 1657011 certs.go:68] Setting up /home/jenkins/minikube-integration/18925-1463640/.minikube/profiles/old-k8s-version-776336 for IP: 192.168.76.2
I0520 11:21:07.665081 1657011 certs.go:194] generating shared ca certs ...
I0520 11:21:07.665099 1657011 certs.go:226] acquiring lock for ca certs: {Name:mke113fbac30e255083f63bab9dafb629ead7667 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0520 11:21:07.665286 1657011 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/18925-1463640/.minikube/ca.key
I0520 11:21:07.665354 1657011 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/18925-1463640/.minikube/proxy-client-ca.key
I0520 11:21:07.665369 1657011 certs.go:256] generating profile certs ...
I0520 11:21:07.665492 1657011 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/18925-1463640/.minikube/profiles/old-k8s-version-776336/client.key
I0520 11:21:07.665593 1657011 certs.go:359] skipping valid signed profile cert regeneration for "minikube": /home/jenkins/minikube-integration/18925-1463640/.minikube/profiles/old-k8s-version-776336/apiserver.key.c4a6d18b
I0520 11:21:07.665691 1657011 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/18925-1463640/.minikube/profiles/old-k8s-version-776336/proxy-client.key
I0520 11:21:07.665854 1657011 certs.go:484] found cert: /home/jenkins/minikube-integration/18925-1463640/.minikube/certs/1469078.pem (1338 bytes)
W0520 11:21:07.665915 1657011 certs.go:480] ignoring /home/jenkins/minikube-integration/18925-1463640/.minikube/certs/1469078_empty.pem, impossibly tiny 0 bytes
I0520 11:21:07.665930 1657011 certs.go:484] found cert: /home/jenkins/minikube-integration/18925-1463640/.minikube/certs/ca-key.pem (1679 bytes)
I0520 11:21:07.665982 1657011 certs.go:484] found cert: /home/jenkins/minikube-integration/18925-1463640/.minikube/certs/ca.pem (1082 bytes)
I0520 11:21:07.666040 1657011 certs.go:484] found cert: /home/jenkins/minikube-integration/18925-1463640/.minikube/certs/cert.pem (1123 bytes)
I0520 11:21:07.666074 1657011 certs.go:484] found cert: /home/jenkins/minikube-integration/18925-1463640/.minikube/certs/key.pem (1679 bytes)
I0520 11:21:07.666150 1657011 certs.go:484] found cert: /home/jenkins/minikube-integration/18925-1463640/.minikube/files/etc/ssl/certs/14690782.pem (1708 bytes)
I0520 11:21:07.666889 1657011 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18925-1463640/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0520 11:21:07.702833 1657011 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18925-1463640/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0520 11:21:07.811701 1657011 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18925-1463640/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0520 11:21:07.910943 1657011 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18925-1463640/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0520 11:21:07.946026 1657011 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18925-1463640/.minikube/profiles/old-k8s-version-776336/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0520 11:21:07.987649 1657011 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18925-1463640/.minikube/profiles/old-k8s-version-776336/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0520 11:21:08.025634 1657011 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18925-1463640/.minikube/profiles/old-k8s-version-776336/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0520 11:21:08.056884 1657011 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18925-1463640/.minikube/profiles/old-k8s-version-776336/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0520 11:21:08.088469 1657011 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18925-1463640/.minikube/certs/1469078.pem --> /usr/share/ca-certificates/1469078.pem (1338 bytes)
I0520 11:21:08.120919 1657011 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18925-1463640/.minikube/files/etc/ssl/certs/14690782.pem --> /usr/share/ca-certificates/14690782.pem (1708 bytes)
I0520 11:21:08.147334 1657011 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18925-1463640/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0520 11:21:08.175553 1657011 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0520 11:21:08.194661 1657011 ssh_runner.go:195] Run: openssl version
I0520 11:21:08.200856 1657011 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0520 11:21:08.211372 1657011 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0520 11:21:08.215048 1657011 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 May 20 10:25 /usr/share/ca-certificates/minikubeCA.pem
I0520 11:21:08.215161 1657011 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0520 11:21:08.222285 1657011 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0520 11:21:08.231733 1657011 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/1469078.pem && ln -fs /usr/share/ca-certificates/1469078.pem /etc/ssl/certs/1469078.pem"
I0520 11:21:08.241740 1657011 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/1469078.pem
I0520 11:21:08.245279 1657011 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 May 20 10:36 /usr/share/ca-certificates/1469078.pem
I0520 11:21:08.245388 1657011 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/1469078.pem
I0520 11:21:08.253320 1657011 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/1469078.pem /etc/ssl/certs/51391683.0"
I0520 11:21:08.263697 1657011 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/14690782.pem && ln -fs /usr/share/ca-certificates/14690782.pem /etc/ssl/certs/14690782.pem"
I0520 11:21:08.273797 1657011 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/14690782.pem
I0520 11:21:08.277321 1657011 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 May 20 10:36 /usr/share/ca-certificates/14690782.pem
I0520 11:21:08.277408 1657011 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/14690782.pem
I0520 11:21:08.284978 1657011 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/14690782.pem /etc/ssl/certs/3ec20f2e.0"
I0520 11:21:08.294599 1657011 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0520 11:21:08.299134 1657011 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
I0520 11:21:08.310310 1657011 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
I0520 11:21:08.324821 1657011 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
I0520 11:21:08.332719 1657011 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
I0520 11:21:08.340916 1657011 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
I0520 11:21:08.349249 1657011 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
I0520 11:21:08.356755 1657011 kubeadm.go:391] StartCluster: {Name:old-k8s-version-776336 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1715707529-18887@sha256:734a2adad159415bd51b0392bc8976bd7e3e543e9165c2374d6e59bac37aed3a Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-776336 Namespace:default APIServerHAVIP: APIServerName:minikube
CA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/m
inikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0520 11:21:08.356864 1657011 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0520 11:21:08.356942 1657011 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0520 11:21:08.412532 1657011 cri.go:89] found id: ""
I0520 11:21:08.412643 1657011 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
W0520 11:21:08.422546 1657011 kubeadm.go:404] apiserver tunnel failed: apiserver port not set
I0520 11:21:08.422616 1657011 kubeadm.go:407] found existing configuration files, will attempt cluster restart
I0520 11:21:08.422635 1657011 kubeadm.go:587] restartPrimaryControlPlane start ...
I0520 11:21:08.422724 1657011 ssh_runner.go:195] Run: sudo test -d /data/minikube
I0520 11:21:08.432529 1657011 kubeadm.go:129] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
stdout:
stderr:
I0520 11:21:08.433031 1657011 kubeconfig.go:47] verify endpoint returned: get endpoint: "old-k8s-version-776336" does not appear in /home/jenkins/minikube-integration/18925-1463640/kubeconfig
I0520 11:21:08.433204 1657011 kubeconfig.go:62] /home/jenkins/minikube-integration/18925-1463640/kubeconfig needs updating (will repair): [kubeconfig missing "old-k8s-version-776336" cluster setting kubeconfig missing "old-k8s-version-776336" context setting]
I0520 11:21:08.433541 1657011 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18925-1463640/kubeconfig: {Name:mk86e76ecc665bde4f67c226ceb67716f06a54d8 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0520 11:21:08.435267 1657011 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
I0520 11:21:08.445111 1657011 kubeadm.go:624] The running cluster does not require reconfiguration: 192.168.76.2
I0520 11:21:08.445184 1657011 kubeadm.go:591] duration metric: took 22.529369ms to restartPrimaryControlPlane
I0520 11:21:08.445210 1657011 kubeadm.go:393] duration metric: took 88.47873ms to StartCluster
I0520 11:21:08.445254 1657011 settings.go:142] acquiring lock: {Name:mkcb442de9baf8dd2fb339ccf162868e80429e33 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0520 11:21:08.445332 1657011 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/18925-1463640/kubeconfig
I0520 11:21:08.446144 1657011 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18925-1463640/kubeconfig: {Name:mk86e76ecc665bde4f67c226ceb67716f06a54d8 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0520 11:21:08.446433 1657011 start.go:234] Will wait 6m0s for node &{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I0520 11:21:08.448798 1657011 out.go:177] * Verifying Kubernetes components...
I0520 11:21:08.446858 1657011 addons.go:502] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:true default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volumesnapshots:false yakd:false]
I0520 11:21:08.447012 1657011 config.go:182] Loaded profile config "old-k8s-version-776336": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0520 11:21:08.450795 1657011 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0520 11:21:08.448963 1657011 addons.go:69] Setting storage-provisioner=true in profile "old-k8s-version-776336"
I0520 11:21:08.451022 1657011 addons.go:234] Setting addon storage-provisioner=true in "old-k8s-version-776336"
W0520 11:21:08.451052 1657011 addons.go:243] addon storage-provisioner should already be in state true
I0520 11:21:08.451103 1657011 host.go:66] Checking if "old-k8s-version-776336" exists ...
I0520 11:21:08.451627 1657011 cli_runner.go:164] Run: docker container inspect old-k8s-version-776336 --format={{.State.Status}}
I0520 11:21:08.448975 1657011 addons.go:69] Setting dashboard=true in profile "old-k8s-version-776336"
I0520 11:21:08.451791 1657011 addons.go:234] Setting addon dashboard=true in "old-k8s-version-776336"
W0520 11:21:08.451857 1657011 addons.go:243] addon dashboard should already be in state true
I0520 11:21:08.451906 1657011 host.go:66] Checking if "old-k8s-version-776336" exists ...
I0520 11:21:08.452350 1657011 cli_runner.go:164] Run: docker container inspect old-k8s-version-776336 --format={{.State.Status}}
I0520 11:21:08.448981 1657011 addons.go:69] Setting default-storageclass=true in profile "old-k8s-version-776336"
I0520 11:21:08.455982 1657011 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "old-k8s-version-776336"
I0520 11:21:08.448988 1657011 addons.go:69] Setting metrics-server=true in profile "old-k8s-version-776336"
I0520 11:21:08.456065 1657011 addons.go:234] Setting addon metrics-server=true in "old-k8s-version-776336"
W0520 11:21:08.456075 1657011 addons.go:243] addon metrics-server should already be in state true
I0520 11:21:08.456103 1657011 host.go:66] Checking if "old-k8s-version-776336" exists ...
I0520 11:21:08.456285 1657011 cli_runner.go:164] Run: docker container inspect old-k8s-version-776336 --format={{.State.Status}}
I0520 11:21:08.456523 1657011 cli_runner.go:164] Run: docker container inspect old-k8s-version-776336 --format={{.State.Status}}
I0520 11:21:08.503611 1657011 out.go:177] - Using image registry.k8s.io/echoserver:1.4
I0520 11:21:08.505494 1657011 out.go:177] - Using image docker.io/kubernetesui/dashboard:v2.7.0
I0520 11:21:08.512481 1657011 addons.go:426] installing /etc/kubernetes/addons/dashboard-ns.yaml
I0520 11:21:08.512510 1657011 ssh_runner.go:362] scp dashboard/dashboard-ns.yaml --> /etc/kubernetes/addons/dashboard-ns.yaml (759 bytes)
I0520 11:21:08.512581 1657011 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-776336
I0520 11:21:08.521732 1657011 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0520 11:21:08.529723 1657011 out.go:177] - Using image fake.domain/registry.k8s.io/echoserver:1.4
I0520 11:21:08.533728 1657011 addons.go:426] installing /etc/kubernetes/addons/metrics-apiservice.yaml
I0520 11:21:08.529910 1657011 addons.go:426] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0520 11:21:08.532325 1657011 addons.go:234] Setting addon default-storageclass=true in "old-k8s-version-776336"
W0520 11:21:08.533766 1657011 addons.go:243] addon default-storageclass should already be in state true
I0520 11:21:08.533774 1657011 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0520 11:21:08.533798 1657011 host.go:66] Checking if "old-k8s-version-776336" exists ...
I0520 11:21:08.533847 1657011 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-776336
I0520 11:21:08.534211 1657011 cli_runner.go:164] Run: docker container inspect old-k8s-version-776336 --format={{.State.Status}}
I0520 11:21:08.533762 1657011 ssh_runner.go:362] scp metrics-server/metrics-apiservice.yaml --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
I0520 11:21:08.534816 1657011 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-776336
I0520 11:21:08.561445 1657011 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:40787 SSHKeyPath:/home/jenkins/minikube-integration/18925-1463640/.minikube/machines/old-k8s-version-776336/id_rsa Username:docker}
I0520 11:21:08.588085 1657011 addons.go:426] installing /etc/kubernetes/addons/storageclass.yaml
I0520 11:21:08.588113 1657011 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0520 11:21:08.588187 1657011 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-776336
I0520 11:21:08.602068 1657011 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:40787 SSHKeyPath:/home/jenkins/minikube-integration/18925-1463640/.minikube/machines/old-k8s-version-776336/id_rsa Username:docker}
I0520 11:21:08.613850 1657011 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:40787 SSHKeyPath:/home/jenkins/minikube-integration/18925-1463640/.minikube/machines/old-k8s-version-776336/id_rsa Username:docker}
I0520 11:21:08.631581 1657011 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:40787 SSHKeyPath:/home/jenkins/minikube-integration/18925-1463640/.minikube/machines/old-k8s-version-776336/id_rsa Username:docker}
I0520 11:21:08.739082 1657011 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0520 11:21:08.764891 1657011 node_ready.go:35] waiting up to 6m0s for node "old-k8s-version-776336" to be "Ready" ...
I0520 11:21:08.800477 1657011 addons.go:426] installing /etc/kubernetes/addons/dashboard-clusterrole.yaml
I0520 11:21:08.800568 1657011 ssh_runner.go:362] scp dashboard/dashboard-clusterrole.yaml --> /etc/kubernetes/addons/dashboard-clusterrole.yaml (1001 bytes)
I0520 11:21:08.843461 1657011 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0520 11:21:08.851334 1657011 addons.go:426] installing /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml
I0520 11:21:08.851409 1657011 ssh_runner.go:362] scp dashboard/dashboard-clusterrolebinding.yaml --> /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml (1018 bytes)
I0520 11:21:08.917751 1657011 addons.go:426] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
I0520 11:21:08.917831 1657011 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1825 bytes)
I0520 11:21:08.937821 1657011 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0520 11:21:08.960190 1657011 addons.go:426] installing /etc/kubernetes/addons/dashboard-configmap.yaml
I0520 11:21:08.960279 1657011 ssh_runner.go:362] scp dashboard/dashboard-configmap.yaml --> /etc/kubernetes/addons/dashboard-configmap.yaml (837 bytes)
I0520 11:21:09.035872 1657011 addons.go:426] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
I0520 11:21:09.035953 1657011 ssh_runner.go:362] scp metrics-server/metrics-server-rbac.yaml --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
I0520 11:21:09.037756 1657011 addons.go:426] installing /etc/kubernetes/addons/dashboard-dp.yaml
I0520 11:21:09.037844 1657011 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-dp.yaml (4201 bytes)
I0520 11:21:09.148097 1657011 addons.go:426] installing /etc/kubernetes/addons/metrics-server-service.yaml
I0520 11:21:09.148174 1657011 ssh_runner.go:362] scp metrics-server/metrics-server-service.yaml --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
I0520 11:21:09.159370 1657011 addons.go:426] installing /etc/kubernetes/addons/dashboard-role.yaml
I0520 11:21:09.159440 1657011 ssh_runner.go:362] scp dashboard/dashboard-role.yaml --> /etc/kubernetes/addons/dashboard-role.yaml (1724 bytes)
W0520 11:21:09.199518 1657011 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 11:21:09.199650 1657011 retry.go:31] will retry after 349.299432ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0520 11:21:09.225793 1657011 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 11:21:09.225871 1657011 retry.go:31] will retry after 322.760295ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 11:21:09.246600 1657011 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0520 11:21:09.255342 1657011 addons.go:426] installing /etc/kubernetes/addons/dashboard-rolebinding.yaml
I0520 11:21:09.255428 1657011 ssh_runner.go:362] scp dashboard/dashboard-rolebinding.yaml --> /etc/kubernetes/addons/dashboard-rolebinding.yaml (1046 bytes)
I0520 11:21:09.315545 1657011 addons.go:426] installing /etc/kubernetes/addons/dashboard-sa.yaml
I0520 11:21:09.315635 1657011 ssh_runner.go:362] scp dashboard/dashboard-sa.yaml --> /etc/kubernetes/addons/dashboard-sa.yaml (837 bytes)
I0520 11:21:09.376865 1657011 addons.go:426] installing /etc/kubernetes/addons/dashboard-secret.yaml
I0520 11:21:09.376931 1657011 ssh_runner.go:362] scp dashboard/dashboard-secret.yaml --> /etc/kubernetes/addons/dashboard-secret.yaml (1389 bytes)
I0520 11:21:09.444471 1657011 addons.go:426] installing /etc/kubernetes/addons/dashboard-svc.yaml
I0520 11:21:09.444597 1657011 ssh_runner.go:362] scp dashboard/dashboard-svc.yaml --> /etc/kubernetes/addons/dashboard-svc.yaml (1294 bytes)
W0520 11:21:09.447357 1657011 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 11:21:09.447454 1657011 retry.go:31] will retry after 165.756904ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 11:21:09.479582 1657011 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0520 11:21:09.549638 1657011 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I0520 11:21:09.549784 1657011 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0520 11:21:09.580846 1657011 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 11:21:09.580881 1657011 retry.go:31] will retry after 242.226239ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 11:21:09.614159 1657011 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0520 11:21:09.679350 1657011 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 11:21:09.679386 1657011 retry.go:31] will retry after 412.409677ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0520 11:21:09.699588 1657011 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 11:21:09.699622 1657011 retry.go:31] will retry after 369.828426ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0520 11:21:09.741117 1657011 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 11:21:09.741152 1657011 retry.go:31] will retry after 357.759751ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 11:21:09.824006 1657011 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0520 11:21:09.913428 1657011 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 11:21:09.913463 1657011 retry.go:31] will retry after 310.334701ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 11:21:10.069705 1657011 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I0520 11:21:10.092137 1657011 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I0520 11:21:10.099567 1657011 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0520 11:21:10.224556 1657011 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0520 11:21:10.263834 1657011 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 11:21:10.263894 1657011 retry.go:31] will retry after 606.429247ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0520 11:21:10.293228 1657011 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 11:21:10.293297 1657011 retry.go:31] will retry after 837.450796ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0520 11:21:10.293387 1657011 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 11:21:10.293403 1657011 retry.go:31] will retry after 281.84287ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0520 11:21:10.318094 1657011 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 11:21:10.318126 1657011 retry.go:31] will retry after 665.286348ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 11:21:10.575466 1657011 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0520 11:21:10.649802 1657011 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 11:21:10.649883 1657011 retry.go:31] will retry after 1.039769389s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 11:21:10.766426 1657011 node_ready.go:53] error getting node "old-k8s-version-776336": Get "https://192.168.76.2:8443/api/v1/nodes/old-k8s-version-776336": dial tcp 192.168.76.2:8443: connect: connection refused
I0520 11:21:10.870801 1657011 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0520 11:21:10.959202 1657011 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 11:21:10.959233 1657011 retry.go:31] will retry after 763.872743ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 11:21:10.984578 1657011 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0520 11:21:11.082742 1657011 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 11:21:11.082777 1657011 retry.go:31] will retry after 974.766668ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 11:21:11.130921 1657011 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0520 11:21:11.201959 1657011 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 11:21:11.202004 1657011 retry.go:31] will retry after 736.761943ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 11:21:11.689902 1657011 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0520 11:21:11.723299 1657011 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0520 11:21:11.778061 1657011 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 11:21:11.778094 1657011 retry.go:31] will retry after 1.448174079s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0520 11:21:11.819486 1657011 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 11:21:11.819523 1657011 retry.go:31] will retry after 1.238034716s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 11:21:11.939785 1657011 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0520 11:21:12.047264 1657011 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 11:21:12.047296 1657011 retry.go:31] will retry after 1.867321261s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 11:21:12.058631 1657011 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0520 11:21:12.144303 1657011 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 11:21:12.144343 1657011 retry.go:31] will retry after 1.771793852s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 11:21:13.057845 1657011 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0520 11:21:13.128513 1657011 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 11:21:13.128559 1657011 retry.go:31] will retry after 2.390076235s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 11:21:13.226744 1657011 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0520 11:21:13.265701 1657011 node_ready.go:53] error getting node "old-k8s-version-776336": Get "https://192.168.76.2:8443/api/v1/nodes/old-k8s-version-776336": dial tcp 192.168.76.2:8443: connect: connection refused
W0520 11:21:13.312990 1657011 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 11:21:13.313025 1657011 retry.go:31] will retry after 1.489908337s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 11:21:13.915353 1657011 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I0520 11:21:13.916597 1657011 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0520 11:21:14.080904 1657011 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 11:21:14.080938 1657011 retry.go:31] will retry after 2.404769744s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0520 11:21:14.080990 1657011 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 11:21:14.081014 1657011 retry.go:31] will retry after 1.136852986s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 11:21:14.803704 1657011 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0520 11:21:14.883832 1657011 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 11:21:14.883867 1657011 retry.go:31] will retry after 2.485984396s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 11:21:15.218512 1657011 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0520 11:21:15.266227 1657011 node_ready.go:53] error getting node "old-k8s-version-776336": Get "https://192.168.76.2:8443/api/v1/nodes/old-k8s-version-776336": dial tcp 192.168.76.2:8443: connect: connection refused
W0520 11:21:15.297146 1657011 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 11:21:15.297235 1657011 retry.go:31] will retry after 2.854456986s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 11:21:15.519622 1657011 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0520 11:21:15.617385 1657011 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 11:21:15.617417 1657011 retry.go:31] will retry after 2.487422181s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 11:21:16.486385 1657011 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0520 11:21:16.573664 1657011 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 11:21:16.573696 1657011 retry.go:31] will retry after 2.715791777s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 11:21:17.370946 1657011 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0520 11:21:18.105537 1657011 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I0520 11:21:18.151885 1657011 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0520 11:21:19.289917 1657011 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I0520 11:21:26.846851 1657011 node_ready.go:49] node "old-k8s-version-776336" has status "Ready":"True"
I0520 11:21:26.846889 1657011 node_ready.go:38] duration metric: took 18.081905274s for node "old-k8s-version-776336" to be "Ready" ...
I0520 11:21:26.846901 1657011 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0520 11:21:27.239577 1657011 pod_ready.go:78] waiting up to 6m0s for pod "coredns-74ff55c5b-grqv6" in "kube-system" namespace to be "Ready" ...
I0520 11:21:27.423469 1657011 pod_ready.go:92] pod "coredns-74ff55c5b-grqv6" in "kube-system" namespace has status "Ready":"True"
I0520 11:21:27.423544 1657011 pod_ready.go:81] duration metric: took 183.864981ms for pod "coredns-74ff55c5b-grqv6" in "kube-system" namespace to be "Ready" ...
I0520 11:21:27.423572 1657011 pod_ready.go:78] waiting up to 6m0s for pod "etcd-old-k8s-version-776336" in "kube-system" namespace to be "Ready" ...
I0520 11:21:27.896045 1657011 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (10.525057577s)
I0520 11:21:27.896151 1657011 addons.go:470] Verifying addon metrics-server=true in "old-k8s-version-776336"
I0520 11:21:27.904136 1657011 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: (9.798563409s)
I0520 11:21:28.207111 1657011 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: (10.055182504s)
I0520 11:21:28.210337 1657011 out.go:177] * Some dashboard features require the metrics-server addon. To enable all features please run:
minikube -p old-k8s-version-776336 addons enable metrics-server
I0520 11:21:28.207442 1657011 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: (8.917498672s)
I0520 11:21:28.227317 1657011 out.go:177] * Enabled addons: metrics-server, storage-provisioner, dashboard, default-storageclass
I0520 11:21:28.229033 1657011 addons.go:505] duration metric: took 19.782170878s for enable addons: enabled=[metrics-server storage-provisioner dashboard default-storageclass]
I0520 11:21:29.448191 1657011 pod_ready.go:102] pod "etcd-old-k8s-version-776336" in "kube-system" namespace has status "Ready":"False"
I0520 11:21:31.929850 1657011 pod_ready.go:102] pod "etcd-old-k8s-version-776336" in "kube-system" namespace has status "Ready":"False"
I0520 11:21:33.930860 1657011 pod_ready.go:102] pod "etcd-old-k8s-version-776336" in "kube-system" namespace has status "Ready":"False"
I0520 11:21:35.938903 1657011 pod_ready.go:102] pod "etcd-old-k8s-version-776336" in "kube-system" namespace has status "Ready":"False"
I0520 11:21:38.430945 1657011 pod_ready.go:102] pod "etcd-old-k8s-version-776336" in "kube-system" namespace has status "Ready":"False"
I0520 11:21:40.930027 1657011 pod_ready.go:102] pod "etcd-old-k8s-version-776336" in "kube-system" namespace has status "Ready":"False"
I0520 11:21:42.935139 1657011 pod_ready.go:102] pod "etcd-old-k8s-version-776336" in "kube-system" namespace has status "Ready":"False"
I0520 11:21:45.429888 1657011 pod_ready.go:102] pod "etcd-old-k8s-version-776336" in "kube-system" namespace has status "Ready":"False"
I0520 11:21:47.453333 1657011 pod_ready.go:102] pod "etcd-old-k8s-version-776336" in "kube-system" namespace has status "Ready":"False"
I0520 11:21:49.934917 1657011 pod_ready.go:102] pod "etcd-old-k8s-version-776336" in "kube-system" namespace has status "Ready":"False"
I0520 11:21:52.440302 1657011 pod_ready.go:102] pod "etcd-old-k8s-version-776336" in "kube-system" namespace has status "Ready":"False"
I0520 11:21:54.930391 1657011 pod_ready.go:102] pod "etcd-old-k8s-version-776336" in "kube-system" namespace has status "Ready":"False"
I0520 11:21:57.429693 1657011 pod_ready.go:102] pod "etcd-old-k8s-version-776336" in "kube-system" namespace has status "Ready":"False"
I0520 11:21:59.429891 1657011 pod_ready.go:102] pod "etcd-old-k8s-version-776336" in "kube-system" namespace has status "Ready":"False"
I0520 11:22:01.431748 1657011 pod_ready.go:102] pod "etcd-old-k8s-version-776336" in "kube-system" namespace has status "Ready":"False"
I0520 11:22:03.931594 1657011 pod_ready.go:102] pod "etcd-old-k8s-version-776336" in "kube-system" namespace has status "Ready":"False"
I0520 11:22:06.430454 1657011 pod_ready.go:102] pod "etcd-old-k8s-version-776336" in "kube-system" namespace has status "Ready":"False"
I0520 11:22:08.432656 1657011 pod_ready.go:102] pod "etcd-old-k8s-version-776336" in "kube-system" namespace has status "Ready":"False"
I0520 11:22:10.930638 1657011 pod_ready.go:102] pod "etcd-old-k8s-version-776336" in "kube-system" namespace has status "Ready":"False"
I0520 11:22:12.931011 1657011 pod_ready.go:102] pod "etcd-old-k8s-version-776336" in "kube-system" namespace has status "Ready":"False"
I0520 11:22:15.430348 1657011 pod_ready.go:102] pod "etcd-old-k8s-version-776336" in "kube-system" namespace has status "Ready":"False"
I0520 11:22:17.430827 1657011 pod_ready.go:102] pod "etcd-old-k8s-version-776336" in "kube-system" namespace has status "Ready":"False"
I0520 11:22:19.929880 1657011 pod_ready.go:102] pod "etcd-old-k8s-version-776336" in "kube-system" namespace has status "Ready":"False"
I0520 11:22:21.931177 1657011 pod_ready.go:102] pod "etcd-old-k8s-version-776336" in "kube-system" namespace has status "Ready":"False"
I0520 11:22:23.932568 1657011 pod_ready.go:102] pod "etcd-old-k8s-version-776336" in "kube-system" namespace has status "Ready":"False"
I0520 11:22:26.431806 1657011 pod_ready.go:102] pod "etcd-old-k8s-version-776336" in "kube-system" namespace has status "Ready":"False"
I0520 11:22:28.936644 1657011 pod_ready.go:102] pod "etcd-old-k8s-version-776336" in "kube-system" namespace has status "Ready":"False"
I0520 11:22:31.430220 1657011 pod_ready.go:102] pod "etcd-old-k8s-version-776336" in "kube-system" namespace has status "Ready":"False"
I0520 11:22:33.431604 1657011 pod_ready.go:102] pod "etcd-old-k8s-version-776336" in "kube-system" namespace has status "Ready":"False"
I0520 11:22:35.932737 1657011 pod_ready.go:102] pod "etcd-old-k8s-version-776336" in "kube-system" namespace has status "Ready":"False"
I0520 11:22:38.430021 1657011 pod_ready.go:102] pod "etcd-old-k8s-version-776336" in "kube-system" namespace has status "Ready":"False"
I0520 11:22:40.929116 1657011 pod_ready.go:102] pod "etcd-old-k8s-version-776336" in "kube-system" namespace has status "Ready":"False"
I0520 11:22:42.929565 1657011 pod_ready.go:102] pod "etcd-old-k8s-version-776336" in "kube-system" namespace has status "Ready":"False"
I0520 11:22:43.429892 1657011 pod_ready.go:92] pod "etcd-old-k8s-version-776336" in "kube-system" namespace has status "Ready":"True"
I0520 11:22:43.429918 1657011 pod_ready.go:81] duration metric: took 1m16.006307183s for pod "etcd-old-k8s-version-776336" in "kube-system" namespace to be "Ready" ...
I0520 11:22:43.429932 1657011 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-old-k8s-version-776336" in "kube-system" namespace to be "Ready" ...
I0520 11:22:43.435357 1657011 pod_ready.go:92] pod "kube-apiserver-old-k8s-version-776336" in "kube-system" namespace has status "Ready":"True"
I0520 11:22:43.435383 1657011 pod_ready.go:81] duration metric: took 5.442109ms for pod "kube-apiserver-old-k8s-version-776336" in "kube-system" namespace to be "Ready" ...
I0520 11:22:43.435394 1657011 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-old-k8s-version-776336" in "kube-system" namespace to be "Ready" ...
I0520 11:22:45.441588 1657011 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-776336" in "kube-system" namespace has status "Ready":"False"
I0520 11:22:47.444715 1657011 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-776336" in "kube-system" namespace has status "Ready":"False"
I0520 11:22:48.442147 1657011 pod_ready.go:92] pod "kube-controller-manager-old-k8s-version-776336" in "kube-system" namespace has status "Ready":"True"
I0520 11:22:48.442173 1657011 pod_ready.go:81] duration metric: took 5.006771016s for pod "kube-controller-manager-old-k8s-version-776336" in "kube-system" namespace to be "Ready" ...
I0520 11:22:48.442186 1657011 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-f5jcm" in "kube-system" namespace to be "Ready" ...
I0520 11:22:48.447307 1657011 pod_ready.go:92] pod "kube-proxy-f5jcm" in "kube-system" namespace has status "Ready":"True"
I0520 11:22:48.447335 1657011 pod_ready.go:81] duration metric: took 5.141464ms for pod "kube-proxy-f5jcm" in "kube-system" namespace to be "Ready" ...
I0520 11:22:48.447348 1657011 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-old-k8s-version-776336" in "kube-system" namespace to be "Ready" ...
I0520 11:22:50.453181 1657011 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-776336" in "kube-system" namespace has status "Ready":"False"
I0520 11:22:52.453245 1657011 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-776336" in "kube-system" namespace has status "Ready":"False"
I0520 11:22:53.453684 1657011 pod_ready.go:92] pod "kube-scheduler-old-k8s-version-776336" in "kube-system" namespace has status "Ready":"True"
I0520 11:22:53.453707 1657011 pod_ready.go:81] duration metric: took 5.006351238s for pod "kube-scheduler-old-k8s-version-776336" in "kube-system" namespace to be "Ready" ...
I0520 11:22:53.453720 1657011 pod_ready.go:78] waiting up to 6m0s for pod "metrics-server-9975d5f86-qdks4" in "kube-system" namespace to be "Ready" ...
I0520 11:22:55.460408 1657011 pod_ready.go:102] pod "metrics-server-9975d5f86-qdks4" in "kube-system" namespace has status "Ready":"False"
I0520 11:22:57.960579 1657011 pod_ready.go:102] pod "metrics-server-9975d5f86-qdks4" in "kube-system" namespace has status "Ready":"False"
I0520 11:23:00.460592 1657011 pod_ready.go:102] pod "metrics-server-9975d5f86-qdks4" in "kube-system" namespace has status "Ready":"False"
I0520 11:23:02.461451 1657011 pod_ready.go:102] pod "metrics-server-9975d5f86-qdks4" in "kube-system" namespace has status "Ready":"False"
I0520 11:23:04.960310 1657011 pod_ready.go:102] pod "metrics-server-9975d5f86-qdks4" in "kube-system" namespace has status "Ready":"False"
I0520 11:23:07.460291 1657011 pod_ready.go:102] pod "metrics-server-9975d5f86-qdks4" in "kube-system" namespace has status "Ready":"False"
I0520 11:23:09.961363 1657011 pod_ready.go:102] pod "metrics-server-9975d5f86-qdks4" in "kube-system" namespace has status "Ready":"False"
I0520 11:23:11.961420 1657011 pod_ready.go:102] pod "metrics-server-9975d5f86-qdks4" in "kube-system" namespace has status "Ready":"False"
I0520 11:23:14.469063 1657011 pod_ready.go:102] pod "metrics-server-9975d5f86-qdks4" in "kube-system" namespace has status "Ready":"False"
I0520 11:23:16.960336 1657011 pod_ready.go:102] pod "metrics-server-9975d5f86-qdks4" in "kube-system" namespace has status "Ready":"False"
I0520 11:23:18.961998 1657011 pod_ready.go:102] pod "metrics-server-9975d5f86-qdks4" in "kube-system" namespace has status "Ready":"False"
I0520 11:23:21.460527 1657011 pod_ready.go:102] pod "metrics-server-9975d5f86-qdks4" in "kube-system" namespace has status "Ready":"False"
I0520 11:23:23.465331 1657011 pod_ready.go:102] pod "metrics-server-9975d5f86-qdks4" in "kube-system" namespace has status "Ready":"False"
I0520 11:23:25.962459 1657011 pod_ready.go:102] pod "metrics-server-9975d5f86-qdks4" in "kube-system" namespace has status "Ready":"False"
I0520 11:23:28.460002 1657011 pod_ready.go:102] pod "metrics-server-9975d5f86-qdks4" in "kube-system" namespace has status "Ready":"False"
I0520 11:23:30.470083 1657011 pod_ready.go:102] pod "metrics-server-9975d5f86-qdks4" in "kube-system" namespace has status "Ready":"False"
I0520 11:23:32.959999 1657011 pod_ready.go:102] pod "metrics-server-9975d5f86-qdks4" in "kube-system" namespace has status "Ready":"False"
I0520 11:23:34.960744 1657011 pod_ready.go:102] pod "metrics-server-9975d5f86-qdks4" in "kube-system" namespace has status "Ready":"False"
I0520 11:23:36.964586 1657011 pod_ready.go:102] pod "metrics-server-9975d5f86-qdks4" in "kube-system" namespace has status "Ready":"False"
I0520 11:23:39.459457 1657011 pod_ready.go:102] pod "metrics-server-9975d5f86-qdks4" in "kube-system" namespace has status "Ready":"False"
I0520 11:23:41.459916 1657011 pod_ready.go:102] pod "metrics-server-9975d5f86-qdks4" in "kube-system" namespace has status "Ready":"False"
I0520 11:23:43.467088 1657011 pod_ready.go:102] pod "metrics-server-9975d5f86-qdks4" in "kube-system" namespace has status "Ready":"False"
I0520 11:23:45.959646 1657011 pod_ready.go:102] pod "metrics-server-9975d5f86-qdks4" in "kube-system" namespace has status "Ready":"False"
I0520 11:23:47.960397 1657011 pod_ready.go:102] pod "metrics-server-9975d5f86-qdks4" in "kube-system" namespace has status "Ready":"False"
I0520 11:23:49.960943 1657011 pod_ready.go:102] pod "metrics-server-9975d5f86-qdks4" in "kube-system" namespace has status "Ready":"False"
I0520 11:23:51.961202 1657011 pod_ready.go:102] pod "metrics-server-9975d5f86-qdks4" in "kube-system" namespace has status "Ready":"False"
I0520 11:23:54.459665 1657011 pod_ready.go:102] pod "metrics-server-9975d5f86-qdks4" in "kube-system" namespace has status "Ready":"False"
I0520 11:23:56.459759 1657011 pod_ready.go:102] pod "metrics-server-9975d5f86-qdks4" in "kube-system" namespace has status "Ready":"False"
I0520 11:23:58.460158 1657011 pod_ready.go:102] pod "metrics-server-9975d5f86-qdks4" in "kube-system" namespace has status "Ready":"False"
I0520 11:24:00.469282 1657011 pod_ready.go:102] pod "metrics-server-9975d5f86-qdks4" in "kube-system" namespace has status "Ready":"False"
I0520 11:24:02.961480 1657011 pod_ready.go:102] pod "metrics-server-9975d5f86-qdks4" in "kube-system" namespace has status "Ready":"False"
I0520 11:24:04.962348 1657011 pod_ready.go:102] pod "metrics-server-9975d5f86-qdks4" in "kube-system" namespace has status "Ready":"False"
I0520 11:24:06.963238 1657011 pod_ready.go:102] pod "metrics-server-9975d5f86-qdks4" in "kube-system" namespace has status "Ready":"False"
I0520 11:24:09.459541 1657011 pod_ready.go:102] pod "metrics-server-9975d5f86-qdks4" in "kube-system" namespace has status "Ready":"False"
I0520 11:24:11.459759 1657011 pod_ready.go:102] pod "metrics-server-9975d5f86-qdks4" in "kube-system" namespace has status "Ready":"False"
I0520 11:24:13.464852 1657011 pod_ready.go:102] pod "metrics-server-9975d5f86-qdks4" in "kube-system" namespace has status "Ready":"False"
I0520 11:24:15.960315 1657011 pod_ready.go:102] pod "metrics-server-9975d5f86-qdks4" in "kube-system" namespace has status "Ready":"False"
I0520 11:24:17.984793 1657011 pod_ready.go:102] pod "metrics-server-9975d5f86-qdks4" in "kube-system" namespace has status "Ready":"False"
I0520 11:24:20.459562 1657011 pod_ready.go:102] pod "metrics-server-9975d5f86-qdks4" in "kube-system" namespace has status "Ready":"False"
I0520 11:24:22.959892 1657011 pod_ready.go:102] pod "metrics-server-9975d5f86-qdks4" in "kube-system" namespace has status "Ready":"False"
I0520 11:24:24.961724 1657011 pod_ready.go:102] pod "metrics-server-9975d5f86-qdks4" in "kube-system" namespace has status "Ready":"False"
I0520 11:24:26.961989 1657011 pod_ready.go:102] pod "metrics-server-9975d5f86-qdks4" in "kube-system" namespace has status "Ready":"False"
I0520 11:24:29.459873 1657011 pod_ready.go:102] pod "metrics-server-9975d5f86-qdks4" in "kube-system" namespace has status "Ready":"False"
I0520 11:24:31.459945 1657011 pod_ready.go:102] pod "metrics-server-9975d5f86-qdks4" in "kube-system" namespace has status "Ready":"False"
I0520 11:24:33.460515 1657011 pod_ready.go:102] pod "metrics-server-9975d5f86-qdks4" in "kube-system" namespace has status "Ready":"False"
I0520 11:24:35.461080 1657011 pod_ready.go:102] pod "metrics-server-9975d5f86-qdks4" in "kube-system" namespace has status "Ready":"False"
I0520 11:24:37.961004 1657011 pod_ready.go:102] pod "metrics-server-9975d5f86-qdks4" in "kube-system" namespace has status "Ready":"False"
I0520 11:24:40.459835 1657011 pod_ready.go:102] pod "metrics-server-9975d5f86-qdks4" in "kube-system" namespace has status "Ready":"False"
I0520 11:24:42.460277 1657011 pod_ready.go:102] pod "metrics-server-9975d5f86-qdks4" in "kube-system" namespace has status "Ready":"False"
I0520 11:24:44.460663 1657011 pod_ready.go:102] pod "metrics-server-9975d5f86-qdks4" in "kube-system" namespace has status "Ready":"False"
I0520 11:24:46.961021 1657011 pod_ready.go:102] pod "metrics-server-9975d5f86-qdks4" in "kube-system" namespace has status "Ready":"False"
I0520 11:24:49.460382 1657011 pod_ready.go:102] pod "metrics-server-9975d5f86-qdks4" in "kube-system" namespace has status "Ready":"False"
I0520 11:24:51.960497 1657011 pod_ready.go:102] pod "metrics-server-9975d5f86-qdks4" in "kube-system" namespace has status "Ready":"False"
I0520 11:24:53.961478 1657011 pod_ready.go:102] pod "metrics-server-9975d5f86-qdks4" in "kube-system" namespace has status "Ready":"False"
I0520 11:24:56.459744 1657011 pod_ready.go:102] pod "metrics-server-9975d5f86-qdks4" in "kube-system" namespace has status "Ready":"False"
I0520 11:24:58.459895 1657011 pod_ready.go:102] pod "metrics-server-9975d5f86-qdks4" in "kube-system" namespace has status "Ready":"False"
I0520 11:25:00.461536 1657011 pod_ready.go:102] pod "metrics-server-9975d5f86-qdks4" in "kube-system" namespace has status "Ready":"False"
I0520 11:25:02.960842 1657011 pod_ready.go:102] pod "metrics-server-9975d5f86-qdks4" in "kube-system" namespace has status "Ready":"False"
I0520 11:25:04.962221 1657011 pod_ready.go:102] pod "metrics-server-9975d5f86-qdks4" in "kube-system" namespace has status "Ready":"False"
I0520 11:25:07.460632 1657011 pod_ready.go:102] pod "metrics-server-9975d5f86-qdks4" in "kube-system" namespace has status "Ready":"False"
I0520 11:25:09.460701 1657011 pod_ready.go:102] pod "metrics-server-9975d5f86-qdks4" in "kube-system" namespace has status "Ready":"False"
I0520 11:25:11.960364 1657011 pod_ready.go:102] pod "metrics-server-9975d5f86-qdks4" in "kube-system" namespace has status "Ready":"False"
I0520 11:25:14.460438 1657011 pod_ready.go:102] pod "metrics-server-9975d5f86-qdks4" in "kube-system" namespace has status "Ready":"False"
I0520 11:25:16.960303 1657011 pod_ready.go:102] pod "metrics-server-9975d5f86-qdks4" in "kube-system" namespace has status "Ready":"False"
I0520 11:25:19.460034 1657011 pod_ready.go:102] pod "metrics-server-9975d5f86-qdks4" in "kube-system" namespace has status "Ready":"False"
I0520 11:25:21.959756 1657011 pod_ready.go:102] pod "metrics-server-9975d5f86-qdks4" in "kube-system" namespace has status "Ready":"False"
I0520 11:25:23.960250 1657011 pod_ready.go:102] pod "metrics-server-9975d5f86-qdks4" in "kube-system" namespace has status "Ready":"False"
I0520 11:25:26.460584 1657011 pod_ready.go:102] pod "metrics-server-9975d5f86-qdks4" in "kube-system" namespace has status "Ready":"False"
I0520 11:25:28.460632 1657011 pod_ready.go:102] pod "metrics-server-9975d5f86-qdks4" in "kube-system" namespace has status "Ready":"False"
I0520 11:25:30.961098 1657011 pod_ready.go:102] pod "metrics-server-9975d5f86-qdks4" in "kube-system" namespace has status "Ready":"False"
I0520 11:25:33.459149 1657011 pod_ready.go:102] pod "metrics-server-9975d5f86-qdks4" in "kube-system" namespace has status "Ready":"False"
I0520 11:25:35.460844 1657011 pod_ready.go:102] pod "metrics-server-9975d5f86-qdks4" in "kube-system" namespace has status "Ready":"False"
I0520 11:25:37.959845 1657011 pod_ready.go:102] pod "metrics-server-9975d5f86-qdks4" in "kube-system" namespace has status "Ready":"False"
I0520 11:25:39.960767 1657011 pod_ready.go:102] pod "metrics-server-9975d5f86-qdks4" in "kube-system" namespace has status "Ready":"False"
I0520 11:25:42.465130 1657011 pod_ready.go:102] pod "metrics-server-9975d5f86-qdks4" in "kube-system" namespace has status "Ready":"False"
I0520 11:25:44.960612 1657011 pod_ready.go:102] pod "metrics-server-9975d5f86-qdks4" in "kube-system" namespace has status "Ready":"False"
I0520 11:25:46.961023 1657011 pod_ready.go:102] pod "metrics-server-9975d5f86-qdks4" in "kube-system" namespace has status "Ready":"False"
I0520 11:25:49.459860 1657011 pod_ready.go:102] pod "metrics-server-9975d5f86-qdks4" in "kube-system" namespace has status "Ready":"False"
I0520 11:25:51.460063 1657011 pod_ready.go:102] pod "metrics-server-9975d5f86-qdks4" in "kube-system" namespace has status "Ready":"False"
I0520 11:25:53.960417 1657011 pod_ready.go:102] pod "metrics-server-9975d5f86-qdks4" in "kube-system" namespace has status "Ready":"False"
I0520 11:25:56.460157 1657011 pod_ready.go:102] pod "metrics-server-9975d5f86-qdks4" in "kube-system" namespace has status "Ready":"False"
I0520 11:25:58.960740 1657011 pod_ready.go:102] pod "metrics-server-9975d5f86-qdks4" in "kube-system" namespace has status "Ready":"False"
I0520 11:26:01.459801 1657011 pod_ready.go:102] pod "metrics-server-9975d5f86-qdks4" in "kube-system" namespace has status "Ready":"False"
I0520 11:26:03.961025 1657011 pod_ready.go:102] pod "metrics-server-9975d5f86-qdks4" in "kube-system" namespace has status "Ready":"False"
I0520 11:26:06.459923 1657011 pod_ready.go:102] pod "metrics-server-9975d5f86-qdks4" in "kube-system" namespace has status "Ready":"False"
I0520 11:26:08.460480 1657011 pod_ready.go:102] pod "metrics-server-9975d5f86-qdks4" in "kube-system" namespace has status "Ready":"False"
I0520 11:26:10.960749 1657011 pod_ready.go:102] pod "metrics-server-9975d5f86-qdks4" in "kube-system" namespace has status "Ready":"False"
I0520 11:26:13.460226 1657011 pod_ready.go:102] pod "metrics-server-9975d5f86-qdks4" in "kube-system" namespace has status "Ready":"False"
I0520 11:26:15.460581 1657011 pod_ready.go:102] pod "metrics-server-9975d5f86-qdks4" in "kube-system" namespace has status "Ready":"False"
I0520 11:26:17.960723 1657011 pod_ready.go:102] pod "metrics-server-9975d5f86-qdks4" in "kube-system" namespace has status "Ready":"False"
I0520 11:26:19.963881 1657011 pod_ready.go:102] pod "metrics-server-9975d5f86-qdks4" in "kube-system" namespace has status "Ready":"False"
I0520 11:26:22.460340 1657011 pod_ready.go:102] pod "metrics-server-9975d5f86-qdks4" in "kube-system" namespace has status "Ready":"False"
I0520 11:26:24.460460 1657011 pod_ready.go:102] pod "metrics-server-9975d5f86-qdks4" in "kube-system" namespace has status "Ready":"False"
I0520 11:26:26.959649 1657011 pod_ready.go:102] pod "metrics-server-9975d5f86-qdks4" in "kube-system" namespace has status "Ready":"False"
I0520 11:26:29.460571 1657011 pod_ready.go:102] pod "metrics-server-9975d5f86-qdks4" in "kube-system" namespace has status "Ready":"False"
I0520 11:26:31.961575 1657011 pod_ready.go:102] pod "metrics-server-9975d5f86-qdks4" in "kube-system" namespace has status "Ready":"False"
I0520 11:26:34.460217 1657011 pod_ready.go:102] pod "metrics-server-9975d5f86-qdks4" in "kube-system" namespace has status "Ready":"False"
I0520 11:26:36.960497 1657011 pod_ready.go:102] pod "metrics-server-9975d5f86-qdks4" in "kube-system" namespace has status "Ready":"False"
I0520 11:26:39.459506 1657011 pod_ready.go:102] pod "metrics-server-9975d5f86-qdks4" in "kube-system" namespace has status "Ready":"False"
I0520 11:26:41.459556 1657011 pod_ready.go:102] pod "metrics-server-9975d5f86-qdks4" in "kube-system" namespace has status "Ready":"False"
I0520 11:26:43.460197 1657011 pod_ready.go:102] pod "metrics-server-9975d5f86-qdks4" in "kube-system" namespace has status "Ready":"False"
I0520 11:26:45.460974 1657011 pod_ready.go:102] pod "metrics-server-9975d5f86-qdks4" in "kube-system" namespace has status "Ready":"False"
I0520 11:26:47.961034 1657011 pod_ready.go:102] pod "metrics-server-9975d5f86-qdks4" in "kube-system" namespace has status "Ready":"False"
I0520 11:26:50.460261 1657011 pod_ready.go:102] pod "metrics-server-9975d5f86-qdks4" in "kube-system" namespace has status "Ready":"False"
I0520 11:26:52.960497 1657011 pod_ready.go:102] pod "metrics-server-9975d5f86-qdks4" in "kube-system" namespace has status "Ready":"False"
I0520 11:26:53.459870 1657011 pod_ready.go:81] duration metric: took 4m0.006138223s for pod "metrics-server-9975d5f86-qdks4" in "kube-system" namespace to be "Ready" ...
E0520 11:26:53.459893 1657011 pod_ready.go:66] WaitExtra: waitPodCondition: context deadline exceeded
I0520 11:26:53.459903 1657011 pod_ready.go:38] duration metric: took 5m26.612991586s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0520 11:26:53.459918 1657011 api_server.go:52] waiting for apiserver process to appear ...
I0520 11:26:53.459948 1657011 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0520 11:26:53.460029 1657011 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0520 11:26:53.512214 1657011 cri.go:89] found id: "0b14a0f156605ce747bbd3ec92b34eb3ecf92d995ef08cfe0d147e8a56eb0eb3"
I0520 11:26:53.512248 1657011 cri.go:89] found id: ""
I0520 11:26:53.512258 1657011 logs.go:276] 1 containers: [0b14a0f156605ce747bbd3ec92b34eb3ecf92d995ef08cfe0d147e8a56eb0eb3]
I0520 11:26:53.512331 1657011 ssh_runner.go:195] Run: which crictl
I0520 11:26:53.516251 1657011 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0520 11:26:53.516328 1657011 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0520 11:26:53.556211 1657011 cri.go:89] found id: "a0c29f0d3e719d5fdc0931e9109cfae19b3167c2b4e839f25c7b1b63784a02a4"
I0520 11:26:53.556234 1657011 cri.go:89] found id: ""
I0520 11:26:53.556243 1657011 logs.go:276] 1 containers: [a0c29f0d3e719d5fdc0931e9109cfae19b3167c2b4e839f25c7b1b63784a02a4]
I0520 11:26:53.556303 1657011 ssh_runner.go:195] Run: which crictl
I0520 11:26:53.559924 1657011 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0520 11:26:53.559997 1657011 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0520 11:26:53.609276 1657011 cri.go:89] found id: "e346471df6217fe773e2ef8f7b75f5b46cd71d6eb9cbc805448692e543b15853"
I0520 11:26:53.609300 1657011 cri.go:89] found id: ""
I0520 11:26:53.609308 1657011 logs.go:276] 1 containers: [e346471df6217fe773e2ef8f7b75f5b46cd71d6eb9cbc805448692e543b15853]
I0520 11:26:53.609365 1657011 ssh_runner.go:195] Run: which crictl
I0520 11:26:53.613170 1657011 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0520 11:26:53.613243 1657011 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0520 11:26:53.667196 1657011 cri.go:89] found id: "200301c79d92cc1dca51aa9d3818041786dbc0fc25722073be3c056ab8ddc40d"
I0520 11:26:53.667216 1657011 cri.go:89] found id: ""
I0520 11:26:53.667225 1657011 logs.go:276] 1 containers: [200301c79d92cc1dca51aa9d3818041786dbc0fc25722073be3c056ab8ddc40d]
I0520 11:26:53.667291 1657011 ssh_runner.go:195] Run: which crictl
I0520 11:26:53.671970 1657011 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0520 11:26:53.672079 1657011 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0520 11:26:53.728222 1657011 cri.go:89] found id: "b026cb8ba53f0d1f48335254f05077b2a31ee7e5a35af6a7b530c5f18dccae5a"
I0520 11:26:53.728245 1657011 cri.go:89] found id: ""
I0520 11:26:53.728253 1657011 logs.go:276] 1 containers: [b026cb8ba53f0d1f48335254f05077b2a31ee7e5a35af6a7b530c5f18dccae5a]
I0520 11:26:53.728311 1657011 ssh_runner.go:195] Run: which crictl
I0520 11:26:53.732459 1657011 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0520 11:26:53.732529 1657011 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0520 11:26:53.795721 1657011 cri.go:89] found id: "7f0c6c3acf70df9c58574fae04af747df228563cb3da7252a8324c5242528d4e"
I0520 11:26:53.795745 1657011 cri.go:89] found id: ""
I0520 11:26:53.795755 1657011 logs.go:276] 1 containers: [7f0c6c3acf70df9c58574fae04af747df228563cb3da7252a8324c5242528d4e]
I0520 11:26:53.795813 1657011 ssh_runner.go:195] Run: which crictl
I0520 11:26:53.799762 1657011 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0520 11:26:53.799828 1657011 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0520 11:26:53.854711 1657011 cri.go:89] found id: "b92863fb0bcbb6bb4f4fb5c32ac048568d8bea72be8749218a1c81ceb8dcbf67"
I0520 11:26:53.854734 1657011 cri.go:89] found id: ""
I0520 11:26:53.854743 1657011 logs.go:276] 1 containers: [b92863fb0bcbb6bb4f4fb5c32ac048568d8bea72be8749218a1c81ceb8dcbf67]
I0520 11:26:53.854797 1657011 ssh_runner.go:195] Run: which crictl
I0520 11:26:53.858901 1657011 cri.go:54] listing CRI containers in root : {State:all Name:storage-provisioner Namespaces:[]}
I0520 11:26:53.858974 1657011 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0520 11:26:53.917739 1657011 cri.go:89] found id: "80aac8daed1fe77959700c7a1f1a34853c09f3dbeb46648d0ab015345f91e607"
I0520 11:26:53.917766 1657011 cri.go:89] found id: ""
I0520 11:26:53.917774 1657011 logs.go:276] 1 containers: [80aac8daed1fe77959700c7a1f1a34853c09f3dbeb46648d0ab015345f91e607]
I0520 11:26:53.917830 1657011 ssh_runner.go:195] Run: which crictl
I0520 11:26:53.923141 1657011 cri.go:54] listing CRI containers in root : {State:all Name:kubernetes-dashboard Namespaces:[]}
I0520 11:26:53.923214 1657011 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I0520 11:26:53.978276 1657011 cri.go:89] found id: "478b985a70c80d44c1dc3a606124f6d8d1a1b16caa15815f4d319199182b0973"
I0520 11:26:53.978300 1657011 cri.go:89] found id: ""
I0520 11:26:53.978307 1657011 logs.go:276] 1 containers: [478b985a70c80d44c1dc3a606124f6d8d1a1b16caa15815f4d319199182b0973]
I0520 11:26:53.978364 1657011 ssh_runner.go:195] Run: which crictl
I0520 11:26:53.982146 1657011 logs.go:123] Gathering logs for coredns [e346471df6217fe773e2ef8f7b75f5b46cd71d6eb9cbc805448692e543b15853] ...
I0520 11:26:53.982173 1657011 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e346471df6217fe773e2ef8f7b75f5b46cd71d6eb9cbc805448692e543b15853"
I0520 11:26:54.050796 1657011 logs.go:123] Gathering logs for kube-scheduler [200301c79d92cc1dca51aa9d3818041786dbc0fc25722073be3c056ab8ddc40d] ...
I0520 11:26:54.050827 1657011 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 200301c79d92cc1dca51aa9d3818041786dbc0fc25722073be3c056ab8ddc40d"
I0520 11:26:54.107903 1657011 logs.go:123] Gathering logs for container status ...
I0520 11:26:54.107935 1657011 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0520 11:26:54.188486 1657011 logs.go:123] Gathering logs for kube-apiserver [0b14a0f156605ce747bbd3ec92b34eb3ecf92d995ef08cfe0d147e8a56eb0eb3] ...
I0520 11:26:54.188568 1657011 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 0b14a0f156605ce747bbd3ec92b34eb3ecf92d995ef08cfe0d147e8a56eb0eb3"
I0520 11:26:54.324072 1657011 logs.go:123] Gathering logs for kubernetes-dashboard [478b985a70c80d44c1dc3a606124f6d8d1a1b16caa15815f4d319199182b0973] ...
I0520 11:26:54.324107 1657011 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 478b985a70c80d44c1dc3a606124f6d8d1a1b16caa15815f4d319199182b0973"
I0520 11:26:54.392484 1657011 logs.go:123] Gathering logs for storage-provisioner [80aac8daed1fe77959700c7a1f1a34853c09f3dbeb46648d0ab015345f91e607] ...
I0520 11:26:54.392514 1657011 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 80aac8daed1fe77959700c7a1f1a34853c09f3dbeb46648d0ab015345f91e607"
I0520 11:26:54.451574 1657011 logs.go:123] Gathering logs for CRI-O ...
I0520 11:26:54.451601 1657011 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0520 11:26:54.560291 1657011 logs.go:123] Gathering logs for kube-proxy [b026cb8ba53f0d1f48335254f05077b2a31ee7e5a35af6a7b530c5f18dccae5a] ...
I0520 11:26:54.560368 1657011 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 b026cb8ba53f0d1f48335254f05077b2a31ee7e5a35af6a7b530c5f18dccae5a"
I0520 11:26:54.618045 1657011 logs.go:123] Gathering logs for kube-controller-manager [7f0c6c3acf70df9c58574fae04af747df228563cb3da7252a8324c5242528d4e] ...
I0520 11:26:54.618073 1657011 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 7f0c6c3acf70df9c58574fae04af747df228563cb3da7252a8324c5242528d4e"
I0520 11:26:54.712023 1657011 logs.go:123] Gathering logs for describe nodes ...
I0520 11:26:54.712071 1657011 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0520 11:26:54.921105 1657011 logs.go:123] Gathering logs for etcd [a0c29f0d3e719d5fdc0931e9109cfae19b3167c2b4e839f25c7b1b63784a02a4] ...
I0520 11:26:54.921136 1657011 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 a0c29f0d3e719d5fdc0931e9109cfae19b3167c2b4e839f25c7b1b63784a02a4"
I0520 11:26:54.992013 1657011 logs.go:123] Gathering logs for kindnet [b92863fb0bcbb6bb4f4fb5c32ac048568d8bea72be8749218a1c81ceb8dcbf67] ...
I0520 11:26:54.992090 1657011 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 b92863fb0bcbb6bb4f4fb5c32ac048568d8bea72be8749218a1c81ceb8dcbf67"
I0520 11:26:55.067881 1657011 logs.go:123] Gathering logs for kubelet ...
I0520 11:26:55.067944 1657011 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0520 11:26:55.133533 1657011 logs.go:138] Found kubelet problem: May 20 11:21:26 old-k8s-version-776336 kubelet[730]: E0520 11:21:26.809242 730 reflector.go:138] object-"kube-system"/"kube-proxy-token-dxbg4": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kube-proxy-token-dxbg4" is forbidden: User "system:node:old-k8s-version-776336" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-776336' and this object
W0520 11:26:55.133818 1657011 logs.go:138] Found kubelet problem: May 20 11:21:26 old-k8s-version-776336 kubelet[730]: E0520 11:21:26.815246 730 reflector.go:138] object-"kube-system"/"metrics-server-token-lstwk": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "metrics-server-token-lstwk" is forbidden: User "system:node:old-k8s-version-776336" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-776336' and this object
W0520 11:26:55.134043 1657011 logs.go:138] Found kubelet problem: May 20 11:21:26 old-k8s-version-776336 kubelet[730]: E0520 11:21:26.815362 730 reflector.go:138] object-"kube-system"/"kindnet-token-5d2mm": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kindnet-token-5d2mm" is forbidden: User "system:node:old-k8s-version-776336" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-776336' and this object
W0520 11:26:55.134255 1657011 logs.go:138] Found kubelet problem: May 20 11:21:26 old-k8s-version-776336 kubelet[730]: E0520 11:21:26.815419 730 reflector.go:138] object-"default"/"default-token-2c9fs": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "default-token-2c9fs" is forbidden: User "system:node:old-k8s-version-776336" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'old-k8s-version-776336' and this object
W0520 11:26:55.134465 1657011 logs.go:138] Found kubelet problem: May 20 11:21:26 old-k8s-version-776336 kubelet[730]: E0520 11:21:26.815480 730 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:old-k8s-version-776336" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-776336' and this object
W0520 11:26:55.134668 1657011 logs.go:138] Found kubelet problem: May 20 11:21:26 old-k8s-version-776336 kubelet[730]: E0520 11:21:26.815526 730 reflector.go:138] object-"kube-system"/"coredns": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:old-k8s-version-776336" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-776336' and this object
W0520 11:26:55.134881 1657011 logs.go:138] Found kubelet problem: May 20 11:21:26 old-k8s-version-776336 kubelet[730]: E0520 11:21:26.815596 730 reflector.go:138] object-"kube-system"/"coredns-token-8nh95": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "coredns-token-8nh95" is forbidden: User "system:node:old-k8s-version-776336" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-776336' and this object
W0520 11:26:55.135118 1657011 logs.go:138] Found kubelet problem: May 20 11:21:26 old-k8s-version-776336 kubelet[730]: E0520 11:21:26.818042 730 reflector.go:138] object-"kube-system"/"storage-provisioner-token-jt6tq": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "storage-provisioner-token-jt6tq" is forbidden: User "system:node:old-k8s-version-776336" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-776336' and this object
W0520 11:26:55.146321 1657011 logs.go:138] Found kubelet problem: May 20 11:21:30 old-k8s-version-776336 kubelet[730]: E0520 11:21:30.748462 730 pod_workers.go:191] Error syncing pod eb2910c3-cbac-462e-901e-4fb79caf95bf ("metrics-server-9975d5f86-qdks4_kube-system(eb2910c3-cbac-462e-901e-4fb79caf95bf)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0520 11:26:55.146532 1657011 logs.go:138] Found kubelet problem: May 20 11:21:31 old-k8s-version-776336 kubelet[730]: E0520 11:21:31.360081 730 pod_workers.go:191] Error syncing pod eb2910c3-cbac-462e-901e-4fb79caf95bf ("metrics-server-9975d5f86-qdks4_kube-system(eb2910c3-cbac-462e-901e-4fb79caf95bf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:26:55.148610 1657011 logs.go:138] Found kubelet problem: May 20 11:21:42 old-k8s-version-776336 kubelet[730]: E0520 11:21:42.354554 730 pod_workers.go:191] Error syncing pod eb2910c3-cbac-462e-901e-4fb79caf95bf ("metrics-server-9975d5f86-qdks4_kube-system(eb2910c3-cbac-462e-901e-4fb79caf95bf)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0520 11:26:55.151115 1657011 logs.go:138] Found kubelet problem: May 20 11:21:55 old-k8s-version-776336 kubelet[730]: E0520 11:21:55.457689 730 pod_workers.go:191] Error syncing pod 2c684adc-682c-4c95-a80c-90b35ac50afd ("dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"
W0520 11:26:55.151679 1657011 logs.go:138] Found kubelet problem: May 20 11:21:56 old-k8s-version-776336 kubelet[730]: E0520 11:21:56.460106 730 pod_workers.go:191] Error syncing pod 2c684adc-682c-4c95-a80c-90b35ac50afd ("dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"
W0520 11:26:55.151899 1657011 logs.go:138] Found kubelet problem: May 20 11:21:57 old-k8s-version-776336 kubelet[730]: E0520 11:21:57.311677 730 pod_workers.go:191] Error syncing pod eb2910c3-cbac-462e-901e-4fb79caf95bf ("metrics-server-9975d5f86-qdks4_kube-system(eb2910c3-cbac-462e-901e-4fb79caf95bf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:26:55.152294 1657011 logs.go:138] Found kubelet problem: May 20 11:22:02 old-k8s-version-776336 kubelet[730]: E0520 11:22:02.482262 730 pod_workers.go:191] Error syncing pod 2c684adc-682c-4c95-a80c-90b35ac50afd ("dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"
W0520 11:26:55.154737 1657011 logs.go:138] Found kubelet problem: May 20 11:22:08 old-k8s-version-776336 kubelet[730]: E0520 11:22:08.322783 730 pod_workers.go:191] Error syncing pod eb2910c3-cbac-462e-901e-4fb79caf95bf ("metrics-server-9975d5f86-qdks4_kube-system(eb2910c3-cbac-462e-901e-4fb79caf95bf)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0520 11:26:55.155443 1657011 logs.go:138] Found kubelet problem: May 20 11:22:17 old-k8s-version-776336 kubelet[730]: E0520 11:22:17.507098 730 pod_workers.go:191] Error syncing pod 2c684adc-682c-4c95-a80c-90b35ac50afd ("dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"
W0520 11:26:55.155816 1657011 logs.go:138] Found kubelet problem: May 20 11:22:22 old-k8s-version-776336 kubelet[730]: E0520 11:22:22.482798 730 pod_workers.go:191] Error syncing pod 2c684adc-682c-4c95-a80c-90b35ac50afd ("dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"
W0520 11:26:55.156031 1657011 logs.go:138] Found kubelet problem: May 20 11:22:23 old-k8s-version-776336 kubelet[730]: E0520 11:22:23.311553 730 pod_workers.go:191] Error syncing pod eb2910c3-cbac-462e-901e-4fb79caf95bf ("metrics-server-9975d5f86-qdks4_kube-system(eb2910c3-cbac-462e-901e-4fb79caf95bf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:26:55.156396 1657011 logs.go:138] Found kubelet problem: May 20 11:22:36 old-k8s-version-776336 kubelet[730]: E0520 11:22:36.311591 730 pod_workers.go:191] Error syncing pod 2c684adc-682c-4c95-a80c-90b35ac50afd ("dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"
W0520 11:26:55.156622 1657011 logs.go:138] Found kubelet problem: May 20 11:22:38 old-k8s-version-776336 kubelet[730]: E0520 11:22:38.312311 730 pod_workers.go:191] Error syncing pod eb2910c3-cbac-462e-901e-4fb79caf95bf ("metrics-server-9975d5f86-qdks4_kube-system(eb2910c3-cbac-462e-901e-4fb79caf95bf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:26:55.157224 1657011 logs.go:138] Found kubelet problem: May 20 11:22:47 old-k8s-version-776336 kubelet[730]: E0520 11:22:47.567324 730 pod_workers.go:191] Error syncing pod 2c684adc-682c-4c95-a80c-90b35ac50afd ("dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"
W0520 11:26:55.157559 1657011 logs.go:138] Found kubelet problem: May 20 11:22:52 old-k8s-version-776336 kubelet[730]: E0520 11:22:52.482120 730 pod_workers.go:191] Error syncing pod 2c684adc-682c-4c95-a80c-90b35ac50afd ("dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"
W0520 11:26:55.159827 1657011 logs.go:138] Found kubelet problem: May 20 11:22:53 old-k8s-version-776336 kubelet[730]: E0520 11:22:53.323112 730 pod_workers.go:191] Error syncing pod eb2910c3-cbac-462e-901e-4fb79caf95bf ("metrics-server-9975d5f86-qdks4_kube-system(eb2910c3-cbac-462e-901e-4fb79caf95bf)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0520 11:26:55.160225 1657011 logs.go:138] Found kubelet problem: May 20 11:23:05 old-k8s-version-776336 kubelet[730]: E0520 11:23:05.311216 730 pod_workers.go:191] Error syncing pod 2c684adc-682c-4c95-a80c-90b35ac50afd ("dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"
W0520 11:26:55.160435 1657011 logs.go:138] Found kubelet problem: May 20 11:23:05 old-k8s-version-776336 kubelet[730]: E0520 11:23:05.312235 730 pod_workers.go:191] Error syncing pod eb2910c3-cbac-462e-901e-4fb79caf95bf ("metrics-server-9975d5f86-qdks4_kube-system(eb2910c3-cbac-462e-901e-4fb79caf95bf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:26:55.160807 1657011 logs.go:138] Found kubelet problem: May 20 11:23:18 old-k8s-version-776336 kubelet[730]: E0520 11:23:18.311005 730 pod_workers.go:191] Error syncing pod 2c684adc-682c-4c95-a80c-90b35ac50afd ("dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"
W0520 11:26:55.161029 1657011 logs.go:138] Found kubelet problem: May 20 11:23:19 old-k8s-version-776336 kubelet[730]: E0520 11:23:19.311931 730 pod_workers.go:191] Error syncing pod eb2910c3-cbac-462e-901e-4fb79caf95bf ("metrics-server-9975d5f86-qdks4_kube-system(eb2910c3-cbac-462e-901e-4fb79caf95bf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:26:55.161510 1657011 logs.go:138] Found kubelet problem: May 20 11:23:34 old-k8s-version-776336 kubelet[730]: E0520 11:23:34.312149 730 pod_workers.go:191] Error syncing pod eb2910c3-cbac-462e-901e-4fb79caf95bf ("metrics-server-9975d5f86-qdks4_kube-system(eb2910c3-cbac-462e-901e-4fb79caf95bf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:26:55.161870 1657011 logs.go:138] Found kubelet problem: May 20 11:23:34 old-k8s-version-776336 kubelet[730]: E0520 11:23:34.647790 730 pod_workers.go:191] Error syncing pod 2c684adc-682c-4c95-a80c-90b35ac50afd ("dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"
W0520 11:26:55.162206 1657011 logs.go:138] Found kubelet problem: May 20 11:23:42 old-k8s-version-776336 kubelet[730]: E0520 11:23:42.482249 730 pod_workers.go:191] Error syncing pod 2c684adc-682c-4c95-a80c-90b35ac50afd ("dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"
W0520 11:26:55.162407 1657011 logs.go:138] Found kubelet problem: May 20 11:23:48 old-k8s-version-776336 kubelet[730]: E0520 11:23:48.311989 730 pod_workers.go:191] Error syncing pod eb2910c3-cbac-462e-901e-4fb79caf95bf ("metrics-server-9975d5f86-qdks4_kube-system(eb2910c3-cbac-462e-901e-4fb79caf95bf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:26:55.162742 1657011 logs.go:138] Found kubelet problem: May 20 11:23:54 old-k8s-version-776336 kubelet[730]: E0520 11:23:54.311066 730 pod_workers.go:191] Error syncing pod 2c684adc-682c-4c95-a80c-90b35ac50afd ("dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"
W0520 11:26:55.162934 1657011 logs.go:138] Found kubelet problem: May 20 11:24:02 old-k8s-version-776336 kubelet[730]: E0520 11:24:02.312243 730 pod_workers.go:191] Error syncing pod eb2910c3-cbac-462e-901e-4fb79caf95bf ("metrics-server-9975d5f86-qdks4_kube-system(eb2910c3-cbac-462e-901e-4fb79caf95bf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:26:55.163359 1657011 logs.go:138] Found kubelet problem: May 20 11:24:06 old-k8s-version-776336 kubelet[730]: E0520 11:24:06.313386 730 pod_workers.go:191] Error syncing pod 2c684adc-682c-4c95-a80c-90b35ac50afd ("dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"
W0520 11:26:55.166411 1657011 logs.go:138] Found kubelet problem: May 20 11:24:17 old-k8s-version-776336 kubelet[730]: E0520 11:24:17.319931 730 pod_workers.go:191] Error syncing pod eb2910c3-cbac-462e-901e-4fb79caf95bf ("metrics-server-9975d5f86-qdks4_kube-system(eb2910c3-cbac-462e-901e-4fb79caf95bf)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0520 11:26:55.166751 1657011 logs.go:138] Found kubelet problem: May 20 11:24:19 old-k8s-version-776336 kubelet[730]: E0520 11:24:19.310996 730 pod_workers.go:191] Error syncing pod 2c684adc-682c-4c95-a80c-90b35ac50afd ("dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"
W0520 11:26:55.166939 1657011 logs.go:138] Found kubelet problem: May 20 11:24:28 old-k8s-version-776336 kubelet[730]: E0520 11:24:28.311548 730 pod_workers.go:191] Error syncing pod eb2910c3-cbac-462e-901e-4fb79caf95bf ("metrics-server-9975d5f86-qdks4_kube-system(eb2910c3-cbac-462e-901e-4fb79caf95bf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:26:55.167275 1657011 logs.go:138] Found kubelet problem: May 20 11:24:32 old-k8s-version-776336 kubelet[730]: E0520 11:24:32.310984 730 pod_workers.go:191] Error syncing pod 2c684adc-682c-4c95-a80c-90b35ac50afd ("dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"
W0520 11:26:55.167608 1657011 logs.go:138] Found kubelet problem: May 20 11:24:43 old-k8s-version-776336 kubelet[730]: E0520 11:24:43.311302 730 pod_workers.go:191] Error syncing pod 2c684adc-682c-4c95-a80c-90b35ac50afd ("dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"
W0520 11:26:55.167796 1657011 logs.go:138] Found kubelet problem: May 20 11:24:43 old-k8s-version-776336 kubelet[730]: E0520 11:24:43.312650 730 pod_workers.go:191] Error syncing pod eb2910c3-cbac-462e-901e-4fb79caf95bf ("metrics-server-9975d5f86-qdks4_kube-system(eb2910c3-cbac-462e-901e-4fb79caf95bf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:26:55.168116 1657011 logs.go:138] Found kubelet problem: May 20 11:24:58 old-k8s-version-776336 kubelet[730]: E0520 11:24:58.313801 730 pod_workers.go:191] Error syncing pod eb2910c3-cbac-462e-901e-4fb79caf95bf ("metrics-server-9975d5f86-qdks4_kube-system(eb2910c3-cbac-462e-901e-4fb79caf95bf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:26:55.168578 1657011 logs.go:138] Found kubelet problem: May 20 11:24:59 old-k8s-version-776336 kubelet[730]: E0520 11:24:59.771509 730 pod_workers.go:191] Error syncing pod 2c684adc-682c-4c95-a80c-90b35ac50afd ("dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"
W0520 11:26:55.168911 1657011 logs.go:138] Found kubelet problem: May 20 11:25:02 old-k8s-version-776336 kubelet[730]: E0520 11:25:02.482351 730 pod_workers.go:191] Error syncing pod 2c684adc-682c-4c95-a80c-90b35ac50afd ("dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"
W0520 11:26:55.169100 1657011 logs.go:138] Found kubelet problem: May 20 11:25:13 old-k8s-version-776336 kubelet[730]: E0520 11:25:13.311740 730 pod_workers.go:191] Error syncing pod eb2910c3-cbac-462e-901e-4fb79caf95bf ("metrics-server-9975d5f86-qdks4_kube-system(eb2910c3-cbac-462e-901e-4fb79caf95bf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:26:55.169433 1657011 logs.go:138] Found kubelet problem: May 20 11:25:14 old-k8s-version-776336 kubelet[730]: E0520 11:25:14.311041 730 pod_workers.go:191] Error syncing pod 2c684adc-682c-4c95-a80c-90b35ac50afd ("dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"
W0520 11:26:55.170301 1657011 logs.go:138] Found kubelet problem: May 20 11:25:26 old-k8s-version-776336 kubelet[730]: E0520 11:25:26.311269 730 pod_workers.go:191] Error syncing pod 2c684adc-682c-4c95-a80c-90b35ac50afd ("dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"
W0520 11:26:55.170493 1657011 logs.go:138] Found kubelet problem: May 20 11:25:28 old-k8s-version-776336 kubelet[730]: E0520 11:25:28.311449 730 pod_workers.go:191] Error syncing pod eb2910c3-cbac-462e-901e-4fb79caf95bf ("metrics-server-9975d5f86-qdks4_kube-system(eb2910c3-cbac-462e-901e-4fb79caf95bf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:26:55.170825 1657011 logs.go:138] Found kubelet problem: May 20 11:25:40 old-k8s-version-776336 kubelet[730]: E0520 11:25:40.311409 730 pod_workers.go:191] Error syncing pod 2c684adc-682c-4c95-a80c-90b35ac50afd ("dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"
W0520 11:26:55.171052 1657011 logs.go:138] Found kubelet problem: May 20 11:25:40 old-k8s-version-776336 kubelet[730]: E0520 11:25:40.312759 730 pod_workers.go:191] Error syncing pod eb2910c3-cbac-462e-901e-4fb79caf95bf ("metrics-server-9975d5f86-qdks4_kube-system(eb2910c3-cbac-462e-901e-4fb79caf95bf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:26:55.171384 1657011 logs.go:138] Found kubelet problem: May 20 11:25:52 old-k8s-version-776336 kubelet[730]: E0520 11:25:52.311113 730 pod_workers.go:191] Error syncing pod 2c684adc-682c-4c95-a80c-90b35ac50afd ("dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"
W0520 11:26:55.171571 1657011 logs.go:138] Found kubelet problem: May 20 11:25:53 old-k8s-version-776336 kubelet[730]: E0520 11:25:53.311487 730 pod_workers.go:191] Error syncing pod eb2910c3-cbac-462e-901e-4fb79caf95bf ("metrics-server-9975d5f86-qdks4_kube-system(eb2910c3-cbac-462e-901e-4fb79caf95bf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:26:55.171903 1657011 logs.go:138] Found kubelet problem: May 20 11:26:05 old-k8s-version-776336 kubelet[730]: E0520 11:26:05.311044 730 pod_workers.go:191] Error syncing pod 2c684adc-682c-4c95-a80c-90b35ac50afd ("dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"
W0520 11:26:55.172108 1657011 logs.go:138] Found kubelet problem: May 20 11:26:07 old-k8s-version-776336 kubelet[730]: E0520 11:26:07.311454 730 pod_workers.go:191] Error syncing pod eb2910c3-cbac-462e-901e-4fb79caf95bf ("metrics-server-9975d5f86-qdks4_kube-system(eb2910c3-cbac-462e-901e-4fb79caf95bf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:26:55.172691 1657011 logs.go:138] Found kubelet problem: May 20 11:26:17 old-k8s-version-776336 kubelet[730]: E0520 11:26:17.312403 730 pod_workers.go:191] Error syncing pod 2c684adc-682c-4c95-a80c-90b35ac50afd ("dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"
W0520 11:26:55.172876 1657011 logs.go:138] Found kubelet problem: May 20 11:26:22 old-k8s-version-776336 kubelet[730]: E0520 11:26:22.311955 730 pod_workers.go:191] Error syncing pod eb2910c3-cbac-462e-901e-4fb79caf95bf ("metrics-server-9975d5f86-qdks4_kube-system(eb2910c3-cbac-462e-901e-4fb79caf95bf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:26:55.173205 1657011 logs.go:138] Found kubelet problem: May 20 11:26:29 old-k8s-version-776336 kubelet[730]: E0520 11:26:29.310991 730 pod_workers.go:191] Error syncing pod 2c684adc-682c-4c95-a80c-90b35ac50afd ("dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"
W0520 11:26:55.173391 1657011 logs.go:138] Found kubelet problem: May 20 11:26:35 old-k8s-version-776336 kubelet[730]: E0520 11:26:35.311614 730 pod_workers.go:191] Error syncing pod eb2910c3-cbac-462e-901e-4fb79caf95bf ("metrics-server-9975d5f86-qdks4_kube-system(eb2910c3-cbac-462e-901e-4fb79caf95bf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:26:55.173732 1657011 logs.go:138] Found kubelet problem: May 20 11:26:40 old-k8s-version-776336 kubelet[730]: E0520 11:26:40.310989 730 pod_workers.go:191] Error syncing pod 2c684adc-682c-4c95-a80c-90b35ac50afd ("dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"
W0520 11:26:55.173917 1657011 logs.go:138] Found kubelet problem: May 20 11:26:46 old-k8s-version-776336 kubelet[730]: E0520 11:26:46.315105 730 pod_workers.go:191] Error syncing pod eb2910c3-cbac-462e-901e-4fb79caf95bf ("metrics-server-9975d5f86-qdks4_kube-system(eb2910c3-cbac-462e-901e-4fb79caf95bf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:26:55.174246 1657011 logs.go:138] Found kubelet problem: May 20 11:26:53 old-k8s-version-776336 kubelet[730]: E0520 11:26:53.310994 730 pod_workers.go:191] Error syncing pod 2c684adc-682c-4c95-a80c-90b35ac50afd ("dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"
I0520 11:26:55.174257 1657011 logs.go:123] Gathering logs for dmesg ...
I0520 11:26:55.174271 1657011 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0520 11:26:55.194470 1657011 out.go:304] Setting ErrFile to fd 2...
I0520 11:26:55.194497 1657011 out.go:338] TERM=,COLORTERM=, which probably does not support color
W0520 11:26:55.195619 1657011 out.go:239] X Problems detected in kubelet:
X Problems detected in kubelet:
W0520 11:26:55.195656 1657011 out.go:239] May 20 11:26:29 old-k8s-version-776336 kubelet[730]: E0520 11:26:29.310991 730 pod_workers.go:191] Error syncing pod 2c684adc-682c-4c95-a80c-90b35ac50afd ("dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"
May 20 11:26:29 old-k8s-version-776336 kubelet[730]: E0520 11:26:29.310991 730 pod_workers.go:191] Error syncing pod 2c684adc-682c-4c95-a80c-90b35ac50afd ("dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"
W0520 11:26:55.195665 1657011 out.go:239] May 20 11:26:35 old-k8s-version-776336 kubelet[730]: E0520 11:26:35.311614 730 pod_workers.go:191] Error syncing pod eb2910c3-cbac-462e-901e-4fb79caf95bf ("metrics-server-9975d5f86-qdks4_kube-system(eb2910c3-cbac-462e-901e-4fb79caf95bf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
May 20 11:26:35 old-k8s-version-776336 kubelet[730]: E0520 11:26:35.311614 730 pod_workers.go:191] Error syncing pod eb2910c3-cbac-462e-901e-4fb79caf95bf ("metrics-server-9975d5f86-qdks4_kube-system(eb2910c3-cbac-462e-901e-4fb79caf95bf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:26:55.195675 1657011 out.go:239] May 20 11:26:40 old-k8s-version-776336 kubelet[730]: E0520 11:26:40.310989 730 pod_workers.go:191] Error syncing pod 2c684adc-682c-4c95-a80c-90b35ac50afd ("dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"
May 20 11:26:40 old-k8s-version-776336 kubelet[730]: E0520 11:26:40.310989 730 pod_workers.go:191] Error syncing pod 2c684adc-682c-4c95-a80c-90b35ac50afd ("dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"
W0520 11:26:55.195689 1657011 out.go:239] May 20 11:26:46 old-k8s-version-776336 kubelet[730]: E0520 11:26:46.315105 730 pod_workers.go:191] Error syncing pod eb2910c3-cbac-462e-901e-4fb79caf95bf ("metrics-server-9975d5f86-qdks4_kube-system(eb2910c3-cbac-462e-901e-4fb79caf95bf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
May 20 11:26:46 old-k8s-version-776336 kubelet[730]: E0520 11:26:46.315105 730 pod_workers.go:191] Error syncing pod eb2910c3-cbac-462e-901e-4fb79caf95bf ("metrics-server-9975d5f86-qdks4_kube-system(eb2910c3-cbac-462e-901e-4fb79caf95bf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:26:55.195707 1657011 out.go:239] May 20 11:26:53 old-k8s-version-776336 kubelet[730]: E0520 11:26:53.310994 730 pod_workers.go:191] Error syncing pod 2c684adc-682c-4c95-a80c-90b35ac50afd ("dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"
May 20 11:26:53 old-k8s-version-776336 kubelet[730]: E0520 11:26:53.310994 730 pod_workers.go:191] Error syncing pod 2c684adc-682c-4c95-a80c-90b35ac50afd ("dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"
I0520 11:26:55.195714 1657011 out.go:304] Setting ErrFile to fd 2...
I0520 11:26:55.195724 1657011 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0520 11:27:05.196731 1657011 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0520 11:27:05.209371 1657011 api_server.go:72] duration metric: took 5m56.762872229s to wait for apiserver process to appear ...
I0520 11:27:05.209406 1657011 api_server.go:88] waiting for apiserver healthz status ...
I0520 11:27:05.209441 1657011 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0520 11:27:05.209503 1657011 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0520 11:27:05.254986 1657011 cri.go:89] found id: "0b14a0f156605ce747bbd3ec92b34eb3ecf92d995ef08cfe0d147e8a56eb0eb3"
I0520 11:27:05.255010 1657011 cri.go:89] found id: ""
I0520 11:27:05.255018 1657011 logs.go:276] 1 containers: [0b14a0f156605ce747bbd3ec92b34eb3ecf92d995ef08cfe0d147e8a56eb0eb3]
I0520 11:27:05.255097 1657011 ssh_runner.go:195] Run: which crictl
I0520 11:27:05.258937 1657011 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0520 11:27:05.259014 1657011 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0520 11:27:05.304683 1657011 cri.go:89] found id: "a0c29f0d3e719d5fdc0931e9109cfae19b3167c2b4e839f25c7b1b63784a02a4"
I0520 11:27:05.304705 1657011 cri.go:89] found id: ""
I0520 11:27:05.304712 1657011 logs.go:276] 1 containers: [a0c29f0d3e719d5fdc0931e9109cfae19b3167c2b4e839f25c7b1b63784a02a4]
I0520 11:27:05.304776 1657011 ssh_runner.go:195] Run: which crictl
I0520 11:27:05.308619 1657011 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0520 11:27:05.308696 1657011 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0520 11:27:05.363412 1657011 cri.go:89] found id: "e346471df6217fe773e2ef8f7b75f5b46cd71d6eb9cbc805448692e543b15853"
I0520 11:27:05.363436 1657011 cri.go:89] found id: ""
I0520 11:27:05.363445 1657011 logs.go:276] 1 containers: [e346471df6217fe773e2ef8f7b75f5b46cd71d6eb9cbc805448692e543b15853]
I0520 11:27:05.363501 1657011 ssh_runner.go:195] Run: which crictl
I0520 11:27:05.368214 1657011 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0520 11:27:05.368293 1657011 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0520 11:27:05.406961 1657011 cri.go:89] found id: "200301c79d92cc1dca51aa9d3818041786dbc0fc25722073be3c056ab8ddc40d"
I0520 11:27:05.406985 1657011 cri.go:89] found id: ""
I0520 11:27:05.407004 1657011 logs.go:276] 1 containers: [200301c79d92cc1dca51aa9d3818041786dbc0fc25722073be3c056ab8ddc40d]
I0520 11:27:05.407109 1657011 ssh_runner.go:195] Run: which crictl
I0520 11:27:05.410985 1657011 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0520 11:27:05.411075 1657011 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0520 11:27:05.452948 1657011 cri.go:89] found id: "b026cb8ba53f0d1f48335254f05077b2a31ee7e5a35af6a7b530c5f18dccae5a"
I0520 11:27:05.452972 1657011 cri.go:89] found id: ""
I0520 11:27:05.452981 1657011 logs.go:276] 1 containers: [b026cb8ba53f0d1f48335254f05077b2a31ee7e5a35af6a7b530c5f18dccae5a]
I0520 11:27:05.453039 1657011 ssh_runner.go:195] Run: which crictl
I0520 11:27:05.456828 1657011 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0520 11:27:05.456935 1657011 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0520 11:27:05.496976 1657011 cri.go:89] found id: "7f0c6c3acf70df9c58574fae04af747df228563cb3da7252a8324c5242528d4e"
I0520 11:27:05.496998 1657011 cri.go:89] found id: ""
I0520 11:27:05.497006 1657011 logs.go:276] 1 containers: [7f0c6c3acf70df9c58574fae04af747df228563cb3da7252a8324c5242528d4e]
I0520 11:27:05.497084 1657011 ssh_runner.go:195] Run: which crictl
I0520 11:27:05.500811 1657011 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0520 11:27:05.500907 1657011 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0520 11:27:05.543135 1657011 cri.go:89] found id: "b92863fb0bcbb6bb4f4fb5c32ac048568d8bea72be8749218a1c81ceb8dcbf67"
I0520 11:27:05.543154 1657011 cri.go:89] found id: ""
I0520 11:27:05.543162 1657011 logs.go:276] 1 containers: [b92863fb0bcbb6bb4f4fb5c32ac048568d8bea72be8749218a1c81ceb8dcbf67]
I0520 11:27:05.543221 1657011 ssh_runner.go:195] Run: which crictl
I0520 11:27:05.547142 1657011 cri.go:54] listing CRI containers in root : {State:all Name:storage-provisioner Namespaces:[]}
I0520 11:27:05.547234 1657011 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0520 11:27:05.606997 1657011 cri.go:89] found id: "80aac8daed1fe77959700c7a1f1a34853c09f3dbeb46648d0ab015345f91e607"
I0520 11:27:05.607065 1657011 cri.go:89] found id: ""
I0520 11:27:05.607080 1657011 logs.go:276] 1 containers: [80aac8daed1fe77959700c7a1f1a34853c09f3dbeb46648d0ab015345f91e607]
I0520 11:27:05.607144 1657011 ssh_runner.go:195] Run: which crictl
I0520 11:27:05.610756 1657011 cri.go:54] listing CRI containers in root : {State:all Name:kubernetes-dashboard Namespaces:[]}
I0520 11:27:05.610852 1657011 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I0520 11:27:05.656696 1657011 cri.go:89] found id: "478b985a70c80d44c1dc3a606124f6d8d1a1b16caa15815f4d319199182b0973"
I0520 11:27:05.656718 1657011 cri.go:89] found id: ""
I0520 11:27:05.656726 1657011 logs.go:276] 1 containers: [478b985a70c80d44c1dc3a606124f6d8d1a1b16caa15815f4d319199182b0973]
I0520 11:27:05.656785 1657011 ssh_runner.go:195] Run: which crictl
I0520 11:27:05.660781 1657011 logs.go:123] Gathering logs for coredns [e346471df6217fe773e2ef8f7b75f5b46cd71d6eb9cbc805448692e543b15853] ...
I0520 11:27:05.660806 1657011 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e346471df6217fe773e2ef8f7b75f5b46cd71d6eb9cbc805448692e543b15853"
I0520 11:27:05.702546 1657011 logs.go:123] Gathering logs for kubernetes-dashboard [478b985a70c80d44c1dc3a606124f6d8d1a1b16caa15815f4d319199182b0973] ...
I0520 11:27:05.702574 1657011 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 478b985a70c80d44c1dc3a606124f6d8d1a1b16caa15815f4d319199182b0973"
I0520 11:27:05.745356 1657011 logs.go:123] Gathering logs for CRI-O ...
I0520 11:27:05.745387 1657011 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0520 11:27:05.825181 1657011 logs.go:123] Gathering logs for kube-scheduler [200301c79d92cc1dca51aa9d3818041786dbc0fc25722073be3c056ab8ddc40d] ...
I0520 11:27:05.825267 1657011 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 200301c79d92cc1dca51aa9d3818041786dbc0fc25722073be3c056ab8ddc40d"
I0520 11:27:05.870836 1657011 logs.go:123] Gathering logs for kindnet [b92863fb0bcbb6bb4f4fb5c32ac048568d8bea72be8749218a1c81ceb8dcbf67] ...
I0520 11:27:05.870867 1657011 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 b92863fb0bcbb6bb4f4fb5c32ac048568d8bea72be8749218a1c81ceb8dcbf67"
I0520 11:27:05.915034 1657011 logs.go:123] Gathering logs for describe nodes ...
I0520 11:27:05.915072 1657011 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0520 11:27:06.107107 1657011 logs.go:123] Gathering logs for kube-apiserver [0b14a0f156605ce747bbd3ec92b34eb3ecf92d995ef08cfe0d147e8a56eb0eb3] ...
I0520 11:27:06.107145 1657011 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 0b14a0f156605ce747bbd3ec92b34eb3ecf92d995ef08cfe0d147e8a56eb0eb3"
I0520 11:27:06.202380 1657011 logs.go:123] Gathering logs for kube-proxy [b026cb8ba53f0d1f48335254f05077b2a31ee7e5a35af6a7b530c5f18dccae5a] ...
I0520 11:27:06.202416 1657011 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 b026cb8ba53f0d1f48335254f05077b2a31ee7e5a35af6a7b530c5f18dccae5a"
I0520 11:27:06.263898 1657011 logs.go:123] Gathering logs for kube-controller-manager [7f0c6c3acf70df9c58574fae04af747df228563cb3da7252a8324c5242528d4e] ...
I0520 11:27:06.263929 1657011 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 7f0c6c3acf70df9c58574fae04af747df228563cb3da7252a8324c5242528d4e"
I0520 11:27:06.385051 1657011 logs.go:123] Gathering logs for container status ...
I0520 11:27:06.385089 1657011 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0520 11:27:06.468248 1657011 logs.go:123] Gathering logs for kubelet ...
I0520 11:27:06.468281 1657011 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0520 11:27:06.537324 1657011 logs.go:138] Found kubelet problem: May 20 11:21:26 old-k8s-version-776336 kubelet[730]: E0520 11:21:26.809242 730 reflector.go:138] object-"kube-system"/"kube-proxy-token-dxbg4": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kube-proxy-token-dxbg4" is forbidden: User "system:node:old-k8s-version-776336" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-776336' and this object
W0520 11:27:06.537613 1657011 logs.go:138] Found kubelet problem: May 20 11:21:26 old-k8s-version-776336 kubelet[730]: E0520 11:21:26.815246 730 reflector.go:138] object-"kube-system"/"metrics-server-token-lstwk": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "metrics-server-token-lstwk" is forbidden: User "system:node:old-k8s-version-776336" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-776336' and this object
W0520 11:27:06.537878 1657011 logs.go:138] Found kubelet problem: May 20 11:21:26 old-k8s-version-776336 kubelet[730]: E0520 11:21:26.815362 730 reflector.go:138] object-"kube-system"/"kindnet-token-5d2mm": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kindnet-token-5d2mm" is forbidden: User "system:node:old-k8s-version-776336" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-776336' and this object
W0520 11:27:06.538107 1657011 logs.go:138] Found kubelet problem: May 20 11:21:26 old-k8s-version-776336 kubelet[730]: E0520 11:21:26.815419 730 reflector.go:138] object-"default"/"default-token-2c9fs": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "default-token-2c9fs" is forbidden: User "system:node:old-k8s-version-776336" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'old-k8s-version-776336' and this object
W0520 11:27:06.538331 1657011 logs.go:138] Found kubelet problem: May 20 11:21:26 old-k8s-version-776336 kubelet[730]: E0520 11:21:26.815480 730 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:old-k8s-version-776336" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-776336' and this object
W0520 11:27:06.538553 1657011 logs.go:138] Found kubelet problem: May 20 11:21:26 old-k8s-version-776336 kubelet[730]: E0520 11:21:26.815526 730 reflector.go:138] object-"kube-system"/"coredns": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:old-k8s-version-776336" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-776336' and this object
W0520 11:27:06.538781 1657011 logs.go:138] Found kubelet problem: May 20 11:21:26 old-k8s-version-776336 kubelet[730]: E0520 11:21:26.815596 730 reflector.go:138] object-"kube-system"/"coredns-token-8nh95": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "coredns-token-8nh95" is forbidden: User "system:node:old-k8s-version-776336" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-776336' and this object
W0520 11:27:06.539091 1657011 logs.go:138] Found kubelet problem: May 20 11:21:26 old-k8s-version-776336 kubelet[730]: E0520 11:21:26.818042 730 reflector.go:138] object-"kube-system"/"storage-provisioner-token-jt6tq": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "storage-provisioner-token-jt6tq" is forbidden: User "system:node:old-k8s-version-776336" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-776336' and this object
W0520 11:27:06.551716 1657011 logs.go:138] Found kubelet problem: May 20 11:21:30 old-k8s-version-776336 kubelet[730]: E0520 11:21:30.748462 730 pod_workers.go:191] Error syncing pod eb2910c3-cbac-462e-901e-4fb79caf95bf ("metrics-server-9975d5f86-qdks4_kube-system(eb2910c3-cbac-462e-901e-4fb79caf95bf)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0520 11:27:06.552134 1657011 logs.go:138] Found kubelet problem: May 20 11:21:31 old-k8s-version-776336 kubelet[730]: E0520 11:21:31.360081 730 pod_workers.go:191] Error syncing pod eb2910c3-cbac-462e-901e-4fb79caf95bf ("metrics-server-9975d5f86-qdks4_kube-system(eb2910c3-cbac-462e-901e-4fb79caf95bf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:27:06.554483 1657011 logs.go:138] Found kubelet problem: May 20 11:21:42 old-k8s-version-776336 kubelet[730]: E0520 11:21:42.354554 730 pod_workers.go:191] Error syncing pod eb2910c3-cbac-462e-901e-4fb79caf95bf ("metrics-server-9975d5f86-qdks4_kube-system(eb2910c3-cbac-462e-901e-4fb79caf95bf)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0520 11:27:06.556998 1657011 logs.go:138] Found kubelet problem: May 20 11:21:55 old-k8s-version-776336 kubelet[730]: E0520 11:21:55.457689 730 pod_workers.go:191] Error syncing pod 2c684adc-682c-4c95-a80c-90b35ac50afd ("dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"
W0520 11:27:06.557750 1657011 logs.go:138] Found kubelet problem: May 20 11:21:56 old-k8s-version-776336 kubelet[730]: E0520 11:21:56.460106 730 pod_workers.go:191] Error syncing pod 2c684adc-682c-4c95-a80c-90b35ac50afd ("dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"
W0520 11:27:06.557970 1657011 logs.go:138] Found kubelet problem: May 20 11:21:57 old-k8s-version-776336 kubelet[730]: E0520 11:21:57.311677 730 pod_workers.go:191] Error syncing pod eb2910c3-cbac-462e-901e-4fb79caf95bf ("metrics-server-9975d5f86-qdks4_kube-system(eb2910c3-cbac-462e-901e-4fb79caf95bf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:27:06.558322 1657011 logs.go:138] Found kubelet problem: May 20 11:22:02 old-k8s-version-776336 kubelet[730]: E0520 11:22:02.482262 730 pod_workers.go:191] Error syncing pod 2c684adc-682c-4c95-a80c-90b35ac50afd ("dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"
W0520 11:27:06.562435 1657011 logs.go:138] Found kubelet problem: May 20 11:22:08 old-k8s-version-776336 kubelet[730]: E0520 11:22:08.322783 730 pod_workers.go:191] Error syncing pod eb2910c3-cbac-462e-901e-4fb79caf95bf ("metrics-server-9975d5f86-qdks4_kube-system(eb2910c3-cbac-462e-901e-4fb79caf95bf)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0520 11:27:06.563063 1657011 logs.go:138] Found kubelet problem: May 20 11:22:17 old-k8s-version-776336 kubelet[730]: E0520 11:22:17.507098 730 pod_workers.go:191] Error syncing pod 2c684adc-682c-4c95-a80c-90b35ac50afd ("dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"
W0520 11:27:06.563422 1657011 logs.go:138] Found kubelet problem: May 20 11:22:22 old-k8s-version-776336 kubelet[730]: E0520 11:22:22.482798 730 pod_workers.go:191] Error syncing pod 2c684adc-682c-4c95-a80c-90b35ac50afd ("dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"
W0520 11:27:06.563636 1657011 logs.go:138] Found kubelet problem: May 20 11:22:23 old-k8s-version-776336 kubelet[730]: E0520 11:22:23.311553 730 pod_workers.go:191] Error syncing pod eb2910c3-cbac-462e-901e-4fb79caf95bf ("metrics-server-9975d5f86-qdks4_kube-system(eb2910c3-cbac-462e-901e-4fb79caf95bf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:27:06.563979 1657011 logs.go:138] Found kubelet problem: May 20 11:22:36 old-k8s-version-776336 kubelet[730]: E0520 11:22:36.311591 730 pod_workers.go:191] Error syncing pod 2c684adc-682c-4c95-a80c-90b35ac50afd ("dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"
W0520 11:27:06.564191 1657011 logs.go:138] Found kubelet problem: May 20 11:22:38 old-k8s-version-776336 kubelet[730]: E0520 11:22:38.312311 730 pod_workers.go:191] Error syncing pod eb2910c3-cbac-462e-901e-4fb79caf95bf ("metrics-server-9975d5f86-qdks4_kube-system(eb2910c3-cbac-462e-901e-4fb79caf95bf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:27:06.565819 1657011 logs.go:138] Found kubelet problem: May 20 11:22:47 old-k8s-version-776336 kubelet[730]: E0520 11:22:47.567324 730 pod_workers.go:191] Error syncing pod 2c684adc-682c-4c95-a80c-90b35ac50afd ("dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"
W0520 11:27:06.566199 1657011 logs.go:138] Found kubelet problem: May 20 11:22:52 old-k8s-version-776336 kubelet[730]: E0520 11:22:52.482120 730 pod_workers.go:191] Error syncing pod 2c684adc-682c-4c95-a80c-90b35ac50afd ("dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"
W0520 11:27:06.568339 1657011 logs.go:138] Found kubelet problem: May 20 11:22:53 old-k8s-version-776336 kubelet[730]: E0520 11:22:53.323112 730 pod_workers.go:191] Error syncing pod eb2910c3-cbac-462e-901e-4fb79caf95bf ("metrics-server-9975d5f86-qdks4_kube-system(eb2910c3-cbac-462e-901e-4fb79caf95bf)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0520 11:27:06.568700 1657011 logs.go:138] Found kubelet problem: May 20 11:23:05 old-k8s-version-776336 kubelet[730]: E0520 11:23:05.311216 730 pod_workers.go:191] Error syncing pod 2c684adc-682c-4c95-a80c-90b35ac50afd ("dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"
W0520 11:27:06.568889 1657011 logs.go:138] Found kubelet problem: May 20 11:23:05 old-k8s-version-776336 kubelet[730]: E0520 11:23:05.312235 730 pod_workers.go:191] Error syncing pod eb2910c3-cbac-462e-901e-4fb79caf95bf ("metrics-server-9975d5f86-qdks4_kube-system(eb2910c3-cbac-462e-901e-4fb79caf95bf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:27:06.569217 1657011 logs.go:138] Found kubelet problem: May 20 11:23:18 old-k8s-version-776336 kubelet[730]: E0520 11:23:18.311005 730 pod_workers.go:191] Error syncing pod 2c684adc-682c-4c95-a80c-90b35ac50afd ("dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"
W0520 11:27:06.569422 1657011 logs.go:138] Found kubelet problem: May 20 11:23:19 old-k8s-version-776336 kubelet[730]: E0520 11:23:19.311931 730 pod_workers.go:191] Error syncing pod eb2910c3-cbac-462e-901e-4fb79caf95bf ("metrics-server-9975d5f86-qdks4_kube-system(eb2910c3-cbac-462e-901e-4fb79caf95bf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:27:06.569956 1657011 logs.go:138] Found kubelet problem: May 20 11:23:34 old-k8s-version-776336 kubelet[730]: E0520 11:23:34.312149 730 pod_workers.go:191] Error syncing pod eb2910c3-cbac-462e-901e-4fb79caf95bf ("metrics-server-9975d5f86-qdks4_kube-system(eb2910c3-cbac-462e-901e-4fb79caf95bf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:27:06.570314 1657011 logs.go:138] Found kubelet problem: May 20 11:23:34 old-k8s-version-776336 kubelet[730]: E0520 11:23:34.647790 730 pod_workers.go:191] Error syncing pod 2c684adc-682c-4c95-a80c-90b35ac50afd ("dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"
W0520 11:27:06.570675 1657011 logs.go:138] Found kubelet problem: May 20 11:23:42 old-k8s-version-776336 kubelet[730]: E0520 11:23:42.482249 730 pod_workers.go:191] Error syncing pod 2c684adc-682c-4c95-a80c-90b35ac50afd ("dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"
W0520 11:27:06.570884 1657011 logs.go:138] Found kubelet problem: May 20 11:23:48 old-k8s-version-776336 kubelet[730]: E0520 11:23:48.311989 730 pod_workers.go:191] Error syncing pod eb2910c3-cbac-462e-901e-4fb79caf95bf ("metrics-server-9975d5f86-qdks4_kube-system(eb2910c3-cbac-462e-901e-4fb79caf95bf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:27:06.571243 1657011 logs.go:138] Found kubelet problem: May 20 11:23:54 old-k8s-version-776336 kubelet[730]: E0520 11:23:54.311066 730 pod_workers.go:191] Error syncing pod 2c684adc-682c-4c95-a80c-90b35ac50afd ("dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"
W0520 11:27:06.571465 1657011 logs.go:138] Found kubelet problem: May 20 11:24:02 old-k8s-version-776336 kubelet[730]: E0520 11:24:02.312243 730 pod_workers.go:191] Error syncing pod eb2910c3-cbac-462e-901e-4fb79caf95bf ("metrics-server-9975d5f86-qdks4_kube-system(eb2910c3-cbac-462e-901e-4fb79caf95bf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:27:06.571815 1657011 logs.go:138] Found kubelet problem: May 20 11:24:06 old-k8s-version-776336 kubelet[730]: E0520 11:24:06.313386 730 pod_workers.go:191] Error syncing pod 2c684adc-682c-4c95-a80c-90b35ac50afd ("dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"
W0520 11:27:06.574161 1657011 logs.go:138] Found kubelet problem: May 20 11:24:17 old-k8s-version-776336 kubelet[730]: E0520 11:24:17.319931 730 pod_workers.go:191] Error syncing pod eb2910c3-cbac-462e-901e-4fb79caf95bf ("metrics-server-9975d5f86-qdks4_kube-system(eb2910c3-cbac-462e-901e-4fb79caf95bf)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0520 11:27:06.574523 1657011 logs.go:138] Found kubelet problem: May 20 11:24:19 old-k8s-version-776336 kubelet[730]: E0520 11:24:19.310996 730 pod_workers.go:191] Error syncing pod 2c684adc-682c-4c95-a80c-90b35ac50afd ("dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"
W0520 11:27:06.574733 1657011 logs.go:138] Found kubelet problem: May 20 11:24:28 old-k8s-version-776336 kubelet[730]: E0520 11:24:28.311548 730 pod_workers.go:191] Error syncing pod eb2910c3-cbac-462e-901e-4fb79caf95bf ("metrics-server-9975d5f86-qdks4_kube-system(eb2910c3-cbac-462e-901e-4fb79caf95bf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:27:06.575111 1657011 logs.go:138] Found kubelet problem: May 20 11:24:32 old-k8s-version-776336 kubelet[730]: E0520 11:24:32.310984 730 pod_workers.go:191] Error syncing pod 2c684adc-682c-4c95-a80c-90b35ac50afd ("dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"
W0520 11:27:06.575465 1657011 logs.go:138] Found kubelet problem: May 20 11:24:43 old-k8s-version-776336 kubelet[730]: E0520 11:24:43.311302 730 pod_workers.go:191] Error syncing pod 2c684adc-682c-4c95-a80c-90b35ac50afd ("dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"
W0520 11:27:06.575675 1657011 logs.go:138] Found kubelet problem: May 20 11:24:43 old-k8s-version-776336 kubelet[730]: E0520 11:24:43.312650 730 pod_workers.go:191] Error syncing pod eb2910c3-cbac-462e-901e-4fb79caf95bf ("metrics-server-9975d5f86-qdks4_kube-system(eb2910c3-cbac-462e-901e-4fb79caf95bf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:27:06.576077 1657011 logs.go:138] Found kubelet problem: May 20 11:24:58 old-k8s-version-776336 kubelet[730]: E0520 11:24:58.313801 730 pod_workers.go:191] Error syncing pod eb2910c3-cbac-462e-901e-4fb79caf95bf ("metrics-server-9975d5f86-qdks4_kube-system(eb2910c3-cbac-462e-901e-4fb79caf95bf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:27:06.576602 1657011 logs.go:138] Found kubelet problem: May 20 11:24:59 old-k8s-version-776336 kubelet[730]: E0520 11:24:59.771509 730 pod_workers.go:191] Error syncing pod 2c684adc-682c-4c95-a80c-90b35ac50afd ("dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"
W0520 11:27:06.577160 1657011 logs.go:138] Found kubelet problem: May 20 11:25:02 old-k8s-version-776336 kubelet[730]: E0520 11:25:02.482351 730 pod_workers.go:191] Error syncing pod 2c684adc-682c-4c95-a80c-90b35ac50afd ("dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"
W0520 11:27:06.577361 1657011 logs.go:138] Found kubelet problem: May 20 11:25:13 old-k8s-version-776336 kubelet[730]: E0520 11:25:13.311740 730 pod_workers.go:191] Error syncing pod eb2910c3-cbac-462e-901e-4fb79caf95bf ("metrics-server-9975d5f86-qdks4_kube-system(eb2910c3-cbac-462e-901e-4fb79caf95bf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:27:06.577700 1657011 logs.go:138] Found kubelet problem: May 20 11:25:14 old-k8s-version-776336 kubelet[730]: E0520 11:25:14.311041 730 pod_workers.go:191] Error syncing pod 2c684adc-682c-4c95-a80c-90b35ac50afd ("dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"
W0520 11:27:06.578552 1657011 logs.go:138] Found kubelet problem: May 20 11:25:26 old-k8s-version-776336 kubelet[730]: E0520 11:25:26.311269 730 pod_workers.go:191] Error syncing pod 2c684adc-682c-4c95-a80c-90b35ac50afd ("dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"
W0520 11:27:06.578740 1657011 logs.go:138] Found kubelet problem: May 20 11:25:28 old-k8s-version-776336 kubelet[730]: E0520 11:25:28.311449 730 pod_workers.go:191] Error syncing pod eb2910c3-cbac-462e-901e-4fb79caf95bf ("metrics-server-9975d5f86-qdks4_kube-system(eb2910c3-cbac-462e-901e-4fb79caf95bf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:27:06.579075 1657011 logs.go:138] Found kubelet problem: May 20 11:25:40 old-k8s-version-776336 kubelet[730]: E0520 11:25:40.311409 730 pod_workers.go:191] Error syncing pod 2c684adc-682c-4c95-a80c-90b35ac50afd ("dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"
W0520 11:27:06.579263 1657011 logs.go:138] Found kubelet problem: May 20 11:25:40 old-k8s-version-776336 kubelet[730]: E0520 11:25:40.312759 730 pod_workers.go:191] Error syncing pod eb2910c3-cbac-462e-901e-4fb79caf95bf ("metrics-server-9975d5f86-qdks4_kube-system(eb2910c3-cbac-462e-901e-4fb79caf95bf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:27:06.579647 1657011 logs.go:138] Found kubelet problem: May 20 11:25:52 old-k8s-version-776336 kubelet[730]: E0520 11:25:52.311113 730 pod_workers.go:191] Error syncing pod 2c684adc-682c-4c95-a80c-90b35ac50afd ("dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"
W0520 11:27:06.579896 1657011 logs.go:138] Found kubelet problem: May 20 11:25:53 old-k8s-version-776336 kubelet[730]: E0520 11:25:53.311487 730 pod_workers.go:191] Error syncing pod eb2910c3-cbac-462e-901e-4fb79caf95bf ("metrics-server-9975d5f86-qdks4_kube-system(eb2910c3-cbac-462e-901e-4fb79caf95bf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:27:06.580290 1657011 logs.go:138] Found kubelet problem: May 20 11:26:05 old-k8s-version-776336 kubelet[730]: E0520 11:26:05.311044 730 pod_workers.go:191] Error syncing pod 2c684adc-682c-4c95-a80c-90b35ac50afd ("dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"
W0520 11:27:06.580502 1657011 logs.go:138] Found kubelet problem: May 20 11:26:07 old-k8s-version-776336 kubelet[730]: E0520 11:26:07.311454 730 pod_workers.go:191] Error syncing pod eb2910c3-cbac-462e-901e-4fb79caf95bf ("metrics-server-9975d5f86-qdks4_kube-system(eb2910c3-cbac-462e-901e-4fb79caf95bf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:27:06.581101 1657011 logs.go:138] Found kubelet problem: May 20 11:26:17 old-k8s-version-776336 kubelet[730]: E0520 11:26:17.312403 730 pod_workers.go:191] Error syncing pod 2c684adc-682c-4c95-a80c-90b35ac50afd ("dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"
W0520 11:27:06.581310 1657011 logs.go:138] Found kubelet problem: May 20 11:26:22 old-k8s-version-776336 kubelet[730]: E0520 11:26:22.311955 730 pod_workers.go:191] Error syncing pod eb2910c3-cbac-462e-901e-4fb79caf95bf ("metrics-server-9975d5f86-qdks4_kube-system(eb2910c3-cbac-462e-901e-4fb79caf95bf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:27:06.581693 1657011 logs.go:138] Found kubelet problem: May 20 11:26:29 old-k8s-version-776336 kubelet[730]: E0520 11:26:29.310991 730 pod_workers.go:191] Error syncing pod 2c684adc-682c-4c95-a80c-90b35ac50afd ("dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"
W0520 11:27:06.581904 1657011 logs.go:138] Found kubelet problem: May 20 11:26:35 old-k8s-version-776336 kubelet[730]: E0520 11:26:35.311614 730 pod_workers.go:191] Error syncing pod eb2910c3-cbac-462e-901e-4fb79caf95bf ("metrics-server-9975d5f86-qdks4_kube-system(eb2910c3-cbac-462e-901e-4fb79caf95bf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:27:06.582279 1657011 logs.go:138] Found kubelet problem: May 20 11:26:40 old-k8s-version-776336 kubelet[730]: E0520 11:26:40.310989 730 pod_workers.go:191] Error syncing pod 2c684adc-682c-4c95-a80c-90b35ac50afd ("dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"
W0520 11:27:06.582688 1657011 logs.go:138] Found kubelet problem: May 20 11:26:46 old-k8s-version-776336 kubelet[730]: E0520 11:26:46.315105 730 pod_workers.go:191] Error syncing pod eb2910c3-cbac-462e-901e-4fb79caf95bf ("metrics-server-9975d5f86-qdks4_kube-system(eb2910c3-cbac-462e-901e-4fb79caf95bf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:27:06.583045 1657011 logs.go:138] Found kubelet problem: May 20 11:26:53 old-k8s-version-776336 kubelet[730]: E0520 11:26:53.310994 730 pod_workers.go:191] Error syncing pod 2c684adc-682c-4c95-a80c-90b35ac50afd ("dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"
W0520 11:27:06.583283 1657011 logs.go:138] Found kubelet problem: May 20 11:26:57 old-k8s-version-776336 kubelet[730]: E0520 11:26:57.312314 730 pod_workers.go:191] Error syncing pod eb2910c3-cbac-462e-901e-4fb79caf95bf ("metrics-server-9975d5f86-qdks4_kube-system(eb2910c3-cbac-462e-901e-4fb79caf95bf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:27:06.583664 1657011 logs.go:138] Found kubelet problem: May 20 11:27:06 old-k8s-version-776336 kubelet[730]: E0520 11:27:06.311519 730 pod_workers.go:191] Error syncing pod 2c684adc-682c-4c95-a80c-90b35ac50afd ("dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"
I0520 11:27:06.583679 1657011 logs.go:123] Gathering logs for dmesg ...
I0520 11:27:06.583709 1657011 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0520 11:27:06.607566 1657011 logs.go:123] Gathering logs for etcd [a0c29f0d3e719d5fdc0931e9109cfae19b3167c2b4e839f25c7b1b63784a02a4] ...
I0520 11:27:06.607599 1657011 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 a0c29f0d3e719d5fdc0931e9109cfae19b3167c2b4e839f25c7b1b63784a02a4"
I0520 11:27:06.704593 1657011 logs.go:123] Gathering logs for storage-provisioner [80aac8daed1fe77959700c7a1f1a34853c09f3dbeb46648d0ab015345f91e607] ...
I0520 11:27:06.704637 1657011 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 80aac8daed1fe77959700c7a1f1a34853c09f3dbeb46648d0ab015345f91e607"
I0520 11:27:06.755173 1657011 out.go:304] Setting ErrFile to fd 2...
I0520 11:27:06.755199 1657011 out.go:338] TERM=,COLORTERM=, which probably does not support color
W0520 11:27:06.755246 1657011 out.go:239] X Problems detected in kubelet:
X Problems detected in kubelet:
W0520 11:27:06.755260 1657011 out.go:239] May 20 11:26:40 old-k8s-version-776336 kubelet[730]: E0520 11:26:40.310989 730 pod_workers.go:191] Error syncing pod 2c684adc-682c-4c95-a80c-90b35ac50afd ("dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"
May 20 11:26:40 old-k8s-version-776336 kubelet[730]: E0520 11:26:40.310989 730 pod_workers.go:191] Error syncing pod 2c684adc-682c-4c95-a80c-90b35ac50afd ("dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"
W0520 11:27:06.755267 1657011 out.go:239] May 20 11:26:46 old-k8s-version-776336 kubelet[730]: E0520 11:26:46.315105 730 pod_workers.go:191] Error syncing pod eb2910c3-cbac-462e-901e-4fb79caf95bf ("metrics-server-9975d5f86-qdks4_kube-system(eb2910c3-cbac-462e-901e-4fb79caf95bf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
May 20 11:26:46 old-k8s-version-776336 kubelet[730]: E0520 11:26:46.315105 730 pod_workers.go:191] Error syncing pod eb2910c3-cbac-462e-901e-4fb79caf95bf ("metrics-server-9975d5f86-qdks4_kube-system(eb2910c3-cbac-462e-901e-4fb79caf95bf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:27:06.755278 1657011 out.go:239] May 20 11:26:53 old-k8s-version-776336 kubelet[730]: E0520 11:26:53.310994 730 pod_workers.go:191] Error syncing pod 2c684adc-682c-4c95-a80c-90b35ac50afd ("dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"
May 20 11:26:53 old-k8s-version-776336 kubelet[730]: E0520 11:26:53.310994 730 pod_workers.go:191] Error syncing pod 2c684adc-682c-4c95-a80c-90b35ac50afd ("dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"
W0520 11:27:06.755303 1657011 out.go:239] May 20 11:26:57 old-k8s-version-776336 kubelet[730]: E0520 11:26:57.312314 730 pod_workers.go:191] Error syncing pod eb2910c3-cbac-462e-901e-4fb79caf95bf ("metrics-server-9975d5f86-qdks4_kube-system(eb2910c3-cbac-462e-901e-4fb79caf95bf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
May 20 11:26:57 old-k8s-version-776336 kubelet[730]: E0520 11:26:57.312314 730 pod_workers.go:191] Error syncing pod eb2910c3-cbac-462e-901e-4fb79caf95bf ("metrics-server-9975d5f86-qdks4_kube-system(eb2910c3-cbac-462e-901e-4fb79caf95bf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:27:06.755309 1657011 out.go:239] May 20 11:27:06 old-k8s-version-776336 kubelet[730]: E0520 11:27:06.311519 730 pod_workers.go:191] Error syncing pod 2c684adc-682c-4c95-a80c-90b35ac50afd ("dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"
May 20 11:27:06 old-k8s-version-776336 kubelet[730]: E0520 11:27:06.311519 730 pod_workers.go:191] Error syncing pod 2c684adc-682c-4c95-a80c-90b35ac50afd ("dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"
I0520 11:27:06.755316 1657011 out.go:304] Setting ErrFile to fd 2...
I0520 11:27:06.755327 1657011 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0520 11:27:16.756505 1657011 api_server.go:253] Checking apiserver healthz at https://192.168.76.2:8443/healthz ...
I0520 11:27:16.769614 1657011 api_server.go:279] https://192.168.76.2:8443/healthz returned 200:
ok
I0520 11:27:16.771733 1657011 out.go:177]
W0520 11:27:16.773260 1657011 out.go:239] X Exiting due to K8S_UNHEALTHY_CONTROL_PLANE: wait 6m0s for node: wait for healthy API server: controlPlane never updated to v1.20.0
X Exiting due to K8S_UNHEALTHY_CONTROL_PLANE: wait 6m0s for node: wait for healthy API server: controlPlane never updated to v1.20.0
W0520 11:27:16.773298 1657011 out.go:239] * Suggestion: Control Plane could not update, try minikube delete --all --purge
* Suggestion: Control Plane could not update, try minikube delete --all --purge
W0520 11:27:16.773326 1657011 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/11417
* Related issue: https://github.com/kubernetes/minikube/issues/11417
W0520 11:27:16.773332 1657011 out.go:239] *
*
W0520 11:27:16.775071 1657011 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0520 11:27:16.777544 1657011 out.go:177]
** /stderr **
start_stop_delete_test.go:259: failed to start minikube post-stop. args "out/minikube-linux-arm64 start -p old-k8s-version-776336 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=crio --kubernetes-version=v1.20.0": exit status 102
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: docker inspect <======
helpers_test.go:231: (dbg) Run: docker inspect old-k8s-version-776336
helpers_test.go:235: (dbg) docker inspect old-k8s-version-776336:
-- stdout --
[
{
"Id": "79b3e893485d03f6c7fa54c0f1076a4e9f6fac7238dffad483d3ab0503f5a33a",
"Created": "2024-05-20T11:17:38.406601646Z",
"Path": "/usr/local/bin/entrypoint",
"Args": [
"/sbin/init"
],
"State": {
"Status": "running",
"Running": true,
"Paused": false,
"Restarting": false,
"OOMKilled": false,
"Dead": false,
"Pid": 1657196,
"ExitCode": 0,
"Error": "",
"StartedAt": "2024-05-20T11:21:00.391994236Z",
"FinishedAt": "2024-05-20T11:20:58.801235956Z"
},
"Image": "sha256:56620e18f2c2c9a0448fc43c42f840334bd2baea497ff8deae66477dd0dbfecf",
"ResolvConfPath": "/var/lib/docker/containers/79b3e893485d03f6c7fa54c0f1076a4e9f6fac7238dffad483d3ab0503f5a33a/resolv.conf",
"HostnamePath": "/var/lib/docker/containers/79b3e893485d03f6c7fa54c0f1076a4e9f6fac7238dffad483d3ab0503f5a33a/hostname",
"HostsPath": "/var/lib/docker/containers/79b3e893485d03f6c7fa54c0f1076a4e9f6fac7238dffad483d3ab0503f5a33a/hosts",
"LogPath": "/var/lib/docker/containers/79b3e893485d03f6c7fa54c0f1076a4e9f6fac7238dffad483d3ab0503f5a33a/79b3e893485d03f6c7fa54c0f1076a4e9f6fac7238dffad483d3ab0503f5a33a-json.log",
"Name": "/old-k8s-version-776336",
"RestartCount": 0,
"Driver": "overlay2",
"Platform": "linux",
"MountLabel": "",
"ProcessLabel": "",
"AppArmorProfile": "unconfined",
"ExecIDs": null,
"HostConfig": {
"Binds": [
"/lib/modules:/lib/modules:ro",
"old-k8s-version-776336:/var"
],
"ContainerIDFile": "",
"LogConfig": {
"Type": "json-file",
"Config": {}
},
"NetworkMode": "old-k8s-version-776336",
"PortBindings": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
]
},
"RestartPolicy": {
"Name": "no",
"MaximumRetryCount": 0
},
"AutoRemove": false,
"VolumeDriver": "",
"VolumesFrom": null,
"ConsoleSize": [
0,
0
],
"CapAdd": null,
"CapDrop": null,
"CgroupnsMode": "host",
"Dns": [],
"DnsOptions": [],
"DnsSearch": [],
"ExtraHosts": null,
"GroupAdd": null,
"IpcMode": "private",
"Cgroup": "",
"Links": null,
"OomScoreAdj": 0,
"PidMode": "",
"Privileged": true,
"PublishAllPorts": false,
"ReadonlyRootfs": false,
"SecurityOpt": [
"seccomp=unconfined",
"apparmor=unconfined",
"label=disable"
],
"Tmpfs": {
"/run": "",
"/tmp": ""
},
"UTSMode": "",
"UsernsMode": "",
"ShmSize": 67108864,
"Runtime": "runc",
"Isolation": "",
"CpuShares": 0,
"Memory": 2306867200,
"NanoCpus": 2000000000,
"CgroupParent": "",
"BlkioWeight": 0,
"BlkioWeightDevice": [],
"BlkioDeviceReadBps": [],
"BlkioDeviceWriteBps": [],
"BlkioDeviceReadIOps": [],
"BlkioDeviceWriteIOps": [],
"CpuPeriod": 0,
"CpuQuota": 0,
"CpuRealtimePeriod": 0,
"CpuRealtimeRuntime": 0,
"CpusetCpus": "",
"CpusetMems": "",
"Devices": [],
"DeviceCgroupRules": null,
"DeviceRequests": null,
"MemoryReservation": 0,
"MemorySwap": 4613734400,
"MemorySwappiness": null,
"OomKillDisable": false,
"PidsLimit": null,
"Ulimits": [],
"CpuCount": 0,
"CpuPercent": 0,
"IOMaximumIOps": 0,
"IOMaximumBandwidth": 0,
"MaskedPaths": null,
"ReadonlyPaths": null
},
"GraphDriver": {
"Data": {
"LowerDir": "/var/lib/docker/overlay2/45b5a8ecb8f2c11d5a9b10ddffcf25f035d195b50dc82be254c42746a2acc0c0-init/diff:/var/lib/docker/overlay2/85c5c7809a5d893ae54ed3fa4fb6194b99d9d246c69ccb3f2daa2ee41dec0e23/diff",
"MergedDir": "/var/lib/docker/overlay2/45b5a8ecb8f2c11d5a9b10ddffcf25f035d195b50dc82be254c42746a2acc0c0/merged",
"UpperDir": "/var/lib/docker/overlay2/45b5a8ecb8f2c11d5a9b10ddffcf25f035d195b50dc82be254c42746a2acc0c0/diff",
"WorkDir": "/var/lib/docker/overlay2/45b5a8ecb8f2c11d5a9b10ddffcf25f035d195b50dc82be254c42746a2acc0c0/work"
},
"Name": "overlay2"
},
"Mounts": [
{
"Type": "bind",
"Source": "/lib/modules",
"Destination": "/lib/modules",
"Mode": "ro",
"RW": false,
"Propagation": "rprivate"
},
{
"Type": "volume",
"Name": "old-k8s-version-776336",
"Source": "/var/lib/docker/volumes/old-k8s-version-776336/_data",
"Destination": "/var",
"Driver": "local",
"Mode": "z",
"RW": true,
"Propagation": ""
}
],
"Config": {
"Hostname": "old-k8s-version-776336",
"Domainname": "",
"User": "",
"AttachStdin": false,
"AttachStdout": false,
"AttachStderr": false,
"ExposedPorts": {
"22/tcp": {},
"2376/tcp": {},
"32443/tcp": {},
"5000/tcp": {},
"8443/tcp": {}
},
"Tty": true,
"OpenStdin": false,
"StdinOnce": false,
"Env": [
"container=docker",
"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
],
"Cmd": null,
"Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1715707529-18887@sha256:734a2adad159415bd51b0392bc8976bd7e3e543e9165c2374d6e59bac37aed3a",
"Volumes": null,
"WorkingDir": "/",
"Entrypoint": [
"/usr/local/bin/entrypoint",
"/sbin/init"
],
"OnBuild": null,
"Labels": {
"created_by.minikube.sigs.k8s.io": "true",
"mode.minikube.sigs.k8s.io": "old-k8s-version-776336",
"name.minikube.sigs.k8s.io": "old-k8s-version-776336",
"role.minikube.sigs.k8s.io": ""
},
"StopSignal": "SIGRTMIN+3"
},
"NetworkSettings": {
"Bridge": "",
"SandboxID": "7ffeb38168be77ad7b17ef0de2f5a15b2d751ea5eb99803db3a753620ce84381",
"SandboxKey": "/var/run/docker/netns/7ffeb38168be",
"Ports": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "40787"
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "40786"
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "40783"
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "40785"
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "40784"
}
]
},
"HairpinMode": false,
"LinkLocalIPv6Address": "",
"LinkLocalIPv6PrefixLen": 0,
"SecondaryIPAddresses": null,
"SecondaryIPv6Addresses": null,
"EndpointID": "",
"Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"IPAddress": "",
"IPPrefixLen": 0,
"IPv6Gateway": "",
"MacAddress": "",
"Networks": {
"old-k8s-version-776336": {
"IPAMConfig": {
"IPv4Address": "192.168.76.2"
},
"Links": null,
"Aliases": null,
"MacAddress": "02:42:c0:a8:4c:02",
"NetworkID": "90b2363a1f83bdfada5377ba313f690b65fa721d788656514bda9a988666874a",
"EndpointID": "7c177a710029eb56c8b20fcd7d3363f28570dda3ae6afa2172f756ce21c8cf7a",
"Gateway": "192.168.76.1",
"IPAddress": "192.168.76.2",
"IPPrefixLen": 24,
"IPv6Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"DriverOpts": null,
"DNSNames": [
"old-k8s-version-776336",
"79b3e893485d"
]
}
}
}
}
]
-- /stdout --
helpers_test.go:239: (dbg) Run: out/minikube-linux-arm64 status --format={{.Host}} -p old-k8s-version-776336 -n old-k8s-version-776336
helpers_test.go:244: <<< TestStartStop/group/old-k8s-version/serial/SecondStart FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: minikube logs <======
helpers_test.go:247: (dbg) Run: out/minikube-linux-arm64 -p old-k8s-version-776336 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-arm64 -p old-k8s-version-776336 logs -n 25: (1.840953073s)
helpers_test.go:252: TestStartStop/group/old-k8s-version/serial/SecondStart logs:
-- stdout --
==> Audit <==
|---------|--------------------------------------------------------|--------------------------|---------|---------|---------------------|---------------------|
| Command | Args | Profile | User | Version | Start Time | End Time |
|---------|--------------------------------------------------------|--------------------------|---------|---------|---------------------|---------------------|
| delete | -p cilium-214342 | cilium-214342 | jenkins | v1.33.1 | 20 May 24 11:16 UTC | 20 May 24 11:16 UTC |
| start | -p cert-expiration-052084 | cert-expiration-052084 | jenkins | v1.33.1 | 20 May 24 11:16 UTC | 20 May 24 11:16 UTC |
| | --memory=2048 | | | | | |
| | --cert-expiration=3m | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=crio | | | | | |
| delete | -p force-systemd-env-085097 | force-systemd-env-085097 | jenkins | v1.33.1 | 20 May 24 11:16 UTC | 20 May 24 11:16 UTC |
| start | -p cert-options-069594 | cert-options-069594 | jenkins | v1.33.1 | 20 May 24 11:16 UTC | 20 May 24 11:17 UTC |
| | --memory=2048 | | | | | |
| | --apiserver-ips=127.0.0.1 | | | | | |
| | --apiserver-ips=192.168.15.15 | | | | | |
| | --apiserver-names=localhost | | | | | |
| | --apiserver-names=www.google.com | | | | | |
| | --apiserver-port=8555 | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=crio | | | | | |
| ssh | cert-options-069594 ssh | cert-options-069594 | jenkins | v1.33.1 | 20 May 24 11:17 UTC | 20 May 24 11:17 UTC |
| | openssl x509 -text -noout -in | | | | | |
| | /var/lib/minikube/certs/apiserver.crt | | | | | |
| ssh | -p cert-options-069594 -- sudo | cert-options-069594 | jenkins | v1.33.1 | 20 May 24 11:17 UTC | 20 May 24 11:17 UTC |
| | cat /etc/kubernetes/admin.conf | | | | | |
| delete | -p cert-options-069594 | cert-options-069594 | jenkins | v1.33.1 | 20 May 24 11:17 UTC | 20 May 24 11:17 UTC |
| start | -p old-k8s-version-776336 | old-k8s-version-776336 | jenkins | v1.33.1 | 20 May 24 11:17 UTC | 20 May 24 11:20 UTC |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --kvm-network=default | | | | | |
| | --kvm-qemu-uri=qemu:///system | | | | | |
| | --disable-driver-mounts | | | | | |
| | --keep-context=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=crio | | | | | |
| | --kubernetes-version=v1.20.0 | | | | | |
| start | -p cert-expiration-052084 | cert-expiration-052084 | jenkins | v1.33.1 | 20 May 24 11:19 UTC | 20 May 24 11:20 UTC |
| | --memory=2048 | | | | | |
| | --cert-expiration=8760h | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=crio | | | | | |
| delete | -p cert-expiration-052084 | cert-expiration-052084 | jenkins | v1.33.1 | 20 May 24 11:20 UTC | 20 May 24 11:20 UTC |
| start | -p no-preload-027096 | no-preload-027096 | jenkins | v1.33.1 | 20 May 24 11:20 UTC | 20 May 24 11:21 UTC |
| | --memory=2200 | | | | | |
| | --alsologtostderr | | | | | |
| | --wait=true --preload=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=crio | | | | | |
| | --kubernetes-version=v1.30.1 | | | | | |
| addons | enable metrics-server -p old-k8s-version-776336 | old-k8s-version-776336 | jenkins | v1.33.1 | 20 May 24 11:20 UTC | 20 May 24 11:20 UTC |
| | --images=MetricsServer=registry.k8s.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| stop | -p old-k8s-version-776336 | old-k8s-version-776336 | jenkins | v1.33.1 | 20 May 24 11:20 UTC | 20 May 24 11:20 UTC |
| | --alsologtostderr -v=3 | | | | | |
| addons | enable dashboard -p old-k8s-version-776336 | old-k8s-version-776336 | jenkins | v1.33.1 | 20 May 24 11:20 UTC | 20 May 24 11:20 UTC |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| start | -p old-k8s-version-776336 | old-k8s-version-776336 | jenkins | v1.33.1 | 20 May 24 11:20 UTC | |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --kvm-network=default | | | | | |
| | --kvm-qemu-uri=qemu:///system | | | | | |
| | --disable-driver-mounts | | | | | |
| | --keep-context=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=crio | | | | | |
| | --kubernetes-version=v1.20.0 | | | | | |
| addons | enable metrics-server -p no-preload-027096 | no-preload-027096 | jenkins | v1.33.1 | 20 May 24 11:21 UTC | 20 May 24 11:21 UTC |
| | --images=MetricsServer=registry.k8s.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| stop | -p no-preload-027096 | no-preload-027096 | jenkins | v1.33.1 | 20 May 24 11:21 UTC | 20 May 24 11:21 UTC |
| | --alsologtostderr -v=3 | | | | | |
| addons | enable dashboard -p no-preload-027096 | no-preload-027096 | jenkins | v1.33.1 | 20 May 24 11:21 UTC | 20 May 24 11:21 UTC |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| start | -p no-preload-027096 | no-preload-027096 | jenkins | v1.33.1 | 20 May 24 11:21 UTC | 20 May 24 11:26 UTC |
| | --memory=2200 | | | | | |
| | --alsologtostderr | | | | | |
| | --wait=true --preload=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=crio | | | | | |
| | --kubernetes-version=v1.30.1 | | | | | |
| image | no-preload-027096 image list | no-preload-027096 | jenkins | v1.33.1 | 20 May 24 11:26 UTC | 20 May 24 11:26 UTC |
| | --format=json | | | | | |
| pause | -p no-preload-027096 | no-preload-027096 | jenkins | v1.33.1 | 20 May 24 11:26 UTC | 20 May 24 11:26 UTC |
| | --alsologtostderr -v=1 | | | | | |
| unpause | -p no-preload-027096 | no-preload-027096 | jenkins | v1.33.1 | 20 May 24 11:26 UTC | 20 May 24 11:26 UTC |
| | --alsologtostderr -v=1 | | | | | |
| delete | -p no-preload-027096 | no-preload-027096 | jenkins | v1.33.1 | 20 May 24 11:26 UTC | 20 May 24 11:26 UTC |
| delete | -p no-preload-027096 | no-preload-027096 | jenkins | v1.33.1 | 20 May 24 11:26 UTC | 20 May 24 11:27 UTC |
| start | -p embed-certs-746238 | embed-certs-746238 | jenkins | v1.33.1 | 20 May 24 11:27 UTC | |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --embed-certs --driver=docker | | | | | |
| | --container-runtime=crio | | | | | |
| | --kubernetes-version=v1.30.1 | | | | | |
|---------|--------------------------------------------------------|--------------------------|---------|---------|---------------------|---------------------|
==> Last Start <==
Log file created at: 2024/05/20 11:27:00
Running on machine: ip-172-31-21-244
Binary: Built with gc go1.22.3 for linux/arm64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I0520 11:27:00.333763 1665508 out.go:291] Setting OutFile to fd 1 ...
I0520 11:27:00.334142 1665508 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0520 11:27:00.334175 1665508 out.go:304] Setting ErrFile to fd 2...
I0520 11:27:00.334182 1665508 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0520 11:27:00.334872 1665508 root.go:338] Updating PATH: /home/jenkins/minikube-integration/18925-1463640/.minikube/bin
I0520 11:27:00.335537 1665508 out.go:298] Setting JSON to false
I0520 11:27:00.336817 1665508 start.go:129] hostinfo: {"hostname":"ip-172-31-21-244","uptime":155368,"bootTime":1716049053,"procs":206,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1058-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"da8ac1fd-6236-412a-a346-95873c98230d"}
I0520 11:27:00.336936 1665508 start.go:139] virtualization:
I0520 11:27:00.340285 1665508 out.go:177] * [embed-certs-746238] minikube v1.33.1 on Ubuntu 20.04 (arm64)
I0520 11:27:00.342920 1665508 out.go:177] - MINIKUBE_LOCATION=18925
I0520 11:27:00.345583 1665508 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0520 11:27:00.343103 1665508 notify.go:220] Checking for updates...
I0520 11:27:00.351132 1665508 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/18925-1463640/kubeconfig
I0520 11:27:00.353823 1665508 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/18925-1463640/.minikube
I0520 11:27:00.362510 1665508 out.go:177] - MINIKUBE_BIN=out/minikube-linux-arm64
I0520 11:27:00.366050 1665508 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0520 11:27:00.370083 1665508 config.go:182] Loaded profile config "old-k8s-version-776336": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0520 11:27:00.370236 1665508 driver.go:392] Setting default libvirt URI to qemu:///system
I0520 11:27:00.395139 1665508 docker.go:122] docker version: linux-26.1.3:Docker Engine - Community
I0520 11:27:00.395298 1665508 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0520 11:27:00.470193 1665508 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:33 OomKillDisable:true NGoroutines:52 SystemTime:2024-05-20 11:27:00.459110555 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1058-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215035904 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:26.1.3 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:e377cd56a71523140ca6ae87e30244719194a521 Expected:e377cd56a71523140ca6ae87e30244719194a521} RuncCommit:{ID:v1.1.12-0-g51d5e94 Expected:v1.1.12-0-g51d5e94} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.14.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.27.0]] Warnings:<nil>}}
I0520 11:27:00.470314 1665508 docker.go:295] overlay module found
I0520 11:27:00.473002 1665508 out.go:177] * Using the docker driver based on user configuration
I0520 11:27:00.475402 1665508 start.go:297] selected driver: docker
I0520 11:27:00.475468 1665508 start.go:901] validating driver "docker" against <nil>
I0520 11:27:00.475485 1665508 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0520 11:27:00.476185 1665508 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0520 11:27:00.530380 1665508 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:33 OomKillDisable:true NGoroutines:52 SystemTime:2024-05-20 11:27:00.520975817 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1058-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215035904 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:26.1.3 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:e377cd56a71523140ca6ae87e30244719194a521 Expected:e377cd56a71523140ca6ae87e30244719194a521} RuncCommit:{ID:v1.1.12-0-g51d5e94 Expected:v1.1.12-0-g51d5e94} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.14.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.27.0]] Warnings:<nil>}}
I0520 11:27:00.530551 1665508 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0520 11:27:00.530802 1665508 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0520 11:27:00.533425 1665508 out.go:177] * Using Docker driver with root privileges
I0520 11:27:00.535901 1665508 cni.go:84] Creating CNI manager for ""
I0520 11:27:00.535931 1665508 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
I0520 11:27:00.535943 1665508 start_flags.go:319] Found "CNI" CNI - setting NetworkPlugin=cni
I0520 11:27:00.536035 1665508 start.go:340] cluster config:
{Name:embed-certs-746238 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1715707529-18887@sha256:734a2adad159415bd51b0392bc8976bd7e3e543e9165c2374d6e59bac37aed3a Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.1 ClusterName:embed-certs-746238 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Contain
erRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.30.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuth
Sock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0520 11:27:00.539131 1665508 out.go:177] * Starting "embed-certs-746238" primary control-plane node in "embed-certs-746238" cluster
I0520 11:27:00.541819 1665508 cache.go:121] Beginning downloading kic base image for docker with crio
I0520 11:27:00.544666 1665508 out.go:177] * Pulling base image v0.0.44-1715707529-18887 ...
I0520 11:27:00.547277 1665508 preload.go:132] Checking if preload exists for k8s version v1.30.1 and runtime crio
I0520 11:27:00.547343 1665508 preload.go:147] Found local preload: /home/jenkins/minikube-integration/18925-1463640/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.1-cri-o-overlay-arm64.tar.lz4
I0520 11:27:00.547355 1665508 cache.go:56] Caching tarball of preloaded images
I0520 11:27:00.547366 1665508 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1715707529-18887@sha256:734a2adad159415bd51b0392bc8976bd7e3e543e9165c2374d6e59bac37aed3a in local docker daemon
I0520 11:27:00.547443 1665508 preload.go:173] Found /home/jenkins/minikube-integration/18925-1463640/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.1-cri-o-overlay-arm64.tar.lz4 in cache, skipping download
I0520 11:27:00.547462 1665508 cache.go:59] Finished verifying existence of preloaded tar for v1.30.1 on crio
I0520 11:27:00.547572 1665508 profile.go:143] Saving config to /home/jenkins/minikube-integration/18925-1463640/.minikube/profiles/embed-certs-746238/config.json ...
I0520 11:27:00.547596 1665508 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18925-1463640/.minikube/profiles/embed-certs-746238/config.json: {Name:mkfbada764bf631f21a9b25221ca0dff2ace95c5 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0520 11:27:00.564081 1665508 image.go:83] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1715707529-18887@sha256:734a2adad159415bd51b0392bc8976bd7e3e543e9165c2374d6e59bac37aed3a in local docker daemon, skipping pull
I0520 11:27:00.564108 1665508 cache.go:144] gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1715707529-18887@sha256:734a2adad159415bd51b0392bc8976bd7e3e543e9165c2374d6e59bac37aed3a exists in daemon, skipping load
I0520 11:27:00.564133 1665508 cache.go:194] Successfully downloaded all kic artifacts
I0520 11:27:00.564177 1665508 start.go:360] acquireMachinesLock for embed-certs-746238: {Name:mk07f80be94c2fb7194b76edb6be0c623fcf20e6 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0520 11:27:00.564719 1665508 start.go:364] duration metric: took 515.164µs to acquireMachinesLock for "embed-certs-746238"
I0520 11:27:00.564757 1665508 start.go:93] Provisioning new machine with config: &{Name:embed-certs-746238 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1715707529-18887@sha256:734a2adad159415bd51b0392bc8976bd7e3e543e9165c2374d6e59bac37aed3a Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.1 ClusterName:embed-certs-746238 Namespace:default APIServerHAVIP: APIServe
rName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.30.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false
CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.30.1 ContainerRuntime:crio ControlPlane:true Worker:true}
I0520 11:27:00.564849 1665508 start.go:125] createHost starting for "" (driver="docker")
I0520 11:27:00.568028 1665508 out.go:204] * Creating docker container (CPUs=2, Memory=2200MB) ...
I0520 11:27:00.568298 1665508 start.go:159] libmachine.API.Create for "embed-certs-746238" (driver="docker")
I0520 11:27:00.568336 1665508 client.go:168] LocalClient.Create starting
I0520 11:27:00.568432 1665508 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/18925-1463640/.minikube/certs/ca.pem
I0520 11:27:00.568476 1665508 main.go:141] libmachine: Decoding PEM data...
I0520 11:27:00.568496 1665508 main.go:141] libmachine: Parsing certificate...
I0520 11:27:00.568554 1665508 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/18925-1463640/.minikube/certs/cert.pem
I0520 11:27:00.568579 1665508 main.go:141] libmachine: Decoding PEM data...
I0520 11:27:00.568589 1665508 main.go:141] libmachine: Parsing certificate...
I0520 11:27:00.568965 1665508 cli_runner.go:164] Run: docker network inspect embed-certs-746238 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
W0520 11:27:00.583701 1665508 cli_runner.go:211] docker network inspect embed-certs-746238 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
I0520 11:27:00.583794 1665508 network_create.go:281] running [docker network inspect embed-certs-746238] to gather additional debugging logs...
I0520 11:27:00.583823 1665508 cli_runner.go:164] Run: docker network inspect embed-certs-746238
W0520 11:27:00.598461 1665508 cli_runner.go:211] docker network inspect embed-certs-746238 returned with exit code 1
I0520 11:27:00.598508 1665508 network_create.go:284] error running [docker network inspect embed-certs-746238]: docker network inspect embed-certs-746238: exit status 1
stdout:
[]
stderr:
Error response from daemon: network embed-certs-746238 not found
I0520 11:27:00.598522 1665508 network_create.go:286] output of [docker network inspect embed-certs-746238]: -- stdout --
[]
-- /stdout --
** stderr **
Error response from daemon: network embed-certs-746238 not found
** /stderr **
I0520 11:27:00.598637 1665508 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0520 11:27:00.613401 1665508 network.go:211] skipping subnet 192.168.49.0/24 that is taken: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName:br-8c4bd3e0faae IfaceIPv4:192.168.49.1 IfaceMTU:1500 IfaceMAC:02:42:ec:12:dd:0e} reservation:<nil>}
I0520 11:27:00.613939 1665508 network.go:211] skipping subnet 192.168.58.0/24 that is taken: &{IP:192.168.58.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.58.0/24 Gateway:192.168.58.1 ClientMin:192.168.58.2 ClientMax:192.168.58.254 Broadcast:192.168.58.255 IsPrivate:true Interface:{IfaceName:br-826182de0a36 IfaceIPv4:192.168.58.1 IfaceMTU:1500 IfaceMAC:02:42:81:f4:78:27} reservation:<nil>}
I0520 11:27:00.614385 1665508 network.go:211] skipping subnet 192.168.67.0/24 that is taken: &{IP:192.168.67.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.67.0/24 Gateway:192.168.67.1 ClientMin:192.168.67.2 ClientMax:192.168.67.254 Broadcast:192.168.67.255 IsPrivate:true Interface:{IfaceName:br-79381957ebaa IfaceIPv4:192.168.67.1 IfaceMTU:1500 IfaceMAC:02:42:bf:b6:44:9d} reservation:<nil>}
I0520 11:27:00.614912 1665508 network.go:211] skipping subnet 192.168.76.0/24 that is taken: &{IP:192.168.76.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.76.0/24 Gateway:192.168.76.1 ClientMin:192.168.76.2 ClientMax:192.168.76.254 Broadcast:192.168.76.255 IsPrivate:true Interface:{IfaceName:br-90b2363a1f83 IfaceIPv4:192.168.76.1 IfaceMTU:1500 IfaceMAC:02:42:6c:6f:9f:af} reservation:<nil>}
I0520 11:27:00.615476 1665508 network.go:206] using free private subnet 192.168.85.0/24: &{IP:192.168.85.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.85.0/24 Gateway:192.168.85.1 ClientMin:192.168.85.2 ClientMax:192.168.85.254 Broadcast:192.168.85.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0x40017c2190}
I0520 11:27:00.615505 1665508 network_create.go:124] attempt to create docker network embed-certs-746238 192.168.85.0/24 with gateway 192.168.85.1 and MTU of 1500 ...
I0520 11:27:00.615572 1665508 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.85.0/24 --gateway=192.168.85.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=embed-certs-746238 embed-certs-746238
I0520 11:27:00.678470 1665508 network_create.go:108] docker network embed-certs-746238 192.168.85.0/24 created
I0520 11:27:00.678504 1665508 kic.go:121] calculated static IP "192.168.85.2" for the "embed-certs-746238" container
I0520 11:27:00.678582 1665508 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
I0520 11:27:00.693608 1665508 cli_runner.go:164] Run: docker volume create embed-certs-746238 --label name.minikube.sigs.k8s.io=embed-certs-746238 --label created_by.minikube.sigs.k8s.io=true
I0520 11:27:00.712179 1665508 oci.go:103] Successfully created a docker volume embed-certs-746238
I0520 11:27:00.712273 1665508 cli_runner.go:164] Run: docker run --rm --name embed-certs-746238-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=embed-certs-746238 --entrypoint /usr/bin/test -v embed-certs-746238:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1715707529-18887@sha256:734a2adad159415bd51b0392bc8976bd7e3e543e9165c2374d6e59bac37aed3a -d /var/lib
I0520 11:27:01.405030 1665508 oci.go:107] Successfully prepared a docker volume embed-certs-746238
I0520 11:27:01.405093 1665508 preload.go:132] Checking if preload exists for k8s version v1.30.1 and runtime crio
I0520 11:27:01.405114 1665508 kic.go:194] Starting extracting preloaded images to volume ...
I0520 11:27:01.405196 1665508 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/18925-1463640/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.1-cri-o-overlay-arm64.tar.lz4:/preloaded.tar:ro -v embed-certs-746238:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1715707529-18887@sha256:734a2adad159415bd51b0392bc8976bd7e3e543e9165c2374d6e59bac37aed3a -I lz4 -xf /preloaded.tar -C /extractDir
I0520 11:27:05.196731 1657011 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0520 11:27:05.209371 1657011 api_server.go:72] duration metric: took 5m56.762872229s to wait for apiserver process to appear ...
I0520 11:27:05.209406 1657011 api_server.go:88] waiting for apiserver healthz status ...
I0520 11:27:05.209441 1657011 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0520 11:27:05.209503 1657011 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0520 11:27:05.254986 1657011 cri.go:89] found id: "0b14a0f156605ce747bbd3ec92b34eb3ecf92d995ef08cfe0d147e8a56eb0eb3"
I0520 11:27:05.255010 1657011 cri.go:89] found id: ""
I0520 11:27:05.255018 1657011 logs.go:276] 1 containers: [0b14a0f156605ce747bbd3ec92b34eb3ecf92d995ef08cfe0d147e8a56eb0eb3]
I0520 11:27:05.255097 1657011 ssh_runner.go:195] Run: which crictl
I0520 11:27:05.258937 1657011 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0520 11:27:05.259014 1657011 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0520 11:27:05.304683 1657011 cri.go:89] found id: "a0c29f0d3e719d5fdc0931e9109cfae19b3167c2b4e839f25c7b1b63784a02a4"
I0520 11:27:05.304705 1657011 cri.go:89] found id: ""
I0520 11:27:05.304712 1657011 logs.go:276] 1 containers: [a0c29f0d3e719d5fdc0931e9109cfae19b3167c2b4e839f25c7b1b63784a02a4]
I0520 11:27:05.304776 1657011 ssh_runner.go:195] Run: which crictl
I0520 11:27:05.308619 1657011 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0520 11:27:05.308696 1657011 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0520 11:27:05.363412 1657011 cri.go:89] found id: "e346471df6217fe773e2ef8f7b75f5b46cd71d6eb9cbc805448692e543b15853"
I0520 11:27:05.363436 1657011 cri.go:89] found id: ""
I0520 11:27:05.363445 1657011 logs.go:276] 1 containers: [e346471df6217fe773e2ef8f7b75f5b46cd71d6eb9cbc805448692e543b15853]
I0520 11:27:05.363501 1657011 ssh_runner.go:195] Run: which crictl
I0520 11:27:05.368214 1657011 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0520 11:27:05.368293 1657011 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0520 11:27:05.406961 1657011 cri.go:89] found id: "200301c79d92cc1dca51aa9d3818041786dbc0fc25722073be3c056ab8ddc40d"
I0520 11:27:05.406985 1657011 cri.go:89] found id: ""
I0520 11:27:05.407004 1657011 logs.go:276] 1 containers: [200301c79d92cc1dca51aa9d3818041786dbc0fc25722073be3c056ab8ddc40d]
I0520 11:27:05.407109 1657011 ssh_runner.go:195] Run: which crictl
I0520 11:27:05.410985 1657011 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0520 11:27:05.411075 1657011 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0520 11:27:05.452948 1657011 cri.go:89] found id: "b026cb8ba53f0d1f48335254f05077b2a31ee7e5a35af6a7b530c5f18dccae5a"
I0520 11:27:05.452972 1657011 cri.go:89] found id: ""
I0520 11:27:05.452981 1657011 logs.go:276] 1 containers: [b026cb8ba53f0d1f48335254f05077b2a31ee7e5a35af6a7b530c5f18dccae5a]
I0520 11:27:05.453039 1657011 ssh_runner.go:195] Run: which crictl
I0520 11:27:05.456828 1657011 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0520 11:27:05.456935 1657011 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0520 11:27:05.496976 1657011 cri.go:89] found id: "7f0c6c3acf70df9c58574fae04af747df228563cb3da7252a8324c5242528d4e"
I0520 11:27:05.496998 1657011 cri.go:89] found id: ""
I0520 11:27:05.497006 1657011 logs.go:276] 1 containers: [7f0c6c3acf70df9c58574fae04af747df228563cb3da7252a8324c5242528d4e]
I0520 11:27:05.497084 1657011 ssh_runner.go:195] Run: which crictl
I0520 11:27:05.500811 1657011 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0520 11:27:05.500907 1657011 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0520 11:27:05.543135 1657011 cri.go:89] found id: "b92863fb0bcbb6bb4f4fb5c32ac048568d8bea72be8749218a1c81ceb8dcbf67"
I0520 11:27:05.543154 1657011 cri.go:89] found id: ""
I0520 11:27:05.543162 1657011 logs.go:276] 1 containers: [b92863fb0bcbb6bb4f4fb5c32ac048568d8bea72be8749218a1c81ceb8dcbf67]
I0520 11:27:05.543221 1657011 ssh_runner.go:195] Run: which crictl
I0520 11:27:05.547142 1657011 cri.go:54] listing CRI containers in root : {State:all Name:storage-provisioner Namespaces:[]}
I0520 11:27:05.547234 1657011 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0520 11:27:05.606997 1657011 cri.go:89] found id: "80aac8daed1fe77959700c7a1f1a34853c09f3dbeb46648d0ab015345f91e607"
I0520 11:27:05.607065 1657011 cri.go:89] found id: ""
I0520 11:27:05.607080 1657011 logs.go:276] 1 containers: [80aac8daed1fe77959700c7a1f1a34853c09f3dbeb46648d0ab015345f91e607]
I0520 11:27:05.607144 1657011 ssh_runner.go:195] Run: which crictl
I0520 11:27:05.610756 1657011 cri.go:54] listing CRI containers in root : {State:all Name:kubernetes-dashboard Namespaces:[]}
I0520 11:27:05.610852 1657011 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I0520 11:27:05.656696 1657011 cri.go:89] found id: "478b985a70c80d44c1dc3a606124f6d8d1a1b16caa15815f4d319199182b0973"
I0520 11:27:05.656718 1657011 cri.go:89] found id: ""
I0520 11:27:05.656726 1657011 logs.go:276] 1 containers: [478b985a70c80d44c1dc3a606124f6d8d1a1b16caa15815f4d319199182b0973]
I0520 11:27:05.656785 1657011 ssh_runner.go:195] Run: which crictl
I0520 11:27:05.660781 1657011 logs.go:123] Gathering logs for coredns [e346471df6217fe773e2ef8f7b75f5b46cd71d6eb9cbc805448692e543b15853] ...
I0520 11:27:05.660806 1657011 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e346471df6217fe773e2ef8f7b75f5b46cd71d6eb9cbc805448692e543b15853"
I0520 11:27:05.702546 1657011 logs.go:123] Gathering logs for kubernetes-dashboard [478b985a70c80d44c1dc3a606124f6d8d1a1b16caa15815f4d319199182b0973] ...
I0520 11:27:05.702574 1657011 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 478b985a70c80d44c1dc3a606124f6d8d1a1b16caa15815f4d319199182b0973"
I0520 11:27:05.745356 1657011 logs.go:123] Gathering logs for CRI-O ...
I0520 11:27:05.745387 1657011 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0520 11:27:05.825181 1657011 logs.go:123] Gathering logs for kube-scheduler [200301c79d92cc1dca51aa9d3818041786dbc0fc25722073be3c056ab8ddc40d] ...
I0520 11:27:05.825267 1657011 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 200301c79d92cc1dca51aa9d3818041786dbc0fc25722073be3c056ab8ddc40d"
I0520 11:27:05.870836 1657011 logs.go:123] Gathering logs for kindnet [b92863fb0bcbb6bb4f4fb5c32ac048568d8bea72be8749218a1c81ceb8dcbf67] ...
I0520 11:27:05.870867 1657011 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 b92863fb0bcbb6bb4f4fb5c32ac048568d8bea72be8749218a1c81ceb8dcbf67"
I0520 11:27:05.915034 1657011 logs.go:123] Gathering logs for describe nodes ...
I0520 11:27:05.915072 1657011 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0520 11:27:06.107107 1657011 logs.go:123] Gathering logs for kube-apiserver [0b14a0f156605ce747bbd3ec92b34eb3ecf92d995ef08cfe0d147e8a56eb0eb3] ...
I0520 11:27:06.107145 1657011 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 0b14a0f156605ce747bbd3ec92b34eb3ecf92d995ef08cfe0d147e8a56eb0eb3"
I0520 11:27:06.202380 1657011 logs.go:123] Gathering logs for kube-proxy [b026cb8ba53f0d1f48335254f05077b2a31ee7e5a35af6a7b530c5f18dccae5a] ...
I0520 11:27:06.202416 1657011 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 b026cb8ba53f0d1f48335254f05077b2a31ee7e5a35af6a7b530c5f18dccae5a"
I0520 11:27:06.263898 1657011 logs.go:123] Gathering logs for kube-controller-manager [7f0c6c3acf70df9c58574fae04af747df228563cb3da7252a8324c5242528d4e] ...
I0520 11:27:06.263929 1657011 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 7f0c6c3acf70df9c58574fae04af747df228563cb3da7252a8324c5242528d4e"
I0520 11:27:06.385051 1657011 logs.go:123] Gathering logs for container status ...
I0520 11:27:06.385089 1657011 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0520 11:27:06.468248 1657011 logs.go:123] Gathering logs for kubelet ...
I0520 11:27:06.468281 1657011 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0520 11:27:06.537324 1657011 logs.go:138] Found kubelet problem: May 20 11:21:26 old-k8s-version-776336 kubelet[730]: E0520 11:21:26.809242 730 reflector.go:138] object-"kube-system"/"kube-proxy-token-dxbg4": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kube-proxy-token-dxbg4" is forbidden: User "system:node:old-k8s-version-776336" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-776336' and this object
W0520 11:27:06.537613 1657011 logs.go:138] Found kubelet problem: May 20 11:21:26 old-k8s-version-776336 kubelet[730]: E0520 11:21:26.815246 730 reflector.go:138] object-"kube-system"/"metrics-server-token-lstwk": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "metrics-server-token-lstwk" is forbidden: User "system:node:old-k8s-version-776336" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-776336' and this object
W0520 11:27:06.537878 1657011 logs.go:138] Found kubelet problem: May 20 11:21:26 old-k8s-version-776336 kubelet[730]: E0520 11:21:26.815362 730 reflector.go:138] object-"kube-system"/"kindnet-token-5d2mm": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kindnet-token-5d2mm" is forbidden: User "system:node:old-k8s-version-776336" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-776336' and this object
W0520 11:27:06.538107 1657011 logs.go:138] Found kubelet problem: May 20 11:21:26 old-k8s-version-776336 kubelet[730]: E0520 11:21:26.815419 730 reflector.go:138] object-"default"/"default-token-2c9fs": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "default-token-2c9fs" is forbidden: User "system:node:old-k8s-version-776336" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'old-k8s-version-776336' and this object
W0520 11:27:06.538331 1657011 logs.go:138] Found kubelet problem: May 20 11:21:26 old-k8s-version-776336 kubelet[730]: E0520 11:21:26.815480 730 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:old-k8s-version-776336" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-776336' and this object
W0520 11:27:06.538553 1657011 logs.go:138] Found kubelet problem: May 20 11:21:26 old-k8s-version-776336 kubelet[730]: E0520 11:21:26.815526 730 reflector.go:138] object-"kube-system"/"coredns": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:old-k8s-version-776336" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-776336' and this object
W0520 11:27:06.538781 1657011 logs.go:138] Found kubelet problem: May 20 11:21:26 old-k8s-version-776336 kubelet[730]: E0520 11:21:26.815596 730 reflector.go:138] object-"kube-system"/"coredns-token-8nh95": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "coredns-token-8nh95" is forbidden: User "system:node:old-k8s-version-776336" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-776336' and this object
W0520 11:27:06.539091 1657011 logs.go:138] Found kubelet problem: May 20 11:21:26 old-k8s-version-776336 kubelet[730]: E0520 11:21:26.818042 730 reflector.go:138] object-"kube-system"/"storage-provisioner-token-jt6tq": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "storage-provisioner-token-jt6tq" is forbidden: User "system:node:old-k8s-version-776336" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-776336' and this object
W0520 11:27:06.551716 1657011 logs.go:138] Found kubelet problem: May 20 11:21:30 old-k8s-version-776336 kubelet[730]: E0520 11:21:30.748462 730 pod_workers.go:191] Error syncing pod eb2910c3-cbac-462e-901e-4fb79caf95bf ("metrics-server-9975d5f86-qdks4_kube-system(eb2910c3-cbac-462e-901e-4fb79caf95bf)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0520 11:27:06.552134 1657011 logs.go:138] Found kubelet problem: May 20 11:21:31 old-k8s-version-776336 kubelet[730]: E0520 11:21:31.360081 730 pod_workers.go:191] Error syncing pod eb2910c3-cbac-462e-901e-4fb79caf95bf ("metrics-server-9975d5f86-qdks4_kube-system(eb2910c3-cbac-462e-901e-4fb79caf95bf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:27:06.554483 1657011 logs.go:138] Found kubelet problem: May 20 11:21:42 old-k8s-version-776336 kubelet[730]: E0520 11:21:42.354554 730 pod_workers.go:191] Error syncing pod eb2910c3-cbac-462e-901e-4fb79caf95bf ("metrics-server-9975d5f86-qdks4_kube-system(eb2910c3-cbac-462e-901e-4fb79caf95bf)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0520 11:27:06.556998 1657011 logs.go:138] Found kubelet problem: May 20 11:21:55 old-k8s-version-776336 kubelet[730]: E0520 11:21:55.457689 730 pod_workers.go:191] Error syncing pod 2c684adc-682c-4c95-a80c-90b35ac50afd ("dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"
W0520 11:27:06.557750 1657011 logs.go:138] Found kubelet problem: May 20 11:21:56 old-k8s-version-776336 kubelet[730]: E0520 11:21:56.460106 730 pod_workers.go:191] Error syncing pod 2c684adc-682c-4c95-a80c-90b35ac50afd ("dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"
W0520 11:27:06.557970 1657011 logs.go:138] Found kubelet problem: May 20 11:21:57 old-k8s-version-776336 kubelet[730]: E0520 11:21:57.311677 730 pod_workers.go:191] Error syncing pod eb2910c3-cbac-462e-901e-4fb79caf95bf ("metrics-server-9975d5f86-qdks4_kube-system(eb2910c3-cbac-462e-901e-4fb79caf95bf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:27:06.558322 1657011 logs.go:138] Found kubelet problem: May 20 11:22:02 old-k8s-version-776336 kubelet[730]: E0520 11:22:02.482262 730 pod_workers.go:191] Error syncing pod 2c684adc-682c-4c95-a80c-90b35ac50afd ("dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"
W0520 11:27:06.562435 1657011 logs.go:138] Found kubelet problem: May 20 11:22:08 old-k8s-version-776336 kubelet[730]: E0520 11:22:08.322783 730 pod_workers.go:191] Error syncing pod eb2910c3-cbac-462e-901e-4fb79caf95bf ("metrics-server-9975d5f86-qdks4_kube-system(eb2910c3-cbac-462e-901e-4fb79caf95bf)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0520 11:27:06.563063 1657011 logs.go:138] Found kubelet problem: May 20 11:22:17 old-k8s-version-776336 kubelet[730]: E0520 11:22:17.507098 730 pod_workers.go:191] Error syncing pod 2c684adc-682c-4c95-a80c-90b35ac50afd ("dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"
W0520 11:27:06.563422 1657011 logs.go:138] Found kubelet problem: May 20 11:22:22 old-k8s-version-776336 kubelet[730]: E0520 11:22:22.482798 730 pod_workers.go:191] Error syncing pod 2c684adc-682c-4c95-a80c-90b35ac50afd ("dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"
W0520 11:27:06.563636 1657011 logs.go:138] Found kubelet problem: May 20 11:22:23 old-k8s-version-776336 kubelet[730]: E0520 11:22:23.311553 730 pod_workers.go:191] Error syncing pod eb2910c3-cbac-462e-901e-4fb79caf95bf ("metrics-server-9975d5f86-qdks4_kube-system(eb2910c3-cbac-462e-901e-4fb79caf95bf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:27:06.563979 1657011 logs.go:138] Found kubelet problem: May 20 11:22:36 old-k8s-version-776336 kubelet[730]: E0520 11:22:36.311591 730 pod_workers.go:191] Error syncing pod 2c684adc-682c-4c95-a80c-90b35ac50afd ("dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"
W0520 11:27:06.564191 1657011 logs.go:138] Found kubelet problem: May 20 11:22:38 old-k8s-version-776336 kubelet[730]: E0520 11:22:38.312311 730 pod_workers.go:191] Error syncing pod eb2910c3-cbac-462e-901e-4fb79caf95bf ("metrics-server-9975d5f86-qdks4_kube-system(eb2910c3-cbac-462e-901e-4fb79caf95bf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:27:06.565819 1657011 logs.go:138] Found kubelet problem: May 20 11:22:47 old-k8s-version-776336 kubelet[730]: E0520 11:22:47.567324 730 pod_workers.go:191] Error syncing pod 2c684adc-682c-4c95-a80c-90b35ac50afd ("dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"
W0520 11:27:06.566199 1657011 logs.go:138] Found kubelet problem: May 20 11:22:52 old-k8s-version-776336 kubelet[730]: E0520 11:22:52.482120 730 pod_workers.go:191] Error syncing pod 2c684adc-682c-4c95-a80c-90b35ac50afd ("dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"
W0520 11:27:06.568339 1657011 logs.go:138] Found kubelet problem: May 20 11:22:53 old-k8s-version-776336 kubelet[730]: E0520 11:22:53.323112 730 pod_workers.go:191] Error syncing pod eb2910c3-cbac-462e-901e-4fb79caf95bf ("metrics-server-9975d5f86-qdks4_kube-system(eb2910c3-cbac-462e-901e-4fb79caf95bf)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0520 11:27:06.568700 1657011 logs.go:138] Found kubelet problem: May 20 11:23:05 old-k8s-version-776336 kubelet[730]: E0520 11:23:05.311216 730 pod_workers.go:191] Error syncing pod 2c684adc-682c-4c95-a80c-90b35ac50afd ("dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"
W0520 11:27:06.568889 1657011 logs.go:138] Found kubelet problem: May 20 11:23:05 old-k8s-version-776336 kubelet[730]: E0520 11:23:05.312235 730 pod_workers.go:191] Error syncing pod eb2910c3-cbac-462e-901e-4fb79caf95bf ("metrics-server-9975d5f86-qdks4_kube-system(eb2910c3-cbac-462e-901e-4fb79caf95bf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:27:06.569217 1657011 logs.go:138] Found kubelet problem: May 20 11:23:18 old-k8s-version-776336 kubelet[730]: E0520 11:23:18.311005 730 pod_workers.go:191] Error syncing pod 2c684adc-682c-4c95-a80c-90b35ac50afd ("dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"
W0520 11:27:06.569422 1657011 logs.go:138] Found kubelet problem: May 20 11:23:19 old-k8s-version-776336 kubelet[730]: E0520 11:23:19.311931 730 pod_workers.go:191] Error syncing pod eb2910c3-cbac-462e-901e-4fb79caf95bf ("metrics-server-9975d5f86-qdks4_kube-system(eb2910c3-cbac-462e-901e-4fb79caf95bf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:27:06.569956 1657011 logs.go:138] Found kubelet problem: May 20 11:23:34 old-k8s-version-776336 kubelet[730]: E0520 11:23:34.312149 730 pod_workers.go:191] Error syncing pod eb2910c3-cbac-462e-901e-4fb79caf95bf ("metrics-server-9975d5f86-qdks4_kube-system(eb2910c3-cbac-462e-901e-4fb79caf95bf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:27:06.570314 1657011 logs.go:138] Found kubelet problem: May 20 11:23:34 old-k8s-version-776336 kubelet[730]: E0520 11:23:34.647790 730 pod_workers.go:191] Error syncing pod 2c684adc-682c-4c95-a80c-90b35ac50afd ("dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"
W0520 11:27:06.570675 1657011 logs.go:138] Found kubelet problem: May 20 11:23:42 old-k8s-version-776336 kubelet[730]: E0520 11:23:42.482249 730 pod_workers.go:191] Error syncing pod 2c684adc-682c-4c95-a80c-90b35ac50afd ("dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"
W0520 11:27:06.570884 1657011 logs.go:138] Found kubelet problem: May 20 11:23:48 old-k8s-version-776336 kubelet[730]: E0520 11:23:48.311989 730 pod_workers.go:191] Error syncing pod eb2910c3-cbac-462e-901e-4fb79caf95bf ("metrics-server-9975d5f86-qdks4_kube-system(eb2910c3-cbac-462e-901e-4fb79caf95bf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:27:06.571243 1657011 logs.go:138] Found kubelet problem: May 20 11:23:54 old-k8s-version-776336 kubelet[730]: E0520 11:23:54.311066 730 pod_workers.go:191] Error syncing pod 2c684adc-682c-4c95-a80c-90b35ac50afd ("dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"
W0520 11:27:06.571465 1657011 logs.go:138] Found kubelet problem: May 20 11:24:02 old-k8s-version-776336 kubelet[730]: E0520 11:24:02.312243 730 pod_workers.go:191] Error syncing pod eb2910c3-cbac-462e-901e-4fb79caf95bf ("metrics-server-9975d5f86-qdks4_kube-system(eb2910c3-cbac-462e-901e-4fb79caf95bf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:27:06.571815 1657011 logs.go:138] Found kubelet problem: May 20 11:24:06 old-k8s-version-776336 kubelet[730]: E0520 11:24:06.313386 730 pod_workers.go:191] Error syncing pod 2c684adc-682c-4c95-a80c-90b35ac50afd ("dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"
W0520 11:27:06.574161 1657011 logs.go:138] Found kubelet problem: May 20 11:24:17 old-k8s-version-776336 kubelet[730]: E0520 11:24:17.319931 730 pod_workers.go:191] Error syncing pod eb2910c3-cbac-462e-901e-4fb79caf95bf ("metrics-server-9975d5f86-qdks4_kube-system(eb2910c3-cbac-462e-901e-4fb79caf95bf)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0520 11:27:06.574523 1657011 logs.go:138] Found kubelet problem: May 20 11:24:19 old-k8s-version-776336 kubelet[730]: E0520 11:24:19.310996 730 pod_workers.go:191] Error syncing pod 2c684adc-682c-4c95-a80c-90b35ac50afd ("dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"
W0520 11:27:06.574733 1657011 logs.go:138] Found kubelet problem: May 20 11:24:28 old-k8s-version-776336 kubelet[730]: E0520 11:24:28.311548 730 pod_workers.go:191] Error syncing pod eb2910c3-cbac-462e-901e-4fb79caf95bf ("metrics-server-9975d5f86-qdks4_kube-system(eb2910c3-cbac-462e-901e-4fb79caf95bf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:27:06.575111 1657011 logs.go:138] Found kubelet problem: May 20 11:24:32 old-k8s-version-776336 kubelet[730]: E0520 11:24:32.310984 730 pod_workers.go:191] Error syncing pod 2c684adc-682c-4c95-a80c-90b35ac50afd ("dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"
W0520 11:27:06.575465 1657011 logs.go:138] Found kubelet problem: May 20 11:24:43 old-k8s-version-776336 kubelet[730]: E0520 11:24:43.311302 730 pod_workers.go:191] Error syncing pod 2c684adc-682c-4c95-a80c-90b35ac50afd ("dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"
W0520 11:27:06.575675 1657011 logs.go:138] Found kubelet problem: May 20 11:24:43 old-k8s-version-776336 kubelet[730]: E0520 11:24:43.312650 730 pod_workers.go:191] Error syncing pod eb2910c3-cbac-462e-901e-4fb79caf95bf ("metrics-server-9975d5f86-qdks4_kube-system(eb2910c3-cbac-462e-901e-4fb79caf95bf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:27:06.576077 1657011 logs.go:138] Found kubelet problem: May 20 11:24:58 old-k8s-version-776336 kubelet[730]: E0520 11:24:58.313801 730 pod_workers.go:191] Error syncing pod eb2910c3-cbac-462e-901e-4fb79caf95bf ("metrics-server-9975d5f86-qdks4_kube-system(eb2910c3-cbac-462e-901e-4fb79caf95bf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:27:06.576602 1657011 logs.go:138] Found kubelet problem: May 20 11:24:59 old-k8s-version-776336 kubelet[730]: E0520 11:24:59.771509 730 pod_workers.go:191] Error syncing pod 2c684adc-682c-4c95-a80c-90b35ac50afd ("dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"
W0520 11:27:06.577160 1657011 logs.go:138] Found kubelet problem: May 20 11:25:02 old-k8s-version-776336 kubelet[730]: E0520 11:25:02.482351 730 pod_workers.go:191] Error syncing pod 2c684adc-682c-4c95-a80c-90b35ac50afd ("dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"
W0520 11:27:06.577361 1657011 logs.go:138] Found kubelet problem: May 20 11:25:13 old-k8s-version-776336 kubelet[730]: E0520 11:25:13.311740 730 pod_workers.go:191] Error syncing pod eb2910c3-cbac-462e-901e-4fb79caf95bf ("metrics-server-9975d5f86-qdks4_kube-system(eb2910c3-cbac-462e-901e-4fb79caf95bf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:27:06.577700 1657011 logs.go:138] Found kubelet problem: May 20 11:25:14 old-k8s-version-776336 kubelet[730]: E0520 11:25:14.311041 730 pod_workers.go:191] Error syncing pod 2c684adc-682c-4c95-a80c-90b35ac50afd ("dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"
W0520 11:27:06.578552 1657011 logs.go:138] Found kubelet problem: May 20 11:25:26 old-k8s-version-776336 kubelet[730]: E0520 11:25:26.311269 730 pod_workers.go:191] Error syncing pod 2c684adc-682c-4c95-a80c-90b35ac50afd ("dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"
W0520 11:27:06.578740 1657011 logs.go:138] Found kubelet problem: May 20 11:25:28 old-k8s-version-776336 kubelet[730]: E0520 11:25:28.311449 730 pod_workers.go:191] Error syncing pod eb2910c3-cbac-462e-901e-4fb79caf95bf ("metrics-server-9975d5f86-qdks4_kube-system(eb2910c3-cbac-462e-901e-4fb79caf95bf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:27:06.579075 1657011 logs.go:138] Found kubelet problem: May 20 11:25:40 old-k8s-version-776336 kubelet[730]: E0520 11:25:40.311409 730 pod_workers.go:191] Error syncing pod 2c684adc-682c-4c95-a80c-90b35ac50afd ("dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"
W0520 11:27:06.579263 1657011 logs.go:138] Found kubelet problem: May 20 11:25:40 old-k8s-version-776336 kubelet[730]: E0520 11:25:40.312759 730 pod_workers.go:191] Error syncing pod eb2910c3-cbac-462e-901e-4fb79caf95bf ("metrics-server-9975d5f86-qdks4_kube-system(eb2910c3-cbac-462e-901e-4fb79caf95bf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:27:06.579647 1657011 logs.go:138] Found kubelet problem: May 20 11:25:52 old-k8s-version-776336 kubelet[730]: E0520 11:25:52.311113 730 pod_workers.go:191] Error syncing pod 2c684adc-682c-4c95-a80c-90b35ac50afd ("dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"
W0520 11:27:06.579896 1657011 logs.go:138] Found kubelet problem: May 20 11:25:53 old-k8s-version-776336 kubelet[730]: E0520 11:25:53.311487 730 pod_workers.go:191] Error syncing pod eb2910c3-cbac-462e-901e-4fb79caf95bf ("metrics-server-9975d5f86-qdks4_kube-system(eb2910c3-cbac-462e-901e-4fb79caf95bf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:27:06.580290 1657011 logs.go:138] Found kubelet problem: May 20 11:26:05 old-k8s-version-776336 kubelet[730]: E0520 11:26:05.311044 730 pod_workers.go:191] Error syncing pod 2c684adc-682c-4c95-a80c-90b35ac50afd ("dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"
W0520 11:27:06.580502 1657011 logs.go:138] Found kubelet problem: May 20 11:26:07 old-k8s-version-776336 kubelet[730]: E0520 11:26:07.311454 730 pod_workers.go:191] Error syncing pod eb2910c3-cbac-462e-901e-4fb79caf95bf ("metrics-server-9975d5f86-qdks4_kube-system(eb2910c3-cbac-462e-901e-4fb79caf95bf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:27:06.581101 1657011 logs.go:138] Found kubelet problem: May 20 11:26:17 old-k8s-version-776336 kubelet[730]: E0520 11:26:17.312403 730 pod_workers.go:191] Error syncing pod 2c684adc-682c-4c95-a80c-90b35ac50afd ("dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"
W0520 11:27:06.581310 1657011 logs.go:138] Found kubelet problem: May 20 11:26:22 old-k8s-version-776336 kubelet[730]: E0520 11:26:22.311955 730 pod_workers.go:191] Error syncing pod eb2910c3-cbac-462e-901e-4fb79caf95bf ("metrics-server-9975d5f86-qdks4_kube-system(eb2910c3-cbac-462e-901e-4fb79caf95bf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:27:06.581693 1657011 logs.go:138] Found kubelet problem: May 20 11:26:29 old-k8s-version-776336 kubelet[730]: E0520 11:26:29.310991 730 pod_workers.go:191] Error syncing pod 2c684adc-682c-4c95-a80c-90b35ac50afd ("dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"
W0520 11:27:06.581904 1657011 logs.go:138] Found kubelet problem: May 20 11:26:35 old-k8s-version-776336 kubelet[730]: E0520 11:26:35.311614 730 pod_workers.go:191] Error syncing pod eb2910c3-cbac-462e-901e-4fb79caf95bf ("metrics-server-9975d5f86-qdks4_kube-system(eb2910c3-cbac-462e-901e-4fb79caf95bf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:27:06.582279 1657011 logs.go:138] Found kubelet problem: May 20 11:26:40 old-k8s-version-776336 kubelet[730]: E0520 11:26:40.310989 730 pod_workers.go:191] Error syncing pod 2c684adc-682c-4c95-a80c-90b35ac50afd ("dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"
W0520 11:27:06.582688 1657011 logs.go:138] Found kubelet problem: May 20 11:26:46 old-k8s-version-776336 kubelet[730]: E0520 11:26:46.315105 730 pod_workers.go:191] Error syncing pod eb2910c3-cbac-462e-901e-4fb79caf95bf ("metrics-server-9975d5f86-qdks4_kube-system(eb2910c3-cbac-462e-901e-4fb79caf95bf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:27:06.583045 1657011 logs.go:138] Found kubelet problem: May 20 11:26:53 old-k8s-version-776336 kubelet[730]: E0520 11:26:53.310994 730 pod_workers.go:191] Error syncing pod 2c684adc-682c-4c95-a80c-90b35ac50afd ("dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"
W0520 11:27:06.583283 1657011 logs.go:138] Found kubelet problem: May 20 11:26:57 old-k8s-version-776336 kubelet[730]: E0520 11:26:57.312314 730 pod_workers.go:191] Error syncing pod eb2910c3-cbac-462e-901e-4fb79caf95bf ("metrics-server-9975d5f86-qdks4_kube-system(eb2910c3-cbac-462e-901e-4fb79caf95bf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:27:06.583664 1657011 logs.go:138] Found kubelet problem: May 20 11:27:06 old-k8s-version-776336 kubelet[730]: E0520 11:27:06.311519 730 pod_workers.go:191] Error syncing pod 2c684adc-682c-4c95-a80c-90b35ac50afd ("dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"
I0520 11:27:06.583679 1657011 logs.go:123] Gathering logs for dmesg ...
I0520 11:27:06.583709 1657011 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0520 11:27:06.607566 1657011 logs.go:123] Gathering logs for etcd [a0c29f0d3e719d5fdc0931e9109cfae19b3167c2b4e839f25c7b1b63784a02a4] ...
I0520 11:27:06.607599 1657011 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 a0c29f0d3e719d5fdc0931e9109cfae19b3167c2b4e839f25c7b1b63784a02a4"
I0520 11:27:06.704593 1657011 logs.go:123] Gathering logs for storage-provisioner [80aac8daed1fe77959700c7a1f1a34853c09f3dbeb46648d0ab015345f91e607] ...
I0520 11:27:06.704637 1657011 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 80aac8daed1fe77959700c7a1f1a34853c09f3dbeb46648d0ab015345f91e607"
I0520 11:27:06.755173 1657011 out.go:304] Setting ErrFile to fd 2...
I0520 11:27:06.755199 1657011 out.go:338] TERM=,COLORTERM=, which probably does not support color
W0520 11:27:06.755246 1657011 out.go:239] X Problems detected in kubelet:
W0520 11:27:06.755260 1657011 out.go:239] May 20 11:26:40 old-k8s-version-776336 kubelet[730]: E0520 11:26:40.310989 730 pod_workers.go:191] Error syncing pod 2c684adc-682c-4c95-a80c-90b35ac50afd ("dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"
W0520 11:27:06.755267 1657011 out.go:239] May 20 11:26:46 old-k8s-version-776336 kubelet[730]: E0520 11:26:46.315105 730 pod_workers.go:191] Error syncing pod eb2910c3-cbac-462e-901e-4fb79caf95bf ("metrics-server-9975d5f86-qdks4_kube-system(eb2910c3-cbac-462e-901e-4fb79caf95bf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:27:06.755278 1657011 out.go:239] May 20 11:26:53 old-k8s-version-776336 kubelet[730]: E0520 11:26:53.310994 730 pod_workers.go:191] Error syncing pod 2c684adc-682c-4c95-a80c-90b35ac50afd ("dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"
W0520 11:27:06.755303 1657011 out.go:239] May 20 11:26:57 old-k8s-version-776336 kubelet[730]: E0520 11:26:57.312314 730 pod_workers.go:191] Error syncing pod eb2910c3-cbac-462e-901e-4fb79caf95bf ("metrics-server-9975d5f86-qdks4_kube-system(eb2910c3-cbac-462e-901e-4fb79caf95bf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 11:27:06.755309 1657011 out.go:239] May 20 11:27:06 old-k8s-version-776336 kubelet[730]: E0520 11:27:06.311519 730 pod_workers.go:191] Error syncing pod 2c684adc-682c-4c95-a80c-90b35ac50afd ("dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"
I0520 11:27:06.755316 1657011 out.go:304] Setting ErrFile to fd 2...
I0520 11:27:06.755327 1657011 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0520 11:27:06.293052 1665508 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/18925-1463640/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.1-cri-o-overlay-arm64.tar.lz4:/preloaded.tar:ro -v embed-certs-746238:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1715707529-18887@sha256:734a2adad159415bd51b0392bc8976bd7e3e543e9165c2374d6e59bac37aed3a -I lz4 -xf /preloaded.tar -C /extractDir: (4.887805558s)
I0520 11:27:06.293083 1665508 kic.go:203] duration metric: took 4.887966548s to extract preloaded images to volume ...
W0520 11:27:06.293234 1665508 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
I0520 11:27:06.293349 1665508 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
I0520 11:27:06.371689 1665508 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname embed-certs-746238 --name embed-certs-746238 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=embed-certs-746238 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=embed-certs-746238 --network embed-certs-746238 --ip 192.168.85.2 --volume embed-certs-746238:/var --security-opt apparmor=unconfined --memory=2200mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1715707529-18887@sha256:734a2adad159415bd51b0392bc8976bd7e3e543e9165c2374d6e59bac37aed3a
I0520 11:27:06.811574 1665508 cli_runner.go:164] Run: docker container inspect embed-certs-746238 --format={{.State.Running}}
I0520 11:27:06.829235 1665508 cli_runner.go:164] Run: docker container inspect embed-certs-746238 --format={{.State.Status}}
I0520 11:27:06.848881 1665508 cli_runner.go:164] Run: docker exec embed-certs-746238 stat /var/lib/dpkg/alternatives/iptables
I0520 11:27:06.928492 1665508 oci.go:144] the created container "embed-certs-746238" has a running status.
I0520 11:27:06.928537 1665508 kic.go:225] Creating ssh key for kic: /home/jenkins/minikube-integration/18925-1463640/.minikube/machines/embed-certs-746238/id_rsa...
I0520 11:27:07.956162 1665508 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/18925-1463640/.minikube/machines/embed-certs-746238/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
I0520 11:27:07.976291 1665508 cli_runner.go:164] Run: docker container inspect embed-certs-746238 --format={{.State.Status}}
I0520 11:27:07.994228 1665508 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
I0520 11:27:07.994258 1665508 kic_runner.go:114] Args: [docker exec --privileged embed-certs-746238 chown docker:docker /home/docker/.ssh/authorized_keys]
I0520 11:27:08.051376 1665508 cli_runner.go:164] Run: docker container inspect embed-certs-746238 --format={{.State.Status}}
I0520 11:27:08.075007 1665508 machine.go:94] provisionDockerMachine start ...
I0520 11:27:08.075133 1665508 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-746238
I0520 11:27:08.099543 1665508 main.go:141] libmachine: Using SSH client type: native
I0520 11:27:08.099913 1665508 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2b30] 0x3e5390 <nil> [] 0s} 127.0.0.1 40797 <nil> <nil>}
I0520 11:27:08.099928 1665508 main.go:141] libmachine: About to run SSH command:
hostname
I0520 11:27:08.233300 1665508 main.go:141] libmachine: SSH cmd err, output: <nil>: embed-certs-746238
I0520 11:27:08.233373 1665508 ubuntu.go:169] provisioning hostname "embed-certs-746238"
I0520 11:27:08.233479 1665508 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-746238
I0520 11:27:08.253156 1665508 main.go:141] libmachine: Using SSH client type: native
I0520 11:27:08.253419 1665508 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2b30] 0x3e5390 <nil> [] 0s} 127.0.0.1 40797 <nil> <nil>}
I0520 11:27:08.253432 1665508 main.go:141] libmachine: About to run SSH command:
sudo hostname embed-certs-746238 && echo "embed-certs-746238" | sudo tee /etc/hostname
I0520 11:27:08.399432 1665508 main.go:141] libmachine: SSH cmd err, output: <nil>: embed-certs-746238
I0520 11:27:08.399512 1665508 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-746238
I0520 11:27:08.416598 1665508 main.go:141] libmachine: Using SSH client type: native
I0520 11:27:08.416859 1665508 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2b30] 0x3e5390 <nil> [] 0s} 127.0.0.1 40797 <nil> <nil>}
I0520 11:27:08.416878 1665508 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sembed-certs-746238' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 embed-certs-746238/g' /etc/hosts;
else
echo '127.0.1.1 embed-certs-746238' | sudo tee -a /etc/hosts;
fi
fi
I0520 11:27:08.543293 1665508 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0520 11:27:08.543374 1665508 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/18925-1463640/.minikube CaCertPath:/home/jenkins/minikube-integration/18925-1463640/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/18925-1463640/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/18925-1463640/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/18925-1463640/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/18925-1463640/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/18925-1463640/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/18925-1463640/.minikube}
I0520 11:27:08.543446 1665508 ubuntu.go:177] setting up certificates
I0520 11:27:08.543490 1665508 provision.go:84] configureAuth start
I0520 11:27:08.543587 1665508 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-746238
I0520 11:27:08.561331 1665508 provision.go:143] copyHostCerts
I0520 11:27:08.561400 1665508 exec_runner.go:144] found /home/jenkins/minikube-integration/18925-1463640/.minikube/ca.pem, removing ...
I0520 11:27:08.561410 1665508 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18925-1463640/.minikube/ca.pem
I0520 11:27:08.561490 1665508 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18925-1463640/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/18925-1463640/.minikube/ca.pem (1082 bytes)
I0520 11:27:08.561582 1665508 exec_runner.go:144] found /home/jenkins/minikube-integration/18925-1463640/.minikube/cert.pem, removing ...
I0520 11:27:08.561587 1665508 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18925-1463640/.minikube/cert.pem
I0520 11:27:08.561612 1665508 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18925-1463640/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/18925-1463640/.minikube/cert.pem (1123 bytes)
I0520 11:27:08.561818 1665508 exec_runner.go:144] found /home/jenkins/minikube-integration/18925-1463640/.minikube/key.pem, removing ...
I0520 11:27:08.561834 1665508 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18925-1463640/.minikube/key.pem
I0520 11:27:08.561878 1665508 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18925-1463640/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/18925-1463640/.minikube/key.pem (1679 bytes)
I0520 11:27:08.561945 1665508 provision.go:117] generating server cert: /home/jenkins/minikube-integration/18925-1463640/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/18925-1463640/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/18925-1463640/.minikube/certs/ca-key.pem org=jenkins.embed-certs-746238 san=[127.0.0.1 192.168.85.2 embed-certs-746238 localhost minikube]
I0520 11:27:08.936633 1665508 provision.go:177] copyRemoteCerts
I0520 11:27:08.936730 1665508 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0520 11:27:08.936799 1665508 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-746238
I0520 11:27:08.955145 1665508 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:40797 SSHKeyPath:/home/jenkins/minikube-integration/18925-1463640/.minikube/machines/embed-certs-746238/id_rsa Username:docker}
I0520 11:27:09.051398 1665508 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18925-1463640/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
I0520 11:27:09.078264 1665508 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18925-1463640/.minikube/machines/server.pem --> /etc/docker/server.pem (1224 bytes)
I0520 11:27:09.104725 1665508 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18925-1463640/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0520 11:27:09.130368 1665508 provision.go:87] duration metric: took 586.849403ms to configureAuth
I0520 11:27:09.130396 1665508 ubuntu.go:193] setting minikube options for container-runtime
I0520 11:27:09.130625 1665508 config.go:182] Loaded profile config "embed-certs-746238": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.30.1
I0520 11:27:09.130767 1665508 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-746238
I0520 11:27:09.155275 1665508 main.go:141] libmachine: Using SSH client type: native
I0520 11:27:09.155513 1665508 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2b30] 0x3e5390 <nil> [] 0s} 127.0.0.1 40797 <nil> <nil>}
I0520 11:27:09.155528 1665508 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %!s(MISSING) "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0520 11:27:09.416964 1665508 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0520 11:27:09.416996 1665508 machine.go:97] duration metric: took 1.341968279s to provisionDockerMachine
I0520 11:27:09.417007 1665508 client.go:171] duration metric: took 8.848661468s to LocalClient.Create
I0520 11:27:09.417024 1665508 start.go:167] duration metric: took 8.848727215s to libmachine.API.Create "embed-certs-746238"
I0520 11:27:09.417033 1665508 start.go:293] postStartSetup for "embed-certs-746238" (driver="docker")
I0520 11:27:09.417046 1665508 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0520 11:27:09.417116 1665508 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0520 11:27:09.417166 1665508 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-746238
I0520 11:27:09.432954 1665508 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:40797 SSHKeyPath:/home/jenkins/minikube-integration/18925-1463640/.minikube/machines/embed-certs-746238/id_rsa Username:docker}
I0520 11:27:09.528268 1665508 ssh_runner.go:195] Run: cat /etc/os-release
I0520 11:27:09.532125 1665508 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0520 11:27:09.532164 1665508 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0520 11:27:09.532182 1665508 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0520 11:27:09.532194 1665508 info.go:137] Remote host: Ubuntu 22.04.4 LTS
I0520 11:27:09.532211 1665508 filesync.go:126] Scanning /home/jenkins/minikube-integration/18925-1463640/.minikube/addons for local assets ...
I0520 11:27:09.532268 1665508 filesync.go:126] Scanning /home/jenkins/minikube-integration/18925-1463640/.minikube/files for local assets ...
I0520 11:27:09.532367 1665508 filesync.go:149] local asset: /home/jenkins/minikube-integration/18925-1463640/.minikube/files/etc/ssl/certs/14690782.pem -> 14690782.pem in /etc/ssl/certs
I0520 11:27:09.532496 1665508 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0520 11:27:09.543199 1665508 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18925-1463640/.minikube/files/etc/ssl/certs/14690782.pem --> /etc/ssl/certs/14690782.pem (1708 bytes)
I0520 11:27:09.577373 1665508 start.go:296] duration metric: took 160.320304ms for postStartSetup
I0520 11:27:09.577944 1665508 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-746238
I0520 11:27:09.600428 1665508 profile.go:143] Saving config to /home/jenkins/minikube-integration/18925-1463640/.minikube/profiles/embed-certs-746238/config.json ...
I0520 11:27:09.600778 1665508 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0520 11:27:09.600832 1665508 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-746238
I0520 11:27:09.620305 1665508 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:40797 SSHKeyPath:/home/jenkins/minikube-integration/18925-1463640/.minikube/machines/embed-certs-746238/id_rsa Username:docker}
I0520 11:27:09.710678 1665508 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I0520 11:27:09.715460 1665508 start.go:128] duration metric: took 9.150596669s to createHost
I0520 11:27:09.715487 1665508 start.go:83] releasing machines lock for "embed-certs-746238", held for 9.150751356s
I0520 11:27:09.715581 1665508 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-746238
I0520 11:27:09.731791 1665508 ssh_runner.go:195] Run: cat /version.json
I0520 11:27:09.731853 1665508 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-746238
I0520 11:27:09.732100 1665508 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0520 11:27:09.732143 1665508 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-746238
I0520 11:27:09.752141 1665508 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:40797 SSHKeyPath:/home/jenkins/minikube-integration/18925-1463640/.minikube/machines/embed-certs-746238/id_rsa Username:docker}
I0520 11:27:09.759892 1665508 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:40797 SSHKeyPath:/home/jenkins/minikube-integration/18925-1463640/.minikube/machines/embed-certs-746238/id_rsa Username:docker}
I0520 11:27:09.846777 1665508 ssh_runner.go:195] Run: systemctl --version
I0520 11:27:09.959580 1665508 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0520 11:27:10.106065 1665508 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I0520 11:27:10.111356 1665508 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0520 11:27:10.134996 1665508 cni.go:221] loopback cni configuration disabled: "/etc/cni/net.d/*loopback.conf*" found
I0520 11:27:10.135124 1665508 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0520 11:27:10.170673 1665508 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist, /etc/cni/net.d/100-crio-bridge.conf] bridge cni config(s)
I0520 11:27:10.170700 1665508 start.go:494] detecting cgroup driver to use...
I0520 11:27:10.170733 1665508 detect.go:196] detected "cgroupfs" cgroup driver on host os
I0520 11:27:10.170783 1665508 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0520 11:27:10.189841 1665508 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0520 11:27:10.203756 1665508 docker.go:217] disabling cri-docker service (if available) ...
I0520 11:27:10.203827 1665508 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0520 11:27:10.218481 1665508 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0520 11:27:10.237242 1665508 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0520 11:27:10.330397 1665508 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0520 11:27:10.438865 1665508 docker.go:233] disabling docker service ...
I0520 11:27:10.438985 1665508 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0520 11:27:10.462205 1665508 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0520 11:27:10.475142 1665508 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0520 11:27:10.562501 1665508 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0520 11:27:10.660982 1665508 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0520 11:27:10.674150 1665508 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0520 11:27:10.691611 1665508 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.9" pause image...
I0520 11:27:10.691709 1665508 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.9"|' /etc/crio/crio.conf.d/02-crio.conf"
I0520 11:27:10.702249 1665508 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0520 11:27:10.702372 1665508 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0520 11:27:10.713132 1665508 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0520 11:27:10.724877 1665508 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0520 11:27:10.735267 1665508 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0520 11:27:10.745751 1665508 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"
I0520 11:27:10.756344 1665508 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"
I0520 11:27:10.777391 1665508 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"
I0520 11:27:10.792747 1665508 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0520 11:27:10.803771 1665508 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0520 11:27:10.814203 1665508 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0520 11:27:10.899138 1665508 ssh_runner.go:195] Run: sudo systemctl restart crio
I0520 11:27:11.023537 1665508 start.go:541] Will wait 60s for socket path /var/run/crio/crio.sock
I0520 11:27:11.023673 1665508 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0520 11:27:11.027637 1665508 start.go:562] Will wait 60s for crictl version
I0520 11:27:11.027705 1665508 ssh_runner.go:195] Run: which crictl
I0520 11:27:11.031338 1665508 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0520 11:27:11.077326 1665508 start.go:578] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.24.6
RuntimeApiVersion: v1
I0520 11:27:11.077454 1665508 ssh_runner.go:195] Run: crio --version
I0520 11:27:11.119646 1665508 ssh_runner.go:195] Run: crio --version
I0520 11:27:11.164467 1665508 out.go:177] * Preparing Kubernetes v1.30.1 on CRI-O 1.24.6 ...
I0520 11:27:11.166173 1665508 cli_runner.go:164] Run: docker network inspect embed-certs-746238 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0520 11:27:11.180141 1665508 ssh_runner.go:195] Run: grep 192.168.85.1 host.minikube.internal$ /etc/hosts
I0520 11:27:11.184136 1665508 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.85.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0520 11:27:11.197103 1665508 kubeadm.go:877] updating cluster {Name:embed-certs-746238 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1715707529-18887@sha256:734a2adad159415bd51b0392bc8976bd7e3e543e9165c2374d6e59bac37aed3a Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.1 ClusterName:embed-certs-746238 Namespace:default APIServerHAVIP: APIServerName:minikubeCA AP
IServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.30.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false Custom
QemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0520 11:27:11.197221 1665508 preload.go:132] Checking if preload exists for k8s version v1.30.1 and runtime crio
I0520 11:27:11.197280 1665508 ssh_runner.go:195] Run: sudo crictl images --output json
I0520 11:27:11.280961 1665508 crio.go:514] all images are preloaded for cri-o runtime.
I0520 11:27:11.280984 1665508 crio.go:433] Images already preloaded, skipping extraction
I0520 11:27:11.281044 1665508 ssh_runner.go:195] Run: sudo crictl images --output json
I0520 11:27:11.322476 1665508 crio.go:514] all images are preloaded for cri-o runtime.
I0520 11:27:11.322539 1665508 cache_images.go:84] Images are preloaded, skipping loading
I0520 11:27:11.322554 1665508 kubeadm.go:928] updating node { 192.168.85.2 8443 v1.30.1 crio true true} ...
I0520 11:27:11.322658 1665508 kubeadm.go:940] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.30.1/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --cgroups-per-qos=false --config=/var/lib/kubelet/config.yaml --enforce-node-allocatable= --hostname-override=embed-certs-746238 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.85.2
[Install]
config:
{KubernetesVersion:v1.30.1 ClusterName:embed-certs-746238 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0520 11:27:11.322747 1665508 ssh_runner.go:195] Run: crio config
I0520 11:27:11.375668 1665508 cni.go:84] Creating CNI manager for ""
I0520 11:27:11.375740 1665508 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
I0520 11:27:11.375757 1665508 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0520 11:27:11.375783 1665508 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.85.2 APIServerPort:8443 KubernetesVersion:v1.30.1 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:embed-certs-746238 NodeName:embed-certs-746238 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.85.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.85.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/e
tc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/crio/crio.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I0520 11:27:11.375946 1665508 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta3
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.85.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///var/run/crio/crio.sock
name: "embed-certs-746238"
kubeletExtraArgs:
node-ip: 192.168.85.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta3
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.85.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.30.1
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
containerRuntimeEndpoint: unix:///var/run/crio/crio.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%!"(MISSING)
nodefs.inodesFree: "0%!"(MISSING)
imagefs.available: "0%!"(MISSING)
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0520 11:27:11.376044 1665508 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.30.1
I0520 11:27:11.385496 1665508 binaries.go:44] Found k8s binaries, skipping transfer
I0520 11:27:11.385634 1665508 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0520 11:27:11.394884 1665508 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (368 bytes)
I0520 11:27:11.415827 1665508 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0520 11:27:11.434168 1665508 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2156 bytes)
I0520 11:27:11.453979 1665508 ssh_runner.go:195] Run: grep 192.168.85.2 control-plane.minikube.internal$ /etc/hosts
I0520 11:27:11.457573 1665508 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.85.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0520 11:27:11.468519 1665508 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0520 11:27:11.555348 1665508 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0520 11:27:11.570584 1665508 certs.go:68] Setting up /home/jenkins/minikube-integration/18925-1463640/.minikube/profiles/embed-certs-746238 for IP: 192.168.85.2
I0520 11:27:11.570607 1665508 certs.go:194] generating shared ca certs ...
I0520 11:27:11.570624 1665508 certs.go:226] acquiring lock for ca certs: {Name:mke113fbac30e255083f63bab9dafb629ead7667 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0520 11:27:11.570762 1665508 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/18925-1463640/.minikube/ca.key
I0520 11:27:11.570811 1665508 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/18925-1463640/.minikube/proxy-client-ca.key
I0520 11:27:11.570822 1665508 certs.go:256] generating profile certs ...
I0520 11:27:11.570880 1665508 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/18925-1463640/.minikube/profiles/embed-certs-746238/client.key
I0520 11:27:11.570906 1665508 crypto.go:68] Generating cert /home/jenkins/minikube-integration/18925-1463640/.minikube/profiles/embed-certs-746238/client.crt with IP's: []
I0520 11:27:11.796196 1665508 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18925-1463640/.minikube/profiles/embed-certs-746238/client.crt ...
I0520 11:27:11.796225 1665508 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18925-1463640/.minikube/profiles/embed-certs-746238/client.crt: {Name:mke2ede68d639e3e144c8b9095c2e663df86e76f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0520 11:27:11.796429 1665508 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18925-1463640/.minikube/profiles/embed-certs-746238/client.key ...
I0520 11:27:11.796446 1665508 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18925-1463640/.minikube/profiles/embed-certs-746238/client.key: {Name:mk33815f5a85ebdae382a81160462c34db373791 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0520 11:27:11.796545 1665508 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/18925-1463640/.minikube/profiles/embed-certs-746238/apiserver.key.b7af1d52
I0520 11:27:11.796565 1665508 crypto.go:68] Generating cert /home/jenkins/minikube-integration/18925-1463640/.minikube/profiles/embed-certs-746238/apiserver.crt.b7af1d52 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.85.2]
I0520 11:27:12.638514 1665508 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18925-1463640/.minikube/profiles/embed-certs-746238/apiserver.crt.b7af1d52 ...
I0520 11:27:12.638554 1665508 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18925-1463640/.minikube/profiles/embed-certs-746238/apiserver.crt.b7af1d52: {Name:mk1f59793193340f3de3b32ee110b4ec37cf4167 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0520 11:27:12.639776 1665508 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18925-1463640/.minikube/profiles/embed-certs-746238/apiserver.key.b7af1d52 ...
I0520 11:27:12.639800 1665508 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18925-1463640/.minikube/profiles/embed-certs-746238/apiserver.key.b7af1d52: {Name:mkc9ec541dd62114a15c3122f3bb8baddd454da5 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0520 11:27:12.640318 1665508 certs.go:381] copying /home/jenkins/minikube-integration/18925-1463640/.minikube/profiles/embed-certs-746238/apiserver.crt.b7af1d52 -> /home/jenkins/minikube-integration/18925-1463640/.minikube/profiles/embed-certs-746238/apiserver.crt
I0520 11:27:12.640410 1665508 certs.go:385] copying /home/jenkins/minikube-integration/18925-1463640/.minikube/profiles/embed-certs-746238/apiserver.key.b7af1d52 -> /home/jenkins/minikube-integration/18925-1463640/.minikube/profiles/embed-certs-746238/apiserver.key
I0520 11:27:12.640474 1665508 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/18925-1463640/.minikube/profiles/embed-certs-746238/proxy-client.key
I0520 11:27:12.640494 1665508 crypto.go:68] Generating cert /home/jenkins/minikube-integration/18925-1463640/.minikube/profiles/embed-certs-746238/proxy-client.crt with IP's: []
I0520 11:27:13.154256 1665508 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18925-1463640/.minikube/profiles/embed-certs-746238/proxy-client.crt ...
I0520 11:27:13.154291 1665508 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18925-1463640/.minikube/profiles/embed-certs-746238/proxy-client.crt: {Name:mk660937c217e737b17b6975257d16b8b7b0d306 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0520 11:27:13.155151 1665508 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18925-1463640/.minikube/profiles/embed-certs-746238/proxy-client.key ...
I0520 11:27:13.155178 1665508 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18925-1463640/.minikube/profiles/embed-certs-746238/proxy-client.key: {Name:mkb7ed79e514a4a4bde816774e6ff3e761b782ae Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0520 11:27:13.155921 1665508 certs.go:484] found cert: /home/jenkins/minikube-integration/18925-1463640/.minikube/certs/1469078.pem (1338 bytes)
W0520 11:27:13.155974 1665508 certs.go:480] ignoring /home/jenkins/minikube-integration/18925-1463640/.minikube/certs/1469078_empty.pem, impossibly tiny 0 bytes
I0520 11:27:13.155985 1665508 certs.go:484] found cert: /home/jenkins/minikube-integration/18925-1463640/.minikube/certs/ca-key.pem (1679 bytes)
I0520 11:27:13.156012 1665508 certs.go:484] found cert: /home/jenkins/minikube-integration/18925-1463640/.minikube/certs/ca.pem (1082 bytes)
I0520 11:27:13.156039 1665508 certs.go:484] found cert: /home/jenkins/minikube-integration/18925-1463640/.minikube/certs/cert.pem (1123 bytes)
I0520 11:27:13.156061 1665508 certs.go:484] found cert: /home/jenkins/minikube-integration/18925-1463640/.minikube/certs/key.pem (1679 bytes)
I0520 11:27:13.156107 1665508 certs.go:484] found cert: /home/jenkins/minikube-integration/18925-1463640/.minikube/files/etc/ssl/certs/14690782.pem (1708 bytes)
I0520 11:27:13.156743 1665508 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18925-1463640/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0520 11:27:13.187895 1665508 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18925-1463640/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0520 11:27:13.214484 1665508 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18925-1463640/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0520 11:27:13.245487 1665508 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18925-1463640/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0520 11:27:13.271348 1665508 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18925-1463640/.minikube/profiles/embed-certs-746238/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1428 bytes)
I0520 11:27:13.297443 1665508 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18925-1463640/.minikube/profiles/embed-certs-746238/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0520 11:27:13.323123 1665508 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18925-1463640/.minikube/profiles/embed-certs-746238/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0520 11:27:13.348327 1665508 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18925-1463640/.minikube/profiles/embed-certs-746238/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0520 11:27:13.374628 1665508 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18925-1463640/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0520 11:27:13.403752 1665508 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18925-1463640/.minikube/certs/1469078.pem --> /usr/share/ca-certificates/1469078.pem (1338 bytes)
I0520 11:27:13.428543 1665508 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18925-1463640/.minikube/files/etc/ssl/certs/14690782.pem --> /usr/share/ca-certificates/14690782.pem (1708 bytes)
I0520 11:27:13.453033 1665508 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0520 11:27:13.472987 1665508 ssh_runner.go:195] Run: openssl version
I0520 11:27:13.478696 1665508 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0520 11:27:13.488267 1665508 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0520 11:27:13.491768 1665508 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 May 20 10:25 /usr/share/ca-certificates/minikubeCA.pem
I0520 11:27:13.491880 1665508 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0520 11:27:13.498826 1665508 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0520 11:27:13.508338 1665508 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/1469078.pem && ln -fs /usr/share/ca-certificates/1469078.pem /etc/ssl/certs/1469078.pem"
I0520 11:27:13.517833 1665508 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/1469078.pem
I0520 11:27:13.521435 1665508 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 May 20 10:36 /usr/share/ca-certificates/1469078.pem
I0520 11:27:13.521540 1665508 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/1469078.pem
I0520 11:27:13.528818 1665508 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/1469078.pem /etc/ssl/certs/51391683.0"
I0520 11:27:13.538327 1665508 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/14690782.pem && ln -fs /usr/share/ca-certificates/14690782.pem /etc/ssl/certs/14690782.pem"
I0520 11:27:13.547784 1665508 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/14690782.pem
I0520 11:27:13.551853 1665508 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 May 20 10:36 /usr/share/ca-certificates/14690782.pem
I0520 11:27:13.551966 1665508 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/14690782.pem
I0520 11:27:13.558891 1665508 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/14690782.pem /etc/ssl/certs/3ec20f2e.0"
I0520 11:27:13.569102 1665508 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0520 11:27:13.572446 1665508 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0520 11:27:13.572536 1665508 kubeadm.go:391] StartCluster: {Name:embed-certs-746238 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1715707529-18887@sha256:734a2adad159415bd51b0392bc8976bd7e3e543e9165c2374d6e59bac37aed3a Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.1 ClusterName:embed-certs-746238 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APISe
rverNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.30.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQem
uFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0520 11:27:13.572651 1665508 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0520 11:27:13.572726 1665508 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0520 11:27:13.613967 1665508 cri.go:89] found id: ""
I0520 11:27:13.614057 1665508 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0520 11:27:13.623199 1665508 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0520 11:27:13.632286 1665508 kubeadm.go:213] ignoring SystemVerification for kubeadm because of docker driver
I0520 11:27:13.632409 1665508 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0520 11:27:13.641379 1665508 kubeadm.go:154] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0520 11:27:13.641443 1665508 kubeadm.go:156] found existing configuration files:
I0520 11:27:13.641517 1665508 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0520 11:27:13.652097 1665508 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0520 11:27:13.652186 1665508 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0520 11:27:13.661060 1665508 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0520 11:27:13.670488 1665508 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0520 11:27:13.670558 1665508 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0520 11:27:13.679142 1665508 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0520 11:27:13.688404 1665508 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0520 11:27:13.688525 1665508 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0520 11:27:13.697799 1665508 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0520 11:27:13.707003 1665508 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0520 11:27:13.707079 1665508 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0520 11:27:13.715880 1665508 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.30.1:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
I0520 11:27:13.825528 1665508 kubeadm.go:309] [WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/5.15.0-1058-aws\n", err: exit status 1
I0520 11:27:13.896087 1665508 kubeadm.go:309] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0520 11:27:16.756505 1657011 api_server.go:253] Checking apiserver healthz at https://192.168.76.2:8443/healthz ...
I0520 11:27:16.769614 1657011 api_server.go:279] https://192.168.76.2:8443/healthz returned 200:
ok
I0520 11:27:16.771733 1657011 out.go:177]
W0520 11:27:16.773260 1657011 out.go:239] X Exiting due to K8S_UNHEALTHY_CONTROL_PLANE: wait 6m0s for node: wait for healthy API server: controlPlane never updated to v1.20.0
W0520 11:27:16.773298 1657011 out.go:239] * Suggestion: Control Plane could not update, try minikube delete --all --purge
W0520 11:27:16.773326 1657011 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/11417
W0520 11:27:16.773332 1657011 out.go:239] *
W0520 11:27:16.775071 1657011 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0520 11:27:16.777544 1657011 out.go:177]
==> CRI-O <==
May 20 11:24:58 old-k8s-version-776336 crio[621]: time="2024-05-20 11:24:58.792262583Z" level=info msg="Removed container 439ff54dab0c5f40db544109ff278f18e63f26bfa5b570d15c2d725d7394fafe: kubernetes-dashboard/dashboard-metrics-scraper-8d5bb5db8-tzcxg/dashboard-metrics-scraper" id=b778c3f8-b12e-4948-b67e-ab41603d37e2 name=/runtime.v1alpha2.RuntimeService/RemoveContainer
May 20 11:25:13 old-k8s-version-776336 crio[621]: time="2024-05-20 11:25:13.311030947Z" level=info msg="Checking image status: fake.domain/registry.k8s.io/echoserver:1.4" id=5e6e6bfb-c538-468d-a1b0-99b19da95357 name=/runtime.v1alpha2.ImageService/ImageStatus
May 20 11:25:13 old-k8s-version-776336 crio[621]: time="2024-05-20 11:25:13.311284808Z" level=info msg="Image fake.domain/registry.k8s.io/echoserver:1.4 not found" id=5e6e6bfb-c538-468d-a1b0-99b19da95357 name=/runtime.v1alpha2.ImageService/ImageStatus
May 20 11:25:28 old-k8s-version-776336 crio[621]: time="2024-05-20 11:25:28.310928300Z" level=info msg="Checking image status: fake.domain/registry.k8s.io/echoserver:1.4" id=0d11a2db-891a-493f-8f28-ad65ef3dec6a name=/runtime.v1alpha2.ImageService/ImageStatus
May 20 11:25:28 old-k8s-version-776336 crio[621]: time="2024-05-20 11:25:28.311209016Z" level=info msg="Image fake.domain/registry.k8s.io/echoserver:1.4 not found" id=0d11a2db-891a-493f-8f28-ad65ef3dec6a name=/runtime.v1alpha2.ImageService/ImageStatus
May 20 11:25:40 old-k8s-version-776336 crio[621]: time="2024-05-20 11:25:40.311807843Z" level=info msg="Checking image status: fake.domain/registry.k8s.io/echoserver:1.4" id=410e5966-9212-4bd5-9aef-f327d26a26f5 name=/runtime.v1alpha2.ImageService/ImageStatus
May 20 11:25:40 old-k8s-version-776336 crio[621]: time="2024-05-20 11:25:40.312344577Z" level=info msg="Image fake.domain/registry.k8s.io/echoserver:1.4 not found" id=410e5966-9212-4bd5-9aef-f327d26a26f5 name=/runtime.v1alpha2.ImageService/ImageStatus
May 20 11:25:53 old-k8s-version-776336 crio[621]: time="2024-05-20 11:25:53.310991771Z" level=info msg="Checking image status: fake.domain/registry.k8s.io/echoserver:1.4" id=f17fc58a-b8e3-4226-9be1-ecf679c769c1 name=/runtime.v1alpha2.ImageService/ImageStatus
May 20 11:25:53 old-k8s-version-776336 crio[621]: time="2024-05-20 11:25:53.311244254Z" level=info msg="Image fake.domain/registry.k8s.io/echoserver:1.4 not found" id=f17fc58a-b8e3-4226-9be1-ecf679c769c1 name=/runtime.v1alpha2.ImageService/ImageStatus
May 20 11:26:07 old-k8s-version-776336 crio[621]: time="2024-05-20 11:26:07.310965883Z" level=info msg="Checking image status: fake.domain/registry.k8s.io/echoserver:1.4" id=ebeed1c9-bde8-4ef0-9be5-ac3ad8d2e577 name=/runtime.v1alpha2.ImageService/ImageStatus
May 20 11:26:07 old-k8s-version-776336 crio[621]: time="2024-05-20 11:26:07.311211719Z" level=info msg="Image fake.domain/registry.k8s.io/echoserver:1.4 not found" id=ebeed1c9-bde8-4ef0-9be5-ac3ad8d2e577 name=/runtime.v1alpha2.ImageService/ImageStatus
May 20 11:26:16 old-k8s-version-776336 crio[621]: time="2024-05-20 11:26:16.297246979Z" level=info msg="Checking image status: k8s.gcr.io/pause:3.2" id=860eea10-a036-43c9-8098-86ad2c1e0385 name=/runtime.v1alpha2.ImageService/ImageStatus
May 20 11:26:16 old-k8s-version-776336 crio[621]: time="2024-05-20 11:26:16.297586008Z" level=info msg="Image status: &ImageStatusResponse{Image:&Image{Id:2a060e2e7101d419352bf82c613158587400be743482d9a537ec4a9d1b4eb93c,RepoTags:[k8s.gcr.io/pause:3.2 registry.k8s.io/pause:3.2],RepoDigests:[k8s.gcr.io/pause@sha256:31d3efd12022ffeffb3146bc10ae8beb890c80ed2f07363515580add7ed47636 k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f registry.k8s.io/pause@sha256:31d3efd12022ffeffb3146bc10ae8beb890c80ed2f07363515580add7ed47636 registry.k8s.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f],Size_:489397,Uid:nil,Username:,Spec:nil,},Info:map[string]string{},}" id=860eea10-a036-43c9-8098-86ad2c1e0385 name=/runtime.v1alpha2.ImageService/ImageStatus
May 20 11:26:22 old-k8s-version-776336 crio[621]: time="2024-05-20 11:26:22.311178422Z" level=info msg="Checking image status: fake.domain/registry.k8s.io/echoserver:1.4" id=cd4a08ba-e376-4ddb-99a2-18c128f3519f name=/runtime.v1alpha2.ImageService/ImageStatus
May 20 11:26:22 old-k8s-version-776336 crio[621]: time="2024-05-20 11:26:22.311480922Z" level=info msg="Image fake.domain/registry.k8s.io/echoserver:1.4 not found" id=cd4a08ba-e376-4ddb-99a2-18c128f3519f name=/runtime.v1alpha2.ImageService/ImageStatus
May 20 11:26:35 old-k8s-version-776336 crio[621]: time="2024-05-20 11:26:35.311053224Z" level=info msg="Checking image status: fake.domain/registry.k8s.io/echoserver:1.4" id=07f80e4c-0007-4099-8ca9-698cf81a32ba name=/runtime.v1alpha2.ImageService/ImageStatus
May 20 11:26:35 old-k8s-version-776336 crio[621]: time="2024-05-20 11:26:35.311398036Z" level=info msg="Image fake.domain/registry.k8s.io/echoserver:1.4 not found" id=07f80e4c-0007-4099-8ca9-698cf81a32ba name=/runtime.v1alpha2.ImageService/ImageStatus
May 20 11:26:46 old-k8s-version-776336 crio[621]: time="2024-05-20 11:26:46.314304768Z" level=info msg="Checking image status: fake.domain/registry.k8s.io/echoserver:1.4" id=451a1125-d79b-48c1-b2fb-e59a063595a7 name=/runtime.v1alpha2.ImageService/ImageStatus
May 20 11:26:46 old-k8s-version-776336 crio[621]: time="2024-05-20 11:26:46.314538559Z" level=info msg="Image fake.domain/registry.k8s.io/echoserver:1.4 not found" id=451a1125-d79b-48c1-b2fb-e59a063595a7 name=/runtime.v1alpha2.ImageService/ImageStatus
May 20 11:26:57 old-k8s-version-776336 crio[621]: time="2024-05-20 11:26:57.311648951Z" level=info msg="Checking image status: fake.domain/registry.k8s.io/echoserver:1.4" id=817c0442-8200-4590-b0e6-a3663feee710 name=/runtime.v1alpha2.ImageService/ImageStatus
May 20 11:26:57 old-k8s-version-776336 crio[621]: time="2024-05-20 11:26:57.311974416Z" level=info msg="Image fake.domain/registry.k8s.io/echoserver:1.4 not found" id=817c0442-8200-4590-b0e6-a3663feee710 name=/runtime.v1alpha2.ImageService/ImageStatus
May 20 11:27:08 old-k8s-version-776336 crio[621]: time="2024-05-20 11:27:08.311159790Z" level=info msg="Checking image status: fake.domain/registry.k8s.io/echoserver:1.4" id=f5bee100-d7d9-4a58-94a8-65cd3ad1d15f name=/runtime.v1alpha2.ImageService/ImageStatus
May 20 11:27:08 old-k8s-version-776336 crio[621]: time="2024-05-20 11:27:08.311403239Z" level=info msg="Image fake.domain/registry.k8s.io/echoserver:1.4 not found" id=f5bee100-d7d9-4a58-94a8-65cd3ad1d15f name=/runtime.v1alpha2.ImageService/ImageStatus
May 20 11:27:08 old-k8s-version-776336 crio[621]: time="2024-05-20 11:27:08.314721695Z" level=info msg="Pulling image: fake.domain/registry.k8s.io/echoserver:1.4" id=6a2ee8e6-7630-4b6d-a71f-a36f461035fd name=/runtime.v1alpha2.ImageService/PullImage
May 20 11:27:08 old-k8s-version-776336 crio[621]: time="2024-05-20 11:27:08.328256216Z" level=info msg="Trying to access \"fake.domain/registry.k8s.io/echoserver:1.4\""
==> container status <==
CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID POD
9880d6ea4fbcf a90209bb39e3d7b5fc9daf60c17044ea969aaca0333d672d8c7a34c7446e7ff7 2 minutes ago Exited dashboard-metrics-scraper 5 1a2d3d31c4fff dashboard-metrics-scraper-8d5bb5db8-tzcxg
478b985a70c80 docker.io/kubernetesui/dashboard@sha256:2e500d29e9d5f4a086b908eb8dfe7ecac57d2ab09d65b24f588b1d449841ef93 5 minutes ago Running kubernetes-dashboard 0 4478b401b05c7 kubernetes-dashboard-cd95d586-cvhs4
80aac8daed1fe ba04bb24b95753201135cbc420b233c1b0b9fa2e1fd21d28319c348c33fbcde6 5 minutes ago Running storage-provisioner 0 dc573c5810f1c storage-provisioner
b026cb8ba53f0 25a5233254979d0678a2db1d15b76b73dc380d81bc5eed93916ba5638b3cd894 5 minutes ago Running kube-proxy 0 354392dabb7db kube-proxy-f5jcm
b92863fb0bcbb 4740c1948d3fceb8d7dacc63033aa6299d80794ee4f4811539ec1081d9211f3d 5 minutes ago Running kindnet-cni 0 afa1f64103951 kindnet-qzxjc
e346471df6217 db91994f4ee8f894a1e8a6c1a76f615da8fc3c019300a3686291ce6fcbc57895 5 minutes ago Running coredns 0 60c396b3b4da1 coredns-74ff55c5b-grqv6
e3f2c9e695265 1611cd07b61d57dbbfebe6db242513fd51e1c02d20ba08af17a45837d86a8a8c 5 minutes ago Running busybox 0 620bb8efc1603 busybox
0b14a0f156605 2c08bbbc02d3aa5dfbf4e79f15c0a61424049288917aa10364464ca1f7de7157 6 minutes ago Running kube-apiserver 0 74a2830e21f5b kube-apiserver-old-k8s-version-776336
7f0c6c3acf70d 1df8a2b116bd16f7070fd383a6769c8d644b365575e8ffa3e492b84e4f05fc74 6 minutes ago Running kube-controller-manager 0 553091a24ec94 kube-controller-manager-old-k8s-version-776336
200301c79d92c e7605f88f17d6a4c3f083ef9c6f5f19b39f87e4d4406a05a8612b54a6ea57051 6 minutes ago Running kube-scheduler 0 b70fb0f2d6bf4 kube-scheduler-old-k8s-version-776336
a0c29f0d3e719 05b738aa1bc6355db8a2ee8639f3631b908286e43f584a3d2ee0c472de033c28 6 minutes ago Running etcd 0 c47259a3b073f etcd-old-k8s-version-776336
==> coredns [e346471df6217fe773e2ef8f7b75f5b46cd71d6eb9cbc805448692e543b15853] <==
I0520 11:21:58.977857 1 trace.go:116] Trace[2019727887]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125 (started: 2024-05-20 11:21:28.976607272 +0000 UTC m=+0.025190857) (total time: 30.00113921s):
Trace[2019727887]: [30.00113921s] [30.00113921s] END
E0520 11:21:58.978440 1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to list *v1.Namespace: Get "https://10.96.0.1:443/api/v1/namespaces?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
I0520 11:21:58.978735 1 trace.go:116] Trace[939984059]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125 (started: 2024-05-20 11:21:28.978392667 +0000 UTC m=+0.026976261) (total time: 30.000325378s):
Trace[939984059]: [30.000325378s] [30.000325378s] END
E0520 11:21:58.978789 1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to list *v1.Service: Get "https://10.96.0.1:443/api/v1/services?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
I0520 11:21:58.979208 1 trace.go:116] Trace[911902081]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125 (started: 2024-05-20 11:21:28.97877094 +0000 UTC m=+0.027354525) (total time: 30.000422377s):
Trace[911902081]: [30.000422377s] [30.000422377s] END
E0520 11:21:58.979220 1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to list *v1.Endpoints: Get "https://10.96.0.1:443/api/v1/endpoints?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
.:53
[INFO] plugin/reload: Running configuration MD5 = b494d968e357ba1b925cee838fbd78ed
CoreDNS-1.7.0
linux/arm64, go1.14.4, f59c03d
[INFO] 127.0.0.1:48798 - 18267 "HINFO IN 6774303480060935370.502628150519182392. udp 56 false 512" NXDOMAIN qr,rd,ra 56 0.035889633s
[INFO] SIGTERM: Shutting down servers then terminating
[INFO] plugin/health: Going into lameduck mode for 5s
[INFO] plugin/ready: Still waiting on: "kubernetes"
.:53
[INFO] plugin/reload: Running configuration MD5 = b494d968e357ba1b925cee838fbd78ed
CoreDNS-1.7.0
linux/arm64, go1.14.4, f59c03d
[INFO] 127.0.0.1:39083 - 13419 "HINFO IN 2801442747761159507.7524682479264674889. udp 57 false 512" NXDOMAIN qr,rd,ra 57 0.012610283s
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/ready: Still waiting on: "kubernetes"
==> describe nodes <==
Name: old-k8s-version-776336
Roles: control-plane,master
Labels: beta.kubernetes.io/arch=arm64
beta.kubernetes.io/os=linux
kubernetes.io/arch=arm64
kubernetes.io/hostname=old-k8s-version-776336
kubernetes.io/os=linux
minikube.k8s.io/commit=1b01766f8cca110acded3a48649b81463b982c91
minikube.k8s.io/name=old-k8s-version-776336
minikube.k8s.io/primary=true
minikube.k8s.io/updated_at=2024_05_20T11_18_24_0700
minikube.k8s.io/version=v1.33.1
node-role.kubernetes.io/control-plane=
node-role.kubernetes.io/master=
Annotations: kubeadm.alpha.kubernetes.io/cri-socket: /var/run/crio/crio.sock
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Mon, 20 May 2024 11:18:20 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: old-k8s-version-776336
AcquireTime: <unset>
RenewTime: Mon, 20 May 2024 11:27:09 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Mon, 20 May 2024 11:22:17 +0000 Mon, 20 May 2024 11:18:14 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Mon, 20 May 2024 11:22:17 +0000 Mon, 20 May 2024 11:18:14 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Mon, 20 May 2024 11:22:17 +0000 Mon, 20 May 2024 11:18:14 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Mon, 20 May 2024 11:22:17 +0000 Mon, 20 May 2024 11:19:22 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.76.2
Hostname: old-k8s-version-776336
Capacity:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022496Ki
pods: 110
Allocatable:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022496Ki
pods: 110
System Info:
Machine ID: 22cf92f476e446f680c31b2e6946156e
System UUID: edf7f3a3-32e9-4e2e-a986-fcdc41cc3408
Boot ID: df9684e8-d429-41b3-8a9f-ef96b9c9133b
Kernel Version: 5.15.0-1058-aws
OS Image: Ubuntu 22.04.4 LTS
Operating System: linux
Architecture: arm64
Container Runtime Version: cri-o://1.24.6
Kubelet Version: v1.20.0
Kube-Proxy Version: v1.20.0
PodCIDR: 10.244.0.0/24
PodCIDRs: 10.244.0.0/24
Non-terminated Pods: (12 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits AGE
--------- ---- ------------ ---------- --------------- ------------- ---
default busybox 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 6m43s
kube-system coredns-74ff55c5b-grqv6 100m (5%!)(MISSING) 0 (0%!)(MISSING) 70Mi (0%!)(MISSING) 170Mi (2%!)(MISSING) 8m38s
kube-system etcd-old-k8s-version-776336 100m (5%!)(MISSING) 0 (0%!)(MISSING) 100Mi (1%!)(MISSING) 0 (0%!)(MISSING) 8m46s
kube-system kindnet-qzxjc 100m (5%!)(MISSING) 100m (5%!)(MISSING) 50Mi (0%!)(MISSING) 50Mi (0%!)(MISSING) 8m38s
kube-system kube-apiserver-old-k8s-version-776336 250m (12%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 8m46s
kube-system kube-controller-manager-old-k8s-version-776336 200m (10%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 8m46s
kube-system kube-proxy-f5jcm 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 8m38s
kube-system kube-scheduler-old-k8s-version-776336 100m (5%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 8m46s
kube-system metrics-server-9975d5f86-qdks4 100m (5%!)(MISSING) 0 (0%!)(MISSING) 200Mi (2%!)(MISSING) 0 (0%!)(MISSING) 6m31s
kube-system storage-provisioner 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 8m37s
kubernetes-dashboard dashboard-metrics-scraper-8d5bb5db8-tzcxg 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 5m34s
kubernetes-dashboard kubernetes-dashboard-cd95d586-cvhs4 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 5m34s
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 950m (47%!)(MISSING) 100m (5%!)(MISSING)
memory 420Mi (5%!)(MISSING) 220Mi (2%!)(MISSING)
ephemeral-storage 100Mi (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-1Gi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-2Mi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-32Mi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-64Ki 0 (0%!)(MISSING) 0 (0%!)(MISSING)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal NodeHasSufficientMemory 9m6s (x5 over 9m6s) kubelet Node old-k8s-version-776336 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 9m6s (x5 over 9m6s) kubelet Node old-k8s-version-776336 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 9m6s (x5 over 9m6s) kubelet Node old-k8s-version-776336 status is now: NodeHasSufficientPID
Normal Starting 8m46s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 8m46s kubelet Node old-k8s-version-776336 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 8m46s kubelet Node old-k8s-version-776336 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 8m46s kubelet Node old-k8s-version-776336 status is now: NodeHasSufficientPID
Normal Starting 8m36s kube-proxy Starting kube-proxy.
Normal NodeReady 7m56s kubelet Node old-k8s-version-776336 status is now: NodeReady
Normal Starting 6m2s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 6m2s (x8 over 6m2s) kubelet Node old-k8s-version-776336 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 6m2s (x8 over 6m2s) kubelet Node old-k8s-version-776336 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 6m2s (x8 over 6m2s) kubelet Node old-k8s-version-776336 status is now: NodeHasSufficientPID
Normal Starting 5m49s kube-proxy Starting kube-proxy.
==> dmesg <==
[ +0.000732] FS-Cache: N-cookie c=00000186 [p=0000017d fl=2 nc=0 na=1]
[ +0.000969] FS-Cache: N-cookie d=00000000865130fc{9p.inode} n=00000000b52af1ec
[ +0.001072] FS-Cache: N-key=[8] '86843b0000000000'
[ +0.003288] FS-Cache: Duplicate cookie detected
[ +0.000779] FS-Cache: O-cookie c=00000180 [p=0000017d fl=226 nc=0 na=1]
[ +0.001126] FS-Cache: O-cookie d=00000000865130fc{9p.inode} n=00000000e8d17cb1
[ +0.001082] FS-Cache: O-key=[8] '86843b0000000000'
[ +0.000756] FS-Cache: N-cookie c=00000187 [p=0000017d fl=2 nc=0 na=1]
[ +0.000963] FS-Cache: N-cookie d=00000000865130fc{9p.inode} n=00000000ed12de27
[ +0.001175] FS-Cache: N-key=[8] '86843b0000000000'
[ +2.193050] FS-Cache: Duplicate cookie detected
[ +0.000790] FS-Cache: O-cookie c=0000017e [p=0000017d fl=226 nc=0 na=1]
[ +0.001021] FS-Cache: O-cookie d=00000000865130fc{9p.inode} n=00000000edfd6497
[ +0.001178] FS-Cache: O-key=[8] '85843b0000000000'
[ +0.000743] FS-Cache: N-cookie c=00000189 [p=0000017d fl=2 nc=0 na=1]
[ +0.001027] FS-Cache: N-cookie d=00000000865130fc{9p.inode} n=00000000b52af1ec
[ +0.001079] FS-Cache: N-key=[8] '85843b0000000000'
[ +0.264933] FS-Cache: Duplicate cookie detected
[ +0.000720] FS-Cache: O-cookie c=00000183 [p=0000017d fl=226 nc=0 na=1]
[ +0.000988] FS-Cache: O-cookie d=00000000865130fc{9p.inode} n=0000000017488ba3
[ +0.001098] FS-Cache: O-key=[8] '8b843b0000000000'
[ +0.000762] FS-Cache: N-cookie c=0000018a [p=0000017d fl=2 nc=0 na=1]
[ +0.000940] FS-Cache: N-cookie d=00000000865130fc{9p.inode} n=0000000005ec9b19
[ +0.001142] FS-Cache: N-key=[8] '8b843b0000000000'
[May20 11:12] overlayfs: '/var/lib/containers/storage/overlay/l/Q2QJNMTVZL6GMULS36RA5ZJGSA' not a directory
==> etcd [a0c29f0d3e719d5fdc0931e9109cfae19b3167c2b4e839f25c7b1b63784a02a4] <==
2024-05-20 11:23:18.184809 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-05-20 11:23:28.184697 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-05-20 11:23:38.184560 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-05-20 11:23:48.184658 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-05-20 11:23:58.184803 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-05-20 11:24:08.184617 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-05-20 11:24:18.184659 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-05-20 11:24:28.185551 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-05-20 11:24:38.184763 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-05-20 11:24:48.184802 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-05-20 11:24:58.184541 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-05-20 11:25:08.184774 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-05-20 11:25:18.184710 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-05-20 11:25:28.184616 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-05-20 11:25:38.184710 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-05-20 11:25:48.184590 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-05-20 11:25:58.184567 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-05-20 11:26:08.184631 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-05-20 11:26:18.184595 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-05-20 11:26:28.184606 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-05-20 11:26:38.184603 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-05-20 11:26:48.184734 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-05-20 11:26:58.184663 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-05-20 11:27:08.184582 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-05-20 11:27:18.190216 I | etcdserver/api/etcdhttp: /health OK (status code 200)
==> kernel <==
11:27:18 up 1 day, 19:09, 0 users, load average: 1.20, 1.71, 2.24
Linux old-k8s-version-776336 5.15.0-1058-aws #64~20.04.1-Ubuntu SMP Tue Apr 9 11:11:55 UTC 2024 aarch64 aarch64 aarch64 GNU/Linux
PRETTY_NAME="Ubuntu 22.04.4 LTS"
==> kindnet [b92863fb0bcbb6bb4f4fb5c32ac048568d8bea72be8749218a1c81ceb8dcbf67] <==
I0520 11:25:10.643327 1 main.go:227] handling current node
I0520 11:25:20.659020 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0520 11:25:20.659056 1 main.go:227] handling current node
I0520 11:25:30.669286 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0520 11:25:30.669312 1 main.go:227] handling current node
I0520 11:25:40.689754 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0520 11:25:40.689787 1 main.go:227] handling current node
I0520 11:25:50.707885 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0520 11:25:50.707915 1 main.go:227] handling current node
I0520 11:26:00.717972 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0520 11:26:00.718000 1 main.go:227] handling current node
I0520 11:26:10.734252 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0520 11:26:10.734282 1 main.go:227] handling current node
I0520 11:26:20.744192 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0520 11:26:20.744348 1 main.go:227] handling current node
I0520 11:26:30.755108 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0520 11:26:30.755139 1 main.go:227] handling current node
I0520 11:26:40.773506 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0520 11:26:40.773532 1 main.go:227] handling current node
I0520 11:26:50.788259 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0520 11:26:50.788288 1 main.go:227] handling current node
I0520 11:27:00.798430 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0520 11:27:00.798461 1 main.go:227] handling current node
I0520 11:27:10.809329 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0520 11:27:10.809464 1 main.go:227] handling current node
==> kube-apiserver [0b14a0f156605ce747bbd3ec92b34eb3ecf92d995ef08cfe0d147e8a56eb0eb3] <==
I0520 11:23:49.919591 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0520 11:23:49.919600 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0520 11:24:29.100283 1 client.go:360] parsed scheme: "passthrough"
I0520 11:24:29.100325 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0520 11:24:29.100334 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
W0520 11:24:29.718154 1 handler_proxy.go:102] no RequestInfo found in the context
E0520 11:24:29.718234 1 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I0520 11:24:29.718245 1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
I0520 11:25:05.356335 1 client.go:360] parsed scheme: "passthrough"
I0520 11:25:05.356378 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0520 11:25:05.356387 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0520 11:25:42.954340 1 client.go:360] parsed scheme: "passthrough"
I0520 11:25:42.954389 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0520 11:25:42.954398 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0520 11:26:23.252746 1 client.go:360] parsed scheme: "passthrough"
I0520 11:26:23.252795 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0520 11:26:23.252804 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
W0520 11:26:27.786076 1 handler_proxy.go:102] no RequestInfo found in the context
E0520 11:26:27.786149 1 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I0520 11:26:27.786158 1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
I0520 11:26:58.788963 1 client.go:360] parsed scheme: "passthrough"
I0520 11:26:58.788999 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0520 11:26:58.789007 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
==> kube-controller-manager [7f0c6c3acf70df9c58574fae04af747df228563cb3da7252a8324c5242528d4e] <==
W0520 11:22:51.630783 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0520 11:23:16.029968 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0520 11:23:23.281175 1 request.go:655] Throttling request took 1.048536809s, request: GET:https://192.168.76.2:8443/apis/apiextensions.k8s.io/v1beta1?timeout=32s
W0520 11:23:24.132740 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0520 11:23:46.531812 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0520 11:23:55.783189 1 request.go:655] Throttling request took 1.048429065s, request: GET:https://192.168.76.2:8443/apis/apiextensions.k8s.io/v1?timeout=32s
W0520 11:23:56.634746 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0520 11:24:17.034007 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0520 11:24:28.284246 1 request.go:655] Throttling request took 1.04844712s, request: GET:https://192.168.76.2:8443/apis/authentication.k8s.io/v1beta1?timeout=32s
W0520 11:24:29.135726 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0520 11:24:47.535940 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0520 11:25:00.786143 1 request.go:655] Throttling request took 1.048254774s, request: GET:https://192.168.76.2:8443/apis/extensions/v1beta1?timeout=32s
W0520 11:25:01.637945 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0520 11:25:18.038320 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0520 11:25:33.288393 1 request.go:655] Throttling request took 1.048562495s, request: GET:https://192.168.76.2:8443/apis/apiextensions.k8s.io/v1beta1?timeout=32s
W0520 11:25:34.139828 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0520 11:25:48.540187 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0520 11:26:05.790250 1 request.go:655] Throttling request took 1.048401944s, request: GET:https://192.168.76.2:8443/apis/coordination.k8s.io/v1?timeout=32s
W0520 11:26:06.641800 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0520 11:26:19.095119 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0520 11:26:38.292215 1 request.go:655] Throttling request took 1.048575177s, request: GET:https://192.168.76.2:8443/apis/apiextensions.k8s.io/v1?timeout=32s
W0520 11:26:39.143672 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0520 11:26:49.597125 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0520 11:27:10.794333 1 request.go:655] Throttling request took 1.048715156s, request: GET:https://192.168.76.2:8443/apis/extensions/v1beta1?timeout=32s
W0520 11:27:11.654436 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
==> kube-proxy [b026cb8ba53f0d1f48335254f05077b2a31ee7e5a35af6a7b530c5f18dccae5a] <==
I0520 11:18:42.297980 1 node.go:172] Successfully retrieved node IP: 192.168.76.2
I0520 11:18:42.298110 1 server_others.go:142] kube-proxy node IP is an IPv4 address (192.168.76.2), assume IPv4 operation
W0520 11:18:42.309389 1 server_others.go:578] Unknown proxy mode "", assuming iptables proxy
I0520 11:18:42.309515 1 server_others.go:185] Using iptables Proxier.
I0520 11:18:42.309842 1 server.go:650] Version: v1.20.0
I0520 11:18:42.310557 1 config.go:315] Starting service config controller
I0520 11:18:42.310588 1 shared_informer.go:240] Waiting for caches to sync for service config
I0520 11:18:42.310620 1 config.go:224] Starting endpoint slice config controller
I0520 11:18:42.310631 1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config
I0520 11:18:42.410729 1 shared_informer.go:247] Caches are synced for endpoint slice config
I0520 11:18:42.410729 1 shared_informer.go:247] Caches are synced for service config
I0520 11:21:29.661422 1 node.go:172] Successfully retrieved node IP: 192.168.76.2
I0520 11:21:29.661753 1 server_others.go:142] kube-proxy node IP is an IPv4 address (192.168.76.2), assume IPv4 operation
W0520 11:21:29.672977 1 server_others.go:578] Unknown proxy mode "", assuming iptables proxy
I0520 11:21:29.673147 1 server_others.go:185] Using iptables Proxier.
I0520 11:21:29.673408 1 server.go:650] Version: v1.20.0
I0520 11:21:29.674223 1 config.go:315] Starting service config controller
I0520 11:21:29.674297 1 shared_informer.go:240] Waiting for caches to sync for service config
I0520 11:21:29.674396 1 config.go:224] Starting endpoint slice config controller
I0520 11:21:29.674427 1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config
I0520 11:21:29.774487 1 shared_informer.go:247] Caches are synced for endpoint slice config
I0520 11:21:29.774633 1 shared_informer.go:247] Caches are synced for service config
==> kube-scheduler [200301c79d92cc1dca51aa9d3818041786dbc0fc25722073be3c056ab8ddc40d] <==
E0520 11:18:20.653827 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
E0520 11:18:20.653974 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
E0520 11:18:20.654087 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
E0520 11:18:20.654235 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
E0520 11:18:20.654427 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
E0520 11:18:20.654985 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
E0520 11:18:20.655323 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
E0520 11:18:20.655439 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
E0520 11:18:20.657919 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
E0520 11:18:21.578939 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
E0520 11:18:21.581316 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
E0520 11:18:21.592150 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
E0520 11:18:21.599085 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1beta1.PodDisruptionBudget: failed to list *v1beta1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
E0520 11:18:21.646082 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
I0520 11:18:22.126500 1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0520 11:21:20.435133 1 serving.go:331] Generated self-signed cert in-memory
W0520 11:21:26.673930 1 requestheader_controller.go:193] Unable to get configmap/extension-apiserver-authentication in kube-system. Usually fixed by 'kubectl create rolebinding -n kube-system ROLEBINDING_NAME --role=extension-apiserver-authentication-reader --serviceaccount=YOUR_NS:YOUR_SA'
W0520 11:21:26.674095 1 authentication.go:332] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"
W0520 11:21:26.674111 1 authentication.go:333] Continuing without authentication configuration. This may treat all requests as anonymous.
W0520 11:21:26.674117 1 authentication.go:334] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false
I0520 11:21:26.951990 1 secure_serving.go:197] Serving securely on 127.0.0.1:10259
I0520 11:21:26.952143 1 configmap_cafile_content.go:202] Starting client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0520 11:21:26.952159 1 shared_informer.go:240] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0520 11:21:26.952174 1 tlsconfig.go:240] Starting DynamicServingCertificateController
I0520 11:21:27.155951 1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
==> kubelet <==
May 20 11:25:53 old-k8s-version-776336 kubelet[730]: E0520 11:25:53.311487 730 pod_workers.go:191] Error syncing pod eb2910c3-cbac-462e-901e-4fb79caf95bf ("metrics-server-9975d5f86-qdks4_kube-system(eb2910c3-cbac-462e-901e-4fb79caf95bf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
May 20 11:26:05 old-k8s-version-776336 kubelet[730]: I0520 11:26:05.310668 730 scope.go:95] [topologymanager] RemoveContainer - Container ID: 9880d6ea4fbcfba04698cb8c4772564d24fc633aa79e6b35ccba51d3677dbb30
May 20 11:26:05 old-k8s-version-776336 kubelet[730]: E0520 11:26:05.311044 730 pod_workers.go:191] Error syncing pod 2c684adc-682c-4c95-a80c-90b35ac50afd ("dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"
May 20 11:26:07 old-k8s-version-776336 kubelet[730]: E0520 11:26:07.311454 730 pod_workers.go:191] Error syncing pod eb2910c3-cbac-462e-901e-4fb79caf95bf ("metrics-server-9975d5f86-qdks4_kube-system(eb2910c3-cbac-462e-901e-4fb79caf95bf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
May 20 11:26:16 old-k8s-version-776336 kubelet[730]: E0520 11:26:16.299580 730 container_manager_linux.go:533] failed to find cgroups of kubelet - cpu and memory cgroup hierarchy not unified. cpu: /docker/79b3e893485d03f6c7fa54c0f1076a4e9f6fac7238dffad483d3ab0503f5a33a, memory: /docker/79b3e893485d03f6c7fa54c0f1076a4e9f6fac7238dffad483d3ab0503f5a33a/system.slice/kubelet.service
May 20 11:26:17 old-k8s-version-776336 kubelet[730]: I0520 11:26:17.311320 730 scope.go:95] [topologymanager] RemoveContainer - Container ID: 9880d6ea4fbcfba04698cb8c4772564d24fc633aa79e6b35ccba51d3677dbb30
May 20 11:26:17 old-k8s-version-776336 kubelet[730]: E0520 11:26:17.312403 730 pod_workers.go:191] Error syncing pod 2c684adc-682c-4c95-a80c-90b35ac50afd ("dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"
May 20 11:26:22 old-k8s-version-776336 kubelet[730]: E0520 11:26:22.311955 730 pod_workers.go:191] Error syncing pod eb2910c3-cbac-462e-901e-4fb79caf95bf ("metrics-server-9975d5f86-qdks4_kube-system(eb2910c3-cbac-462e-901e-4fb79caf95bf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
May 20 11:26:29 old-k8s-version-776336 kubelet[730]: I0520 11:26:29.310672 730 scope.go:95] [topologymanager] RemoveContainer - Container ID: 9880d6ea4fbcfba04698cb8c4772564d24fc633aa79e6b35ccba51d3677dbb30
May 20 11:26:29 old-k8s-version-776336 kubelet[730]: E0520 11:26:29.310991 730 pod_workers.go:191] Error syncing pod 2c684adc-682c-4c95-a80c-90b35ac50afd ("dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"
May 20 11:26:35 old-k8s-version-776336 kubelet[730]: E0520 11:26:35.311614 730 pod_workers.go:191] Error syncing pod eb2910c3-cbac-462e-901e-4fb79caf95bf ("metrics-server-9975d5f86-qdks4_kube-system(eb2910c3-cbac-462e-901e-4fb79caf95bf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
May 20 11:26:40 old-k8s-version-776336 kubelet[730]: I0520 11:26:40.310649 730 scope.go:95] [topologymanager] RemoveContainer - Container ID: 9880d6ea4fbcfba04698cb8c4772564d24fc633aa79e6b35ccba51d3677dbb30
May 20 11:26:40 old-k8s-version-776336 kubelet[730]: E0520 11:26:40.310989 730 pod_workers.go:191] Error syncing pod 2c684adc-682c-4c95-a80c-90b35ac50afd ("dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"
May 20 11:26:46 old-k8s-version-776336 kubelet[730]: E0520 11:26:46.315105 730 pod_workers.go:191] Error syncing pod eb2910c3-cbac-462e-901e-4fb79caf95bf ("metrics-server-9975d5f86-qdks4_kube-system(eb2910c3-cbac-462e-901e-4fb79caf95bf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
May 20 11:26:53 old-k8s-version-776336 kubelet[730]: I0520 11:26:53.310649 730 scope.go:95] [topologymanager] RemoveContainer - Container ID: 9880d6ea4fbcfba04698cb8c4772564d24fc633aa79e6b35ccba51d3677dbb30
May 20 11:26:53 old-k8s-version-776336 kubelet[730]: E0520 11:26:53.310994 730 pod_workers.go:191] Error syncing pod 2c684adc-682c-4c95-a80c-90b35ac50afd ("dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"
May 20 11:26:57 old-k8s-version-776336 kubelet[730]: E0520 11:26:57.312314 730 pod_workers.go:191] Error syncing pod eb2910c3-cbac-462e-901e-4fb79caf95bf ("metrics-server-9975d5f86-qdks4_kube-system(eb2910c3-cbac-462e-901e-4fb79caf95bf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
May 20 11:27:06 old-k8s-version-776336 kubelet[730]: I0520 11:27:06.311130 730 scope.go:95] [topologymanager] RemoveContainer - Container ID: 9880d6ea4fbcfba04698cb8c4772564d24fc633aa79e6b35ccba51d3677dbb30
May 20 11:27:06 old-k8s-version-776336 kubelet[730]: E0520 11:27:06.311519 730 pod_workers.go:191] Error syncing pod 2c684adc-682c-4c95-a80c-90b35ac50afd ("dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"
May 20 11:27:08 old-k8s-version-776336 kubelet[730]: E0520 11:27:08.334331 730 remote_image.go:113] PullImage "fake.domain/registry.k8s.io/echoserver:1.4" from image service failed: rpc error: code = Unknown desc = pinging container registry fake.domain: Get "https://fake.domain/v2/": dial tcp: lookup fake.domain: no such host
May 20 11:27:08 old-k8s-version-776336 kubelet[730]: E0520 11:27:08.334385 730 kuberuntime_image.go:51] Pull image "fake.domain/registry.k8s.io/echoserver:1.4" failed: rpc error: code = Unknown desc = pinging container registry fake.domain: Get "https://fake.domain/v2/": dial tcp: lookup fake.domain: no such host
May 20 11:27:08 old-k8s-version-776336 kubelet[730]: E0520 11:27:08.334514 730 kuberuntime_manager.go:829] container &Container{Name:metrics-server,Image:fake.domain/registry.k8s.io/echoserver:1.4,Command:[],Args:[--cert-dir=/tmp --secure-port=4443 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --kubelet-use-node-status-port --metric-resolution=60s --kubelet-insecure-tls],WorkingDir:,Ports:[]ContainerPort{ContainerPort{Name:https,HostPort:0,ContainerPort:4443,Protocol:TCP,HostIP:,},},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{cpu: {{100 -3} {<nil>} 100m DecimalSI},memory: {{209715200 0} {<nil>} BinarySI},},},VolumeMounts:[]VolumeMount{VolumeMount{Name:tmp-dir,ReadOnly:false,MountPath:/tmp,SubPath:,MountPropagation:nil,SubPathExpr:,},VolumeMount{Name:metrics-server-token-lstwk,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:&Probe{Handler:Handler{Exec
:nil,HTTPGet:&HTTPGetAction{Path:/livez,Port:{1 0 https},Host:,Scheme:HTTPS,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,},InitialDelaySeconds:0,TimeoutSeconds:1,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,},ReadinessProbe:&Probe{Handler:Handler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/readyz,Port:{1 0 https},Host:,Scheme:HTTPS,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,},InitialDelaySeconds:0,TimeoutSeconds:1,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:*1000,RunAsNonRoot:*true,ReadOnlyRootFilesystem:*true,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,} start failed in pod metrics-server-9975d5f86-qdks4_kube-system(eb2910c
3-cbac-462e-901e-4fb79caf95bf): ErrImagePull: rpc error: code = Unknown desc = pinging container registry fake.domain: Get "https://fake.domain/v2/": dial tcp: lookup fake.domain: no such host
May 20 11:27:08 old-k8s-version-776336 kubelet[730]: E0520 11:27:08.334543 730 pod_workers.go:191] Error syncing pod eb2910c3-cbac-462e-901e-4fb79caf95bf ("metrics-server-9975d5f86-qdks4_kube-system(eb2910c3-cbac-462e-901e-4fb79caf95bf)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
May 20 11:27:17 old-k8s-version-776336 kubelet[730]: I0520 11:27:17.310600 730 scope.go:95] [topologymanager] RemoveContainer - Container ID: 9880d6ea4fbcfba04698cb8c4772564d24fc633aa79e6b35ccba51d3677dbb30
May 20 11:27:17 old-k8s-version-776336 kubelet[730]: E0520 11:27:17.310927 730 pod_workers.go:191] Error syncing pod 2c684adc-682c-4c95-a80c-90b35ac50afd ("dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tzcxg_kubernetes-dashboard(2c684adc-682c-4c95-a80c-90b35ac50afd)"
==> kubernetes-dashboard [478b985a70c80d44c1dc3a606124f6d8d1a1b16caa15815f4d319199182b0973] <==
2024/05/20 11:21:49 Using namespace: kubernetes-dashboard
2024/05/20 11:21:49 Using in-cluster config to connect to apiserver
2024/05/20 11:21:49 Using secret token for csrf signing
2024/05/20 11:21:49 Initializing csrf token from kubernetes-dashboard-csrf secret
2024/05/20 11:21:49 Empty token. Generating and storing in a secret kubernetes-dashboard-csrf
2024/05/20 11:21:49 Successful initial request to the apiserver, version: v1.20.0
2024/05/20 11:21:49 Generating JWE encryption key
2024/05/20 11:21:49 New synchronizer has been registered: kubernetes-dashboard-key-holder-kubernetes-dashboard. Starting
2024/05/20 11:21:49 Starting secret synchronizer for kubernetes-dashboard-key-holder in namespace kubernetes-dashboard
2024/05/20 11:21:51 Initializing JWE encryption key from synchronized object
2024/05/20 11:21:51 Creating in-cluster Sidecar client
2024/05/20 11:21:52 Serving insecurely on HTTP port: 9090
2024/05/20 11:21:52 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/05/20 11:22:22 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/05/20 11:22:52 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/05/20 11:23:22 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/05/20 11:23:52 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/05/20 11:24:22 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/05/20 11:24:52 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/05/20 11:25:22 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/05/20 11:25:52 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/05/20 11:26:22 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/05/20 11:26:52 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/05/20 11:21:49 Starting overwatch
==> storage-provisioner [80aac8daed1fe77959700c7a1f1a34853c09f3dbeb46648d0ab015345f91e607] <==
I0520 11:19:27.221501 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
I0520 11:19:27.248233 1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
I0520 11:19:27.248373 1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
I0520 11:19:27.279001 1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
I0520 11:19:27.279233 1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_old-k8s-version-776336_8c64fc10-b564-4274-87de-2aab05e36e61!
I0520 11:19:27.281383 1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"445e794e-cf50-4b51-9c2b-3eb437caaac3", APIVersion:"v1", ResourceVersion:"491", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' old-k8s-version-776336_8c64fc10-b564-4274-87de-2aab05e36e61 became leader
I0520 11:19:27.380359 1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_old-k8s-version-776336_8c64fc10-b564-4274-87de-2aab05e36e61!
I0520 11:21:30.756969 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
I0520 11:21:30.772996 1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
I0520 11:21:30.773128 1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
I0520 11:21:48.250771 1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
I0520 11:21:48.251717 1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_old-k8s-version-776336_e4d92e54-c78c-4ba9-8674-7ab6051a02e7!
I0520 11:21:48.251322 1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"445e794e-cf50-4b51-9c2b-3eb437caaac3", APIVersion:"v1", ResourceVersion:"769", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' old-k8s-version-776336_e4d92e54-c78c-4ba9-8674-7ab6051a02e7 became leader
I0520 11:21:48.357048 1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_old-k8s-version-776336_e4d92e54-c78c-4ba9-8674-7ab6051a02e7!
-- /stdout --
helpers_test.go:254: (dbg) Run: out/minikube-linux-arm64 status --format={{.APIServer}} -p old-k8s-version-776336 -n old-k8s-version-776336
helpers_test.go:261: (dbg) Run: kubectl --context old-k8s-version-776336 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:272: non-running pods: metrics-server-9975d5f86-qdks4
helpers_test.go:274: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: describe non-running pods <======
helpers_test.go:277: (dbg) Run: kubectl --context old-k8s-version-776336 describe pod metrics-server-9975d5f86-qdks4
helpers_test.go:277: (dbg) Non-zero exit: kubectl --context old-k8s-version-776336 describe pod metrics-server-9975d5f86-qdks4: exit status 1 (105.644483ms)
** stderr **
Error from server (NotFound): pods "metrics-server-9975d5f86-qdks4" not found
** /stderr **
helpers_test.go:279: kubectl --context old-k8s-version-776336 describe pod metrics-server-9975d5f86-qdks4: exit status 1
--- FAIL: TestStartStop/group/old-k8s-version/serial/SecondStart (380.68s)