=== RUN TestStartStop/group/old-k8s-version/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run: out/minikube-linux-arm64 start -p old-k8s-version-130660 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=crio --kubernetes-version=v1.20.0
E0731 23:34:55.539814 1584615 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19360-1579223/.minikube/profiles/custom-flannel-570273/client.crt: no such file or directory
E0731 23:35:03.377220 1584615 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19360-1579223/.minikube/profiles/addons-849486/client.crt: no such file or directory
E0731 23:35:04.779607 1584615 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19360-1579223/.minikube/profiles/kindnet-570273/client.crt: no such file or directory
E0731 23:35:08.592261 1584615 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19360-1579223/.minikube/profiles/enable-default-cni-570273/client.crt: no such file or directory
E0731 23:35:08.597499 1584615 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19360-1579223/.minikube/profiles/enable-default-cni-570273/client.crt: no such file or directory
E0731 23:35:08.607706 1584615 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19360-1579223/.minikube/profiles/enable-default-cni-570273/client.crt: no such file or directory
E0731 23:35:08.627978 1584615 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19360-1579223/.minikube/profiles/enable-default-cni-570273/client.crt: no such file or directory
E0731 23:35:08.668868 1584615 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19360-1579223/.minikube/profiles/enable-default-cni-570273/client.crt: no such file or directory
E0731 23:35:08.749161 1584615 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19360-1579223/.minikube/profiles/enable-default-cni-570273/client.crt: no such file or directory
E0731 23:35:08.909503 1584615 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19360-1579223/.minikube/profiles/enable-default-cni-570273/client.crt: no such file or directory
E0731 23:35:09.230461 1584615 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19360-1579223/.minikube/profiles/enable-default-cni-570273/client.crt: no such file or directory
E0731 23:35:09.871449 1584615 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19360-1579223/.minikube/profiles/enable-default-cni-570273/client.crt: no such file or directory
E0731 23:35:11.152612 1584615 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19360-1579223/.minikube/profiles/enable-default-cni-570273/client.crt: no such file or directory
E0731 23:35:13.713635 1584615 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19360-1579223/.minikube/profiles/enable-default-cni-570273/client.crt: no such file or directory
E0731 23:35:18.833869 1584615 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19360-1579223/.minikube/profiles/enable-default-cni-570273/client.crt: no such file or directory
E0731 23:35:20.329030 1584615 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19360-1579223/.minikube/profiles/addons-849486/client.crt: no such file or directory
E0731 23:35:29.074428 1584615 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19360-1579223/.minikube/profiles/enable-default-cni-570273/client.crt: no such file or directory
E0731 23:35:36.500633 1584615 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19360-1579223/.minikube/profiles/custom-flannel-570273/client.crt: no such file or directory
E0731 23:35:40.025617 1584615 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19360-1579223/.minikube/profiles/calico-570273/client.crt: no such file or directory
E0731 23:35:49.555457 1584615 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19360-1579223/.minikube/profiles/enable-default-cni-570273/client.crt: no such file or directory
E0731 23:35:55.295897 1584615 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19360-1579223/.minikube/profiles/flannel-570273/client.crt: no such file or directory
E0731 23:35:55.301149 1584615 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19360-1579223/.minikube/profiles/flannel-570273/client.crt: no such file or directory
E0731 23:35:55.311387 1584615 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19360-1579223/.minikube/profiles/flannel-570273/client.crt: no such file or directory
E0731 23:35:55.331640 1584615 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19360-1579223/.minikube/profiles/flannel-570273/client.crt: no such file or directory
E0731 23:35:55.371876 1584615 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19360-1579223/.minikube/profiles/flannel-570273/client.crt: no such file or directory
E0731 23:35:55.452129 1584615 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19360-1579223/.minikube/profiles/flannel-570273/client.crt: no such file or directory
E0731 23:35:55.612489 1584615 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19360-1579223/.minikube/profiles/flannel-570273/client.crt: no such file or directory
E0731 23:35:55.933033 1584615 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19360-1579223/.minikube/profiles/flannel-570273/client.crt: no such file or directory
E0731 23:35:56.573371 1584615 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19360-1579223/.minikube/profiles/flannel-570273/client.crt: no such file or directory
E0731 23:35:57.854290 1584615 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19360-1579223/.minikube/profiles/flannel-570273/client.crt: no such file or directory
E0731 23:36:00.415309 1584615 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19360-1579223/.minikube/profiles/flannel-570273/client.crt: no such file or directory
E0731 23:36:04.231852 1584615 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19360-1579223/.minikube/profiles/auto-570273/client.crt: no such file or directory
E0731 23:36:05.536080 1584615 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19360-1579223/.minikube/profiles/flannel-570273/client.crt: no such file or directory
E0731 23:36:15.776330 1584615 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19360-1579223/.minikube/profiles/flannel-570273/client.crt: no such file or directory
E0731 23:36:30.515631 1584615 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19360-1579223/.minikube/profiles/enable-default-cni-570273/client.crt: no such file or directory
E0731 23:36:31.914987 1584615 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19360-1579223/.minikube/profiles/auto-570273/client.crt: no such file or directory
E0731 23:36:36.256723 1584615 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19360-1579223/.minikube/profiles/flannel-570273/client.crt: no such file or directory
E0731 23:36:37.672996 1584615 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19360-1579223/.minikube/profiles/functional-818778/client.crt: no such file or directory
E0731 23:36:58.420835 1584615 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19360-1579223/.minikube/profiles/custom-flannel-570273/client.crt: no such file or directory
E0731 23:37:10.989350 1584615 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19360-1579223/.minikube/profiles/bridge-570273/client.crt: no such file or directory
E0731 23:37:10.994656 1584615 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19360-1579223/.minikube/profiles/bridge-570273/client.crt: no such file or directory
E0731 23:37:11.005310 1584615 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19360-1579223/.minikube/profiles/bridge-570273/client.crt: no such file or directory
E0731 23:37:11.025623 1584615 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19360-1579223/.minikube/profiles/bridge-570273/client.crt: no such file or directory
E0731 23:37:11.065939 1584615 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19360-1579223/.minikube/profiles/bridge-570273/client.crt: no such file or directory
E0731 23:37:11.146431 1584615 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19360-1579223/.minikube/profiles/bridge-570273/client.crt: no such file or directory
E0731 23:37:11.306678 1584615 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19360-1579223/.minikube/profiles/bridge-570273/client.crt: no such file or directory
E0731 23:37:11.627256 1584615 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19360-1579223/.minikube/profiles/bridge-570273/client.crt: no such file or directory
E0731 23:37:12.268068 1584615 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19360-1579223/.minikube/profiles/bridge-570273/client.crt: no such file or directory
E0731 23:37:13.548262 1584615 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19360-1579223/.minikube/profiles/bridge-570273/client.crt: no such file or directory
E0731 23:37:16.108502 1584615 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19360-1579223/.minikube/profiles/bridge-570273/client.crt: no such file or directory
E0731 23:37:17.216964 1584615 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19360-1579223/.minikube/profiles/flannel-570273/client.crt: no such file or directory
E0731 23:37:20.935725 1584615 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19360-1579223/.minikube/profiles/kindnet-570273/client.crt: no such file or directory
E0731 23:37:21.229435 1584615 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19360-1579223/.minikube/profiles/bridge-570273/client.crt: no such file or directory
E0731 23:37:31.470309 1584615 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19360-1579223/.minikube/profiles/bridge-570273/client.crt: no such file or directory
E0731 23:37:48.620228 1584615 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19360-1579223/.minikube/profiles/kindnet-570273/client.crt: no such file or directory
E0731 23:37:51.951185 1584615 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19360-1579223/.minikube/profiles/bridge-570273/client.crt: no such file or directory
E0731 23:37:52.435858 1584615 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19360-1579223/.minikube/profiles/enable-default-cni-570273/client.crt: no such file or directory
E0731 23:37:56.183012 1584615 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19360-1579223/.minikube/profiles/calico-570273/client.crt: no such file or directory
E0731 23:38:23.866418 1584615 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19360-1579223/.minikube/profiles/calico-570273/client.crt: no such file or directory
E0731 23:38:32.912026 1584615 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19360-1579223/.minikube/profiles/bridge-570273/client.crt: no such file or directory
E0731 23:38:39.137724 1584615 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19360-1579223/.minikube/profiles/flannel-570273/client.crt: no such file or directory
start_stop_delete_test.go:256: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p old-k8s-version-130660 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=crio --kubernetes-version=v1.20.0: exit status 102 (6m11.511466869s)
-- stdout --
* [old-k8s-version-130660] minikube v1.33.1 on Ubuntu 20.04 (arm64)
- MINIKUBE_LOCATION=19360
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/19360-1579223/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/19360-1579223/.minikube
- MINIKUBE_BIN=out/minikube-linux-arm64
- MINIKUBE_FORCE_SYSTEMD=
* Kubernetes 1.30.3 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.30.3
* Using the docker driver based on existing profile
* Starting "old-k8s-version-130660" primary control-plane node in "old-k8s-version-130660" cluster
* Pulling base image v0.0.44-1721902582-19326 ...
* Restarting existing docker container for "old-k8s-version-130660" ...
* Preparing Kubernetes v1.20.0 on CRI-O 1.24.6 ...
* Verifying Kubernetes components...
- Using image gcr.io/k8s-minikube/storage-provisioner:v5
- Using image docker.io/kubernetesui/dashboard:v2.7.0
- Using image registry.k8s.io/echoserver:1.4
- Using image fake.domain/registry.k8s.io/echoserver:1.4
* Some dashboard features require the metrics-server addon. To enable all features please run:
minikube -p old-k8s-version-130660 addons enable metrics-server
* Enabled addons: default-storageclass, metrics-server, storage-provisioner, dashboard
-- /stdout --
** stderr **
I0731 23:34:42.571842 1829252 out.go:291] Setting OutFile to fd 1 ...
I0731 23:34:42.572021 1829252 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0731 23:34:42.572028 1829252 out.go:304] Setting ErrFile to fd 2...
I0731 23:34:42.572034 1829252 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0731 23:34:42.572281 1829252 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19360-1579223/.minikube/bin
I0731 23:34:42.572626 1829252 out.go:298] Setting JSON to false
I0731 23:34:42.573723 1829252 start.go:129] hostinfo: {"hostname":"ip-172-31-31-251","uptime":26221,"bootTime":1722442662,"procs":208,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1066-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"982e3628-3742-4b3e-bb63-ac1b07660ec7"}
I0731 23:34:42.573790 1829252 start.go:139] virtualization:
I0731 23:34:42.579705 1829252 out.go:177] * [old-k8s-version-130660] minikube v1.33.1 on Ubuntu 20.04 (arm64)
I0731 23:34:42.582193 1829252 out.go:177] - MINIKUBE_LOCATION=19360
I0731 23:34:42.582266 1829252 notify.go:220] Checking for updates...
I0731 23:34:42.587839 1829252 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0731 23:34:42.589981 1829252 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/19360-1579223/kubeconfig
I0731 23:34:42.592131 1829252 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/19360-1579223/.minikube
I0731 23:34:42.594418 1829252 out.go:177] - MINIKUBE_BIN=out/minikube-linux-arm64
I0731 23:34:42.596267 1829252 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0731 23:34:42.598828 1829252 config.go:182] Loaded profile config "old-k8s-version-130660": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0731 23:34:42.601707 1829252 out.go:177] * Kubernetes 1.30.3 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.30.3
I0731 23:34:42.603940 1829252 driver.go:392] Setting default libvirt URI to qemu:///system
I0731 23:34:42.672802 1829252 docker.go:123] docker version: linux-27.1.1:Docker Engine - Community
I0731 23:34:42.672919 1829252 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0731 23:34:42.765387 1829252 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:34 OomKillDisable:true NGoroutines:53 SystemTime:2024-07-31 23:34:42.752603406 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1066-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214900736 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:27.1.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41 Expected:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.16.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.1]] Warnings:<nil>}}
I0731 23:34:42.765509 1829252 docker.go:307] overlay module found
I0731 23:34:42.769473 1829252 out.go:177] * Using the docker driver based on existing profile
I0731 23:34:42.771631 1829252 start.go:297] selected driver: docker
I0731 23:34:42.771649 1829252 start.go:901] validating driver "docker" against &{Name:old-k8s-version-130660 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-130660 Namespace:default APIServerHAVIP: AP
IServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountStr
ing:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0731 23:34:42.771771 1829252 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0731 23:34:42.772380 1829252 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0731 23:34:42.862826 1829252 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:34 OomKillDisable:true NGoroutines:53 SystemTime:2024-07-31 23:34:42.852215928 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1066-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214900736 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:27.1.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41 Expected:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.16.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.1]] Warnings:<nil>}}
I0731 23:34:42.863158 1829252 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0731 23:34:42.863179 1829252 cni.go:84] Creating CNI manager for ""
I0731 23:34:42.863187 1829252 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
I0731 23:34:42.863237 1829252 start.go:340] cluster config:
{Name:old-k8s-version-130660 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-130660 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local
ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP
: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0731 23:34:42.866811 1829252 out.go:177] * Starting "old-k8s-version-130660" primary control-plane node in "old-k8s-version-130660" cluster
I0731 23:34:42.868555 1829252 cache.go:121] Beginning downloading kic base image for docker with crio
I0731 23:34:42.870453 1829252 out.go:177] * Pulling base image v0.0.44-1721902582-19326 ...
I0731 23:34:42.873198 1829252 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0731 23:34:42.873258 1829252 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19360-1579223/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-arm64.tar.lz4
I0731 23:34:42.873268 1829252 cache.go:56] Caching tarball of preloaded images
I0731 23:34:42.873347 1829252 preload.go:172] Found /home/jenkins/minikube-integration/19360-1579223/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-arm64.tar.lz4 in cache, skipping download
I0731 23:34:42.873356 1829252 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on crio
I0731 23:34:42.873476 1829252 profile.go:143] Saving config to /home/jenkins/minikube-integration/19360-1579223/.minikube/profiles/old-k8s-version-130660/config.json ...
I0731 23:34:42.873678 1829252 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 in local docker daemon
W0731 23:34:42.899696 1829252 image.go:95] image gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 is of wrong architecture
I0731 23:34:42.899716 1829252 cache.go:149] Downloading gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 to local cache
I0731 23:34:42.899790 1829252 image.go:63] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 in local cache directory
I0731 23:34:42.899822 1829252 image.go:66] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 in local cache directory, skipping pull
I0731 23:34:42.899828 1829252 image.go:135] gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 exists in cache, skipping pull
I0731 23:34:42.899837 1829252 cache.go:152] successfully saved gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 as a tarball
I0731 23:34:42.899848 1829252 cache.go:162] Loading gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 from local cache
I0731 23:34:43.030338 1829252 cache.go:164] successfully loaded and using gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 from cached tarball
I0731 23:34:43.030378 1829252 cache.go:194] Successfully downloaded all kic artifacts
I0731 23:34:43.030408 1829252 start.go:360] acquireMachinesLock for old-k8s-version-130660: {Name:mkc9755a68757cdabbee4e5fe1d18f5125691b13 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0731 23:34:43.030473 1829252 start.go:364] duration metric: took 41.895µs to acquireMachinesLock for "old-k8s-version-130660"
I0731 23:34:43.030500 1829252 start.go:96] Skipping create...Using existing machine configuration
I0731 23:34:43.030509 1829252 fix.go:54] fixHost starting:
I0731 23:34:43.030795 1829252 cli_runner.go:164] Run: docker container inspect old-k8s-version-130660 --format={{.State.Status}}
I0731 23:34:43.056095 1829252 fix.go:112] recreateIfNeeded on old-k8s-version-130660: state=Stopped err=<nil>
W0731 23:34:43.056215 1829252 fix.go:138] unexpected machine state, will restart: <nil>
I0731 23:34:43.060563 1829252 out.go:177] * Restarting existing docker container for "old-k8s-version-130660" ...
I0731 23:34:43.064776 1829252 cli_runner.go:164] Run: docker start old-k8s-version-130660
I0731 23:34:43.416704 1829252 cli_runner.go:164] Run: docker container inspect old-k8s-version-130660 --format={{.State.Status}}
I0731 23:34:43.441233 1829252 kic.go:430] container "old-k8s-version-130660" state is running.
I0731 23:34:43.441625 1829252 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-130660
I0731 23:34:43.478467 1829252 profile.go:143] Saving config to /home/jenkins/minikube-integration/19360-1579223/.minikube/profiles/old-k8s-version-130660/config.json ...
I0731 23:34:43.478679 1829252 machine.go:94] provisionDockerMachine start ...
I0731 23:34:43.478734 1829252 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-130660
I0731 23:34:43.508418 1829252 main.go:141] libmachine: Using SSH client type: native
I0731 23:34:43.508675 1829252 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2cd0] 0x3e5530 <nil> [] 0s} 127.0.0.1 34971 <nil> <nil>}
I0731 23:34:43.508684 1829252 main.go:141] libmachine: About to run SSH command:
hostname
I0731 23:34:43.509307 1829252 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:54300->127.0.0.1:34971: read: connection reset by peer
I0731 23:34:46.645604 1829252 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-130660
I0731 23:34:46.645631 1829252 ubuntu.go:169] provisioning hostname "old-k8s-version-130660"
I0731 23:34:46.645716 1829252 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-130660
I0731 23:34:46.663860 1829252 main.go:141] libmachine: Using SSH client type: native
I0731 23:34:46.664119 1829252 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2cd0] 0x3e5530 <nil> [] 0s} 127.0.0.1 34971 <nil> <nil>}
I0731 23:34:46.664135 1829252 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-130660 && echo "old-k8s-version-130660" | sudo tee /etc/hostname
I0731 23:34:46.809430 1829252 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-130660
I0731 23:34:46.809567 1829252 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-130660
I0731 23:34:46.827603 1829252 main.go:141] libmachine: Using SSH client type: native
I0731 23:34:46.827858 1829252 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2cd0] 0x3e5530 <nil> [] 0s} 127.0.0.1 34971 <nil> <nil>}
I0731 23:34:46.827882 1829252 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-130660' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-130660/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-130660' | sudo tee -a /etc/hosts;
fi
fi
I0731 23:34:46.960981 1829252 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0731 23:34:46.961011 1829252 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/19360-1579223/.minikube CaCertPath:/home/jenkins/minikube-integration/19360-1579223/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19360-1579223/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19360-1579223/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19360-1579223/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19360-1579223/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19360-1579223/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19360-1579223/.minikube}
I0731 23:34:46.961039 1829252 ubuntu.go:177] setting up certificates
I0731 23:34:46.961049 1829252 provision.go:84] configureAuth start
I0731 23:34:46.961135 1829252 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-130660
I0731 23:34:46.977494 1829252 provision.go:143] copyHostCerts
I0731 23:34:46.977571 1829252 exec_runner.go:144] found /home/jenkins/minikube-integration/19360-1579223/.minikube/cert.pem, removing ...
I0731 23:34:46.977595 1829252 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19360-1579223/.minikube/cert.pem
I0731 23:34:46.977678 1829252 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19360-1579223/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19360-1579223/.minikube/cert.pem (1123 bytes)
I0731 23:34:46.977794 1829252 exec_runner.go:144] found /home/jenkins/minikube-integration/19360-1579223/.minikube/key.pem, removing ...
I0731 23:34:46.977803 1829252 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19360-1579223/.minikube/key.pem
I0731 23:34:46.977833 1829252 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19360-1579223/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19360-1579223/.minikube/key.pem (1679 bytes)
I0731 23:34:46.977901 1829252 exec_runner.go:144] found /home/jenkins/minikube-integration/19360-1579223/.minikube/ca.pem, removing ...
I0731 23:34:46.977911 1829252 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19360-1579223/.minikube/ca.pem
I0731 23:34:46.977935 1829252 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19360-1579223/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19360-1579223/.minikube/ca.pem (1082 bytes)
I0731 23:34:46.978004 1829252 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19360-1579223/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19360-1579223/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19360-1579223/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-130660 san=[127.0.0.1 192.168.76.2 localhost minikube old-k8s-version-130660]
I0731 23:34:47.628190 1829252 provision.go:177] copyRemoteCerts
I0731 23:34:47.628262 1829252 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0731 23:34:47.628313 1829252 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-130660
I0731 23:34:47.647606 1829252 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34971 SSHKeyPath:/home/jenkins/minikube-integration/19360-1579223/.minikube/machines/old-k8s-version-130660/id_rsa Username:docker}
I0731 23:34:47.744044 1829252 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19360-1579223/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0731 23:34:47.772817 1829252 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19360-1579223/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0731 23:34:47.798561 1829252 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19360-1579223/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
I0731 23:34:47.824300 1829252 provision.go:87] duration metric: took 863.23431ms to configureAuth
I0731 23:34:47.824329 1829252 ubuntu.go:193] setting minikube options for container-runtime
I0731 23:34:47.824517 1829252 config.go:182] Loaded profile config "old-k8s-version-130660": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0731 23:34:47.824622 1829252 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-130660
I0731 23:34:47.842182 1829252 main.go:141] libmachine: Using SSH client type: native
I0731 23:34:47.842438 1829252 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2cd0] 0x3e5530 <nil> [] 0s} 127.0.0.1 34971 <nil> <nil>}
I0731 23:34:47.842461 1829252 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0731 23:34:48.245409 1829252 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0731 23:34:48.245434 1829252 machine.go:97] duration metric: took 4.766745179s to provisionDockerMachine
I0731 23:34:48.245445 1829252 start.go:293] postStartSetup for "old-k8s-version-130660" (driver="docker")
I0731 23:34:48.245457 1829252 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0731 23:34:48.245521 1829252 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0731 23:34:48.245570 1829252 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-130660
I0731 23:34:48.270987 1829252 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34971 SSHKeyPath:/home/jenkins/minikube-integration/19360-1579223/.minikube/machines/old-k8s-version-130660/id_rsa Username:docker}
I0731 23:34:48.374511 1829252 ssh_runner.go:195] Run: cat /etc/os-release
I0731 23:34:48.377761 1829252 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0731 23:34:48.377795 1829252 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0731 23:34:48.377806 1829252 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0731 23:34:48.377813 1829252 info.go:137] Remote host: Ubuntu 22.04.4 LTS
I0731 23:34:48.377823 1829252 filesync.go:126] Scanning /home/jenkins/minikube-integration/19360-1579223/.minikube/addons for local assets ...
I0731 23:34:48.377882 1829252 filesync.go:126] Scanning /home/jenkins/minikube-integration/19360-1579223/.minikube/files for local assets ...
I0731 23:34:48.377968 1829252 filesync.go:149] local asset: /home/jenkins/minikube-integration/19360-1579223/.minikube/files/etc/ssl/certs/15846152.pem -> 15846152.pem in /etc/ssl/certs
I0731 23:34:48.378071 1829252 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0731 23:34:48.386660 1829252 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19360-1579223/.minikube/files/etc/ssl/certs/15846152.pem --> /etc/ssl/certs/15846152.pem (1708 bytes)
I0731 23:34:48.412948 1829252 start.go:296] duration metric: took 167.486544ms for postStartSetup
I0731 23:34:48.413040 1829252 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0731 23:34:48.413107 1829252 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-130660
I0731 23:34:48.429303 1829252 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34971 SSHKeyPath:/home/jenkins/minikube-integration/19360-1579223/.minikube/machines/old-k8s-version-130660/id_rsa Username:docker}
I0731 23:34:48.522938 1829252 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I0731 23:34:48.530726 1829252 fix.go:56] duration metric: took 5.500208417s for fixHost
I0731 23:34:48.530791 1829252 start.go:83] releasing machines lock for "old-k8s-version-130660", held for 5.500302915s
I0731 23:34:48.530883 1829252 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-130660
I0731 23:34:48.549303 1829252 ssh_runner.go:195] Run: cat /version.json
I0731 23:34:48.549375 1829252 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-130660
I0731 23:34:48.549312 1829252 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0731 23:34:48.549458 1829252 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-130660
I0731 23:34:48.566790 1829252 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34971 SSHKeyPath:/home/jenkins/minikube-integration/19360-1579223/.minikube/machines/old-k8s-version-130660/id_rsa Username:docker}
I0731 23:34:48.578834 1829252 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34971 SSHKeyPath:/home/jenkins/minikube-integration/19360-1579223/.minikube/machines/old-k8s-version-130660/id_rsa Username:docker}
I0731 23:34:48.668787 1829252 ssh_runner.go:195] Run: systemctl --version
I0731 23:34:48.806523 1829252 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0731 23:34:48.951601 1829252 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I0731 23:34:48.959106 1829252 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0731 23:34:48.970037 1829252 cni.go:221] loopback cni configuration disabled: "/etc/cni/net.d/*loopback.conf*" found
I0731 23:34:48.970120 1829252 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0731 23:34:48.979676 1829252 cni.go:259] no active bridge cni configs found in "/etc/cni/net.d" - nothing to disable
I0731 23:34:48.979752 1829252 start.go:495] detecting cgroup driver to use...
I0731 23:34:48.979815 1829252 detect.go:187] detected "cgroupfs" cgroup driver on host os
I0731 23:34:48.979868 1829252 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0731 23:34:48.993884 1829252 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0731 23:34:49.007955 1829252 docker.go:217] disabling cri-docker service (if available) ...
I0731 23:34:49.008063 1829252 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0731 23:34:49.021838 1829252 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0731 23:34:49.034664 1829252 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0731 23:34:49.156344 1829252 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0731 23:34:49.254566 1829252 docker.go:233] disabling docker service ...
I0731 23:34:49.254663 1829252 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0731 23:34:49.270457 1829252 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0731 23:34:49.282378 1829252 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0731 23:34:49.383088 1829252 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0731 23:34:49.481713 1829252 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0731 23:34:49.494372 1829252 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0731 23:34:49.516143 1829252 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.2" pause image...
I0731 23:34:49.516273 1829252 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.2"|' /etc/crio/crio.conf.d/02-crio.conf"
I0731 23:34:49.533365 1829252 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0731 23:34:49.533482 1829252 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0731 23:34:49.544770 1829252 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0731 23:34:49.555230 1829252 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0731 23:34:49.565818 1829252 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0731 23:34:49.575301 1829252 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0731 23:34:49.584172 1829252 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0731 23:34:49.592980 1829252 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0731 23:34:49.679605 1829252 ssh_runner.go:195] Run: sudo systemctl restart crio
I0731 23:34:49.854687 1829252 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
I0731 23:34:49.854767 1829252 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0731 23:34:49.859156 1829252 start.go:563] Will wait 60s for crictl version
I0731 23:34:49.859219 1829252 ssh_runner.go:195] Run: which crictl
I0731 23:34:49.863047 1829252 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0731 23:34:49.901119 1829252 start.go:579] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.24.6
RuntimeApiVersion: v1
I0731 23:34:49.901208 1829252 ssh_runner.go:195] Run: crio --version
I0731 23:34:49.943141 1829252 ssh_runner.go:195] Run: crio --version
I0731 23:34:49.992974 1829252 out.go:177] * Preparing Kubernetes v1.20.0 on CRI-O 1.24.6 ...
I0731 23:34:49.995115 1829252 cli_runner.go:164] Run: docker network inspect old-k8s-version-130660 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0731 23:34:50.025302 1829252 ssh_runner.go:195] Run: grep 192.168.76.1 host.minikube.internal$ /etc/hosts
I0731 23:34:50.029680 1829252 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.76.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0731 23:34:50.043201 1829252 kubeadm.go:883] updating cluster {Name:old-k8s-version-130660 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-130660 Namespace:default APIServerHAVIP: APIServerName:minik
ubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins
:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0731 23:34:50.043323 1829252 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0731 23:34:50.043383 1829252 ssh_runner.go:195] Run: sudo crictl images --output json
I0731 23:34:50.098774 1829252 crio.go:514] all images are preloaded for cri-o runtime.
I0731 23:34:50.098803 1829252 crio.go:433] Images already preloaded, skipping extraction
I0731 23:34:50.098865 1829252 ssh_runner.go:195] Run: sudo crictl images --output json
I0731 23:34:50.144958 1829252 crio.go:514] all images are preloaded for cri-o runtime.
I0731 23:34:50.144982 1829252 cache_images.go:84] Images are preloaded, skipping loading
I0731 23:34:50.144994 1829252 kubeadm.go:934] updating node { 192.168.76.2 8443 v1.20.0 crio true true} ...
I0731 23:34:50.145141 1829252 kubeadm.go:946] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --cgroups-per-qos=false --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///var/run/crio/crio.sock --enforce-node-allocatable= --hostname-override=old-k8s-version-130660 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.76.2
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-130660 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0731 23:34:50.145234 1829252 ssh_runner.go:195] Run: crio config
I0731 23:34:50.221393 1829252 cni.go:84] Creating CNI manager for ""
I0731 23:34:50.221475 1829252 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
I0731 23:34:50.221502 1829252 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0731 23:34:50.221556 1829252 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.76.2 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-130660 NodeName:old-k8s-version-130660 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.76.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.76.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPo
dPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0731 23:34:50.221746 1829252 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.76.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/crio/crio.sock
name: "old-k8s-version-130660"
kubeletExtraArgs:
node-ip: 192.168.76.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.76.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0731 23:34:50.221859 1829252 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0731 23:34:50.231031 1829252 binaries.go:44] Found k8s binaries, skipping transfer
I0731 23:34:50.231141 1829252 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0731 23:34:50.240231 1829252 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (480 bytes)
I0731 23:34:50.258865 1829252 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0731 23:34:50.277657 1829252 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2117 bytes)
I0731 23:34:50.297409 1829252 ssh_runner.go:195] Run: grep 192.168.76.2 control-plane.minikube.internal$ /etc/hosts
I0731 23:34:50.300938 1829252 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.76.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0731 23:34:50.312070 1829252 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0731 23:34:50.399413 1829252 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0731 23:34:50.413937 1829252 certs.go:68] Setting up /home/jenkins/minikube-integration/19360-1579223/.minikube/profiles/old-k8s-version-130660 for IP: 192.168.76.2
I0731 23:34:50.414004 1829252 certs.go:194] generating shared ca certs ...
I0731 23:34:50.414034 1829252 certs.go:226] acquiring lock for ca certs: {Name:mk6ccdabf08b8b9bfa2ad4dfbceb108d85e42085 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0731 23:34:50.414208 1829252 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19360-1579223/.minikube/ca.key
I0731 23:34:50.414287 1829252 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19360-1579223/.minikube/proxy-client-ca.key
I0731 23:34:50.414320 1829252 certs.go:256] generating profile certs ...
I0731 23:34:50.414457 1829252 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/19360-1579223/.minikube/profiles/old-k8s-version-130660/client.key
I0731 23:34:50.414587 1829252 certs.go:359] skipping valid signed profile cert regeneration for "minikube": /home/jenkins/minikube-integration/19360-1579223/.minikube/profiles/old-k8s-version-130660/apiserver.key.699bafe4
I0731 23:34:50.414674 1829252 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/19360-1579223/.minikube/profiles/old-k8s-version-130660/proxy-client.key
I0731 23:34:50.414817 1829252 certs.go:484] found cert: /home/jenkins/minikube-integration/19360-1579223/.minikube/certs/1584615.pem (1338 bytes)
W0731 23:34:50.414873 1829252 certs.go:480] ignoring /home/jenkins/minikube-integration/19360-1579223/.minikube/certs/1584615_empty.pem, impossibly tiny 0 bytes
I0731 23:34:50.414898 1829252 certs.go:484] found cert: /home/jenkins/minikube-integration/19360-1579223/.minikube/certs/ca-key.pem (1679 bytes)
I0731 23:34:50.414953 1829252 certs.go:484] found cert: /home/jenkins/minikube-integration/19360-1579223/.minikube/certs/ca.pem (1082 bytes)
I0731 23:34:50.415001 1829252 certs.go:484] found cert: /home/jenkins/minikube-integration/19360-1579223/.minikube/certs/cert.pem (1123 bytes)
I0731 23:34:50.415054 1829252 certs.go:484] found cert: /home/jenkins/minikube-integration/19360-1579223/.minikube/certs/key.pem (1679 bytes)
I0731 23:34:50.415129 1829252 certs.go:484] found cert: /home/jenkins/minikube-integration/19360-1579223/.minikube/files/etc/ssl/certs/15846152.pem (1708 bytes)
I0731 23:34:50.415823 1829252 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19360-1579223/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0731 23:34:50.464050 1829252 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19360-1579223/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0731 23:34:50.503553 1829252 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19360-1579223/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0731 23:34:50.542575 1829252 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19360-1579223/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0731 23:34:50.576585 1829252 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19360-1579223/.minikube/profiles/old-k8s-version-130660/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0731 23:34:50.602949 1829252 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19360-1579223/.minikube/profiles/old-k8s-version-130660/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0731 23:34:50.631574 1829252 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19360-1579223/.minikube/profiles/old-k8s-version-130660/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0731 23:34:50.657355 1829252 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19360-1579223/.minikube/profiles/old-k8s-version-130660/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0731 23:34:50.683051 1829252 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19360-1579223/.minikube/certs/1584615.pem --> /usr/share/ca-certificates/1584615.pem (1338 bytes)
I0731 23:34:50.708462 1829252 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19360-1579223/.minikube/files/etc/ssl/certs/15846152.pem --> /usr/share/ca-certificates/15846152.pem (1708 bytes)
I0731 23:34:50.733889 1829252 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19360-1579223/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0731 23:34:50.761009 1829252 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0731 23:34:50.779770 1829252 ssh_runner.go:195] Run: openssl version
I0731 23:34:50.785507 1829252 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/1584615.pem && ln -fs /usr/share/ca-certificates/1584615.pem /etc/ssl/certs/1584615.pem"
I0731 23:34:50.795458 1829252 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/1584615.pem
I0731 23:34:50.798968 1829252 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Jul 31 22:43 /usr/share/ca-certificates/1584615.pem
I0731 23:34:50.799039 1829252 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/1584615.pem
I0731 23:34:50.806615 1829252 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/1584615.pem /etc/ssl/certs/51391683.0"
I0731 23:34:50.823621 1829252 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/15846152.pem && ln -fs /usr/share/ca-certificates/15846152.pem /etc/ssl/certs/15846152.pem"
I0731 23:34:50.833226 1829252 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/15846152.pem
I0731 23:34:50.838566 1829252 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Jul 31 22:43 /usr/share/ca-certificates/15846152.pem
I0731 23:34:50.838635 1829252 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/15846152.pem
I0731 23:34:50.846076 1829252 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/15846152.pem /etc/ssl/certs/3ec20f2e.0"
I0731 23:34:50.855502 1829252 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0731 23:34:50.865365 1829252 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0731 23:34:50.869175 1829252 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Jul 31 22:32 /usr/share/ca-certificates/minikubeCA.pem
I0731 23:34:50.869246 1829252 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0731 23:34:50.876735 1829252 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0731 23:34:50.886063 1829252 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0731 23:34:50.889867 1829252 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
I0731 23:34:50.896834 1829252 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
I0731 23:34:50.904427 1829252 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
I0731 23:34:50.911444 1829252 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
I0731 23:34:50.919058 1829252 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
I0731 23:34:50.926709 1829252 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
I0731 23:34:50.933902 1829252 kubeadm.go:392] StartCluster: {Name:old-k8s-version-130660 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-130660 Namespace:default APIServerHAVIP: APIServerName:minikube
CA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/m
inikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0731 23:34:50.933999 1829252 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0731 23:34:50.934106 1829252 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0731 23:34:50.980758 1829252 cri.go:89] found id: ""
I0731 23:34:50.980881 1829252 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0731 23:34:50.989899 1829252 kubeadm.go:408] found existing configuration files, will attempt cluster restart
I0731 23:34:50.989951 1829252 kubeadm.go:593] restartPrimaryControlPlane start ...
I0731 23:34:50.990026 1829252 ssh_runner.go:195] Run: sudo test -d /data/minikube
I0731 23:34:50.998797 1829252 kubeadm.go:130] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
stdout:
stderr:
I0731 23:34:50.999433 1829252 kubeconfig.go:47] verify endpoint returned: get endpoint: "old-k8s-version-130660" does not appear in /home/jenkins/minikube-integration/19360-1579223/kubeconfig
I0731 23:34:50.999697 1829252 kubeconfig.go:62] /home/jenkins/minikube-integration/19360-1579223/kubeconfig needs updating (will repair): [kubeconfig missing "old-k8s-version-130660" cluster setting kubeconfig missing "old-k8s-version-130660" context setting]
I0731 23:34:51.000185 1829252 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19360-1579223/kubeconfig: {Name:mkfef6e38d1ebcc45fcbbe766a2ae2945f7bd392 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0731 23:34:51.002069 1829252 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
I0731 23:34:51.013954 1829252 kubeadm.go:630] The running cluster does not require reconfiguration: 192.168.76.2
I0731 23:34:51.013991 1829252 kubeadm.go:597] duration metric: took 24.027374ms to restartPrimaryControlPlane
I0731 23:34:51.014003 1829252 kubeadm.go:394] duration metric: took 80.110628ms to StartCluster
I0731 23:34:51.014019 1829252 settings.go:142] acquiring lock: {Name:mk3c0c3b857f6d982767b7eb95481d3e4843baa4 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0731 23:34:51.014093 1829252 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/19360-1579223/kubeconfig
I0731 23:34:51.015040 1829252 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19360-1579223/kubeconfig: {Name:mkfef6e38d1ebcc45fcbbe766a2ae2945f7bd392 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0731 23:34:51.015278 1829252 start.go:235] Will wait 6m0s for node &{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I0731 23:34:51.015657 1829252 config.go:182] Loaded profile config "old-k8s-version-130660": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0731 23:34:51.015730 1829252 addons.go:507] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:true default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]
I0731 23:34:51.015894 1829252 addons.go:69] Setting storage-provisioner=true in profile "old-k8s-version-130660"
I0731 23:34:51.015931 1829252 addons.go:234] Setting addon storage-provisioner=true in "old-k8s-version-130660"
W0731 23:34:51.015943 1829252 addons.go:243] addon storage-provisioner should already be in state true
I0731 23:34:51.015955 1829252 addons.go:69] Setting default-storageclass=true in profile "old-k8s-version-130660"
I0731 23:34:51.016020 1829252 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "old-k8s-version-130660"
I0731 23:34:51.015968 1829252 host.go:66] Checking if "old-k8s-version-130660" exists ...
I0731 23:34:51.016417 1829252 cli_runner.go:164] Run: docker container inspect old-k8s-version-130660 --format={{.State.Status}}
I0731 23:34:51.016557 1829252 cli_runner.go:164] Run: docker container inspect old-k8s-version-130660 --format={{.State.Status}}
I0731 23:34:51.015973 1829252 addons.go:69] Setting metrics-server=true in profile "old-k8s-version-130660"
I0731 23:34:51.017148 1829252 addons.go:234] Setting addon metrics-server=true in "old-k8s-version-130660"
W0731 23:34:51.017184 1829252 addons.go:243] addon metrics-server should already be in state true
I0731 23:34:51.017405 1829252 host.go:66] Checking if "old-k8s-version-130660" exists ...
I0731 23:34:51.018015 1829252 cli_runner.go:164] Run: docker container inspect old-k8s-version-130660 --format={{.State.Status}}
I0731 23:34:51.015978 1829252 addons.go:69] Setting dashboard=true in profile "old-k8s-version-130660"
I0731 23:34:51.019508 1829252 addons.go:234] Setting addon dashboard=true in "old-k8s-version-130660"
W0731 23:34:51.019522 1829252 addons.go:243] addon dashboard should already be in state true
I0731 23:34:51.019556 1829252 host.go:66] Checking if "old-k8s-version-130660" exists ...
I0731 23:34:51.020033 1829252 cli_runner.go:164] Run: docker container inspect old-k8s-version-130660 --format={{.State.Status}}
I0731 23:34:51.021517 1829252 out.go:177] * Verifying Kubernetes components...
I0731 23:34:51.028483 1829252 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0731 23:34:51.056343 1829252 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0731 23:34:51.058585 1829252 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0731 23:34:51.058613 1829252 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0731 23:34:51.058686 1829252 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-130660
I0731 23:34:51.073014 1829252 addons.go:234] Setting addon default-storageclass=true in "old-k8s-version-130660"
W0731 23:34:51.073045 1829252 addons.go:243] addon default-storageclass should already be in state true
I0731 23:34:51.073074 1829252 host.go:66] Checking if "old-k8s-version-130660" exists ...
I0731 23:34:51.073549 1829252 cli_runner.go:164] Run: docker container inspect old-k8s-version-130660 --format={{.State.Status}}
I0731 23:34:51.088668 1829252 out.go:177] - Using image docker.io/kubernetesui/dashboard:v2.7.0
I0731 23:34:51.095082 1829252 out.go:177] - Using image registry.k8s.io/echoserver:1.4
I0731 23:34:51.096858 1829252 addons.go:431] installing /etc/kubernetes/addons/dashboard-ns.yaml
I0731 23:34:51.096886 1829252 ssh_runner.go:362] scp dashboard/dashboard-ns.yaml --> /etc/kubernetes/addons/dashboard-ns.yaml (759 bytes)
I0731 23:34:51.096961 1829252 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-130660
I0731 23:34:51.098973 1829252 out.go:177] - Using image fake.domain/registry.k8s.io/echoserver:1.4
I0731 23:34:51.102794 1829252 addons.go:431] installing /etc/kubernetes/addons/metrics-apiservice.yaml
I0731 23:34:51.102822 1829252 ssh_runner.go:362] scp metrics-server/metrics-apiservice.yaml --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
I0731 23:34:51.102898 1829252 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-130660
I0731 23:34:51.126436 1829252 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34971 SSHKeyPath:/home/jenkins/minikube-integration/19360-1579223/.minikube/machines/old-k8s-version-130660/id_rsa Username:docker}
I0731 23:34:51.155770 1829252 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34971 SSHKeyPath:/home/jenkins/minikube-integration/19360-1579223/.minikube/machines/old-k8s-version-130660/id_rsa Username:docker}
I0731 23:34:51.158719 1829252 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34971 SSHKeyPath:/home/jenkins/minikube-integration/19360-1579223/.minikube/machines/old-k8s-version-130660/id_rsa Username:docker}
I0731 23:34:51.165441 1829252 addons.go:431] installing /etc/kubernetes/addons/storageclass.yaml
I0731 23:34:51.165466 1829252 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0731 23:34:51.165531 1829252 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-130660
I0731 23:34:51.202804 1829252 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34971 SSHKeyPath:/home/jenkins/minikube-integration/19360-1579223/.minikube/machines/old-k8s-version-130660/id_rsa Username:docker}
I0731 23:34:51.255873 1829252 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0731 23:34:51.273494 1829252 node_ready.go:35] waiting up to 6m0s for node "old-k8s-version-130660" to be "Ready" ...
I0731 23:34:51.303556 1829252 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0731 23:34:51.317699 1829252 addons.go:431] installing /etc/kubernetes/addons/dashboard-clusterrole.yaml
I0731 23:34:51.317765 1829252 ssh_runner.go:362] scp dashboard/dashboard-clusterrole.yaml --> /etc/kubernetes/addons/dashboard-clusterrole.yaml (1001 bytes)
I0731 23:34:51.319146 1829252 addons.go:431] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
I0731 23:34:51.319199 1829252 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1825 bytes)
I0731 23:34:51.353359 1829252 addons.go:431] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
I0731 23:34:51.353435 1829252 ssh_runner.go:362] scp metrics-server/metrics-server-rbac.yaml --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
I0731 23:34:51.366493 1829252 addons.go:431] installing /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml
I0731 23:34:51.366561 1829252 ssh_runner.go:362] scp dashboard/dashboard-clusterrolebinding.yaml --> /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml (1018 bytes)
I0731 23:34:51.382428 1829252 addons.go:431] installing /etc/kubernetes/addons/metrics-server-service.yaml
I0731 23:34:51.382498 1829252 ssh_runner.go:362] scp metrics-server/metrics-server-service.yaml --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
I0731 23:34:51.390365 1829252 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0731 23:34:51.433226 1829252 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0731 23:34:51.436476 1829252 addons.go:431] installing /etc/kubernetes/addons/dashboard-configmap.yaml
I0731 23:34:51.436542 1829252 ssh_runner.go:362] scp dashboard/dashboard-configmap.yaml --> /etc/kubernetes/addons/dashboard-configmap.yaml (837 bytes)
W0731 23:34:51.484191 1829252 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0731 23:34:51.484293 1829252 retry.go:31] will retry after 369.379041ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0731 23:34:51.518805 1829252 addons.go:431] installing /etc/kubernetes/addons/dashboard-dp.yaml
I0731 23:34:51.518880 1829252 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-dp.yaml (4201 bytes)
W0731 23:34:51.568892 1829252 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0731 23:34:51.568981 1829252 retry.go:31] will retry after 349.994928ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0731 23:34:51.575418 1829252 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0731 23:34:51.575501 1829252 retry.go:31] will retry after 157.613409ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0731 23:34:51.581956 1829252 addons.go:431] installing /etc/kubernetes/addons/dashboard-role.yaml
I0731 23:34:51.582041 1829252 ssh_runner.go:362] scp dashboard/dashboard-role.yaml --> /etc/kubernetes/addons/dashboard-role.yaml (1724 bytes)
I0731 23:34:51.601884 1829252 addons.go:431] installing /etc/kubernetes/addons/dashboard-rolebinding.yaml
I0731 23:34:51.601914 1829252 ssh_runner.go:362] scp dashboard/dashboard-rolebinding.yaml --> /etc/kubernetes/addons/dashboard-rolebinding.yaml (1046 bytes)
I0731 23:34:51.620126 1829252 addons.go:431] installing /etc/kubernetes/addons/dashboard-sa.yaml
I0731 23:34:51.620194 1829252 ssh_runner.go:362] scp dashboard/dashboard-sa.yaml --> /etc/kubernetes/addons/dashboard-sa.yaml (837 bytes)
I0731 23:34:51.639546 1829252 addons.go:431] installing /etc/kubernetes/addons/dashboard-secret.yaml
I0731 23:34:51.639612 1829252 ssh_runner.go:362] scp dashboard/dashboard-secret.yaml --> /etc/kubernetes/addons/dashboard-secret.yaml (1389 bytes)
I0731 23:34:51.658738 1829252 addons.go:431] installing /etc/kubernetes/addons/dashboard-svc.yaml
I0731 23:34:51.658762 1829252 ssh_runner.go:362] scp dashboard/dashboard-svc.yaml --> /etc/kubernetes/addons/dashboard-svc.yaml (1294 bytes)
I0731 23:34:51.677418 1829252 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0731 23:34:51.733676 1829252 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0731 23:34:51.750444 1829252 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0731 23:34:51.750495 1829252 retry.go:31] will retry after 291.173746ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0731 23:34:51.814532 1829252 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0731 23:34:51.814566 1829252 retry.go:31] will retry after 411.534813ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0731 23:34:51.854698 1829252 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I0731 23:34:51.919507 1829252 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0731 23:34:51.924348 1829252 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0731 23:34:51.924425 1829252 retry.go:31] will retry after 472.075349ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0731 23:34:52.011425 1829252 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0731 23:34:52.011504 1829252 retry.go:31] will retry after 428.082989ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0731 23:34:52.042653 1829252 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0731 23:34:52.116575 1829252 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0731 23:34:52.116656 1829252 retry.go:31] will retry after 480.082374ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0731 23:34:52.226908 1829252 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0731 23:34:52.308525 1829252 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0731 23:34:52.308606 1829252 retry.go:31] will retry after 653.383075ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0731 23:34:52.396741 1829252 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I0731 23:34:52.440044 1829252 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0731 23:34:52.478701 1829252 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0731 23:34:52.478734 1829252 retry.go:31] will retry after 473.963657ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0731 23:34:52.536070 1829252 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0731 23:34:52.536104 1829252 retry.go:31] will retry after 731.504261ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0731 23:34:52.597796 1829252 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0731 23:34:52.668242 1829252 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0731 23:34:52.668284 1829252 retry.go:31] will retry after 313.156115ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0731 23:34:52.952955 1829252 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I0731 23:34:52.962328 1829252 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0731 23:34:52.981817 1829252 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0731 23:34:53.091336 1829252 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0731 23:34:53.091415 1829252 retry.go:31] will retry after 1.218785027s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0731 23:34:53.091506 1829252 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0731 23:34:53.091541 1829252 retry.go:31] will retry after 1.043755261s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0731 23:34:53.123253 1829252 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0731 23:34:53.123334 1829252 retry.go:31] will retry after 928.941521ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0731 23:34:53.268616 1829252 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I0731 23:34:53.274312 1829252 node_ready.go:53] error getting node "old-k8s-version-130660": Get "https://192.168.76.2:8443/api/v1/nodes/old-k8s-version-130660": dial tcp 192.168.76.2:8443: connect: connection refused
W0731 23:34:53.339765 1829252 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0731 23:34:53.339812 1829252 retry.go:31] will retry after 1.096558658s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0731 23:34:54.053265 1829252 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0731 23:34:54.132421 1829252 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0731 23:34:54.132455 1829252 retry.go:31] will retry after 1.122891049s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0731 23:34:54.135522 1829252 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0731 23:34:54.206612 1829252 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0731 23:34:54.206646 1829252 retry.go:31] will retry after 706.786803ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0731 23:34:54.311310 1829252 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0731 23:34:54.382664 1829252 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0731 23:34:54.382707 1829252 retry.go:31] will retry after 1.140551629s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0731 23:34:54.436982 1829252 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0731 23:34:54.507745 1829252 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0731 23:34:54.507781 1829252 retry.go:31] will retry after 1.831122878s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0731 23:34:54.914030 1829252 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0731 23:34:54.992690 1829252 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0731 23:34:54.992762 1829252 retry.go:31] will retry after 1.051771021s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0731 23:34:55.256124 1829252 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0731 23:34:55.274798 1829252 node_ready.go:53] error getting node "old-k8s-version-130660": Get "https://192.168.76.2:8443/api/v1/nodes/old-k8s-version-130660": dial tcp 192.168.76.2:8443: connect: connection refused
W0731 23:34:55.335284 1829252 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0731 23:34:55.335316 1829252 retry.go:31] will retry after 969.985535ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0731 23:34:55.523458 1829252 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0731 23:34:55.614999 1829252 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0731 23:34:55.615030 1829252 retry.go:31] will retry after 1.226301392s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0731 23:34:56.045143 1829252 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0731 23:34:56.122917 1829252 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0731 23:34:56.122950 1829252 retry.go:31] will retry after 3.547415234s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0731 23:34:56.305776 1829252 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0731 23:34:56.339047 1829252 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0731 23:34:56.396119 1829252 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0731 23:34:56.396151 1829252 retry.go:31] will retry after 1.830283978s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0731 23:34:56.428447 1829252 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0731 23:34:56.428480 1829252 retry.go:31] will retry after 1.144135109s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0731 23:34:56.841657 1829252 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0731 23:34:56.919660 1829252 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0731 23:34:56.919694 1829252 retry.go:31] will retry after 3.666014723s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0731 23:34:57.573705 1829252 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0731 23:34:57.646721 1829252 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0731 23:34:57.646753 1829252 retry.go:31] will retry after 2.134642162s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0731 23:34:57.774320 1829252 node_ready.go:53] error getting node "old-k8s-version-130660": Get "https://192.168.76.2:8443/api/v1/nodes/old-k8s-version-130660": dial tcp 192.168.76.2:8443: connect: connection refused
I0731 23:34:58.226796 1829252 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0731 23:34:58.298068 1829252 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0731 23:34:58.298102 1829252 retry.go:31] will retry after 2.154378395s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0731 23:34:59.670519 1829252 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I0731 23:34:59.782566 1829252 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0731 23:34:59.795306 1829252 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0731 23:34:59.795340 1829252 retry.go:31] will retry after 4.804806928s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0731 23:35:00.453682 1829252 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0731 23:35:00.586654 1829252 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0731 23:35:04.601221 1829252 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I0731 23:35:08.008444 1829252 node_ready.go:49] node "old-k8s-version-130660" has status "Ready":"True"
I0731 23:35:08.008487 1829252 node_ready.go:38] duration metric: took 16.734896105s for node "old-k8s-version-130660" to be "Ready" ...
I0731 23:35:08.008501 1829252 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0731 23:35:08.234129 1829252 pod_ready.go:78] waiting up to 6m0s for pod "coredns-74ff55c5b-nqxld" in "kube-system" namespace to be "Ready" ...
I0731 23:35:08.414576 1829252 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: (8.631954963s)
I0731 23:35:08.452124 1829252 pod_ready.go:92] pod "coredns-74ff55c5b-nqxld" in "kube-system" namespace has status "Ready":"True"
I0731 23:35:08.452150 1829252 pod_ready.go:81] duration metric: took 217.925298ms for pod "coredns-74ff55c5b-nqxld" in "kube-system" namespace to be "Ready" ...
I0731 23:35:08.452161 1829252 pod_ready.go:78] waiting up to 6m0s for pod "etcd-old-k8s-version-130660" in "kube-system" namespace to be "Ready" ...
I0731 23:35:08.583967 1829252 pod_ready.go:92] pod "etcd-old-k8s-version-130660" in "kube-system" namespace has status "Ready":"True"
I0731 23:35:08.584025 1829252 pod_ready.go:81] duration metric: took 131.844287ms for pod "etcd-old-k8s-version-130660" in "kube-system" namespace to be "Ready" ...
I0731 23:35:08.584041 1829252 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-old-k8s-version-130660" in "kube-system" namespace to be "Ready" ...
I0731 23:35:08.646613 1829252 pod_ready.go:92] pod "kube-apiserver-old-k8s-version-130660" in "kube-system" namespace has status "Ready":"True"
I0731 23:35:08.646636 1829252 pod_ready.go:81] duration metric: took 62.58664ms for pod "kube-apiserver-old-k8s-version-130660" in "kube-system" namespace to be "Ready" ...
I0731 23:35:08.646649 1829252 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-old-k8s-version-130660" in "kube-system" namespace to be "Ready" ...
I0731 23:35:09.090986 1829252 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (8.504282344s)
I0731 23:35:09.091035 1829252 addons.go:475] Verifying addon metrics-server=true in "old-k8s-version-130660"
I0731 23:35:09.091086 1829252 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: (4.489833647s)
I0731 23:35:09.091230 1829252 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: (8.637483345s)
I0731 23:35:09.093648 1829252 out.go:177] * Some dashboard features require the metrics-server addon. To enable all features please run:
minikube -p old-k8s-version-130660 addons enable metrics-server
I0731 23:35:09.095796 1829252 out.go:177] * Enabled addons: default-storageclass, metrics-server, storage-provisioner, dashboard
I0731 23:35:09.098143 1829252 addons.go:510] duration metric: took 18.082407739s for enable addons: enabled=[default-storageclass metrics-server storage-provisioner dashboard]
I0731 23:35:10.652905 1829252 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-130660" in "kube-system" namespace has status "Ready":"False"
I0731 23:35:13.152805 1829252 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-130660" in "kube-system" namespace has status "Ready":"False"
I0731 23:35:15.154232 1829252 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-130660" in "kube-system" namespace has status "Ready":"False"
I0731 23:35:17.155438 1829252 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-130660" in "kube-system" namespace has status "Ready":"False"
I0731 23:35:19.653385 1829252 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-130660" in "kube-system" namespace has status "Ready":"False"
I0731 23:35:21.653737 1829252 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-130660" in "kube-system" namespace has status "Ready":"False"
I0731 23:35:24.153141 1829252 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-130660" in "kube-system" namespace has status "Ready":"False"
I0731 23:35:26.656094 1829252 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-130660" in "kube-system" namespace has status "Ready":"False"
I0731 23:35:29.156445 1829252 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-130660" in "kube-system" namespace has status "Ready":"False"
I0731 23:35:31.656314 1829252 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-130660" in "kube-system" namespace has status "Ready":"False"
I0731 23:35:33.658736 1829252 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-130660" in "kube-system" namespace has status "Ready":"False"
I0731 23:35:36.153237 1829252 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-130660" in "kube-system" namespace has status "Ready":"False"
I0731 23:35:38.154328 1829252 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-130660" in "kube-system" namespace has status "Ready":"False"
I0731 23:35:40.176989 1829252 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-130660" in "kube-system" namespace has status "Ready":"False"
I0731 23:35:42.654057 1829252 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-130660" in "kube-system" namespace has status "Ready":"False"
I0731 23:35:45.159309 1829252 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-130660" in "kube-system" namespace has status "Ready":"False"
I0731 23:35:47.653290 1829252 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-130660" in "kube-system" namespace has status "Ready":"False"
I0731 23:35:49.653341 1829252 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-130660" in "kube-system" namespace has status "Ready":"False"
I0731 23:35:52.152523 1829252 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-130660" in "kube-system" namespace has status "Ready":"False"
I0731 23:35:54.654106 1829252 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-130660" in "kube-system" namespace has status "Ready":"False"
I0731 23:35:56.661924 1829252 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-130660" in "kube-system" namespace has status "Ready":"False"
I0731 23:35:59.152990 1829252 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-130660" in "kube-system" namespace has status "Ready":"False"
I0731 23:36:01.652826 1829252 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-130660" in "kube-system" namespace has status "Ready":"False"
I0731 23:36:03.654018 1829252 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-130660" in "kube-system" namespace has status "Ready":"False"
I0731 23:36:06.153149 1829252 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-130660" in "kube-system" namespace has status "Ready":"False"
I0731 23:36:08.153368 1829252 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-130660" in "kube-system" namespace has status "Ready":"False"
I0731 23:36:10.155166 1829252 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-130660" in "kube-system" namespace has status "Ready":"False"
I0731 23:36:12.158720 1829252 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-130660" in "kube-system" namespace has status "Ready":"False"
I0731 23:36:14.653295 1829252 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-130660" in "kube-system" namespace has status "Ready":"False"
I0731 23:36:17.152392 1829252 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-130660" in "kube-system" namespace has status "Ready":"False"
I0731 23:36:19.152728 1829252 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-130660" in "kube-system" namespace has status "Ready":"False"
I0731 23:36:21.153723 1829252 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-130660" in "kube-system" namespace has status "Ready":"False"
I0731 23:36:23.653157 1829252 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-130660" in "kube-system" namespace has status "Ready":"False"
I0731 23:36:26.153464 1829252 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-130660" in "kube-system" namespace has status "Ready":"False"
I0731 23:36:28.652819 1829252 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-130660" in "kube-system" namespace has status "Ready":"False"
I0731 23:36:30.652986 1829252 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-130660" in "kube-system" namespace has status "Ready":"False"
I0731 23:36:31.152275 1829252 pod_ready.go:92] pod "kube-controller-manager-old-k8s-version-130660" in "kube-system" namespace has status "Ready":"True"
I0731 23:36:31.152302 1829252 pod_ready.go:81] duration metric: took 1m22.505645262s for pod "kube-controller-manager-old-k8s-version-130660" in "kube-system" namespace to be "Ready" ...
I0731 23:36:31.152314 1829252 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-vsnfm" in "kube-system" namespace to be "Ready" ...
I0731 23:36:31.156916 1829252 pod_ready.go:92] pod "kube-proxy-vsnfm" in "kube-system" namespace has status "Ready":"True"
I0731 23:36:31.156942 1829252 pod_ready.go:81] duration metric: took 4.620923ms for pod "kube-proxy-vsnfm" in "kube-system" namespace to be "Ready" ...
I0731 23:36:31.156953 1829252 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-old-k8s-version-130660" in "kube-system" namespace to be "Ready" ...
I0731 23:36:31.162135 1829252 pod_ready.go:92] pod "kube-scheduler-old-k8s-version-130660" in "kube-system" namespace has status "Ready":"True"
I0731 23:36:31.162158 1829252 pod_ready.go:81] duration metric: took 5.19715ms for pod "kube-scheduler-old-k8s-version-130660" in "kube-system" namespace to be "Ready" ...
I0731 23:36:31.162170 1829252 pod_ready.go:78] waiting up to 6m0s for pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace to be "Ready" ...
I0731 23:36:33.167491 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:36:35.169793 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:36:37.668704 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:36:40.171893 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:36:42.668624 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:36:44.670037 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:36:47.168429 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:36:49.668952 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:36:51.669365 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:36:54.169279 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:36:56.669441 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:36:59.168537 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:37:01.668623 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:37:04.168426 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:37:06.668001 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:37:09.168518 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:37:11.169340 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:37:13.669231 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:37:16.167485 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:37:18.168578 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:37:20.168924 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:37:22.668086 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:37:24.668837 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:37:27.168490 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:37:29.668495 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:37:32.168260 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:37:34.168394 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:37:36.678419 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:37:39.169849 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:37:41.668283 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:37:44.167842 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:37:46.168117 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:37:48.667986 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:37:50.668536 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:37:53.167883 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:37:55.169044 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:37:57.667987 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:37:59.668836 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:38:02.167946 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:38:04.167994 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:38:06.671011 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:38:09.168278 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:38:11.168735 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:38:13.174613 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:38:15.668627 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:38:17.668843 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:38:19.670167 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:38:22.168265 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:38:24.668802 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:38:27.168530 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:38:29.169519 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:38:31.668442 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:38:34.167934 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:38:36.668752 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:38:39.168385 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:38:41.169284 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:38:43.668258 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:38:45.668387 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:38:47.669412 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:38:49.677744 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:38:52.169320 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:38:54.669004 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:38:57.168232 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:38:59.244594 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:39:01.668742 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:39:03.670959 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:39:06.167769 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:39:08.168483 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:39:10.169075 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:39:12.668394 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:39:14.670193 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:39:17.167442 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:39:19.167603 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:39:21.167785 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:39:23.168142 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:39:25.169514 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:39:27.199210 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:39:29.670147 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:39:32.169370 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:39:34.669368 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:39:37.168209 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:39:39.730387 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:39:42.169022 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:39:44.668803 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:39:47.168065 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:39:49.171344 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:39:51.670446 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:39:53.672244 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:39:56.168225 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:39:58.670724 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:40:00.671990 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:40:03.169169 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:40:05.169709 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:40:07.668238 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:40:09.669577 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:40:11.669953 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:40:14.168734 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:40:16.170059 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:40:18.668036 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:40:20.669542 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:40:23.168832 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:40:25.169914 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:40:27.667676 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:40:29.668497 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:40:31.168677 1829252 pod_ready.go:81] duration metric: took 4m0.006492497s for pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace to be "Ready" ...
E0731 23:40:31.168708 1829252 pod_ready.go:66] WaitExtra: waitPodCondition: context deadline exceeded
I0731 23:40:31.168720 1829252 pod_ready.go:38] duration metric: took 5m23.160205049s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0731 23:40:31.168736 1829252 api_server.go:52] waiting for apiserver process to appear ...
I0731 23:40:31.168766 1829252 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0731 23:40:31.168832 1829252 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0731 23:40:31.210665 1829252 cri.go:89] found id: "46018fe62e056d85a9d92909a3ffe934843c413af90487065b86f79764b6e416"
I0731 23:40:31.210687 1829252 cri.go:89] found id: ""
I0731 23:40:31.210695 1829252 logs.go:276] 1 containers: [46018fe62e056d85a9d92909a3ffe934843c413af90487065b86f79764b6e416]
I0731 23:40:31.210762 1829252 ssh_runner.go:195] Run: which crictl
I0731 23:40:31.214275 1829252 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0731 23:40:31.214347 1829252 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0731 23:40:31.254998 1829252 cri.go:89] found id: "6854efb05017bc711513167086bed436131771d8c2f42fe3910912ac80224c6c"
I0731 23:40:31.255072 1829252 cri.go:89] found id: ""
I0731 23:40:31.255096 1829252 logs.go:276] 1 containers: [6854efb05017bc711513167086bed436131771d8c2f42fe3910912ac80224c6c]
I0731 23:40:31.255183 1829252 ssh_runner.go:195] Run: which crictl
I0731 23:40:31.259162 1829252 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0731 23:40:31.259290 1829252 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0731 23:40:31.306298 1829252 cri.go:89] found id: "de1b5cb3d187661a9da8df949ef36da261421dac028ae8e070be86f4226a470b"
I0731 23:40:31.306366 1829252 cri.go:89] found id: ""
I0731 23:40:31.306386 1829252 logs.go:276] 1 containers: [de1b5cb3d187661a9da8df949ef36da261421dac028ae8e070be86f4226a470b]
I0731 23:40:31.306468 1829252 ssh_runner.go:195] Run: which crictl
I0731 23:40:31.310127 1829252 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0731 23:40:31.310198 1829252 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0731 23:40:31.350673 1829252 cri.go:89] found id: "9ea334663167822d57c49e09d75be27e43c4d14410ab00696d0bd381e74ba548"
I0731 23:40:31.350738 1829252 cri.go:89] found id: ""
I0731 23:40:31.350753 1829252 logs.go:276] 1 containers: [9ea334663167822d57c49e09d75be27e43c4d14410ab00696d0bd381e74ba548]
I0731 23:40:31.350819 1829252 ssh_runner.go:195] Run: which crictl
I0731 23:40:31.354414 1829252 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0731 23:40:31.354500 1829252 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0731 23:40:31.396679 1829252 cri.go:89] found id: "c21ba7634bd1a874c9ebc36d102421cb8c623f6f4fc40ef723fae526a1693796"
I0731 23:40:31.396705 1829252 cri.go:89] found id: ""
I0731 23:40:31.396712 1829252 logs.go:276] 1 containers: [c21ba7634bd1a874c9ebc36d102421cb8c623f6f4fc40ef723fae526a1693796]
I0731 23:40:31.396776 1829252 ssh_runner.go:195] Run: which crictl
I0731 23:40:31.400231 1829252 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0731 23:40:31.400307 1829252 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0731 23:40:31.453366 1829252 cri.go:89] found id: "6d2854e476f196556888fd39fa1c3e23a43223b6bf7632e42e8a2d3e07316f00"
I0731 23:40:31.453390 1829252 cri.go:89] found id: ""
I0731 23:40:31.453398 1829252 logs.go:276] 1 containers: [6d2854e476f196556888fd39fa1c3e23a43223b6bf7632e42e8a2d3e07316f00]
I0731 23:40:31.453454 1829252 ssh_runner.go:195] Run: which crictl
I0731 23:40:31.457018 1829252 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0731 23:40:31.457089 1829252 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0731 23:40:31.495600 1829252 cri.go:89] found id: "bab863fc639de5e0d2e1165a89d0b3b22043e0ffdb80ad3296bca7a7262985f7"
I0731 23:40:31.495620 1829252 cri.go:89] found id: ""
I0731 23:40:31.495628 1829252 logs.go:276] 1 containers: [bab863fc639de5e0d2e1165a89d0b3b22043e0ffdb80ad3296bca7a7262985f7]
I0731 23:40:31.495689 1829252 ssh_runner.go:195] Run: which crictl
I0731 23:40:31.499263 1829252 cri.go:54] listing CRI containers in root : {State:all Name:kubernetes-dashboard Namespaces:[]}
I0731 23:40:31.499355 1829252 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I0731 23:40:31.538992 1829252 cri.go:89] found id: "d6f8ffde1c928670ca20febc0c4a113d8ad3e22267d8fd745d5c54e8cc854a27"
I0731 23:40:31.539015 1829252 cri.go:89] found id: ""
I0731 23:40:31.539023 1829252 logs.go:276] 1 containers: [d6f8ffde1c928670ca20febc0c4a113d8ad3e22267d8fd745d5c54e8cc854a27]
I0731 23:40:31.539099 1829252 ssh_runner.go:195] Run: which crictl
I0731 23:40:31.542861 1829252 cri.go:54] listing CRI containers in root : {State:all Name:storage-provisioner Namespaces:[]}
I0731 23:40:31.542996 1829252 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0731 23:40:31.594113 1829252 cri.go:89] found id: "af4a5d8f7ff273f31d82cb997af6a85d6437344b03032e0188e4e18ed9144b92"
I0731 23:40:31.594172 1829252 cri.go:89] found id: "e7eb6229b113884a77ab02b300c2b453be8b1723c83dc8f8862391ed9ef419e1"
I0731 23:40:31.594192 1829252 cri.go:89] found id: ""
I0731 23:40:31.594219 1829252 logs.go:276] 2 containers: [af4a5d8f7ff273f31d82cb997af6a85d6437344b03032e0188e4e18ed9144b92 e7eb6229b113884a77ab02b300c2b453be8b1723c83dc8f8862391ed9ef419e1]
I0731 23:40:31.594308 1829252 ssh_runner.go:195] Run: which crictl
I0731 23:40:31.598495 1829252 ssh_runner.go:195] Run: which crictl
I0731 23:40:31.601970 1829252 logs.go:123] Gathering logs for dmesg ...
I0731 23:40:31.601993 1829252 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0731 23:40:31.622722 1829252 logs.go:123] Gathering logs for etcd [6854efb05017bc711513167086bed436131771d8c2f42fe3910912ac80224c6c] ...
I0731 23:40:31.622751 1829252 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 6854efb05017bc711513167086bed436131771d8c2f42fe3910912ac80224c6c"
I0731 23:40:31.669324 1829252 logs.go:123] Gathering logs for kube-proxy [c21ba7634bd1a874c9ebc36d102421cb8c623f6f4fc40ef723fae526a1693796] ...
I0731 23:40:31.669358 1829252 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 c21ba7634bd1a874c9ebc36d102421cb8c623f6f4fc40ef723fae526a1693796"
I0731 23:40:31.709562 1829252 logs.go:123] Gathering logs for kindnet [bab863fc639de5e0d2e1165a89d0b3b22043e0ffdb80ad3296bca7a7262985f7] ...
I0731 23:40:31.709593 1829252 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 bab863fc639de5e0d2e1165a89d0b3b22043e0ffdb80ad3296bca7a7262985f7"
I0731 23:40:31.760136 1829252 logs.go:123] Gathering logs for storage-provisioner [af4a5d8f7ff273f31d82cb997af6a85d6437344b03032e0188e4e18ed9144b92] ...
I0731 23:40:31.760180 1829252 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 af4a5d8f7ff273f31d82cb997af6a85d6437344b03032e0188e4e18ed9144b92"
I0731 23:40:31.800595 1829252 logs.go:123] Gathering logs for container status ...
I0731 23:40:31.800673 1829252 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0731 23:40:31.852654 1829252 logs.go:123] Gathering logs for kubelet ...
I0731 23:40:31.852732 1829252 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0731 23:40:31.905287 1829252 logs.go:138] Found kubelet problem: Jul 31 23:35:07 old-k8s-version-130660 kubelet[742]: E0731 23:35:07.593291 742 reflector.go:138] object-"kube-system"/"kindnet-token-crzsj": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kindnet-token-crzsj" is forbidden: User "system:node:old-k8s-version-130660" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-130660' and this object
W0731 23:40:31.905584 1829252 logs.go:138] Found kubelet problem: Jul 31 23:35:07 old-k8s-version-130660 kubelet[742]: E0731 23:35:07.593424 742 reflector.go:138] object-"kube-system"/"storage-provisioner-token-d22vf": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "storage-provisioner-token-d22vf" is forbidden: User "system:node:old-k8s-version-130660" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-130660' and this object
W0731 23:40:31.905826 1829252 logs.go:138] Found kubelet problem: Jul 31 23:35:07 old-k8s-version-130660 kubelet[742]: E0731 23:35:07.593481 742 reflector.go:138] object-"kube-system"/"metrics-server-token-kr52c": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "metrics-server-token-kr52c" is forbidden: User "system:node:old-k8s-version-130660" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-130660' and this object
W0731 23:40:31.906052 1829252 logs.go:138] Found kubelet problem: Jul 31 23:35:07 old-k8s-version-130660 kubelet[742]: E0731 23:35:07.593534 742 reflector.go:138] object-"kube-system"/"kube-proxy-token-fzgtf": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kube-proxy-token-fzgtf" is forbidden: User "system:node:old-k8s-version-130660" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-130660' and this object
W0731 23:40:31.906267 1829252 logs.go:138] Found kubelet problem: Jul 31 23:35:07 old-k8s-version-130660 kubelet[742]: E0731 23:35:07.593592 742 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:old-k8s-version-130660" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-130660' and this object
W0731 23:40:31.906486 1829252 logs.go:138] Found kubelet problem: Jul 31 23:35:07 old-k8s-version-130660 kubelet[742]: E0731 23:35:07.593646 742 reflector.go:138] object-"default"/"default-token-4prkn": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "default-token-4prkn" is forbidden: User "system:node:old-k8s-version-130660" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'old-k8s-version-130660' and this object
W0731 23:40:31.906695 1829252 logs.go:138] Found kubelet problem: Jul 31 23:35:07 old-k8s-version-130660 kubelet[742]: E0731 23:35:07.593719 742 reflector.go:138] object-"kube-system"/"coredns": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:old-k8s-version-130660" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-130660' and this object
W0731 23:40:31.906917 1829252 logs.go:138] Found kubelet problem: Jul 31 23:35:07 old-k8s-version-130660 kubelet[742]: E0731 23:35:07.593768 742 reflector.go:138] object-"kube-system"/"coredns-token-6sgwf": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "coredns-token-6sgwf" is forbidden: User "system:node:old-k8s-version-130660" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-130660' and this object
W0731 23:40:31.917757 1829252 logs.go:138] Found kubelet problem: Jul 31 23:35:09 old-k8s-version-130660 kubelet[742]: E0731 23:35:09.731660 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0731 23:40:31.918380 1829252 logs.go:138] Found kubelet problem: Jul 31 23:35:09 old-k8s-version-130660 kubelet[742]: E0731 23:35:09.980822 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 23:40:31.922205 1829252 logs.go:138] Found kubelet problem: Jul 31 23:35:23 old-k8s-version-130660 kubelet[742]: E0731 23:35:23.912962 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0731 23:40:31.923741 1829252 logs.go:138] Found kubelet problem: Jul 31 23:35:37 old-k8s-version-130660 kubelet[742]: E0731 23:35:37.900150 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 23:40:31.924088 1829252 logs.go:138] Found kubelet problem: Jul 31 23:35:38 old-k8s-version-130660 kubelet[742]: E0731 23:35:38.139768 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
W0731 23:40:31.924573 1829252 logs.go:138] Found kubelet problem: Jul 31 23:35:39 old-k8s-version-130660 kubelet[742]: E0731 23:35:39.142583 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
W0731 23:40:31.925055 1829252 logs.go:138] Found kubelet problem: Jul 31 23:35:42 old-k8s-version-130660 kubelet[742]: E0731 23:35:42.939292 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
W0731 23:40:31.927208 1829252 logs.go:138] Found kubelet problem: Jul 31 23:35:51 old-k8s-version-130660 kubelet[742]: E0731 23:35:51.915245 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0731 23:40:31.927833 1829252 logs.go:138] Found kubelet problem: Jul 31 23:35:55 old-k8s-version-130660 kubelet[742]: E0731 23:35:55.174079 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
W0731 23:40:31.928027 1829252 logs.go:138] Found kubelet problem: Jul 31 23:36:02 old-k8s-version-130660 kubelet[742]: E0731 23:36:02.900602 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 23:40:31.928415 1829252 logs.go:138] Found kubelet problem: Jul 31 23:36:02 old-k8s-version-130660 kubelet[742]: E0731 23:36:02.938961 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
W0731 23:40:31.928612 1829252 logs.go:138] Found kubelet problem: Jul 31 23:36:14 old-k8s-version-130660 kubelet[742]: E0731 23:36:14.900659 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 23:40:31.929257 1829252 logs.go:138] Found kubelet problem: Jul 31 23:36:16 old-k8s-version-130660 kubelet[742]: E0731 23:36:16.237810 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
W0731 23:40:31.929603 1829252 logs.go:138] Found kubelet problem: Jul 31 23:36:22 old-k8s-version-130660 kubelet[742]: E0731 23:36:22.938992 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
W0731 23:40:31.929795 1829252 logs.go:138] Found kubelet problem: Jul 31 23:36:25 old-k8s-version-130660 kubelet[742]: E0731 23:36:25.900141 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 23:40:31.930137 1829252 logs.go:138] Found kubelet problem: Jul 31 23:36:37 old-k8s-version-130660 kubelet[742]: E0731 23:36:37.900048 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
W0731 23:40:31.932288 1829252 logs.go:138] Found kubelet problem: Jul 31 23:36:37 old-k8s-version-130660 kubelet[742]: E0731 23:36:37.913581 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0731 23:40:31.932483 1829252 logs.go:138] Found kubelet problem: Jul 31 23:36:48 old-k8s-version-130660 kubelet[742]: E0731 23:36:48.900800 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 23:40:31.932831 1829252 logs.go:138] Found kubelet problem: Jul 31 23:36:50 old-k8s-version-130660 kubelet[742]: E0731 23:36:50.899714 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
W0731 23:40:31.933026 1829252 logs.go:138] Found kubelet problem: Jul 31 23:37:02 old-k8s-version-130660 kubelet[742]: E0731 23:37:02.901296 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 23:40:31.933664 1829252 logs.go:138] Found kubelet problem: Jul 31 23:37:06 old-k8s-version-130660 kubelet[742]: E0731 23:37:06.310165 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
W0731 23:40:31.934010 1829252 logs.go:138] Found kubelet problem: Jul 31 23:37:12 old-k8s-version-130660 kubelet[742]: E0731 23:37:12.939044 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
W0731 23:40:31.934204 1829252 logs.go:138] Found kubelet problem: Jul 31 23:37:14 old-k8s-version-130660 kubelet[742]: E0731 23:37:14.900812 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 23:40:31.934549 1829252 logs.go:138] Found kubelet problem: Jul 31 23:37:27 old-k8s-version-130660 kubelet[742]: E0731 23:37:27.899533 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
W0731 23:40:31.934743 1829252 logs.go:138] Found kubelet problem: Jul 31 23:37:28 old-k8s-version-130660 kubelet[742]: E0731 23:37:28.900944 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 23:40:31.935086 1829252 logs.go:138] Found kubelet problem: Jul 31 23:37:41 old-k8s-version-130660 kubelet[742]: E0731 23:37:41.899714 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
W0731 23:40:31.935276 1829252 logs.go:138] Found kubelet problem: Jul 31 23:37:42 old-k8s-version-130660 kubelet[742]: E0731 23:37:42.900065 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 23:40:31.935465 1829252 logs.go:138] Found kubelet problem: Jul 31 23:37:54 old-k8s-version-130660 kubelet[742]: E0731 23:37:54.900104 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 23:40:31.935812 1829252 logs.go:138] Found kubelet problem: Jul 31 23:37:55 old-k8s-version-130660 kubelet[742]: E0731 23:37:55.899783 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
W0731 23:40:31.938272 1829252 logs.go:138] Found kubelet problem: Jul 31 23:38:05 old-k8s-version-130660 kubelet[742]: E0731 23:38:05.912798 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0731 23:40:31.939974 1829252 logs.go:138] Found kubelet problem: Jul 31 23:38:10 old-k8s-version-130660 kubelet[742]: E0731 23:38:10.899721 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
W0731 23:40:31.940195 1829252 logs.go:138] Found kubelet problem: Jul 31 23:38:18 old-k8s-version-130660 kubelet[742]: E0731 23:38:18.901024 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 23:40:31.940543 1829252 logs.go:138] Found kubelet problem: Jul 31 23:38:21 old-k8s-version-130660 kubelet[742]: E0731 23:38:21.899662 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
W0731 23:40:31.940734 1829252 logs.go:138] Found kubelet problem: Jul 31 23:38:33 old-k8s-version-130660 kubelet[742]: E0731 23:38:33.900179 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 23:40:31.941390 1829252 logs.go:138] Found kubelet problem: Jul 31 23:38:36 old-k8s-version-130660 kubelet[742]: E0731 23:38:36.433618 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
W0731 23:40:31.941754 1829252 logs.go:138] Found kubelet problem: Jul 31 23:38:42 old-k8s-version-130660 kubelet[742]: E0731 23:38:42.939018 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
W0731 23:40:31.941951 1829252 logs.go:138] Found kubelet problem: Jul 31 23:38:46 old-k8s-version-130660 kubelet[742]: E0731 23:38:46.900616 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 23:40:31.942315 1829252 logs.go:138] Found kubelet problem: Jul 31 23:38:54 old-k8s-version-130660 kubelet[742]: E0731 23:38:54.899746 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
W0731 23:40:31.942519 1829252 logs.go:138] Found kubelet problem: Jul 31 23:39:01 old-k8s-version-130660 kubelet[742]: E0731 23:39:01.900337 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 23:40:31.942862 1829252 logs.go:138] Found kubelet problem: Jul 31 23:39:08 old-k8s-version-130660 kubelet[742]: E0731 23:39:08.899966 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
W0731 23:40:31.943053 1829252 logs.go:138] Found kubelet problem: Jul 31 23:39:14 old-k8s-version-130660 kubelet[742]: E0731 23:39:14.900213 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 23:40:31.943394 1829252 logs.go:138] Found kubelet problem: Jul 31 23:39:20 old-k8s-version-130660 kubelet[742]: E0731 23:39:20.899847 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
W0731 23:40:31.943585 1829252 logs.go:138] Found kubelet problem: Jul 31 23:39:25 old-k8s-version-130660 kubelet[742]: E0731 23:39:25.900329 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 23:40:31.943933 1829252 logs.go:138] Found kubelet problem: Jul 31 23:39:32 old-k8s-version-130660 kubelet[742]: E0731 23:39:32.900100 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
W0731 23:40:31.944131 1829252 logs.go:138] Found kubelet problem: Jul 31 23:39:36 old-k8s-version-130660 kubelet[742]: E0731 23:39:36.900554 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 23:40:31.944482 1829252 logs.go:138] Found kubelet problem: Jul 31 23:39:46 old-k8s-version-130660 kubelet[742]: E0731 23:39:46.899659 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
W0731 23:40:31.944678 1829252 logs.go:138] Found kubelet problem: Jul 31 23:39:47 old-k8s-version-130660 kubelet[742]: E0731 23:39:47.900629 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 23:40:31.945022 1829252 logs.go:138] Found kubelet problem: Jul 31 23:39:57 old-k8s-version-130660 kubelet[742]: E0731 23:39:57.899835 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
W0731 23:40:31.945479 1829252 logs.go:138] Found kubelet problem: Jul 31 23:40:02 old-k8s-version-130660 kubelet[742]: E0731 23:40:02.900337 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 23:40:31.945825 1829252 logs.go:138] Found kubelet problem: Jul 31 23:40:11 old-k8s-version-130660 kubelet[742]: E0731 23:40:11.899717 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
W0731 23:40:31.946044 1829252 logs.go:138] Found kubelet problem: Jul 31 23:40:16 old-k8s-version-130660 kubelet[742]: E0731 23:40:16.900104 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 23:40:31.946393 1829252 logs.go:138] Found kubelet problem: Jul 31 23:40:24 old-k8s-version-130660 kubelet[742]: E0731 23:40:24.899764 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
W0731 23:40:31.946587 1829252 logs.go:138] Found kubelet problem: Jul 31 23:40:27 old-k8s-version-130660 kubelet[742]: E0731 23:40:27.900206 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
I0731 23:40:31.946597 1829252 logs.go:123] Gathering logs for kube-scheduler [9ea334663167822d57c49e09d75be27e43c4d14410ab00696d0bd381e74ba548] ...
I0731 23:40:31.946613 1829252 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 9ea334663167822d57c49e09d75be27e43c4d14410ab00696d0bd381e74ba548"
I0731 23:40:31.994035 1829252 logs.go:123] Gathering logs for describe nodes ...
I0731 23:40:31.994065 1829252 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0731 23:40:32.158567 1829252 logs.go:123] Gathering logs for kube-apiserver [46018fe62e056d85a9d92909a3ffe934843c413af90487065b86f79764b6e416] ...
I0731 23:40:32.158602 1829252 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 46018fe62e056d85a9d92909a3ffe934843c413af90487065b86f79764b6e416"
I0731 23:40:32.227818 1829252 logs.go:123] Gathering logs for coredns [de1b5cb3d187661a9da8df949ef36da261421dac028ae8e070be86f4226a470b] ...
I0731 23:40:32.227860 1829252 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 de1b5cb3d187661a9da8df949ef36da261421dac028ae8e070be86f4226a470b"
I0731 23:40:32.273447 1829252 logs.go:123] Gathering logs for kube-controller-manager [6d2854e476f196556888fd39fa1c3e23a43223b6bf7632e42e8a2d3e07316f00] ...
I0731 23:40:32.273478 1829252 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 6d2854e476f196556888fd39fa1c3e23a43223b6bf7632e42e8a2d3e07316f00"
I0731 23:40:32.344093 1829252 logs.go:123] Gathering logs for kubernetes-dashboard [d6f8ffde1c928670ca20febc0c4a113d8ad3e22267d8fd745d5c54e8cc854a27] ...
I0731 23:40:32.344134 1829252 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 d6f8ffde1c928670ca20febc0c4a113d8ad3e22267d8fd745d5c54e8cc854a27"
I0731 23:40:32.385695 1829252 logs.go:123] Gathering logs for storage-provisioner [e7eb6229b113884a77ab02b300c2b453be8b1723c83dc8f8862391ed9ef419e1] ...
I0731 23:40:32.385724 1829252 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e7eb6229b113884a77ab02b300c2b453be8b1723c83dc8f8862391ed9ef419e1"
I0731 23:40:32.435975 1829252 logs.go:123] Gathering logs for CRI-O ...
I0731 23:40:32.436001 1829252 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0731 23:40:32.522296 1829252 out.go:304] Setting ErrFile to fd 2...
I0731 23:40:32.522372 1829252 out.go:338] TERM=,COLORTERM=, which probably does not support color
W0731 23:40:32.522460 1829252 out.go:239] X Problems detected in kubelet:
X Problems detected in kubelet:
W0731 23:40:32.522500 1829252 out.go:239] Jul 31 23:40:02 old-k8s-version-130660 kubelet[742]: E0731 23:40:02.900337 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jul 31 23:40:02 old-k8s-version-130660 kubelet[742]: E0731 23:40:02.900337 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 23:40:32.522532 1829252 out.go:239] Jul 31 23:40:11 old-k8s-version-130660 kubelet[742]: E0731 23:40:11.899717 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
Jul 31 23:40:11 old-k8s-version-130660 kubelet[742]: E0731 23:40:11.899717 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
W0731 23:40:32.522583 1829252 out.go:239] Jul 31 23:40:16 old-k8s-version-130660 kubelet[742]: E0731 23:40:16.900104 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jul 31 23:40:16 old-k8s-version-130660 kubelet[742]: E0731 23:40:16.900104 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 23:40:32.522613 1829252 out.go:239] Jul 31 23:40:24 old-k8s-version-130660 kubelet[742]: E0731 23:40:24.899764 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
Jul 31 23:40:24 old-k8s-version-130660 kubelet[742]: E0731 23:40:24.899764 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
W0731 23:40:32.522668 1829252 out.go:239] Jul 31 23:40:27 old-k8s-version-130660 kubelet[742]: E0731 23:40:27.900206 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jul 31 23:40:27 old-k8s-version-130660 kubelet[742]: E0731 23:40:27.900206 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
I0731 23:40:32.522702 1829252 out.go:304] Setting ErrFile to fd 2...
I0731 23:40:32.522720 1829252 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0731 23:40:42.523167 1829252 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0731 23:40:42.534963 1829252 api_server.go:72] duration metric: took 5m51.519646281s to wait for apiserver process to appear ...
I0731 23:40:42.534988 1829252 api_server.go:88] waiting for apiserver healthz status ...
I0731 23:40:42.535022 1829252 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0731 23:40:42.535080 1829252 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0731 23:40:42.573475 1829252 cri.go:89] found id: "46018fe62e056d85a9d92909a3ffe934843c413af90487065b86f79764b6e416"
I0731 23:40:42.573498 1829252 cri.go:89] found id: ""
I0731 23:40:42.573507 1829252 logs.go:276] 1 containers: [46018fe62e056d85a9d92909a3ffe934843c413af90487065b86f79764b6e416]
I0731 23:40:42.573565 1829252 ssh_runner.go:195] Run: which crictl
I0731 23:40:42.577141 1829252 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0731 23:40:42.577216 1829252 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0731 23:40:42.618294 1829252 cri.go:89] found id: "6854efb05017bc711513167086bed436131771d8c2f42fe3910912ac80224c6c"
I0731 23:40:42.618317 1829252 cri.go:89] found id: ""
I0731 23:40:42.618325 1829252 logs.go:276] 1 containers: [6854efb05017bc711513167086bed436131771d8c2f42fe3910912ac80224c6c]
I0731 23:40:42.618380 1829252 ssh_runner.go:195] Run: which crictl
I0731 23:40:42.622074 1829252 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0731 23:40:42.622146 1829252 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0731 23:40:42.661456 1829252 cri.go:89] found id: "de1b5cb3d187661a9da8df949ef36da261421dac028ae8e070be86f4226a470b"
I0731 23:40:42.661478 1829252 cri.go:89] found id: ""
I0731 23:40:42.661486 1829252 logs.go:276] 1 containers: [de1b5cb3d187661a9da8df949ef36da261421dac028ae8e070be86f4226a470b]
I0731 23:40:42.661547 1829252 ssh_runner.go:195] Run: which crictl
I0731 23:40:42.665157 1829252 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0731 23:40:42.665221 1829252 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0731 23:40:42.701128 1829252 cri.go:89] found id: "9ea334663167822d57c49e09d75be27e43c4d14410ab00696d0bd381e74ba548"
I0731 23:40:42.701152 1829252 cri.go:89] found id: ""
I0731 23:40:42.701160 1829252 logs.go:276] 1 containers: [9ea334663167822d57c49e09d75be27e43c4d14410ab00696d0bd381e74ba548]
I0731 23:40:42.701216 1829252 ssh_runner.go:195] Run: which crictl
I0731 23:40:42.704806 1829252 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0731 23:40:42.704875 1829252 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0731 23:40:42.741987 1829252 cri.go:89] found id: "c21ba7634bd1a874c9ebc36d102421cb8c623f6f4fc40ef723fae526a1693796"
I0731 23:40:42.742008 1829252 cri.go:89] found id: ""
I0731 23:40:42.742017 1829252 logs.go:276] 1 containers: [c21ba7634bd1a874c9ebc36d102421cb8c623f6f4fc40ef723fae526a1693796]
I0731 23:40:42.742095 1829252 ssh_runner.go:195] Run: which crictl
I0731 23:40:42.745798 1829252 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0731 23:40:42.745867 1829252 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0731 23:40:42.789352 1829252 cri.go:89] found id: "6d2854e476f196556888fd39fa1c3e23a43223b6bf7632e42e8a2d3e07316f00"
I0731 23:40:42.789377 1829252 cri.go:89] found id: ""
I0731 23:40:42.789384 1829252 logs.go:276] 1 containers: [6d2854e476f196556888fd39fa1c3e23a43223b6bf7632e42e8a2d3e07316f00]
I0731 23:40:42.789443 1829252 ssh_runner.go:195] Run: which crictl
I0731 23:40:42.793051 1829252 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0731 23:40:42.793147 1829252 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0731 23:40:42.830015 1829252 cri.go:89] found id: "bab863fc639de5e0d2e1165a89d0b3b22043e0ffdb80ad3296bca7a7262985f7"
I0731 23:40:42.830034 1829252 cri.go:89] found id: ""
I0731 23:40:42.830042 1829252 logs.go:276] 1 containers: [bab863fc639de5e0d2e1165a89d0b3b22043e0ffdb80ad3296bca7a7262985f7]
I0731 23:40:42.830096 1829252 ssh_runner.go:195] Run: which crictl
I0731 23:40:42.833643 1829252 cri.go:54] listing CRI containers in root : {State:all Name:storage-provisioner Namespaces:[]}
I0731 23:40:42.833716 1829252 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0731 23:40:42.873447 1829252 cri.go:89] found id: "af4a5d8f7ff273f31d82cb997af6a85d6437344b03032e0188e4e18ed9144b92"
I0731 23:40:42.873469 1829252 cri.go:89] found id: "e7eb6229b113884a77ab02b300c2b453be8b1723c83dc8f8862391ed9ef419e1"
I0731 23:40:42.873474 1829252 cri.go:89] found id: ""
I0731 23:40:42.873481 1829252 logs.go:276] 2 containers: [af4a5d8f7ff273f31d82cb997af6a85d6437344b03032e0188e4e18ed9144b92 e7eb6229b113884a77ab02b300c2b453be8b1723c83dc8f8862391ed9ef419e1]
I0731 23:40:42.873535 1829252 ssh_runner.go:195] Run: which crictl
I0731 23:40:42.877038 1829252 ssh_runner.go:195] Run: which crictl
I0731 23:40:42.880423 1829252 cri.go:54] listing CRI containers in root : {State:all Name:kubernetes-dashboard Namespaces:[]}
I0731 23:40:42.880533 1829252 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I0731 23:40:42.919417 1829252 cri.go:89] found id: "d6f8ffde1c928670ca20febc0c4a113d8ad3e22267d8fd745d5c54e8cc854a27"
I0731 23:40:42.919441 1829252 cri.go:89] found id: ""
I0731 23:40:42.919448 1829252 logs.go:276] 1 containers: [d6f8ffde1c928670ca20febc0c4a113d8ad3e22267d8fd745d5c54e8cc854a27]
I0731 23:40:42.919510 1829252 ssh_runner.go:195] Run: which crictl
I0731 23:40:42.923555 1829252 logs.go:123] Gathering logs for dmesg ...
I0731 23:40:42.923587 1829252 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0731 23:40:42.942311 1829252 logs.go:123] Gathering logs for kube-controller-manager [6d2854e476f196556888fd39fa1c3e23a43223b6bf7632e42e8a2d3e07316f00] ...
I0731 23:40:42.942342 1829252 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 6d2854e476f196556888fd39fa1c3e23a43223b6bf7632e42e8a2d3e07316f00"
I0731 23:40:43.024646 1829252 logs.go:123] Gathering logs for kindnet [bab863fc639de5e0d2e1165a89d0b3b22043e0ffdb80ad3296bca7a7262985f7] ...
I0731 23:40:43.024684 1829252 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 bab863fc639de5e0d2e1165a89d0b3b22043e0ffdb80ad3296bca7a7262985f7"
I0731 23:40:43.086681 1829252 logs.go:123] Gathering logs for CRI-O ...
I0731 23:40:43.086711 1829252 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0731 23:40:43.174577 1829252 logs.go:123] Gathering logs for container status ...
I0731 23:40:43.174613 1829252 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0731 23:40:43.216374 1829252 logs.go:123] Gathering logs for kube-apiserver [46018fe62e056d85a9d92909a3ffe934843c413af90487065b86f79764b6e416] ...
I0731 23:40:43.216401 1829252 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 46018fe62e056d85a9d92909a3ffe934843c413af90487065b86f79764b6e416"
I0731 23:40:43.291210 1829252 logs.go:123] Gathering logs for storage-provisioner [af4a5d8f7ff273f31d82cb997af6a85d6437344b03032e0188e4e18ed9144b92] ...
I0731 23:40:43.291247 1829252 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 af4a5d8f7ff273f31d82cb997af6a85d6437344b03032e0188e4e18ed9144b92"
I0731 23:40:43.333618 1829252 logs.go:123] Gathering logs for storage-provisioner [e7eb6229b113884a77ab02b300c2b453be8b1723c83dc8f8862391ed9ef419e1] ...
I0731 23:40:43.333647 1829252 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e7eb6229b113884a77ab02b300c2b453be8b1723c83dc8f8862391ed9ef419e1"
I0731 23:40:43.373657 1829252 logs.go:123] Gathering logs for kubernetes-dashboard [d6f8ffde1c928670ca20febc0c4a113d8ad3e22267d8fd745d5c54e8cc854a27] ...
I0731 23:40:43.373686 1829252 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 d6f8ffde1c928670ca20febc0c4a113d8ad3e22267d8fd745d5c54e8cc854a27"
I0731 23:40:43.418607 1829252 logs.go:123] Gathering logs for etcd [6854efb05017bc711513167086bed436131771d8c2f42fe3910912ac80224c6c] ...
I0731 23:40:43.418636 1829252 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 6854efb05017bc711513167086bed436131771d8c2f42fe3910912ac80224c6c"
I0731 23:40:43.484482 1829252 logs.go:123] Gathering logs for kube-scheduler [9ea334663167822d57c49e09d75be27e43c4d14410ab00696d0bd381e74ba548] ...
I0731 23:40:43.484516 1829252 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 9ea334663167822d57c49e09d75be27e43c4d14410ab00696d0bd381e74ba548"
I0731 23:40:43.544591 1829252 logs.go:123] Gathering logs for kube-proxy [c21ba7634bd1a874c9ebc36d102421cb8c623f6f4fc40ef723fae526a1693796] ...
I0731 23:40:43.544623 1829252 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 c21ba7634bd1a874c9ebc36d102421cb8c623f6f4fc40ef723fae526a1693796"
I0731 23:40:43.622041 1829252 logs.go:123] Gathering logs for kubelet ...
I0731 23:40:43.622069 1829252 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0731 23:40:43.694432 1829252 logs.go:138] Found kubelet problem: Jul 31 23:35:07 old-k8s-version-130660 kubelet[742]: E0731 23:35:07.593291 742 reflector.go:138] object-"kube-system"/"kindnet-token-crzsj": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kindnet-token-crzsj" is forbidden: User "system:node:old-k8s-version-130660" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-130660' and this object
W0731 23:40:43.694779 1829252 logs.go:138] Found kubelet problem: Jul 31 23:35:07 old-k8s-version-130660 kubelet[742]: E0731 23:35:07.593424 742 reflector.go:138] object-"kube-system"/"storage-provisioner-token-d22vf": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "storage-provisioner-token-d22vf" is forbidden: User "system:node:old-k8s-version-130660" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-130660' and this object
W0731 23:40:43.695038 1829252 logs.go:138] Found kubelet problem: Jul 31 23:35:07 old-k8s-version-130660 kubelet[742]: E0731 23:35:07.593481 742 reflector.go:138] object-"kube-system"/"metrics-server-token-kr52c": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "metrics-server-token-kr52c" is forbidden: User "system:node:old-k8s-version-130660" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-130660' and this object
W0731 23:40:43.695680 1829252 logs.go:138] Found kubelet problem: Jul 31 23:35:07 old-k8s-version-130660 kubelet[742]: E0731 23:35:07.593534 742 reflector.go:138] object-"kube-system"/"kube-proxy-token-fzgtf": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kube-proxy-token-fzgtf" is forbidden: User "system:node:old-k8s-version-130660" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-130660' and this object
W0731 23:40:43.695993 1829252 logs.go:138] Found kubelet problem: Jul 31 23:35:07 old-k8s-version-130660 kubelet[742]: E0731 23:35:07.593592 742 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:old-k8s-version-130660" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-130660' and this object
W0731 23:40:43.697348 1829252 logs.go:138] Found kubelet problem: Jul 31 23:35:07 old-k8s-version-130660 kubelet[742]: E0731 23:35:07.593646 742 reflector.go:138] object-"default"/"default-token-4prkn": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "default-token-4prkn" is forbidden: User "system:node:old-k8s-version-130660" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'old-k8s-version-130660' and this object
W0731 23:40:43.697624 1829252 logs.go:138] Found kubelet problem: Jul 31 23:35:07 old-k8s-version-130660 kubelet[742]: E0731 23:35:07.593719 742 reflector.go:138] object-"kube-system"/"coredns": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:old-k8s-version-130660" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-130660' and this object
W0731 23:40:43.697848 1829252 logs.go:138] Found kubelet problem: Jul 31 23:35:07 old-k8s-version-130660 kubelet[742]: E0731 23:35:07.593768 742 reflector.go:138] object-"kube-system"/"coredns-token-6sgwf": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "coredns-token-6sgwf" is forbidden: User "system:node:old-k8s-version-130660" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-130660' and this object
W0731 23:40:43.710124 1829252 logs.go:138] Found kubelet problem: Jul 31 23:35:09 old-k8s-version-130660 kubelet[742]: E0731 23:35:09.731660 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0731 23:40:43.710762 1829252 logs.go:138] Found kubelet problem: Jul 31 23:35:09 old-k8s-version-130660 kubelet[742]: E0731 23:35:09.980822 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 23:40:43.714635 1829252 logs.go:138] Found kubelet problem: Jul 31 23:35:23 old-k8s-version-130660 kubelet[742]: E0731 23:35:23.912962 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0731 23:40:43.716251 1829252 logs.go:138] Found kubelet problem: Jul 31 23:35:37 old-k8s-version-130660 kubelet[742]: E0731 23:35:37.900150 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 23:40:43.716594 1829252 logs.go:138] Found kubelet problem: Jul 31 23:35:38 old-k8s-version-130660 kubelet[742]: E0731 23:35:38.139768 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
W0731 23:40:43.717077 1829252 logs.go:138] Found kubelet problem: Jul 31 23:35:39 old-k8s-version-130660 kubelet[742]: E0731 23:35:39.142583 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
W0731 23:40:43.717609 1829252 logs.go:138] Found kubelet problem: Jul 31 23:35:42 old-k8s-version-130660 kubelet[742]: E0731 23:35:42.939292 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
W0731 23:40:43.719764 1829252 logs.go:138] Found kubelet problem: Jul 31 23:35:51 old-k8s-version-130660 kubelet[742]: E0731 23:35:51.915245 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0731 23:40:43.720376 1829252 logs.go:138] Found kubelet problem: Jul 31 23:35:55 old-k8s-version-130660 kubelet[742]: E0731 23:35:55.174079 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
W0731 23:40:43.720568 1829252 logs.go:138] Found kubelet problem: Jul 31 23:36:02 old-k8s-version-130660 kubelet[742]: E0731 23:36:02.900602 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 23:40:43.720909 1829252 logs.go:138] Found kubelet problem: Jul 31 23:36:02 old-k8s-version-130660 kubelet[742]: E0731 23:36:02.938961 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
W0731 23:40:43.721129 1829252 logs.go:138] Found kubelet problem: Jul 31 23:36:14 old-k8s-version-130660 kubelet[742]: E0731 23:36:14.900659 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 23:40:43.721793 1829252 logs.go:138] Found kubelet problem: Jul 31 23:36:16 old-k8s-version-130660 kubelet[742]: E0731 23:36:16.237810 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
W0731 23:40:43.722238 1829252 logs.go:138] Found kubelet problem: Jul 31 23:36:22 old-k8s-version-130660 kubelet[742]: E0731 23:36:22.938992 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
W0731 23:40:43.722440 1829252 logs.go:138] Found kubelet problem: Jul 31 23:36:25 old-k8s-version-130660 kubelet[742]: E0731 23:36:25.900141 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 23:40:43.722784 1829252 logs.go:138] Found kubelet problem: Jul 31 23:36:37 old-k8s-version-130660 kubelet[742]: E0731 23:36:37.900048 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
W0731 23:40:43.726823 1829252 logs.go:138] Found kubelet problem: Jul 31 23:36:37 old-k8s-version-130660 kubelet[742]: E0731 23:36:37.913581 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0731 23:40:43.727038 1829252 logs.go:138] Found kubelet problem: Jul 31 23:36:48 old-k8s-version-130660 kubelet[742]: E0731 23:36:48.900800 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 23:40:43.727383 1829252 logs.go:138] Found kubelet problem: Jul 31 23:36:50 old-k8s-version-130660 kubelet[742]: E0731 23:36:50.899714 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
W0731 23:40:43.727574 1829252 logs.go:138] Found kubelet problem: Jul 31 23:37:02 old-k8s-version-130660 kubelet[742]: E0731 23:37:02.901296 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 23:40:43.728202 1829252 logs.go:138] Found kubelet problem: Jul 31 23:37:06 old-k8s-version-130660 kubelet[742]: E0731 23:37:06.310165 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
W0731 23:40:43.728542 1829252 logs.go:138] Found kubelet problem: Jul 31 23:37:12 old-k8s-version-130660 kubelet[742]: E0731 23:37:12.939044 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
W0731 23:40:43.728737 1829252 logs.go:138] Found kubelet problem: Jul 31 23:37:14 old-k8s-version-130660 kubelet[742]: E0731 23:37:14.900812 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 23:40:43.729312 1829252 logs.go:138] Found kubelet problem: Jul 31 23:37:27 old-k8s-version-130660 kubelet[742]: E0731 23:37:27.899533 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
W0731 23:40:43.729512 1829252 logs.go:138] Found kubelet problem: Jul 31 23:37:28 old-k8s-version-130660 kubelet[742]: E0731 23:37:28.900944 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 23:40:43.729863 1829252 logs.go:138] Found kubelet problem: Jul 31 23:37:41 old-k8s-version-130660 kubelet[742]: E0731 23:37:41.899714 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
W0731 23:40:43.730056 1829252 logs.go:138] Found kubelet problem: Jul 31 23:37:42 old-k8s-version-130660 kubelet[742]: E0731 23:37:42.900065 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 23:40:43.730313 1829252 logs.go:138] Found kubelet problem: Jul 31 23:37:54 old-k8s-version-130660 kubelet[742]: E0731 23:37:54.900104 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 23:40:43.730658 1829252 logs.go:138] Found kubelet problem: Jul 31 23:37:55 old-k8s-version-130660 kubelet[742]: E0731 23:37:55.899783 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
W0731 23:40:43.732864 1829252 logs.go:138] Found kubelet problem: Jul 31 23:38:05 old-k8s-version-130660 kubelet[742]: E0731 23:38:05.912798 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0731 23:40:43.733822 1829252 logs.go:138] Found kubelet problem: Jul 31 23:38:10 old-k8s-version-130660 kubelet[742]: E0731 23:38:10.899721 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
W0731 23:40:43.734056 1829252 logs.go:138] Found kubelet problem: Jul 31 23:38:18 old-k8s-version-130660 kubelet[742]: E0731 23:38:18.901024 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 23:40:43.734397 1829252 logs.go:138] Found kubelet problem: Jul 31 23:38:21 old-k8s-version-130660 kubelet[742]: E0731 23:38:21.899662 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
W0731 23:40:43.734588 1829252 logs.go:138] Found kubelet problem: Jul 31 23:38:33 old-k8s-version-130660 kubelet[742]: E0731 23:38:33.900179 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 23:40:43.735701 1829252 logs.go:138] Found kubelet problem: Jul 31 23:38:36 old-k8s-version-130660 kubelet[742]: E0731 23:38:36.433618 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
W0731 23:40:43.736069 1829252 logs.go:138] Found kubelet problem: Jul 31 23:38:42 old-k8s-version-130660 kubelet[742]: E0731 23:38:42.939018 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
W0731 23:40:43.736263 1829252 logs.go:138] Found kubelet problem: Jul 31 23:38:46 old-k8s-version-130660 kubelet[742]: E0731 23:38:46.900616 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 23:40:43.736604 1829252 logs.go:138] Found kubelet problem: Jul 31 23:38:54 old-k8s-version-130660 kubelet[742]: E0731 23:38:54.899746 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
W0731 23:40:43.736845 1829252 logs.go:138] Found kubelet problem: Jul 31 23:39:01 old-k8s-version-130660 kubelet[742]: E0731 23:39:01.900337 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 23:40:43.737255 1829252 logs.go:138] Found kubelet problem: Jul 31 23:39:08 old-k8s-version-130660 kubelet[742]: E0731 23:39:08.899966 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
W0731 23:40:43.737462 1829252 logs.go:138] Found kubelet problem: Jul 31 23:39:14 old-k8s-version-130660 kubelet[742]: E0731 23:39:14.900213 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 23:40:43.737829 1829252 logs.go:138] Found kubelet problem: Jul 31 23:39:20 old-k8s-version-130660 kubelet[742]: E0731 23:39:20.899847 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
W0731 23:40:43.738043 1829252 logs.go:138] Found kubelet problem: Jul 31 23:39:25 old-k8s-version-130660 kubelet[742]: E0731 23:39:25.900329 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 23:40:43.738420 1829252 logs.go:138] Found kubelet problem: Jul 31 23:39:32 old-k8s-version-130660 kubelet[742]: E0731 23:39:32.900100 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
W0731 23:40:43.738641 1829252 logs.go:138] Found kubelet problem: Jul 31 23:39:36 old-k8s-version-130660 kubelet[742]: E0731 23:39:36.900554 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 23:40:43.739002 1829252 logs.go:138] Found kubelet problem: Jul 31 23:39:46 old-k8s-version-130660 kubelet[742]: E0731 23:39:46.899659 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
W0731 23:40:43.739207 1829252 logs.go:138] Found kubelet problem: Jul 31 23:39:47 old-k8s-version-130660 kubelet[742]: E0731 23:39:47.900629 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 23:40:43.739595 1829252 logs.go:138] Found kubelet problem: Jul 31 23:39:57 old-k8s-version-130660 kubelet[742]: E0731 23:39:57.899835 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
W0731 23:40:43.740089 1829252 logs.go:138] Found kubelet problem: Jul 31 23:40:02 old-k8s-version-130660 kubelet[742]: E0731 23:40:02.900337 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 23:40:43.740457 1829252 logs.go:138] Found kubelet problem: Jul 31 23:40:11 old-k8s-version-130660 kubelet[742]: E0731 23:40:11.899717 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
W0731 23:40:43.740670 1829252 logs.go:138] Found kubelet problem: Jul 31 23:40:16 old-k8s-version-130660 kubelet[742]: E0731 23:40:16.900104 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 23:40:43.741031 1829252 logs.go:138] Found kubelet problem: Jul 31 23:40:24 old-k8s-version-130660 kubelet[742]: E0731 23:40:24.899764 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
W0731 23:40:43.741253 1829252 logs.go:138] Found kubelet problem: Jul 31 23:40:27 old-k8s-version-130660 kubelet[742]: E0731 23:40:27.900206 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 23:40:43.741628 1829252 logs.go:138] Found kubelet problem: Jul 31 23:40:37 old-k8s-version-130660 kubelet[742]: E0731 23:40:37.900394 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
W0731 23:40:43.741830 1829252 logs.go:138] Found kubelet problem: Jul 31 23:40:38 old-k8s-version-130660 kubelet[742]: E0731 23:40:38.900915 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
I0731 23:40:43.741846 1829252 logs.go:123] Gathering logs for describe nodes ...
I0731 23:40:43.741863 1829252 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0731 23:40:43.924872 1829252 logs.go:123] Gathering logs for coredns [de1b5cb3d187661a9da8df949ef36da261421dac028ae8e070be86f4226a470b] ...
I0731 23:40:43.924913 1829252 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 de1b5cb3d187661a9da8df949ef36da261421dac028ae8e070be86f4226a470b"
I0731 23:40:43.993229 1829252 out.go:304] Setting ErrFile to fd 2...
I0731 23:40:43.993305 1829252 out.go:338] TERM=,COLORTERM=, which probably does not support color
W0731 23:40:43.993387 1829252 out.go:239] X Problems detected in kubelet:
X Problems detected in kubelet:
W0731 23:40:43.993430 1829252 out.go:239] Jul 31 23:40:16 old-k8s-version-130660 kubelet[742]: E0731 23:40:16.900104 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jul 31 23:40:16 old-k8s-version-130660 kubelet[742]: E0731 23:40:16.900104 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 23:40:43.993462 1829252 out.go:239] Jul 31 23:40:24 old-k8s-version-130660 kubelet[742]: E0731 23:40:24.899764 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
Jul 31 23:40:24 old-k8s-version-130660 kubelet[742]: E0731 23:40:24.899764 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
W0731 23:40:43.993512 1829252 out.go:239] Jul 31 23:40:27 old-k8s-version-130660 kubelet[742]: E0731 23:40:27.900206 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jul 31 23:40:27 old-k8s-version-130660 kubelet[742]: E0731 23:40:27.900206 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 23:40:43.993545 1829252 out.go:239] Jul 31 23:40:37 old-k8s-version-130660 kubelet[742]: E0731 23:40:37.900394 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
Jul 31 23:40:37 old-k8s-version-130660 kubelet[742]: E0731 23:40:37.900394 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
W0731 23:40:43.993586 1829252 out.go:239] Jul 31 23:40:38 old-k8s-version-130660 kubelet[742]: E0731 23:40:38.900915 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jul 31 23:40:38 old-k8s-version-130660 kubelet[742]: E0731 23:40:38.900915 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
I0731 23:40:43.993620 1829252 out.go:304] Setting ErrFile to fd 2...
I0731 23:40:43.993640 1829252 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0731 23:40:53.995026 1829252 api_server.go:253] Checking apiserver healthz at https://192.168.76.2:8443/healthz ...
I0731 23:40:54.009309 1829252 api_server.go:279] https://192.168.76.2:8443/healthz returned 200:
ok
I0731 23:40:54.011797 1829252 out.go:177]
W0731 23:40:54.013632 1829252 out.go:239] X Exiting due to K8S_UNHEALTHY_CONTROL_PLANE: wait 6m0s for node: wait for healthy API server: controlPlane never updated to v1.20.0
X Exiting due to K8S_UNHEALTHY_CONTROL_PLANE: wait 6m0s for node: wait for healthy API server: controlPlane never updated to v1.20.0
W0731 23:40:54.013674 1829252 out.go:239] * Suggestion: Control Plane could not update, try minikube delete --all --purge
* Suggestion: Control Plane could not update, try minikube delete --all --purge
W0731 23:40:54.013694 1829252 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/11417
* Related issue: https://github.com/kubernetes/minikube/issues/11417
W0731 23:40:54.013700 1829252 out.go:239] *
*
W0731 23:40:54.014777 1829252 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0731 23:40:54.018048 1829252 out.go:177]
** /stderr **
start_stop_delete_test.go:259: failed to start minikube post-stop. args "out/minikube-linux-arm64 start -p old-k8s-version-130660 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=crio --kubernetes-version=v1.20.0": exit status 102
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: docker inspect <======
helpers_test.go:231: (dbg) Run: docker inspect old-k8s-version-130660
helpers_test.go:235: (dbg) docker inspect old-k8s-version-130660:
-- stdout --
[
{
"Id": "113aa41627b627283271b1441f6762c7553c9518cd510a6ea5aeb3e393c5884b",
"Created": "2024-07-31T23:31:45.08271664Z",
"Path": "/usr/local/bin/entrypoint",
"Args": [
"/sbin/init"
],
"State": {
"Status": "running",
"Running": true,
"Paused": false,
"Restarting": false,
"OOMKilled": false,
"Dead": false,
"Pid": 1829466,
"ExitCode": 0,
"Error": "",
"StartedAt": "2024-07-31T23:34:43.21527362Z",
"FinishedAt": "2024-07-31T23:34:41.224241335Z"
},
"Image": "sha256:2cd84ab2172023a68162f38a55db46353562cea41552fd8e8bdec97b31b2c495",
"ResolvConfPath": "/var/lib/docker/containers/113aa41627b627283271b1441f6762c7553c9518cd510a6ea5aeb3e393c5884b/resolv.conf",
"HostnamePath": "/var/lib/docker/containers/113aa41627b627283271b1441f6762c7553c9518cd510a6ea5aeb3e393c5884b/hostname",
"HostsPath": "/var/lib/docker/containers/113aa41627b627283271b1441f6762c7553c9518cd510a6ea5aeb3e393c5884b/hosts",
"LogPath": "/var/lib/docker/containers/113aa41627b627283271b1441f6762c7553c9518cd510a6ea5aeb3e393c5884b/113aa41627b627283271b1441f6762c7553c9518cd510a6ea5aeb3e393c5884b-json.log",
"Name": "/old-k8s-version-130660",
"RestartCount": 0,
"Driver": "overlay2",
"Platform": "linux",
"MountLabel": "",
"ProcessLabel": "",
"AppArmorProfile": "unconfined",
"ExecIDs": null,
"HostConfig": {
"Binds": [
"/lib/modules:/lib/modules:ro",
"old-k8s-version-130660:/var"
],
"ContainerIDFile": "",
"LogConfig": {
"Type": "json-file",
"Config": {}
},
"NetworkMode": "old-k8s-version-130660",
"PortBindings": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
]
},
"RestartPolicy": {
"Name": "no",
"MaximumRetryCount": 0
},
"AutoRemove": false,
"VolumeDriver": "",
"VolumesFrom": null,
"ConsoleSize": [
0,
0
],
"CapAdd": null,
"CapDrop": null,
"CgroupnsMode": "host",
"Dns": [],
"DnsOptions": [],
"DnsSearch": [],
"ExtraHosts": null,
"GroupAdd": null,
"IpcMode": "private",
"Cgroup": "",
"Links": null,
"OomScoreAdj": 0,
"PidMode": "",
"Privileged": true,
"PublishAllPorts": false,
"ReadonlyRootfs": false,
"SecurityOpt": [
"seccomp=unconfined",
"apparmor=unconfined",
"label=disable"
],
"Tmpfs": {
"/run": "",
"/tmp": ""
},
"UTSMode": "",
"UsernsMode": "",
"ShmSize": 67108864,
"Runtime": "runc",
"Isolation": "",
"CpuShares": 0,
"Memory": 2306867200,
"NanoCpus": 2000000000,
"CgroupParent": "",
"BlkioWeight": 0,
"BlkioWeightDevice": [],
"BlkioDeviceReadBps": [],
"BlkioDeviceWriteBps": [],
"BlkioDeviceReadIOps": [],
"BlkioDeviceWriteIOps": [],
"CpuPeriod": 0,
"CpuQuota": 0,
"CpuRealtimePeriod": 0,
"CpuRealtimeRuntime": 0,
"CpusetCpus": "",
"CpusetMems": "",
"Devices": [],
"DeviceCgroupRules": null,
"DeviceRequests": null,
"MemoryReservation": 0,
"MemorySwap": 4613734400,
"MemorySwappiness": null,
"OomKillDisable": false,
"PidsLimit": null,
"Ulimits": [],
"CpuCount": 0,
"CpuPercent": 0,
"IOMaximumIOps": 0,
"IOMaximumBandwidth": 0,
"MaskedPaths": null,
"ReadonlyPaths": null
},
"GraphDriver": {
"Data": {
"LowerDir": "/var/lib/docker/overlay2/1f19ddf8372dcb83a3355044ece73dd52a1c30025dd4af40f52a993d25961f03-init/diff:/var/lib/docker/overlay2/a3c8edb55465dd5b1044de542fb24c31e00154ba5ba4e9841112d37a01d06a98/diff",
"MergedDir": "/var/lib/docker/overlay2/1f19ddf8372dcb83a3355044ece73dd52a1c30025dd4af40f52a993d25961f03/merged",
"UpperDir": "/var/lib/docker/overlay2/1f19ddf8372dcb83a3355044ece73dd52a1c30025dd4af40f52a993d25961f03/diff",
"WorkDir": "/var/lib/docker/overlay2/1f19ddf8372dcb83a3355044ece73dd52a1c30025dd4af40f52a993d25961f03/work"
},
"Name": "overlay2"
},
"Mounts": [
{
"Type": "bind",
"Source": "/lib/modules",
"Destination": "/lib/modules",
"Mode": "ro",
"RW": false,
"Propagation": "rprivate"
},
{
"Type": "volume",
"Name": "old-k8s-version-130660",
"Source": "/var/lib/docker/volumes/old-k8s-version-130660/_data",
"Destination": "/var",
"Driver": "local",
"Mode": "z",
"RW": true,
"Propagation": ""
}
],
"Config": {
"Hostname": "old-k8s-version-130660",
"Domainname": "",
"User": "",
"AttachStdin": false,
"AttachStdout": false,
"AttachStderr": false,
"ExposedPorts": {
"22/tcp": {},
"2376/tcp": {},
"32443/tcp": {},
"5000/tcp": {},
"8443/tcp": {}
},
"Tty": true,
"OpenStdin": false,
"StdinOnce": false,
"Env": [
"container=docker",
"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
],
"Cmd": null,
"Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7",
"Volumes": null,
"WorkingDir": "/",
"Entrypoint": [
"/usr/local/bin/entrypoint",
"/sbin/init"
],
"OnBuild": null,
"Labels": {
"created_by.minikube.sigs.k8s.io": "true",
"mode.minikube.sigs.k8s.io": "old-k8s-version-130660",
"name.minikube.sigs.k8s.io": "old-k8s-version-130660",
"role.minikube.sigs.k8s.io": ""
},
"StopSignal": "SIGRTMIN+3"
},
"NetworkSettings": {
"Bridge": "",
"SandboxID": "2e670b72156ddd331573c487209fc7eaa98204c9ca1bcb6728c714f9a1c0ceea",
"SandboxKey": "/var/run/docker/netns/2e670b72156d",
"Ports": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "34971"
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "34972"
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "34975"
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "34973"
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "34974"
}
]
},
"HairpinMode": false,
"LinkLocalIPv6Address": "",
"LinkLocalIPv6PrefixLen": 0,
"SecondaryIPAddresses": null,
"SecondaryIPv6Addresses": null,
"EndpointID": "",
"Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"IPAddress": "",
"IPPrefixLen": 0,
"IPv6Gateway": "",
"MacAddress": "",
"Networks": {
"old-k8s-version-130660": {
"IPAMConfig": {
"IPv4Address": "192.168.76.2"
},
"Links": null,
"Aliases": null,
"MacAddress": "02:42:c0:a8:4c:02",
"DriverOpts": null,
"NetworkID": "ad2d90793e0afb82e8d6c67a260b43aa4c527904541179831a171f65e50d2bea",
"EndpointID": "930abddff8199ae77386e9f06da4e1453e9588a4fb29ba7be6e0a896b3959db0",
"Gateway": "192.168.76.1",
"IPAddress": "192.168.76.2",
"IPPrefixLen": 24,
"IPv6Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"DNSNames": [
"old-k8s-version-130660",
"113aa41627b6"
]
}
}
}
}
]
-- /stdout --
helpers_test.go:239: (dbg) Run: out/minikube-linux-arm64 status --format={{.Host}} -p old-k8s-version-130660 -n old-k8s-version-130660
helpers_test.go:244: <<< TestStartStop/group/old-k8s-version/serial/SecondStart FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: minikube logs <======
helpers_test.go:247: (dbg) Run: out/minikube-linux-arm64 -p old-k8s-version-130660 logs -n 25
E0731 23:40:55.295443 1584615 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19360-1579223/.minikube/profiles/flannel-570273/client.crt: no such file or directory
helpers_test.go:247: (dbg) Done: out/minikube-linux-arm64 -p old-k8s-version-130660 logs -n 25: (1.458857025s)
helpers_test.go:252: TestStartStop/group/old-k8s-version/serial/SecondStart logs:
-- stdout --
==> Audit <==
|---------|--------------------------------------------------------|------------------------|---------|---------|---------------------|---------------------|
| Command | Args | Profile | User | Version | Start Time | End Time |
|---------|--------------------------------------------------------|------------------------|---------|---------|---------------------|---------------------|
| ssh | -p bridge-570273 sudo cat | bridge-570273 | jenkins | v1.33.1 | 31 Jul 24 23:32 UTC | 31 Jul 24 23:32 UTC |
| | /lib/systemd/system/containerd.service | | | | | |
| ssh | -p bridge-570273 sudo cat | bridge-570273 | jenkins | v1.33.1 | 31 Jul 24 23:32 UTC | 31 Jul 24 23:32 UTC |
| | /etc/containerd/config.toml | | | | | |
| ssh | -p bridge-570273 sudo | bridge-570273 | jenkins | v1.33.1 | 31 Jul 24 23:32 UTC | 31 Jul 24 23:32 UTC |
| | containerd config dump | | | | | |
| ssh | -p bridge-570273 sudo | bridge-570273 | jenkins | v1.33.1 | 31 Jul 24 23:32 UTC | 31 Jul 24 23:32 UTC |
| | systemctl status crio --all | | | | | |
| | --full --no-pager | | | | | |
| ssh | -p bridge-570273 sudo | bridge-570273 | jenkins | v1.33.1 | 31 Jul 24 23:32 UTC | 31 Jul 24 23:32 UTC |
| | systemctl cat crio --no-pager | | | | | |
| ssh | -p bridge-570273 sudo find | bridge-570273 | jenkins | v1.33.1 | 31 Jul 24 23:32 UTC | 31 Jul 24 23:32 UTC |
| | /etc/crio -type f -exec sh -c | | | | | |
| | 'echo {}; cat {}' \; | | | | | |
| ssh | -p bridge-570273 sudo crio | bridge-570273 | jenkins | v1.33.1 | 31 Jul 24 23:32 UTC | 31 Jul 24 23:32 UTC |
| | config | | | | | |
| delete | -p bridge-570273 | bridge-570273 | jenkins | v1.33.1 | 31 Jul 24 23:32 UTC | 31 Jul 24 23:32 UTC |
| start | -p no-preload-637585 --memory=2200 | no-preload-637585 | jenkins | v1.33.1 | 31 Jul 24 23:32 UTC | 31 Jul 24 23:33 UTC |
| | --alsologtostderr --wait=true | | | | | |
| | --preload=false --driver=docker | | | | | |
| | --container-runtime=crio | | | | | |
| | --kubernetes-version=v1.31.0-beta.0 | | | | | |
| addons | enable metrics-server -p no-preload-637585 | no-preload-637585 | jenkins | v1.33.1 | 31 Jul 24 23:34 UTC | 31 Jul 24 23:34 UTC |
| | --images=MetricsServer=registry.k8s.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| stop | -p no-preload-637585 | no-preload-637585 | jenkins | v1.33.1 | 31 Jul 24 23:34 UTC | 31 Jul 24 23:34 UTC |
| | --alsologtostderr -v=3 | | | | | |
| addons | enable dashboard -p no-preload-637585 | no-preload-637585 | jenkins | v1.33.1 | 31 Jul 24 23:34 UTC | 31 Jul 24 23:34 UTC |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| start | -p no-preload-637585 --memory=2200 | no-preload-637585 | jenkins | v1.33.1 | 31 Jul 24 23:34 UTC | 31 Jul 24 23:39 UTC |
| | --alsologtostderr --wait=true | | | | | |
| | --preload=false --driver=docker | | | | | |
| | --container-runtime=crio | | | | | |
| | --kubernetes-version=v1.31.0-beta.0 | | | | | |
| addons | enable metrics-server -p old-k8s-version-130660 | old-k8s-version-130660 | jenkins | v1.33.1 | 31 Jul 24 23:34 UTC | 31 Jul 24 23:34 UTC |
| | --images=MetricsServer=registry.k8s.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| stop | -p old-k8s-version-130660 | old-k8s-version-130660 | jenkins | v1.33.1 | 31 Jul 24 23:34 UTC | 31 Jul 24 23:34 UTC |
| | --alsologtostderr -v=3 | | | | | |
| addons | enable dashboard -p old-k8s-version-130660 | old-k8s-version-130660 | jenkins | v1.33.1 | 31 Jul 24 23:34 UTC | 31 Jul 24 23:34 UTC |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| start | -p old-k8s-version-130660 | old-k8s-version-130660 | jenkins | v1.33.1 | 31 Jul 24 23:34 UTC | |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --kvm-network=default | | | | | |
| | --kvm-qemu-uri=qemu:///system | | | | | |
| | --disable-driver-mounts | | | | | |
| | --keep-context=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=crio | | | | | |
| | --kubernetes-version=v1.20.0 | | | | | |
| image | no-preload-637585 image list | no-preload-637585 | jenkins | v1.33.1 | 31 Jul 24 23:39 UTC | 31 Jul 24 23:39 UTC |
| | --format=json | | | | | |
| pause | -p no-preload-637585 | no-preload-637585 | jenkins | v1.33.1 | 31 Jul 24 23:39 UTC | 31 Jul 24 23:39 UTC |
| | --alsologtostderr -v=1 | | | | | |
| unpause | -p no-preload-637585 | no-preload-637585 | jenkins | v1.33.1 | 31 Jul 24 23:39 UTC | 31 Jul 24 23:39 UTC |
| | --alsologtostderr -v=1 | | | | | |
| delete | -p no-preload-637585 | no-preload-637585 | jenkins | v1.33.1 | 31 Jul 24 23:39 UTC | 31 Jul 24 23:39 UTC |
| delete | -p no-preload-637585 | no-preload-637585 | jenkins | v1.33.1 | 31 Jul 24 23:39 UTC | 31 Jul 24 23:39 UTC |
| start | -p embed-certs-442076 | embed-certs-442076 | jenkins | v1.33.1 | 31 Jul 24 23:39 UTC | 31 Jul 24 23:40 UTC |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --embed-certs --driver=docker | | | | | |
| | --container-runtime=crio | | | | | |
| | --kubernetes-version=v1.30.3 | | | | | |
| addons | enable metrics-server -p embed-certs-442076 | embed-certs-442076 | jenkins | v1.33.1 | 31 Jul 24 23:40 UTC | 31 Jul 24 23:40 UTC |
| | --images=MetricsServer=registry.k8s.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| stop | -p embed-certs-442076 | embed-certs-442076 | jenkins | v1.33.1 | 31 Jul 24 23:40 UTC | |
| | --alsologtostderr -v=3 | | | | | |
|---------|--------------------------------------------------------|------------------------|---------|---------|---------------------|---------------------|
==> Last Start <==
Log file created at: 2024/07/31 23:39:33
Running on machine: ip-172-31-31-251
Binary: Built with gc go1.22.5 for linux/arm64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I0731 23:39:33.490791 1834111 out.go:291] Setting OutFile to fd 1 ...
I0731 23:39:33.490966 1834111 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0731 23:39:33.490975 1834111 out.go:304] Setting ErrFile to fd 2...
I0731 23:39:33.490982 1834111 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0731 23:39:33.491207 1834111 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19360-1579223/.minikube/bin
I0731 23:39:33.491591 1834111 out.go:298] Setting JSON to false
I0731 23:39:33.492611 1834111 start.go:129] hostinfo: {"hostname":"ip-172-31-31-251","uptime":26512,"bootTime":1722442662,"procs":209,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1066-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"982e3628-3742-4b3e-bb63-ac1b07660ec7"}
I0731 23:39:33.492679 1834111 start.go:139] virtualization:
I0731 23:39:33.495829 1834111 out.go:177] * [embed-certs-442076] minikube v1.33.1 on Ubuntu 20.04 (arm64)
I0731 23:39:33.498529 1834111 out.go:177] - MINIKUBE_LOCATION=19360
I0731 23:39:33.499508 1834111 notify.go:220] Checking for updates...
I0731 23:39:33.502491 1834111 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0731 23:39:33.504502 1834111 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/19360-1579223/kubeconfig
I0731 23:39:33.506721 1834111 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/19360-1579223/.minikube
I0731 23:39:33.508677 1834111 out.go:177] - MINIKUBE_BIN=out/minikube-linux-arm64
I0731 23:39:33.510568 1834111 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0731 23:39:33.512834 1834111 config.go:182] Loaded profile config "old-k8s-version-130660": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0731 23:39:33.512932 1834111 driver.go:392] Setting default libvirt URI to qemu:///system
I0731 23:39:33.535358 1834111 docker.go:123] docker version: linux-27.1.1:Docker Engine - Community
I0731 23:39:33.535480 1834111 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0731 23:39:33.612215 1834111 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:34 OomKillDisable:true NGoroutines:53 SystemTime:2024-07-31 23:39:33.601736505 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1066-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214900736 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:27.1.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41 Expected:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.16.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.1]] Warnings:<nil>}}
I0731 23:39:33.613344 1834111 docker.go:307] overlay module found
I0731 23:39:33.615366 1834111 out.go:177] * Using the docker driver based on user configuration
I0731 23:39:33.617330 1834111 start.go:297] selected driver: docker
I0731 23:39:33.617347 1834111 start.go:901] validating driver "docker" against <nil>
I0731 23:39:33.617362 1834111 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0731 23:39:33.618012 1834111 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0731 23:39:33.682348 1834111 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:34 OomKillDisable:true NGoroutines:53 SystemTime:2024-07-31 23:39:33.6727252 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1066-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aarch
64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214900736 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:27.1.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41 Expected:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErrors
:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.16.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.1]] Warnings:<nil>}}
I0731 23:39:33.682533 1834111 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0731 23:39:33.682782 1834111 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0731 23:39:33.685166 1834111 out.go:177] * Using Docker driver with root privileges
I0731 23:39:33.687414 1834111 cni.go:84] Creating CNI manager for ""
I0731 23:39:33.687439 1834111 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
I0731 23:39:33.687451 1834111 start_flags.go:319] Found "CNI" CNI - setting NetworkPlugin=cni
I0731 23:39:33.687551 1834111 start.go:340] cluster config:
{Name:embed-certs-442076 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.3 ClusterName:embed-certs-442076 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Contain
erRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuth
Sock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0731 23:39:33.689851 1834111 out.go:177] * Starting "embed-certs-442076" primary control-plane node in "embed-certs-442076" cluster
I0731 23:39:33.692164 1834111 cache.go:121] Beginning downloading kic base image for docker with crio
I0731 23:39:33.694389 1834111 out.go:177] * Pulling base image v0.0.44-1721902582-19326 ...
I0731 23:39:33.696643 1834111 preload.go:131] Checking if preload exists for k8s version v1.30.3 and runtime crio
I0731 23:39:33.696698 1834111 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19360-1579223/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.3-cri-o-overlay-arm64.tar.lz4
I0731 23:39:33.696710 1834111 cache.go:56] Caching tarball of preloaded images
I0731 23:39:33.696768 1834111 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 in local docker daemon
I0731 23:39:33.696793 1834111 preload.go:172] Found /home/jenkins/minikube-integration/19360-1579223/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.3-cri-o-overlay-arm64.tar.lz4 in cache, skipping download
I0731 23:39:33.696803 1834111 cache.go:59] Finished verifying existence of preloaded tar for v1.30.3 on crio
I0731 23:39:33.696908 1834111 profile.go:143] Saving config to /home/jenkins/minikube-integration/19360-1579223/.minikube/profiles/embed-certs-442076/config.json ...
I0731 23:39:33.696925 1834111 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19360-1579223/.minikube/profiles/embed-certs-442076/config.json: {Name:mk05c497e83cce4dbc0b049befb1cc6b6da976a3 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
W0731 23:39:33.716938 1834111 image.go:95] image gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 is of wrong architecture
I0731 23:39:33.716964 1834111 cache.go:149] Downloading gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 to local cache
I0731 23:39:33.717060 1834111 image.go:63] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 in local cache directory
I0731 23:39:33.717082 1834111 image.go:66] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 in local cache directory, skipping pull
I0731 23:39:33.717087 1834111 image.go:135] gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 exists in cache, skipping pull
I0731 23:39:33.717128 1834111 cache.go:152] successfully saved gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 as a tarball
I0731 23:39:33.717135 1834111 cache.go:162] Loading gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 from local cache
I0731 23:39:33.846435 1834111 cache.go:164] successfully loaded and using gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 from cached tarball
I0731 23:39:33.846471 1834111 cache.go:194] Successfully downloaded all kic artifacts
I0731 23:39:33.846513 1834111 start.go:360] acquireMachinesLock for embed-certs-442076: {Name:mk55f3a1ee9136bd0ac98e642686547e3861f047 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0731 23:39:33.847239 1834111 start.go:364] duration metric: took 699.575µs to acquireMachinesLock for "embed-certs-442076"
I0731 23:39:33.847280 1834111 start.go:93] Provisioning new machine with config: &{Name:embed-certs-442076 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.3 ClusterName:embed-certs-442076 Namespace:default APIServerHAVIP: APIServe
rName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false
CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:crio ControlPlane:true Worker:true}
I0731 23:39:33.847370 1834111 start.go:125] createHost starting for "" (driver="docker")
I0731 23:39:34.669368 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:39:37.168209 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:39:33.851251 1834111 out.go:204] * Creating docker container (CPUs=2, Memory=2200MB) ...
I0731 23:39:33.851495 1834111 start.go:159] libmachine.API.Create for "embed-certs-442076" (driver="docker")
I0731 23:39:33.851538 1834111 client.go:168] LocalClient.Create starting
I0731 23:39:33.851623 1834111 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19360-1579223/.minikube/certs/ca.pem
I0731 23:39:33.851663 1834111 main.go:141] libmachine: Decoding PEM data...
I0731 23:39:33.851683 1834111 main.go:141] libmachine: Parsing certificate...
I0731 23:39:33.851745 1834111 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19360-1579223/.minikube/certs/cert.pem
I0731 23:39:33.851768 1834111 main.go:141] libmachine: Decoding PEM data...
I0731 23:39:33.851793 1834111 main.go:141] libmachine: Parsing certificate...
I0731 23:39:33.852177 1834111 cli_runner.go:164] Run: docker network inspect embed-certs-442076 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
W0731 23:39:33.867053 1834111 cli_runner.go:211] docker network inspect embed-certs-442076 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
I0731 23:39:33.867155 1834111 network_create.go:284] running [docker network inspect embed-certs-442076] to gather additional debugging logs...
I0731 23:39:33.867176 1834111 cli_runner.go:164] Run: docker network inspect embed-certs-442076
W0731 23:39:33.882442 1834111 cli_runner.go:211] docker network inspect embed-certs-442076 returned with exit code 1
I0731 23:39:33.882482 1834111 network_create.go:287] error running [docker network inspect embed-certs-442076]: docker network inspect embed-certs-442076: exit status 1
stdout:
[]
stderr:
Error response from daemon: network embed-certs-442076 not found
I0731 23:39:33.882495 1834111 network_create.go:289] output of [docker network inspect embed-certs-442076]: -- stdout --
[]
-- /stdout --
** stderr **
Error response from daemon: network embed-certs-442076 not found
** /stderr **
I0731 23:39:33.882600 1834111 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0731 23:39:33.899486 1834111 network.go:211] skipping subnet 192.168.49.0/24 that is taken: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName:br-6f1e4293cdc4 IfaceIPv4:192.168.49.1 IfaceMTU:1500 IfaceMAC:02:42:71:39:fb:ee} reservation:<nil>}
I0731 23:39:33.899867 1834111 network.go:211] skipping subnet 192.168.58.0/24 that is taken: &{IP:192.168.58.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.58.0/24 Gateway:192.168.58.1 ClientMin:192.168.58.2 ClientMax:192.168.58.254 Broadcast:192.168.58.255 IsPrivate:true Interface:{IfaceName:br-81a9ef350509 IfaceIPv4:192.168.58.1 IfaceMTU:1500 IfaceMAC:02:42:a6:64:66:d4} reservation:<nil>}
I0731 23:39:33.900290 1834111 network.go:211] skipping subnet 192.168.67.0/24 that is taken: &{IP:192.168.67.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.67.0/24 Gateway:192.168.67.1 ClientMin:192.168.67.2 ClientMax:192.168.67.254 Broadcast:192.168.67.255 IsPrivate:true Interface:{IfaceName:br-9077c8841468 IfaceIPv4:192.168.67.1 IfaceMTU:1500 IfaceMAC:02:42:5f:f6:fa:5c} reservation:<nil>}
I0731 23:39:33.900706 1834111 network.go:211] skipping subnet 192.168.76.0/24 that is taken: &{IP:192.168.76.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.76.0/24 Gateway:192.168.76.1 ClientMin:192.168.76.2 ClientMax:192.168.76.254 Broadcast:192.168.76.255 IsPrivate:true Interface:{IfaceName:br-ad2d90793e0a IfaceIPv4:192.168.76.1 IfaceMTU:1500 IfaceMAC:02:42:04:19:5e:26} reservation:<nil>}
I0731 23:39:33.901265 1834111 network.go:206] using free private subnet 192.168.85.0/24: &{IP:192.168.85.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.85.0/24 Gateway:192.168.85.1 ClientMin:192.168.85.2 ClientMax:192.168.85.254 Broadcast:192.168.85.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0x4001843f10}
I0731 23:39:33.901306 1834111 network_create.go:124] attempt to create docker network embed-certs-442076 192.168.85.0/24 with gateway 192.168.85.1 and MTU of 1500 ...
I0731 23:39:33.901402 1834111 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.85.0/24 --gateway=192.168.85.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=embed-certs-442076 embed-certs-442076
I0731 23:39:33.970523 1834111 network_create.go:108] docker network embed-certs-442076 192.168.85.0/24 created
I0731 23:39:33.970564 1834111 kic.go:121] calculated static IP "192.168.85.2" for the "embed-certs-442076" container
I0731 23:39:33.970655 1834111 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
I0731 23:39:33.991583 1834111 cli_runner.go:164] Run: docker volume create embed-certs-442076 --label name.minikube.sigs.k8s.io=embed-certs-442076 --label created_by.minikube.sigs.k8s.io=true
I0731 23:39:34.021559 1834111 oci.go:103] Successfully created a docker volume embed-certs-442076
I0731 23:39:34.021671 1834111 cli_runner.go:164] Run: docker run --rm --name embed-certs-442076-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=embed-certs-442076 --entrypoint /usr/bin/test -v embed-certs-442076:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 -d /var/lib
I0731 23:39:34.722484 1834111 oci.go:107] Successfully prepared a docker volume embed-certs-442076
I0731 23:39:34.722535 1834111 preload.go:131] Checking if preload exists for k8s version v1.30.3 and runtime crio
I0731 23:39:34.722558 1834111 kic.go:194] Starting extracting preloaded images to volume ...
I0731 23:39:34.722648 1834111 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/19360-1579223/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.3-cri-o-overlay-arm64.tar.lz4:/preloaded.tar:ro -v embed-certs-442076:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 -I lz4 -xf /preloaded.tar -C /extractDir
I0731 23:39:39.730387 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:39:42.169022 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:39:40.561849 1834111 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/19360-1579223/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.3-cri-o-overlay-arm64.tar.lz4:/preloaded.tar:ro -v embed-certs-442076:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 -I lz4 -xf /preloaded.tar -C /extractDir: (5.839160829s)
I0731 23:39:40.561885 1834111 kic.go:203] duration metric: took 5.839323192s to extract preloaded images to volume ...
W0731 23:39:40.562028 1834111 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
I0731 23:39:40.562145 1834111 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
I0731 23:39:40.615978 1834111 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname embed-certs-442076 --name embed-certs-442076 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=embed-certs-442076 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=embed-certs-442076 --network embed-certs-442076 --ip 192.168.85.2 --volume embed-certs-442076:/var --security-opt apparmor=unconfined --memory=2200mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7
I0731 23:39:40.956487 1834111 cli_runner.go:164] Run: docker container inspect embed-certs-442076 --format={{.State.Running}}
I0731 23:39:40.979148 1834111 cli_runner.go:164] Run: docker container inspect embed-certs-442076 --format={{.State.Status}}
I0731 23:39:41.017834 1834111 cli_runner.go:164] Run: docker exec embed-certs-442076 stat /var/lib/dpkg/alternatives/iptables
I0731 23:39:41.081998 1834111 oci.go:144] the created container "embed-certs-442076" has a running status.
I0731 23:39:41.082028 1834111 kic.go:225] Creating ssh key for kic: /home/jenkins/minikube-integration/19360-1579223/.minikube/machines/embed-certs-442076/id_rsa...
I0731 23:39:41.329175 1834111 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/19360-1579223/.minikube/machines/embed-certs-442076/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
I0731 23:39:41.349474 1834111 cli_runner.go:164] Run: docker container inspect embed-certs-442076 --format={{.State.Status}}
I0731 23:39:41.384125 1834111 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
I0731 23:39:41.384145 1834111 kic_runner.go:114] Args: [docker exec --privileged embed-certs-442076 chown docker:docker /home/docker/.ssh/authorized_keys]
I0731 23:39:41.454898 1834111 cli_runner.go:164] Run: docker container inspect embed-certs-442076 --format={{.State.Status}}
I0731 23:39:41.475627 1834111 machine.go:94] provisionDockerMachine start ...
I0731 23:39:41.475712 1834111 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-442076
I0731 23:39:41.496548 1834111 main.go:141] libmachine: Using SSH client type: native
I0731 23:39:41.496819 1834111 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2cd0] 0x3e5530 <nil> [] 0s} 127.0.0.1 34976 <nil> <nil>}
I0731 23:39:41.496828 1834111 main.go:141] libmachine: About to run SSH command:
hostname
I0731 23:39:41.497554 1834111 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:51278->127.0.0.1:34976: read: connection reset by peer
I0731 23:39:44.668803 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:39:47.168065 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:39:44.632485 1834111 main.go:141] libmachine: SSH cmd err, output: <nil>: embed-certs-442076
I0731 23:39:44.632512 1834111 ubuntu.go:169] provisioning hostname "embed-certs-442076"
I0731 23:39:44.632578 1834111 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-442076
I0731 23:39:44.649708 1834111 main.go:141] libmachine: Using SSH client type: native
I0731 23:39:44.649961 1834111 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2cd0] 0x3e5530 <nil> [] 0s} 127.0.0.1 34976 <nil> <nil>}
I0731 23:39:44.649979 1834111 main.go:141] libmachine: About to run SSH command:
sudo hostname embed-certs-442076 && echo "embed-certs-442076" | sudo tee /etc/hostname
I0731 23:39:44.801489 1834111 main.go:141] libmachine: SSH cmd err, output: <nil>: embed-certs-442076
I0731 23:39:44.801566 1834111 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-442076
I0731 23:39:44.819758 1834111 main.go:141] libmachine: Using SSH client type: native
I0731 23:39:44.820012 1834111 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2cd0] 0x3e5530 <nil> [] 0s} 127.0.0.1 34976 <nil> <nil>}
I0731 23:39:44.820028 1834111 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sembed-certs-442076' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 embed-certs-442076/g' /etc/hosts;
else
echo '127.0.1.1 embed-certs-442076' | sudo tee -a /etc/hosts;
fi
fi
I0731 23:39:44.961859 1834111 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0731 23:39:44.961887 1834111 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/19360-1579223/.minikube CaCertPath:/home/jenkins/minikube-integration/19360-1579223/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19360-1579223/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19360-1579223/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19360-1579223/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19360-1579223/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19360-1579223/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19360-1579223/.minikube}
I0731 23:39:44.961915 1834111 ubuntu.go:177] setting up certificates
I0731 23:39:44.961924 1834111 provision.go:84] configureAuth start
I0731 23:39:44.961987 1834111 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-442076
I0731 23:39:44.979355 1834111 provision.go:143] copyHostCerts
I0731 23:39:44.979430 1834111 exec_runner.go:144] found /home/jenkins/minikube-integration/19360-1579223/.minikube/cert.pem, removing ...
I0731 23:39:44.979444 1834111 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19360-1579223/.minikube/cert.pem
I0731 23:39:44.979527 1834111 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19360-1579223/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19360-1579223/.minikube/cert.pem (1123 bytes)
I0731 23:39:44.979665 1834111 exec_runner.go:144] found /home/jenkins/minikube-integration/19360-1579223/.minikube/key.pem, removing ...
I0731 23:39:44.979675 1834111 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19360-1579223/.minikube/key.pem
I0731 23:39:44.979703 1834111 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19360-1579223/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19360-1579223/.minikube/key.pem (1679 bytes)
I0731 23:39:44.979777 1834111 exec_runner.go:144] found /home/jenkins/minikube-integration/19360-1579223/.minikube/ca.pem, removing ...
I0731 23:39:44.979787 1834111 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19360-1579223/.minikube/ca.pem
I0731 23:39:44.979814 1834111 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19360-1579223/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19360-1579223/.minikube/ca.pem (1082 bytes)
I0731 23:39:44.979877 1834111 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19360-1579223/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19360-1579223/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19360-1579223/.minikube/certs/ca-key.pem org=jenkins.embed-certs-442076 san=[127.0.0.1 192.168.85.2 embed-certs-442076 localhost minikube]
I0731 23:39:45.275615 1834111 provision.go:177] copyRemoteCerts
I0731 23:39:45.275702 1834111 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0731 23:39:45.275782 1834111 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-442076
I0731 23:39:45.296278 1834111 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34976 SSHKeyPath:/home/jenkins/minikube-integration/19360-1579223/.minikube/machines/embed-certs-442076/id_rsa Username:docker}
I0731 23:39:45.402917 1834111 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19360-1579223/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
I0731 23:39:45.431419 1834111 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19360-1579223/.minikube/machines/server.pem --> /etc/docker/server.pem (1224 bytes)
I0731 23:39:45.460670 1834111 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19360-1579223/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0731 23:39:45.488937 1834111 provision.go:87] duration metric: took 526.998981ms to configureAuth
I0731 23:39:45.488964 1834111 ubuntu.go:193] setting minikube options for container-runtime
I0731 23:39:45.489237 1834111 config.go:182] Loaded profile config "embed-certs-442076": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.30.3
I0731 23:39:45.489351 1834111 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-442076
I0731 23:39:45.505573 1834111 main.go:141] libmachine: Using SSH client type: native
I0731 23:39:45.505837 1834111 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2cd0] 0x3e5530 <nil> [] 0s} 127.0.0.1 34976 <nil> <nil>}
I0731 23:39:45.505859 1834111 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %!s(MISSING) "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0731 23:39:45.852654 1834111 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0731 23:39:45.852726 1834111 machine.go:97] duration metric: took 4.377080669s to provisionDockerMachine
I0731 23:39:45.852751 1834111 client.go:171] duration metric: took 12.001198816s to LocalClient.Create
I0731 23:39:45.852784 1834111 start.go:167] duration metric: took 12.001289515s to libmachine.API.Create "embed-certs-442076"
I0731 23:39:45.852827 1834111 start.go:293] postStartSetup for "embed-certs-442076" (driver="docker")
I0731 23:39:45.852854 1834111 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0731 23:39:45.852966 1834111 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0731 23:39:45.853041 1834111 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-442076
I0731 23:39:45.869715 1834111 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34976 SSHKeyPath:/home/jenkins/minikube-integration/19360-1579223/.minikube/machines/embed-certs-442076/id_rsa Username:docker}
I0731 23:39:45.967760 1834111 ssh_runner.go:195] Run: cat /etc/os-release
I0731 23:39:45.971677 1834111 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0731 23:39:45.971711 1834111 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0731 23:39:45.971721 1834111 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0731 23:39:45.971728 1834111 info.go:137] Remote host: Ubuntu 22.04.4 LTS
I0731 23:39:45.971748 1834111 filesync.go:126] Scanning /home/jenkins/minikube-integration/19360-1579223/.minikube/addons for local assets ...
I0731 23:39:45.971817 1834111 filesync.go:126] Scanning /home/jenkins/minikube-integration/19360-1579223/.minikube/files for local assets ...
I0731 23:39:45.971924 1834111 filesync.go:149] local asset: /home/jenkins/minikube-integration/19360-1579223/.minikube/files/etc/ssl/certs/15846152.pem -> 15846152.pem in /etc/ssl/certs
I0731 23:39:45.972036 1834111 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0731 23:39:45.984638 1834111 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19360-1579223/.minikube/files/etc/ssl/certs/15846152.pem --> /etc/ssl/certs/15846152.pem (1708 bytes)
I0731 23:39:46.013796 1834111 start.go:296] duration metric: took 160.938288ms for postStartSetup
I0731 23:39:46.014230 1834111 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-442076
I0731 23:39:46.031953 1834111 profile.go:143] Saving config to /home/jenkins/minikube-integration/19360-1579223/.minikube/profiles/embed-certs-442076/config.json ...
I0731 23:39:46.032258 1834111 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0731 23:39:46.032310 1834111 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-442076
I0731 23:39:46.048937 1834111 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34976 SSHKeyPath:/home/jenkins/minikube-integration/19360-1579223/.minikube/machines/embed-certs-442076/id_rsa Username:docker}
I0731 23:39:46.141995 1834111 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I0731 23:39:46.146593 1834111 start.go:128] duration metric: took 12.299205507s to createHost
I0731 23:39:46.146657 1834111 start.go:83] releasing machines lock for "embed-certs-442076", held for 12.299400575s
I0731 23:39:46.146754 1834111 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-442076
I0731 23:39:46.165792 1834111 ssh_runner.go:195] Run: cat /version.json
I0731 23:39:46.165844 1834111 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-442076
I0731 23:39:46.166270 1834111 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0731 23:39:46.166348 1834111 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-442076
I0731 23:39:46.187484 1834111 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34976 SSHKeyPath:/home/jenkins/minikube-integration/19360-1579223/.minikube/machines/embed-certs-442076/id_rsa Username:docker}
I0731 23:39:46.190008 1834111 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34976 SSHKeyPath:/home/jenkins/minikube-integration/19360-1579223/.minikube/machines/embed-certs-442076/id_rsa Username:docker}
I0731 23:39:46.276389 1834111 ssh_runner.go:195] Run: systemctl --version
I0731 23:39:46.408885 1834111 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0731 23:39:46.558925 1834111 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I0731 23:39:46.563912 1834111 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0731 23:39:46.587932 1834111 cni.go:221] loopback cni configuration disabled: "/etc/cni/net.d/*loopback.conf*" found
I0731 23:39:46.588053 1834111 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0731 23:39:46.628244 1834111 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist, /etc/cni/net.d/100-crio-bridge.conf] bridge cni config(s)
I0731 23:39:46.628269 1834111 start.go:495] detecting cgroup driver to use...
I0731 23:39:46.628302 1834111 detect.go:187] detected "cgroupfs" cgroup driver on host os
I0731 23:39:46.628366 1834111 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0731 23:39:46.644686 1834111 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0731 23:39:46.656852 1834111 docker.go:217] disabling cri-docker service (if available) ...
I0731 23:39:46.656927 1834111 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0731 23:39:46.676752 1834111 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0731 23:39:46.695070 1834111 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0731 23:39:46.798268 1834111 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0731 23:39:46.904476 1834111 docker.go:233] disabling docker service ...
I0731 23:39:46.904571 1834111 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0731 23:39:46.928879 1834111 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0731 23:39:46.941888 1834111 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0731 23:39:47.039788 1834111 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0731 23:39:47.132523 1834111 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0731 23:39:47.146022 1834111 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0731 23:39:47.165468 1834111 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.9" pause image...
I0731 23:39:47.165587 1834111 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.9"|' /etc/crio/crio.conf.d/02-crio.conf"
I0731 23:39:47.178974 1834111 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0731 23:39:47.179092 1834111 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0731 23:39:47.189078 1834111 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0731 23:39:47.199268 1834111 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0731 23:39:47.210136 1834111 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0731 23:39:47.220049 1834111 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"
I0731 23:39:47.231555 1834111 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"
I0731 23:39:47.248492 1834111 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"
I0731 23:39:47.260541 1834111 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0731 23:39:47.269253 1834111 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0731 23:39:47.278124 1834111 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0731 23:39:47.361840 1834111 ssh_runner.go:195] Run: sudo systemctl restart crio
I0731 23:39:47.482928 1834111 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
I0731 23:39:47.483051 1834111 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0731 23:39:47.487267 1834111 start.go:563] Will wait 60s for crictl version
I0731 23:39:47.487376 1834111 ssh_runner.go:195] Run: which crictl
I0731 23:39:47.490738 1834111 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0731 23:39:47.531621 1834111 start.go:579] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.24.6
RuntimeApiVersion: v1
I0731 23:39:47.531786 1834111 ssh_runner.go:195] Run: crio --version
I0731 23:39:47.575537 1834111 ssh_runner.go:195] Run: crio --version
I0731 23:39:47.621512 1834111 out.go:177] * Preparing Kubernetes v1.30.3 on CRI-O 1.24.6 ...
I0731 23:39:47.623713 1834111 cli_runner.go:164] Run: docker network inspect embed-certs-442076 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0731 23:39:47.639488 1834111 ssh_runner.go:195] Run: grep 192.168.85.1 host.minikube.internal$ /etc/hosts
I0731 23:39:47.643283 1834111 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.85.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0731 23:39:47.654167 1834111 kubeadm.go:883] updating cluster {Name:embed-certs-442076 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.3 ClusterName:embed-certs-442076 Namespace:default APIServerHAVIP: APIServerName:minikubeCA AP
IServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false Custom
QemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0731 23:39:47.654292 1834111 preload.go:131] Checking if preload exists for k8s version v1.30.3 and runtime crio
I0731 23:39:47.654354 1834111 ssh_runner.go:195] Run: sudo crictl images --output json
I0731 23:39:47.734294 1834111 crio.go:514] all images are preloaded for cri-o runtime.
I0731 23:39:47.734316 1834111 crio.go:433] Images already preloaded, skipping extraction
I0731 23:39:47.734380 1834111 ssh_runner.go:195] Run: sudo crictl images --output json
I0731 23:39:47.770411 1834111 crio.go:514] all images are preloaded for cri-o runtime.
I0731 23:39:47.770435 1834111 cache_images.go:84] Images are preloaded, skipping loading
I0731 23:39:47.770443 1834111 kubeadm.go:934] updating node { 192.168.85.2 8443 v1.30.3 crio true true} ...
I0731 23:39:47.770540 1834111 kubeadm.go:946] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.30.3/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --cgroups-per-qos=false --config=/var/lib/kubelet/config.yaml --enforce-node-allocatable= --hostname-override=embed-certs-442076 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.85.2
[Install]
config:
{KubernetesVersion:v1.30.3 ClusterName:embed-certs-442076 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0731 23:39:47.770623 1834111 ssh_runner.go:195] Run: crio config
I0731 23:39:47.827409 1834111 cni.go:84] Creating CNI manager for ""
I0731 23:39:47.827435 1834111 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
I0731 23:39:47.827444 1834111 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0731 23:39:47.827470 1834111 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.85.2 APIServerPort:8443 KubernetesVersion:v1.30.3 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:embed-certs-442076 NodeName:embed-certs-442076 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.85.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.85.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/e
tc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/crio/crio.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I0731 23:39:47.827608 1834111 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta3
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.85.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///var/run/crio/crio.sock
name: "embed-certs-442076"
kubeletExtraArgs:
node-ip: 192.168.85.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta3
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.85.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.30.3
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
containerRuntimeEndpoint: unix:///var/run/crio/crio.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%!"(MISSING)
nodefs.inodesFree: "0%!"(MISSING)
imagefs.available: "0%!"(MISSING)
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0731 23:39:47.827684 1834111 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.30.3
I0731 23:39:47.836812 1834111 binaries.go:44] Found k8s binaries, skipping transfer
I0731 23:39:47.836944 1834111 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0731 23:39:47.846032 1834111 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (368 bytes)
I0731 23:39:47.868485 1834111 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0731 23:39:47.888018 1834111 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2156 bytes)
I0731 23:39:47.907906 1834111 ssh_runner.go:195] Run: grep 192.168.85.2 control-plane.minikube.internal$ /etc/hosts
I0731 23:39:47.911441 1834111 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.85.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0731 23:39:47.922431 1834111 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0731 23:39:48.015540 1834111 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0731 23:39:48.032506 1834111 certs.go:68] Setting up /home/jenkins/minikube-integration/19360-1579223/.minikube/profiles/embed-certs-442076 for IP: 192.168.85.2
I0731 23:39:48.032531 1834111 certs.go:194] generating shared ca certs ...
I0731 23:39:48.032548 1834111 certs.go:226] acquiring lock for ca certs: {Name:mk6ccdabf08b8b9bfa2ad4dfbceb108d85e42085 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0731 23:39:48.032697 1834111 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19360-1579223/.minikube/ca.key
I0731 23:39:48.032743 1834111 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19360-1579223/.minikube/proxy-client-ca.key
I0731 23:39:48.032754 1834111 certs.go:256] generating profile certs ...
I0731 23:39:48.032814 1834111 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/19360-1579223/.minikube/profiles/embed-certs-442076/client.key
I0731 23:39:48.032831 1834111 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19360-1579223/.minikube/profiles/embed-certs-442076/client.crt with IP's: []
I0731 23:39:48.361753 1834111 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19360-1579223/.minikube/profiles/embed-certs-442076/client.crt ...
I0731 23:39:48.361784 1834111 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19360-1579223/.minikube/profiles/embed-certs-442076/client.crt: {Name:mk938f7bb94214cac36924a43920d97602976c07 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0731 23:39:48.362451 1834111 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19360-1579223/.minikube/profiles/embed-certs-442076/client.key ...
I0731 23:39:48.362467 1834111 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19360-1579223/.minikube/profiles/embed-certs-442076/client.key: {Name:mke169bbae62bb8f05100383dc1211c9a59c0fa0 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0731 23:39:48.362953 1834111 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19360-1579223/.minikube/profiles/embed-certs-442076/apiserver.key.a9b1a3b7
I0731 23:39:48.362969 1834111 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19360-1579223/.minikube/profiles/embed-certs-442076/apiserver.crt.a9b1a3b7 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.85.2]
I0731 23:39:48.990133 1834111 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19360-1579223/.minikube/profiles/embed-certs-442076/apiserver.crt.a9b1a3b7 ...
I0731 23:39:48.990166 1834111 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19360-1579223/.minikube/profiles/embed-certs-442076/apiserver.crt.a9b1a3b7: {Name:mk78cdb66dc52fb58ead4cb7fb2087f5aa51dbbd Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0731 23:39:48.990927 1834111 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19360-1579223/.minikube/profiles/embed-certs-442076/apiserver.key.a9b1a3b7 ...
I0731 23:39:48.990946 1834111 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19360-1579223/.minikube/profiles/embed-certs-442076/apiserver.key.a9b1a3b7: {Name:mk2a0132d79bb1f49e5ea21f1ad57933d434cbe0 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0731 23:39:48.991037 1834111 certs.go:381] copying /home/jenkins/minikube-integration/19360-1579223/.minikube/profiles/embed-certs-442076/apiserver.crt.a9b1a3b7 -> /home/jenkins/minikube-integration/19360-1579223/.minikube/profiles/embed-certs-442076/apiserver.crt
I0731 23:39:48.991118 1834111 certs.go:385] copying /home/jenkins/minikube-integration/19360-1579223/.minikube/profiles/embed-certs-442076/apiserver.key.a9b1a3b7 -> /home/jenkins/minikube-integration/19360-1579223/.minikube/profiles/embed-certs-442076/apiserver.key
I0731 23:39:48.991189 1834111 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/19360-1579223/.minikube/profiles/embed-certs-442076/proxy-client.key
I0731 23:39:48.991215 1834111 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19360-1579223/.minikube/profiles/embed-certs-442076/proxy-client.crt with IP's: []
I0731 23:39:49.307933 1834111 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19360-1579223/.minikube/profiles/embed-certs-442076/proxy-client.crt ...
I0731 23:39:49.307969 1834111 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19360-1579223/.minikube/profiles/embed-certs-442076/proxy-client.crt: {Name:mkf8638ee681f202b320c4ca42be442e54bba924 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0731 23:39:49.308193 1834111 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19360-1579223/.minikube/profiles/embed-certs-442076/proxy-client.key ...
I0731 23:39:49.308212 1834111 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19360-1579223/.minikube/profiles/embed-certs-442076/proxy-client.key: {Name:mk5f7fd48dec2e1633535fb21dd4997032346d7f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0731 23:39:49.308943 1834111 certs.go:484] found cert: /home/jenkins/minikube-integration/19360-1579223/.minikube/certs/1584615.pem (1338 bytes)
W0731 23:39:49.308997 1834111 certs.go:480] ignoring /home/jenkins/minikube-integration/19360-1579223/.minikube/certs/1584615_empty.pem, impossibly tiny 0 bytes
I0731 23:39:49.309011 1834111 certs.go:484] found cert: /home/jenkins/minikube-integration/19360-1579223/.minikube/certs/ca-key.pem (1679 bytes)
I0731 23:39:49.309038 1834111 certs.go:484] found cert: /home/jenkins/minikube-integration/19360-1579223/.minikube/certs/ca.pem (1082 bytes)
I0731 23:39:49.309066 1834111 certs.go:484] found cert: /home/jenkins/minikube-integration/19360-1579223/.minikube/certs/cert.pem (1123 bytes)
I0731 23:39:49.309093 1834111 certs.go:484] found cert: /home/jenkins/minikube-integration/19360-1579223/.minikube/certs/key.pem (1679 bytes)
I0731 23:39:49.309165 1834111 certs.go:484] found cert: /home/jenkins/minikube-integration/19360-1579223/.minikube/files/etc/ssl/certs/15846152.pem (1708 bytes)
I0731 23:39:49.309783 1834111 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19360-1579223/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0731 23:39:49.338943 1834111 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19360-1579223/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0731 23:39:49.366092 1834111 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19360-1579223/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0731 23:39:49.391593 1834111 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19360-1579223/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0731 23:39:49.417278 1834111 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19360-1579223/.minikube/profiles/embed-certs-442076/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1428 bytes)
I0731 23:39:49.442826 1834111 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19360-1579223/.minikube/profiles/embed-certs-442076/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0731 23:39:49.468182 1834111 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19360-1579223/.minikube/profiles/embed-certs-442076/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0731 23:39:49.494797 1834111 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19360-1579223/.minikube/profiles/embed-certs-442076/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0731 23:39:49.521137 1834111 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19360-1579223/.minikube/certs/1584615.pem --> /usr/share/ca-certificates/1584615.pem (1338 bytes)
I0731 23:39:49.552824 1834111 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19360-1579223/.minikube/files/etc/ssl/certs/15846152.pem --> /usr/share/ca-certificates/15846152.pem (1708 bytes)
I0731 23:39:49.584096 1834111 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19360-1579223/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0731 23:39:49.621716 1834111 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0731 23:39:49.646191 1834111 ssh_runner.go:195] Run: openssl version
I0731 23:39:49.652697 1834111 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/1584615.pem && ln -fs /usr/share/ca-certificates/1584615.pem /etc/ssl/certs/1584615.pem"
I0731 23:39:49.664061 1834111 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/1584615.pem
I0731 23:39:49.668695 1834111 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Jul 31 22:43 /usr/share/ca-certificates/1584615.pem
I0731 23:39:49.668812 1834111 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/1584615.pem
I0731 23:39:49.677032 1834111 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/1584615.pem /etc/ssl/certs/51391683.0"
I0731 23:39:49.687881 1834111 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/15846152.pem && ln -fs /usr/share/ca-certificates/15846152.pem /etc/ssl/certs/15846152.pem"
I0731 23:39:49.698378 1834111 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/15846152.pem
I0731 23:39:49.703030 1834111 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Jul 31 22:43 /usr/share/ca-certificates/15846152.pem
I0731 23:39:49.703154 1834111 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/15846152.pem
I0731 23:39:49.712460 1834111 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/15846152.pem /etc/ssl/certs/3ec20f2e.0"
I0731 23:39:49.723352 1834111 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0731 23:39:49.734595 1834111 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0731 23:39:49.738717 1834111 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Jul 31 22:32 /usr/share/ca-certificates/minikubeCA.pem
I0731 23:39:49.738843 1834111 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0731 23:39:49.747267 1834111 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0731 23:39:49.759099 1834111 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0731 23:39:49.762830 1834111 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0731 23:39:49.762929 1834111 kubeadm.go:392] StartCluster: {Name:embed-certs-442076 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.3 ClusterName:embed-certs-442076 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APISe
rverNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQem
uFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0731 23:39:49.763051 1834111 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0731 23:39:49.763139 1834111 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0731 23:39:49.812413 1834111 cri.go:89] found id: ""
I0731 23:39:49.812534 1834111 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0731 23:39:49.821717 1834111 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0731 23:39:49.831495 1834111 kubeadm.go:214] ignoring SystemVerification for kubeadm because of docker driver
I0731 23:39:49.831597 1834111 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0731 23:39:49.841296 1834111 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0731 23:39:49.841319 1834111 kubeadm.go:157] found existing configuration files:
I0731 23:39:49.841373 1834111 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0731 23:39:49.851174 1834111 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0731 23:39:49.851245 1834111 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0731 23:39:49.860266 1834111 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0731 23:39:49.869719 1834111 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0731 23:39:49.869785 1834111 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0731 23:39:49.880733 1834111 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0731 23:39:49.890301 1834111 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0731 23:39:49.890364 1834111 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0731 23:39:49.899321 1834111 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0731 23:39:49.909000 1834111 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0731 23:39:49.909078 1834111 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0731 23:39:49.918104 1834111 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.30.3:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
I0731 23:39:49.979677 1834111 kubeadm.go:310] [init] Using Kubernetes version: v1.30.3
I0731 23:39:49.979737 1834111 kubeadm.go:310] [preflight] Running pre-flight checks
I0731 23:39:50.029429 1834111 kubeadm.go:310] [preflight] The system verification failed. Printing the output from the verification:
I0731 23:39:50.029558 1834111 kubeadm.go:310] [0;37mKERNEL_VERSION[0m: [0;32m5.15.0-1066-aws[0m
I0731 23:39:50.029621 1834111 kubeadm.go:310] [0;37mOS[0m: [0;32mLinux[0m
I0731 23:39:50.029695 1834111 kubeadm.go:310] [0;37mCGROUPS_CPU[0m: [0;32menabled[0m
I0731 23:39:50.029774 1834111 kubeadm.go:310] [0;37mCGROUPS_CPUACCT[0m: [0;32menabled[0m
I0731 23:39:50.029848 1834111 kubeadm.go:310] [0;37mCGROUPS_CPUSET[0m: [0;32menabled[0m
I0731 23:39:50.029925 1834111 kubeadm.go:310] [0;37mCGROUPS_DEVICES[0m: [0;32menabled[0m
I0731 23:39:50.030001 1834111 kubeadm.go:310] [0;37mCGROUPS_FREEZER[0m: [0;32menabled[0m
I0731 23:39:50.030078 1834111 kubeadm.go:310] [0;37mCGROUPS_MEMORY[0m: [0;32menabled[0m
I0731 23:39:50.030151 1834111 kubeadm.go:310] [0;37mCGROUPS_PIDS[0m: [0;32menabled[0m
I0731 23:39:50.030241 1834111 kubeadm.go:310] [0;37mCGROUPS_HUGETLB[0m: [0;32menabled[0m
I0731 23:39:50.030318 1834111 kubeadm.go:310] [0;37mCGROUPS_BLKIO[0m: [0;32menabled[0m
I0731 23:39:50.108301 1834111 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0731 23:39:50.108460 1834111 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0731 23:39:50.108596 1834111 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0731 23:39:50.396380 1834111 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0731 23:39:49.171344 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:39:51.670446 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:39:50.398840 1834111 out.go:204] - Generating certificates and keys ...
I0731 23:39:50.399005 1834111 kubeadm.go:310] [certs] Using existing ca certificate authority
I0731 23:39:50.399119 1834111 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0731 23:39:50.767108 1834111 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
I0731 23:39:51.116836 1834111 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
I0731 23:39:52.157666 1834111 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
I0731 23:39:52.330566 1834111 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
I0731 23:39:52.950611 1834111 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
I0731 23:39:52.950755 1834111 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [embed-certs-442076 localhost] and IPs [192.168.85.2 127.0.0.1 ::1]
I0731 23:39:53.512174 1834111 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
I0731 23:39:53.512506 1834111 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [embed-certs-442076 localhost] and IPs [192.168.85.2 127.0.0.1 ::1]
I0731 23:39:53.843085 1834111 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
I0731 23:39:54.013729 1834111 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
I0731 23:39:54.313417 1834111 kubeadm.go:310] [certs] Generating "sa" key and public key
I0731 23:39:54.313721 1834111 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0731 23:39:54.673426 1834111 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0731 23:39:55.196378 1834111 kubeadm.go:310] [kubeconfig] Writing "super-admin.conf" kubeconfig file
I0731 23:39:55.409894 1834111 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0731 23:39:56.136508 1834111 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0731 23:39:56.732801 1834111 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0731 23:39:56.733480 1834111 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0731 23:39:56.736403 1834111 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0731 23:39:53.672244 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:39:56.168225 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:39:56.744628 1834111 out.go:204] - Booting up control plane ...
I0731 23:39:56.744737 1834111 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0731 23:39:56.744822 1834111 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0731 23:39:56.744890 1834111 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0731 23:39:56.749569 1834111 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0731 23:39:56.752077 1834111 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0731 23:39:56.752493 1834111 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0731 23:39:56.851134 1834111 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests"
I0731 23:39:56.851227 1834111 kubeadm.go:310] [kubelet-check] Waiting for a healthy kubelet. This can take up to 4m0s
I0731 23:39:58.352145 1834111 kubeadm.go:310] [kubelet-check] The kubelet is healthy after 1.500804847s
I0731 23:39:58.352233 1834111 kubeadm.go:310] [api-check] Waiting for a healthy API server. This can take up to 4m0s
I0731 23:39:58.670724 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:40:00.671990 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:40:04.854156 1834111 kubeadm.go:310] [api-check] The API server is healthy after 6.502195374s
I0731 23:40:04.875327 1834111 kubeadm.go:310] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
I0731 23:40:04.890040 1834111 kubeadm.go:310] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster
I0731 23:40:04.918298 1834111 kubeadm.go:310] [upload-certs] Skipping phase. Please see --upload-certs
I0731 23:40:04.918498 1834111 kubeadm.go:310] [mark-control-plane] Marking the node embed-certs-442076 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
I0731 23:40:04.929879 1834111 kubeadm.go:310] [bootstrap-token] Using token: mhkz47.gp5m54wbjtla0ioz
I0731 23:40:04.931797 1834111 out.go:204] - Configuring RBAC rules ...
I0731 23:40:04.931926 1834111 kubeadm.go:310] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
I0731 23:40:04.937555 1834111 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes
I0731 23:40:04.945785 1834111 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
I0731 23:40:04.949645 1834111 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
I0731 23:40:04.953568 1834111 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
I0731 23:40:04.959582 1834111 kubeadm.go:310] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
I0731 23:40:05.261144 1834111 kubeadm.go:310] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
I0731 23:40:05.721461 1834111 kubeadm.go:310] [addons] Applied essential addon: CoreDNS
I0731 23:40:06.267708 1834111 kubeadm.go:310] [addons] Applied essential addon: kube-proxy
I0731 23:40:06.267731 1834111 kubeadm.go:310]
I0731 23:40:06.267800 1834111 kubeadm.go:310] Your Kubernetes control-plane has initialized successfully!
I0731 23:40:06.267806 1834111 kubeadm.go:310]
I0731 23:40:06.267880 1834111 kubeadm.go:310] To start using your cluster, you need to run the following as a regular user:
I0731 23:40:06.267885 1834111 kubeadm.go:310]
I0731 23:40:06.267911 1834111 kubeadm.go:310] mkdir -p $HOME/.kube
I0731 23:40:06.267967 1834111 kubeadm.go:310] sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
I0731 23:40:06.268019 1834111 kubeadm.go:310] sudo chown $(id -u):$(id -g) $HOME/.kube/config
I0731 23:40:06.268023 1834111 kubeadm.go:310]
I0731 23:40:06.268075 1834111 kubeadm.go:310] Alternatively, if you are the root user, you can run:
I0731 23:40:06.268079 1834111 kubeadm.go:310]
I0731 23:40:06.268130 1834111 kubeadm.go:310] export KUBECONFIG=/etc/kubernetes/admin.conf
I0731 23:40:06.268151 1834111 kubeadm.go:310]
I0731 23:40:06.268207 1834111 kubeadm.go:310] You should now deploy a pod network to the cluster.
I0731 23:40:06.268279 1834111 kubeadm.go:310] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
I0731 23:40:06.268350 1834111 kubeadm.go:310] https://kubernetes.io/docs/concepts/cluster-administration/addons/
I0731 23:40:06.268357 1834111 kubeadm.go:310]
I0731 23:40:06.268444 1834111 kubeadm.go:310] You can now join any number of control-plane nodes by copying certificate authorities
I0731 23:40:06.268517 1834111 kubeadm.go:310] and service account keys on each node and then running the following as root:
I0731 23:40:06.268522 1834111 kubeadm.go:310]
I0731 23:40:06.268602 1834111 kubeadm.go:310] kubeadm join control-plane.minikube.internal:8443 --token mhkz47.gp5m54wbjtla0ioz \
I0731 23:40:06.268705 1834111 kubeadm.go:310] --discovery-token-ca-cert-hash sha256:6aeac36715e45fc93d88e018ede78e85fe5c7ed540db2ea7e85e78caf89de8d9 \
I0731 23:40:06.268725 1834111 kubeadm.go:310] --control-plane
I0731 23:40:06.268729 1834111 kubeadm.go:310]
I0731 23:40:06.268812 1834111 kubeadm.go:310] Then you can join any number of worker nodes by running the following on each as root:
I0731 23:40:06.268817 1834111 kubeadm.go:310]
I0731 23:40:06.268895 1834111 kubeadm.go:310] kubeadm join control-plane.minikube.internal:8443 --token mhkz47.gp5m54wbjtla0ioz \
I0731 23:40:06.268992 1834111 kubeadm.go:310] --discovery-token-ca-cert-hash sha256:6aeac36715e45fc93d88e018ede78e85fe5c7ed540db2ea7e85e78caf89de8d9
I0731 23:40:06.270050 1834111 kubeadm.go:310] [WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/5.15.0-1066-aws\n", err: exit status 1
I0731 23:40:06.270170 1834111 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0731 23:40:06.270197 1834111 cni.go:84] Creating CNI manager for ""
I0731 23:40:06.270207 1834111 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
I0731 23:40:06.272263 1834111 out.go:177] * Configuring CNI (Container Networking Interface) ...
I0731 23:40:03.169169 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:40:05.169709 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:40:06.274137 1834111 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap
I0731 23:40:06.278246 1834111 cni.go:182] applying CNI manifest using /var/lib/minikube/binaries/v1.30.3/kubectl ...
I0731 23:40:06.278268 1834111 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2601 bytes)
I0731 23:40:06.298633 1834111 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
I0731 23:40:06.586806 1834111 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
I0731 23:40:06.586930 1834111 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
I0731 23:40:06.587016 1834111 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes embed-certs-442076 minikube.k8s.io/updated_at=2024_07_31T23_40_06_0700 minikube.k8s.io/version=v1.33.1 minikube.k8s.io/commit=578c9d758a3a1e9afe57056f3521c9dabc3709f1 minikube.k8s.io/name=embed-certs-442076 minikube.k8s.io/primary=true
I0731 23:40:06.726480 1834111 ops.go:34] apiserver oom_adj: -16
I0731 23:40:06.726583 1834111 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0731 23:40:07.227685 1834111 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0731 23:40:07.727196 1834111 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0731 23:40:08.227678 1834111 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0731 23:40:07.668238 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:40:09.669577 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:40:11.669953 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:40:08.727355 1834111 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0731 23:40:09.227282 1834111 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0731 23:40:09.726968 1834111 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0731 23:40:10.226779 1834111 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0731 23:40:10.726733 1834111 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0731 23:40:11.227486 1834111 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0731 23:40:11.727201 1834111 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0731 23:40:12.227157 1834111 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0731 23:40:12.727387 1834111 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0731 23:40:13.226722 1834111 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0731 23:40:14.168734 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:40:16.170059 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:40:13.727712 1834111 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0731 23:40:14.227461 1834111 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0731 23:40:14.727653 1834111 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0731 23:40:15.226692 1834111 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0731 23:40:15.727651 1834111 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0731 23:40:16.227619 1834111 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0731 23:40:16.727088 1834111 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0731 23:40:17.227457 1834111 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0731 23:40:17.726748 1834111 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0731 23:40:18.226964 1834111 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0731 23:40:18.727264 1834111 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0731 23:40:19.227013 1834111 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0731 23:40:19.420176 1834111 kubeadm.go:1113] duration metric: took 12.833289402s to wait for elevateKubeSystemPrivileges
I0731 23:40:19.420206 1834111 kubeadm.go:394] duration metric: took 29.657282433s to StartCluster
I0731 23:40:19.420224 1834111 settings.go:142] acquiring lock: {Name:mk3c0c3b857f6d982767b7eb95481d3e4843baa4 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0731 23:40:19.420288 1834111 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/19360-1579223/kubeconfig
I0731 23:40:19.421718 1834111 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19360-1579223/kubeconfig: {Name:mkfef6e38d1ebcc45fcbbe766a2ae2945f7bd392 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0731 23:40:19.421942 1834111 start.go:235] Will wait 6m0s for node &{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:crio ControlPlane:true Worker:true}
I0731 23:40:19.422074 1834111 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.30.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
I0731 23:40:19.422325 1834111 config.go:182] Loaded profile config "embed-certs-442076": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.30.3
I0731 23:40:19.422292 1834111 addons.go:507] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]
I0731 23:40:19.422408 1834111 addons.go:69] Setting storage-provisioner=true in profile "embed-certs-442076"
I0731 23:40:19.422432 1834111 addons.go:234] Setting addon storage-provisioner=true in "embed-certs-442076"
I0731 23:40:19.422457 1834111 host.go:66] Checking if "embed-certs-442076" exists ...
I0731 23:40:19.422538 1834111 addons.go:69] Setting default-storageclass=true in profile "embed-certs-442076"
I0731 23:40:19.422596 1834111 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "embed-certs-442076"
I0731 23:40:19.422889 1834111 cli_runner.go:164] Run: docker container inspect embed-certs-442076 --format={{.State.Status}}
I0731 23:40:19.422938 1834111 cli_runner.go:164] Run: docker container inspect embed-certs-442076 --format={{.State.Status}}
I0731 23:40:19.425390 1834111 out.go:177] * Verifying Kubernetes components...
I0731 23:40:19.433698 1834111 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0731 23:40:19.465973 1834111 addons.go:234] Setting addon default-storageclass=true in "embed-certs-442076"
I0731 23:40:19.466017 1834111 host.go:66] Checking if "embed-certs-442076" exists ...
I0731 23:40:19.466255 1834111 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0731 23:40:19.466500 1834111 cli_runner.go:164] Run: docker container inspect embed-certs-442076 --format={{.State.Status}}
I0731 23:40:19.469290 1834111 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0731 23:40:19.469314 1834111 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0731 23:40:19.469375 1834111 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-442076
I0731 23:40:19.529581 1834111 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34976 SSHKeyPath:/home/jenkins/minikube-integration/19360-1579223/.minikube/machines/embed-certs-442076/id_rsa Username:docker}
I0731 23:40:19.531466 1834111 addons.go:431] installing /etc/kubernetes/addons/storageclass.yaml
I0731 23:40:19.531486 1834111 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0731 23:40:19.531547 1834111 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-442076
I0731 23:40:19.560725 1834111 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34976 SSHKeyPath:/home/jenkins/minikube-integration/19360-1579223/.minikube/machines/embed-certs-442076/id_rsa Username:docker}
I0731 23:40:19.711273 1834111 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.30.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^ forward . \/etc\/resolv.conf.*/i \ hosts {\n 192.168.85.1 host.minikube.internal\n fallthrough\n }' -e '/^ errors *$/i \ log' | sudo /var/lib/minikube/binaries/v1.30.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
I0731 23:40:19.711368 1834111 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0731 23:40:19.717687 1834111 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0731 23:40:19.781889 1834111 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0731 23:40:20.300237 1834111 start.go:971] {"host.minikube.internal": 192.168.85.1} host record injected into CoreDNS's ConfigMap
I0731 23:40:20.301438 1834111 node_ready.go:35] waiting up to 6m0s for node "embed-certs-442076" to be "Ready" ...
I0731 23:40:20.532371 1834111 out.go:177] * Enabled addons: storage-provisioner, default-storageclass
I0731 23:40:18.668036 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:40:20.669542 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:40:20.534250 1834111 addons.go:510] duration metric: took 1.111951927s for enable addons: enabled=[storage-provisioner default-storageclass]
I0731 23:40:20.806703 1834111 kapi.go:214] "coredns" deployment in "kube-system" namespace and "embed-certs-442076" context rescaled to 1 replicas
I0731 23:40:22.304469 1834111 node_ready.go:53] node "embed-certs-442076" has status "Ready":"False"
I0731 23:40:23.168832 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:40:25.169914 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:40:24.306224 1834111 node_ready.go:53] node "embed-certs-442076" has status "Ready":"False"
I0731 23:40:26.804638 1834111 node_ready.go:53] node "embed-certs-442076" has status "Ready":"False"
I0731 23:40:27.667676 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:40:29.668497 1829252 pod_ready.go:102] pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace has status "Ready":"False"
I0731 23:40:31.168677 1829252 pod_ready.go:81] duration metric: took 4m0.006492497s for pod "metrics-server-9975d5f86-w25p2" in "kube-system" namespace to be "Ready" ...
E0731 23:40:31.168708 1829252 pod_ready.go:66] WaitExtra: waitPodCondition: context deadline exceeded
I0731 23:40:31.168720 1829252 pod_ready.go:38] duration metric: took 5m23.160205049s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0731 23:40:31.168736 1829252 api_server.go:52] waiting for apiserver process to appear ...
I0731 23:40:31.168766 1829252 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0731 23:40:31.168832 1829252 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0731 23:40:31.210665 1829252 cri.go:89] found id: "46018fe62e056d85a9d92909a3ffe934843c413af90487065b86f79764b6e416"
I0731 23:40:31.210687 1829252 cri.go:89] found id: ""
I0731 23:40:31.210695 1829252 logs.go:276] 1 containers: [46018fe62e056d85a9d92909a3ffe934843c413af90487065b86f79764b6e416]
I0731 23:40:31.210762 1829252 ssh_runner.go:195] Run: which crictl
I0731 23:40:31.214275 1829252 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0731 23:40:31.214347 1829252 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0731 23:40:31.254998 1829252 cri.go:89] found id: "6854efb05017bc711513167086bed436131771d8c2f42fe3910912ac80224c6c"
I0731 23:40:31.255072 1829252 cri.go:89] found id: ""
I0731 23:40:31.255096 1829252 logs.go:276] 1 containers: [6854efb05017bc711513167086bed436131771d8c2f42fe3910912ac80224c6c]
I0731 23:40:31.255183 1829252 ssh_runner.go:195] Run: which crictl
I0731 23:40:31.259162 1829252 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0731 23:40:31.259290 1829252 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0731 23:40:31.306298 1829252 cri.go:89] found id: "de1b5cb3d187661a9da8df949ef36da261421dac028ae8e070be86f4226a470b"
I0731 23:40:31.306366 1829252 cri.go:89] found id: ""
I0731 23:40:31.306386 1829252 logs.go:276] 1 containers: [de1b5cb3d187661a9da8df949ef36da261421dac028ae8e070be86f4226a470b]
I0731 23:40:31.306468 1829252 ssh_runner.go:195] Run: which crictl
I0731 23:40:31.310127 1829252 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0731 23:40:31.310198 1829252 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0731 23:40:31.350673 1829252 cri.go:89] found id: "9ea334663167822d57c49e09d75be27e43c4d14410ab00696d0bd381e74ba548"
I0731 23:40:31.350738 1829252 cri.go:89] found id: ""
I0731 23:40:31.350753 1829252 logs.go:276] 1 containers: [9ea334663167822d57c49e09d75be27e43c4d14410ab00696d0bd381e74ba548]
I0731 23:40:31.350819 1829252 ssh_runner.go:195] Run: which crictl
I0731 23:40:31.354414 1829252 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0731 23:40:31.354500 1829252 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0731 23:40:31.396679 1829252 cri.go:89] found id: "c21ba7634bd1a874c9ebc36d102421cb8c623f6f4fc40ef723fae526a1693796"
I0731 23:40:31.396705 1829252 cri.go:89] found id: ""
I0731 23:40:31.396712 1829252 logs.go:276] 1 containers: [c21ba7634bd1a874c9ebc36d102421cb8c623f6f4fc40ef723fae526a1693796]
I0731 23:40:31.396776 1829252 ssh_runner.go:195] Run: which crictl
I0731 23:40:31.400231 1829252 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0731 23:40:31.400307 1829252 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0731 23:40:31.453366 1829252 cri.go:89] found id: "6d2854e476f196556888fd39fa1c3e23a43223b6bf7632e42e8a2d3e07316f00"
I0731 23:40:31.453390 1829252 cri.go:89] found id: ""
I0731 23:40:31.453398 1829252 logs.go:276] 1 containers: [6d2854e476f196556888fd39fa1c3e23a43223b6bf7632e42e8a2d3e07316f00]
I0731 23:40:31.453454 1829252 ssh_runner.go:195] Run: which crictl
I0731 23:40:31.457018 1829252 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0731 23:40:31.457089 1829252 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0731 23:40:31.495600 1829252 cri.go:89] found id: "bab863fc639de5e0d2e1165a89d0b3b22043e0ffdb80ad3296bca7a7262985f7"
I0731 23:40:31.495620 1829252 cri.go:89] found id: ""
I0731 23:40:31.495628 1829252 logs.go:276] 1 containers: [bab863fc639de5e0d2e1165a89d0b3b22043e0ffdb80ad3296bca7a7262985f7]
I0731 23:40:31.495689 1829252 ssh_runner.go:195] Run: which crictl
I0731 23:40:31.499263 1829252 cri.go:54] listing CRI containers in root : {State:all Name:kubernetes-dashboard Namespaces:[]}
I0731 23:40:31.499355 1829252 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I0731 23:40:31.538992 1829252 cri.go:89] found id: "d6f8ffde1c928670ca20febc0c4a113d8ad3e22267d8fd745d5c54e8cc854a27"
I0731 23:40:31.539015 1829252 cri.go:89] found id: ""
I0731 23:40:31.539023 1829252 logs.go:276] 1 containers: [d6f8ffde1c928670ca20febc0c4a113d8ad3e22267d8fd745d5c54e8cc854a27]
I0731 23:40:31.539099 1829252 ssh_runner.go:195] Run: which crictl
I0731 23:40:31.542861 1829252 cri.go:54] listing CRI containers in root : {State:all Name:storage-provisioner Namespaces:[]}
I0731 23:40:31.542996 1829252 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0731 23:40:31.594113 1829252 cri.go:89] found id: "af4a5d8f7ff273f31d82cb997af6a85d6437344b03032e0188e4e18ed9144b92"
I0731 23:40:31.594172 1829252 cri.go:89] found id: "e7eb6229b113884a77ab02b300c2b453be8b1723c83dc8f8862391ed9ef419e1"
I0731 23:40:31.594192 1829252 cri.go:89] found id: ""
I0731 23:40:31.594219 1829252 logs.go:276] 2 containers: [af4a5d8f7ff273f31d82cb997af6a85d6437344b03032e0188e4e18ed9144b92 e7eb6229b113884a77ab02b300c2b453be8b1723c83dc8f8862391ed9ef419e1]
I0731 23:40:31.594308 1829252 ssh_runner.go:195] Run: which crictl
I0731 23:40:31.598495 1829252 ssh_runner.go:195] Run: which crictl
I0731 23:40:31.601970 1829252 logs.go:123] Gathering logs for dmesg ...
I0731 23:40:31.601993 1829252 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0731 23:40:31.622722 1829252 logs.go:123] Gathering logs for etcd [6854efb05017bc711513167086bed436131771d8c2f42fe3910912ac80224c6c] ...
I0731 23:40:31.622751 1829252 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 6854efb05017bc711513167086bed436131771d8c2f42fe3910912ac80224c6c"
I0731 23:40:31.669324 1829252 logs.go:123] Gathering logs for kube-proxy [c21ba7634bd1a874c9ebc36d102421cb8c623f6f4fc40ef723fae526a1693796] ...
I0731 23:40:31.669358 1829252 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 c21ba7634bd1a874c9ebc36d102421cb8c623f6f4fc40ef723fae526a1693796"
I0731 23:40:31.709562 1829252 logs.go:123] Gathering logs for kindnet [bab863fc639de5e0d2e1165a89d0b3b22043e0ffdb80ad3296bca7a7262985f7] ...
I0731 23:40:31.709593 1829252 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 bab863fc639de5e0d2e1165a89d0b3b22043e0ffdb80ad3296bca7a7262985f7"
I0731 23:40:31.760136 1829252 logs.go:123] Gathering logs for storage-provisioner [af4a5d8f7ff273f31d82cb997af6a85d6437344b03032e0188e4e18ed9144b92] ...
I0731 23:40:31.760180 1829252 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 af4a5d8f7ff273f31d82cb997af6a85d6437344b03032e0188e4e18ed9144b92"
I0731 23:40:31.800595 1829252 logs.go:123] Gathering logs for container status ...
I0731 23:40:31.800673 1829252 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0731 23:40:31.852654 1829252 logs.go:123] Gathering logs for kubelet ...
I0731 23:40:31.852732 1829252 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0731 23:40:31.905287 1829252 logs.go:138] Found kubelet problem: Jul 31 23:35:07 old-k8s-version-130660 kubelet[742]: E0731 23:35:07.593291 742 reflector.go:138] object-"kube-system"/"kindnet-token-crzsj": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kindnet-token-crzsj" is forbidden: User "system:node:old-k8s-version-130660" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-130660' and this object
W0731 23:40:31.905584 1829252 logs.go:138] Found kubelet problem: Jul 31 23:35:07 old-k8s-version-130660 kubelet[742]: E0731 23:35:07.593424 742 reflector.go:138] object-"kube-system"/"storage-provisioner-token-d22vf": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "storage-provisioner-token-d22vf" is forbidden: User "system:node:old-k8s-version-130660" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-130660' and this object
W0731 23:40:31.905826 1829252 logs.go:138] Found kubelet problem: Jul 31 23:35:07 old-k8s-version-130660 kubelet[742]: E0731 23:35:07.593481 742 reflector.go:138] object-"kube-system"/"metrics-server-token-kr52c": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "metrics-server-token-kr52c" is forbidden: User "system:node:old-k8s-version-130660" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-130660' and this object
W0731 23:40:31.906052 1829252 logs.go:138] Found kubelet problem: Jul 31 23:35:07 old-k8s-version-130660 kubelet[742]: E0731 23:35:07.593534 742 reflector.go:138] object-"kube-system"/"kube-proxy-token-fzgtf": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kube-proxy-token-fzgtf" is forbidden: User "system:node:old-k8s-version-130660" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-130660' and this object
W0731 23:40:31.906267 1829252 logs.go:138] Found kubelet problem: Jul 31 23:35:07 old-k8s-version-130660 kubelet[742]: E0731 23:35:07.593592 742 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:old-k8s-version-130660" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-130660' and this object
W0731 23:40:31.906486 1829252 logs.go:138] Found kubelet problem: Jul 31 23:35:07 old-k8s-version-130660 kubelet[742]: E0731 23:35:07.593646 742 reflector.go:138] object-"default"/"default-token-4prkn": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "default-token-4prkn" is forbidden: User "system:node:old-k8s-version-130660" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'old-k8s-version-130660' and this object
W0731 23:40:31.906695 1829252 logs.go:138] Found kubelet problem: Jul 31 23:35:07 old-k8s-version-130660 kubelet[742]: E0731 23:35:07.593719 742 reflector.go:138] object-"kube-system"/"coredns": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:old-k8s-version-130660" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-130660' and this object
W0731 23:40:31.906917 1829252 logs.go:138] Found kubelet problem: Jul 31 23:35:07 old-k8s-version-130660 kubelet[742]: E0731 23:35:07.593768 742 reflector.go:138] object-"kube-system"/"coredns-token-6sgwf": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "coredns-token-6sgwf" is forbidden: User "system:node:old-k8s-version-130660" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-130660' and this object
W0731 23:40:31.917757 1829252 logs.go:138] Found kubelet problem: Jul 31 23:35:09 old-k8s-version-130660 kubelet[742]: E0731 23:35:09.731660 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0731 23:40:31.918380 1829252 logs.go:138] Found kubelet problem: Jul 31 23:35:09 old-k8s-version-130660 kubelet[742]: E0731 23:35:09.980822 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 23:40:31.922205 1829252 logs.go:138] Found kubelet problem: Jul 31 23:35:23 old-k8s-version-130660 kubelet[742]: E0731 23:35:23.912962 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0731 23:40:31.923741 1829252 logs.go:138] Found kubelet problem: Jul 31 23:35:37 old-k8s-version-130660 kubelet[742]: E0731 23:35:37.900150 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 23:40:31.924088 1829252 logs.go:138] Found kubelet problem: Jul 31 23:35:38 old-k8s-version-130660 kubelet[742]: E0731 23:35:38.139768 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
W0731 23:40:31.924573 1829252 logs.go:138] Found kubelet problem: Jul 31 23:35:39 old-k8s-version-130660 kubelet[742]: E0731 23:35:39.142583 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
W0731 23:40:31.925055 1829252 logs.go:138] Found kubelet problem: Jul 31 23:35:42 old-k8s-version-130660 kubelet[742]: E0731 23:35:42.939292 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
W0731 23:40:31.927208 1829252 logs.go:138] Found kubelet problem: Jul 31 23:35:51 old-k8s-version-130660 kubelet[742]: E0731 23:35:51.915245 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0731 23:40:31.927833 1829252 logs.go:138] Found kubelet problem: Jul 31 23:35:55 old-k8s-version-130660 kubelet[742]: E0731 23:35:55.174079 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
W0731 23:40:31.928027 1829252 logs.go:138] Found kubelet problem: Jul 31 23:36:02 old-k8s-version-130660 kubelet[742]: E0731 23:36:02.900602 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 23:40:31.928415 1829252 logs.go:138] Found kubelet problem: Jul 31 23:36:02 old-k8s-version-130660 kubelet[742]: E0731 23:36:02.938961 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
W0731 23:40:31.928612 1829252 logs.go:138] Found kubelet problem: Jul 31 23:36:14 old-k8s-version-130660 kubelet[742]: E0731 23:36:14.900659 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 23:40:31.929257 1829252 logs.go:138] Found kubelet problem: Jul 31 23:36:16 old-k8s-version-130660 kubelet[742]: E0731 23:36:16.237810 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
W0731 23:40:31.929603 1829252 logs.go:138] Found kubelet problem: Jul 31 23:36:22 old-k8s-version-130660 kubelet[742]: E0731 23:36:22.938992 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
W0731 23:40:31.929795 1829252 logs.go:138] Found kubelet problem: Jul 31 23:36:25 old-k8s-version-130660 kubelet[742]: E0731 23:36:25.900141 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 23:40:31.930137 1829252 logs.go:138] Found kubelet problem: Jul 31 23:36:37 old-k8s-version-130660 kubelet[742]: E0731 23:36:37.900048 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
W0731 23:40:31.932288 1829252 logs.go:138] Found kubelet problem: Jul 31 23:36:37 old-k8s-version-130660 kubelet[742]: E0731 23:36:37.913581 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0731 23:40:31.932483 1829252 logs.go:138] Found kubelet problem: Jul 31 23:36:48 old-k8s-version-130660 kubelet[742]: E0731 23:36:48.900800 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 23:40:31.932831 1829252 logs.go:138] Found kubelet problem: Jul 31 23:36:50 old-k8s-version-130660 kubelet[742]: E0731 23:36:50.899714 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
W0731 23:40:31.933026 1829252 logs.go:138] Found kubelet problem: Jul 31 23:37:02 old-k8s-version-130660 kubelet[742]: E0731 23:37:02.901296 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 23:40:31.933664 1829252 logs.go:138] Found kubelet problem: Jul 31 23:37:06 old-k8s-version-130660 kubelet[742]: E0731 23:37:06.310165 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
W0731 23:40:31.934010 1829252 logs.go:138] Found kubelet problem: Jul 31 23:37:12 old-k8s-version-130660 kubelet[742]: E0731 23:37:12.939044 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
W0731 23:40:31.934204 1829252 logs.go:138] Found kubelet problem: Jul 31 23:37:14 old-k8s-version-130660 kubelet[742]: E0731 23:37:14.900812 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 23:40:31.934549 1829252 logs.go:138] Found kubelet problem: Jul 31 23:37:27 old-k8s-version-130660 kubelet[742]: E0731 23:37:27.899533 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
W0731 23:40:31.934743 1829252 logs.go:138] Found kubelet problem: Jul 31 23:37:28 old-k8s-version-130660 kubelet[742]: E0731 23:37:28.900944 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 23:40:31.935086 1829252 logs.go:138] Found kubelet problem: Jul 31 23:37:41 old-k8s-version-130660 kubelet[742]: E0731 23:37:41.899714 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
W0731 23:40:31.935276 1829252 logs.go:138] Found kubelet problem: Jul 31 23:37:42 old-k8s-version-130660 kubelet[742]: E0731 23:37:42.900065 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 23:40:31.935465 1829252 logs.go:138] Found kubelet problem: Jul 31 23:37:54 old-k8s-version-130660 kubelet[742]: E0731 23:37:54.900104 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 23:40:31.935812 1829252 logs.go:138] Found kubelet problem: Jul 31 23:37:55 old-k8s-version-130660 kubelet[742]: E0731 23:37:55.899783 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
W0731 23:40:31.938272 1829252 logs.go:138] Found kubelet problem: Jul 31 23:38:05 old-k8s-version-130660 kubelet[742]: E0731 23:38:05.912798 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0731 23:40:31.939974 1829252 logs.go:138] Found kubelet problem: Jul 31 23:38:10 old-k8s-version-130660 kubelet[742]: E0731 23:38:10.899721 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
W0731 23:40:31.940195 1829252 logs.go:138] Found kubelet problem: Jul 31 23:38:18 old-k8s-version-130660 kubelet[742]: E0731 23:38:18.901024 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 23:40:31.940543 1829252 logs.go:138] Found kubelet problem: Jul 31 23:38:21 old-k8s-version-130660 kubelet[742]: E0731 23:38:21.899662 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
W0731 23:40:31.940734 1829252 logs.go:138] Found kubelet problem: Jul 31 23:38:33 old-k8s-version-130660 kubelet[742]: E0731 23:38:33.900179 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 23:40:31.941390 1829252 logs.go:138] Found kubelet problem: Jul 31 23:38:36 old-k8s-version-130660 kubelet[742]: E0731 23:38:36.433618 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
W0731 23:40:31.941754 1829252 logs.go:138] Found kubelet problem: Jul 31 23:38:42 old-k8s-version-130660 kubelet[742]: E0731 23:38:42.939018 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
W0731 23:40:31.941951 1829252 logs.go:138] Found kubelet problem: Jul 31 23:38:46 old-k8s-version-130660 kubelet[742]: E0731 23:38:46.900616 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 23:40:31.942315 1829252 logs.go:138] Found kubelet problem: Jul 31 23:38:54 old-k8s-version-130660 kubelet[742]: E0731 23:38:54.899746 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
W0731 23:40:31.942519 1829252 logs.go:138] Found kubelet problem: Jul 31 23:39:01 old-k8s-version-130660 kubelet[742]: E0731 23:39:01.900337 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 23:40:31.942862 1829252 logs.go:138] Found kubelet problem: Jul 31 23:39:08 old-k8s-version-130660 kubelet[742]: E0731 23:39:08.899966 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
W0731 23:40:31.943053 1829252 logs.go:138] Found kubelet problem: Jul 31 23:39:14 old-k8s-version-130660 kubelet[742]: E0731 23:39:14.900213 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 23:40:31.943394 1829252 logs.go:138] Found kubelet problem: Jul 31 23:39:20 old-k8s-version-130660 kubelet[742]: E0731 23:39:20.899847 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
W0731 23:40:31.943585 1829252 logs.go:138] Found kubelet problem: Jul 31 23:39:25 old-k8s-version-130660 kubelet[742]: E0731 23:39:25.900329 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 23:40:31.943933 1829252 logs.go:138] Found kubelet problem: Jul 31 23:39:32 old-k8s-version-130660 kubelet[742]: E0731 23:39:32.900100 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
W0731 23:40:31.944131 1829252 logs.go:138] Found kubelet problem: Jul 31 23:39:36 old-k8s-version-130660 kubelet[742]: E0731 23:39:36.900554 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 23:40:31.944482 1829252 logs.go:138] Found kubelet problem: Jul 31 23:39:46 old-k8s-version-130660 kubelet[742]: E0731 23:39:46.899659 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
W0731 23:40:31.944678 1829252 logs.go:138] Found kubelet problem: Jul 31 23:39:47 old-k8s-version-130660 kubelet[742]: E0731 23:39:47.900629 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 23:40:31.945022 1829252 logs.go:138] Found kubelet problem: Jul 31 23:39:57 old-k8s-version-130660 kubelet[742]: E0731 23:39:57.899835 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
W0731 23:40:31.945479 1829252 logs.go:138] Found kubelet problem: Jul 31 23:40:02 old-k8s-version-130660 kubelet[742]: E0731 23:40:02.900337 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 23:40:31.945825 1829252 logs.go:138] Found kubelet problem: Jul 31 23:40:11 old-k8s-version-130660 kubelet[742]: E0731 23:40:11.899717 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
W0731 23:40:31.946044 1829252 logs.go:138] Found kubelet problem: Jul 31 23:40:16 old-k8s-version-130660 kubelet[742]: E0731 23:40:16.900104 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 23:40:31.946393 1829252 logs.go:138] Found kubelet problem: Jul 31 23:40:24 old-k8s-version-130660 kubelet[742]: E0731 23:40:24.899764 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
W0731 23:40:31.946587 1829252 logs.go:138] Found kubelet problem: Jul 31 23:40:27 old-k8s-version-130660 kubelet[742]: E0731 23:40:27.900206 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
I0731 23:40:31.946597 1829252 logs.go:123] Gathering logs for kube-scheduler [9ea334663167822d57c49e09d75be27e43c4d14410ab00696d0bd381e74ba548] ...
I0731 23:40:31.946613 1829252 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 9ea334663167822d57c49e09d75be27e43c4d14410ab00696d0bd381e74ba548"
I0731 23:40:31.994035 1829252 logs.go:123] Gathering logs for describe nodes ...
I0731 23:40:31.994065 1829252 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0731 23:40:32.158567 1829252 logs.go:123] Gathering logs for kube-apiserver [46018fe62e056d85a9d92909a3ffe934843c413af90487065b86f79764b6e416] ...
I0731 23:40:32.158602 1829252 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 46018fe62e056d85a9d92909a3ffe934843c413af90487065b86f79764b6e416"
I0731 23:40:32.227818 1829252 logs.go:123] Gathering logs for coredns [de1b5cb3d187661a9da8df949ef36da261421dac028ae8e070be86f4226a470b] ...
I0731 23:40:32.227860 1829252 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 de1b5cb3d187661a9da8df949ef36da261421dac028ae8e070be86f4226a470b"
I0731 23:40:32.273447 1829252 logs.go:123] Gathering logs for kube-controller-manager [6d2854e476f196556888fd39fa1c3e23a43223b6bf7632e42e8a2d3e07316f00] ...
I0731 23:40:32.273478 1829252 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 6d2854e476f196556888fd39fa1c3e23a43223b6bf7632e42e8a2d3e07316f00"
I0731 23:40:32.344093 1829252 logs.go:123] Gathering logs for kubernetes-dashboard [d6f8ffde1c928670ca20febc0c4a113d8ad3e22267d8fd745d5c54e8cc854a27] ...
I0731 23:40:32.344134 1829252 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 d6f8ffde1c928670ca20febc0c4a113d8ad3e22267d8fd745d5c54e8cc854a27"
I0731 23:40:32.385695 1829252 logs.go:123] Gathering logs for storage-provisioner [e7eb6229b113884a77ab02b300c2b453be8b1723c83dc8f8862391ed9ef419e1] ...
I0731 23:40:32.385724 1829252 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e7eb6229b113884a77ab02b300c2b453be8b1723c83dc8f8862391ed9ef419e1"
I0731 23:40:32.435975 1829252 logs.go:123] Gathering logs for CRI-O ...
I0731 23:40:32.436001 1829252 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0731 23:40:32.522296 1829252 out.go:304] Setting ErrFile to fd 2...
I0731 23:40:32.522372 1829252 out.go:338] TERM=,COLORTERM=, which probably does not support color
W0731 23:40:32.522460 1829252 out.go:239] X Problems detected in kubelet:
W0731 23:40:32.522500 1829252 out.go:239] Jul 31 23:40:02 old-k8s-version-130660 kubelet[742]: E0731 23:40:02.900337 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 23:40:32.522532 1829252 out.go:239] Jul 31 23:40:11 old-k8s-version-130660 kubelet[742]: E0731 23:40:11.899717 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
W0731 23:40:32.522583 1829252 out.go:239] Jul 31 23:40:16 old-k8s-version-130660 kubelet[742]: E0731 23:40:16.900104 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 23:40:32.522613 1829252 out.go:239] Jul 31 23:40:24 old-k8s-version-130660 kubelet[742]: E0731 23:40:24.899764 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
W0731 23:40:32.522668 1829252 out.go:239] Jul 31 23:40:27 old-k8s-version-130660 kubelet[742]: E0731 23:40:27.900206 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
I0731 23:40:32.522702 1829252 out.go:304] Setting ErrFile to fd 2...
I0731 23:40:32.522720 1829252 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0731 23:40:29.305131 1834111 node_ready.go:53] node "embed-certs-442076" has status "Ready":"False"
I0731 23:40:31.805944 1834111 node_ready.go:53] node "embed-certs-442076" has status "Ready":"False"
I0731 23:40:32.805330 1834111 node_ready.go:49] node "embed-certs-442076" has status "Ready":"True"
I0731 23:40:32.805357 1834111 node_ready.go:38] duration metric: took 12.503858647s for node "embed-certs-442076" to be "Ready" ...
I0731 23:40:32.805368 1834111 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0731 23:40:32.812915 1834111 pod_ready.go:78] waiting up to 6m0s for pod "coredns-7db6d8ff4d-5dqg7" in "kube-system" namespace to be "Ready" ...
I0731 23:40:33.819296 1834111 pod_ready.go:92] pod "coredns-7db6d8ff4d-5dqg7" in "kube-system" namespace has status "Ready":"True"
I0731 23:40:33.819361 1834111 pod_ready.go:81] duration metric: took 1.006413591s for pod "coredns-7db6d8ff4d-5dqg7" in "kube-system" namespace to be "Ready" ...
I0731 23:40:33.819381 1834111 pod_ready.go:78] waiting up to 6m0s for pod "etcd-embed-certs-442076" in "kube-system" namespace to be "Ready" ...
I0731 23:40:33.824885 1834111 pod_ready.go:92] pod "etcd-embed-certs-442076" in "kube-system" namespace has status "Ready":"True"
I0731 23:40:33.824914 1834111 pod_ready.go:81] duration metric: took 5.524895ms for pod "etcd-embed-certs-442076" in "kube-system" namespace to be "Ready" ...
I0731 23:40:33.824930 1834111 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-embed-certs-442076" in "kube-system" namespace to be "Ready" ...
I0731 23:40:33.830637 1834111 pod_ready.go:92] pod "kube-apiserver-embed-certs-442076" in "kube-system" namespace has status "Ready":"True"
I0731 23:40:33.830664 1834111 pod_ready.go:81] duration metric: took 5.72523ms for pod "kube-apiserver-embed-certs-442076" in "kube-system" namespace to be "Ready" ...
I0731 23:40:33.830676 1834111 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-embed-certs-442076" in "kube-system" namespace to be "Ready" ...
I0731 23:40:33.835985 1834111 pod_ready.go:92] pod "kube-controller-manager-embed-certs-442076" in "kube-system" namespace has status "Ready":"True"
I0731 23:40:33.836012 1834111 pod_ready.go:81] duration metric: took 5.328227ms for pod "kube-controller-manager-embed-certs-442076" in "kube-system" namespace to be "Ready" ...
I0731 23:40:33.836024 1834111 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-65tsd" in "kube-system" namespace to be "Ready" ...
I0731 23:40:34.006590 1834111 pod_ready.go:92] pod "kube-proxy-65tsd" in "kube-system" namespace has status "Ready":"True"
I0731 23:40:34.006624 1834111 pod_ready.go:81] duration metric: took 170.572756ms for pod "kube-proxy-65tsd" in "kube-system" namespace to be "Ready" ...
I0731 23:40:34.006639 1834111 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-embed-certs-442076" in "kube-system" namespace to be "Ready" ...
I0731 23:40:34.406068 1834111 pod_ready.go:92] pod "kube-scheduler-embed-certs-442076" in "kube-system" namespace has status "Ready":"True"
I0731 23:40:34.406094 1834111 pod_ready.go:81] duration metric: took 399.446918ms for pod "kube-scheduler-embed-certs-442076" in "kube-system" namespace to be "Ready" ...
I0731 23:40:34.406107 1834111 pod_ready.go:38] duration metric: took 1.600699153s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0731 23:40:34.406141 1834111 api_server.go:52] waiting for apiserver process to appear ...
I0731 23:40:34.406220 1834111 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0731 23:40:34.417712 1834111 api_server.go:72] duration metric: took 14.995740445s to wait for apiserver process to appear ...
I0731 23:40:34.417781 1834111 api_server.go:88] waiting for apiserver healthz status ...
I0731 23:40:34.417807 1834111 api_server.go:253] Checking apiserver healthz at https://192.168.85.2:8443/healthz ...
I0731 23:40:34.426374 1834111 api_server.go:279] https://192.168.85.2:8443/healthz returned 200:
ok
I0731 23:40:34.427349 1834111 api_server.go:141] control plane version: v1.30.3
I0731 23:40:34.427374 1834111 api_server.go:131] duration metric: took 9.581783ms to wait for apiserver health ...
I0731 23:40:34.427382 1834111 system_pods.go:43] waiting for kube-system pods to appear ...
I0731 23:40:34.608528 1834111 system_pods.go:59] 8 kube-system pods found
I0731 23:40:34.608563 1834111 system_pods.go:61] "coredns-7db6d8ff4d-5dqg7" [b5e9d8a3-ab26-467a-8a95-24f8b88652ad] Running
I0731 23:40:34.608569 1834111 system_pods.go:61] "etcd-embed-certs-442076" [f1ffacd1-c460-4211-815d-3a5402822164] Running
I0731 23:40:34.608574 1834111 system_pods.go:61] "kindnet-2qv9v" [5d313ae4-ab0a-477e-b68a-c8f8fdd30ca8] Running
I0731 23:40:34.608579 1834111 system_pods.go:61] "kube-apiserver-embed-certs-442076" [cde12b03-952c-4947-95a1-bb2902b3da2e] Running
I0731 23:40:34.608584 1834111 system_pods.go:61] "kube-controller-manager-embed-certs-442076" [7937b520-cbfd-4ba8-a67a-90ed3600296c] Running
I0731 23:40:34.608589 1834111 system_pods.go:61] "kube-proxy-65tsd" [45c66915-c96b-487b-9f5c-cd29cf7522b9] Running
I0731 23:40:34.608593 1834111 system_pods.go:61] "kube-scheduler-embed-certs-442076" [1133e84e-5a70-445e-b8e0-28fafcedb28e] Running
I0731 23:40:34.608597 1834111 system_pods.go:61] "storage-provisioner" [e54f8cba-d6ab-44c0-b886-e78a5c6d8359] Running
I0731 23:40:34.608605 1834111 system_pods.go:74] duration metric: took 181.215786ms to wait for pod list to return data ...
I0731 23:40:34.608617 1834111 default_sa.go:34] waiting for default service account to be created ...
I0731 23:40:34.805589 1834111 default_sa.go:45] found service account: "default"
I0731 23:40:34.805615 1834111 default_sa.go:55] duration metric: took 196.987461ms for default service account to be created ...
I0731 23:40:34.805627 1834111 system_pods.go:116] waiting for k8s-apps to be running ...
I0731 23:40:35.015695 1834111 system_pods.go:86] 8 kube-system pods found
I0731 23:40:35.015725 1834111 system_pods.go:89] "coredns-7db6d8ff4d-5dqg7" [b5e9d8a3-ab26-467a-8a95-24f8b88652ad] Running
I0731 23:40:35.015732 1834111 system_pods.go:89] "etcd-embed-certs-442076" [f1ffacd1-c460-4211-815d-3a5402822164] Running
I0731 23:40:35.015737 1834111 system_pods.go:89] "kindnet-2qv9v" [5d313ae4-ab0a-477e-b68a-c8f8fdd30ca8] Running
I0731 23:40:35.015741 1834111 system_pods.go:89] "kube-apiserver-embed-certs-442076" [cde12b03-952c-4947-95a1-bb2902b3da2e] Running
I0731 23:40:35.015747 1834111 system_pods.go:89] "kube-controller-manager-embed-certs-442076" [7937b520-cbfd-4ba8-a67a-90ed3600296c] Running
I0731 23:40:35.015751 1834111 system_pods.go:89] "kube-proxy-65tsd" [45c66915-c96b-487b-9f5c-cd29cf7522b9] Running
I0731 23:40:35.016837 1834111 system_pods.go:89] "kube-scheduler-embed-certs-442076" [1133e84e-5a70-445e-b8e0-28fafcedb28e] Running
I0731 23:40:35.016864 1834111 system_pods.go:89] "storage-provisioner" [e54f8cba-d6ab-44c0-b886-e78a5c6d8359] Running
I0731 23:40:35.016875 1834111 system_pods.go:126] duration metric: took 211.241037ms to wait for k8s-apps to be running ...
I0731 23:40:35.016884 1834111 system_svc.go:44] waiting for kubelet service to be running ....
I0731 23:40:35.016954 1834111 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0731 23:40:35.030257 1834111 system_svc.go:56] duration metric: took 13.362708ms WaitForService to wait for kubelet
I0731 23:40:35.030288 1834111 kubeadm.go:582] duration metric: took 15.608320841s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0731 23:40:35.030309 1834111 node_conditions.go:102] verifying NodePressure condition ...
I0731 23:40:35.205649 1834111 node_conditions.go:122] node storage ephemeral capacity is 203034800Ki
I0731 23:40:35.205683 1834111 node_conditions.go:123] node cpu capacity is 2
I0731 23:40:35.205694 1834111 node_conditions.go:105] duration metric: took 175.380533ms to run NodePressure ...
I0731 23:40:35.205707 1834111 start.go:241] waiting for startup goroutines ...
I0731 23:40:35.205714 1834111 start.go:246] waiting for cluster config update ...
I0731 23:40:35.205725 1834111 start.go:255] writing updated cluster config ...
I0731 23:40:35.206000 1834111 ssh_runner.go:195] Run: rm -f paused
I0731 23:40:35.262744 1834111 start.go:600] kubectl: 1.30.3, cluster: 1.30.3 (minor skew: 0)
I0731 23:40:35.265019 1834111 out.go:177] * Done! kubectl is now configured to use "embed-certs-442076" cluster and "default" namespace by default
I0731 23:40:42.523167 1829252 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0731 23:40:42.534963 1829252 api_server.go:72] duration metric: took 5m51.519646281s to wait for apiserver process to appear ...
I0731 23:40:42.534988 1829252 api_server.go:88] waiting for apiserver healthz status ...
I0731 23:40:42.535022 1829252 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0731 23:40:42.535080 1829252 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0731 23:40:42.573475 1829252 cri.go:89] found id: "46018fe62e056d85a9d92909a3ffe934843c413af90487065b86f79764b6e416"
I0731 23:40:42.573498 1829252 cri.go:89] found id: ""
I0731 23:40:42.573507 1829252 logs.go:276] 1 containers: [46018fe62e056d85a9d92909a3ffe934843c413af90487065b86f79764b6e416]
I0731 23:40:42.573565 1829252 ssh_runner.go:195] Run: which crictl
I0731 23:40:42.577141 1829252 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0731 23:40:42.577216 1829252 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0731 23:40:42.618294 1829252 cri.go:89] found id: "6854efb05017bc711513167086bed436131771d8c2f42fe3910912ac80224c6c"
I0731 23:40:42.618317 1829252 cri.go:89] found id: ""
I0731 23:40:42.618325 1829252 logs.go:276] 1 containers: [6854efb05017bc711513167086bed436131771d8c2f42fe3910912ac80224c6c]
I0731 23:40:42.618380 1829252 ssh_runner.go:195] Run: which crictl
I0731 23:40:42.622074 1829252 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0731 23:40:42.622146 1829252 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0731 23:40:42.661456 1829252 cri.go:89] found id: "de1b5cb3d187661a9da8df949ef36da261421dac028ae8e070be86f4226a470b"
I0731 23:40:42.661478 1829252 cri.go:89] found id: ""
I0731 23:40:42.661486 1829252 logs.go:276] 1 containers: [de1b5cb3d187661a9da8df949ef36da261421dac028ae8e070be86f4226a470b]
I0731 23:40:42.661547 1829252 ssh_runner.go:195] Run: which crictl
I0731 23:40:42.665157 1829252 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0731 23:40:42.665221 1829252 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0731 23:40:42.701128 1829252 cri.go:89] found id: "9ea334663167822d57c49e09d75be27e43c4d14410ab00696d0bd381e74ba548"
I0731 23:40:42.701152 1829252 cri.go:89] found id: ""
I0731 23:40:42.701160 1829252 logs.go:276] 1 containers: [9ea334663167822d57c49e09d75be27e43c4d14410ab00696d0bd381e74ba548]
I0731 23:40:42.701216 1829252 ssh_runner.go:195] Run: which crictl
I0731 23:40:42.704806 1829252 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0731 23:40:42.704875 1829252 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0731 23:40:42.741987 1829252 cri.go:89] found id: "c21ba7634bd1a874c9ebc36d102421cb8c623f6f4fc40ef723fae526a1693796"
I0731 23:40:42.742008 1829252 cri.go:89] found id: ""
I0731 23:40:42.742017 1829252 logs.go:276] 1 containers: [c21ba7634bd1a874c9ebc36d102421cb8c623f6f4fc40ef723fae526a1693796]
I0731 23:40:42.742095 1829252 ssh_runner.go:195] Run: which crictl
I0731 23:40:42.745798 1829252 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0731 23:40:42.745867 1829252 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0731 23:40:42.789352 1829252 cri.go:89] found id: "6d2854e476f196556888fd39fa1c3e23a43223b6bf7632e42e8a2d3e07316f00"
I0731 23:40:42.789377 1829252 cri.go:89] found id: ""
I0731 23:40:42.789384 1829252 logs.go:276] 1 containers: [6d2854e476f196556888fd39fa1c3e23a43223b6bf7632e42e8a2d3e07316f00]
I0731 23:40:42.789443 1829252 ssh_runner.go:195] Run: which crictl
I0731 23:40:42.793051 1829252 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0731 23:40:42.793147 1829252 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0731 23:40:42.830015 1829252 cri.go:89] found id: "bab863fc639de5e0d2e1165a89d0b3b22043e0ffdb80ad3296bca7a7262985f7"
I0731 23:40:42.830034 1829252 cri.go:89] found id: ""
I0731 23:40:42.830042 1829252 logs.go:276] 1 containers: [bab863fc639de5e0d2e1165a89d0b3b22043e0ffdb80ad3296bca7a7262985f7]
I0731 23:40:42.830096 1829252 ssh_runner.go:195] Run: which crictl
I0731 23:40:42.833643 1829252 cri.go:54] listing CRI containers in root : {State:all Name:storage-provisioner Namespaces:[]}
I0731 23:40:42.833716 1829252 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0731 23:40:42.873447 1829252 cri.go:89] found id: "af4a5d8f7ff273f31d82cb997af6a85d6437344b03032e0188e4e18ed9144b92"
I0731 23:40:42.873469 1829252 cri.go:89] found id: "e7eb6229b113884a77ab02b300c2b453be8b1723c83dc8f8862391ed9ef419e1"
I0731 23:40:42.873474 1829252 cri.go:89] found id: ""
I0731 23:40:42.873481 1829252 logs.go:276] 2 containers: [af4a5d8f7ff273f31d82cb997af6a85d6437344b03032e0188e4e18ed9144b92 e7eb6229b113884a77ab02b300c2b453be8b1723c83dc8f8862391ed9ef419e1]
I0731 23:40:42.873535 1829252 ssh_runner.go:195] Run: which crictl
I0731 23:40:42.877038 1829252 ssh_runner.go:195] Run: which crictl
I0731 23:40:42.880423 1829252 cri.go:54] listing CRI containers in root : {State:all Name:kubernetes-dashboard Namespaces:[]}
I0731 23:40:42.880533 1829252 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I0731 23:40:42.919417 1829252 cri.go:89] found id: "d6f8ffde1c928670ca20febc0c4a113d8ad3e22267d8fd745d5c54e8cc854a27"
I0731 23:40:42.919441 1829252 cri.go:89] found id: ""
I0731 23:40:42.919448 1829252 logs.go:276] 1 containers: [d6f8ffde1c928670ca20febc0c4a113d8ad3e22267d8fd745d5c54e8cc854a27]
I0731 23:40:42.919510 1829252 ssh_runner.go:195] Run: which crictl
I0731 23:40:42.923555 1829252 logs.go:123] Gathering logs for dmesg ...
I0731 23:40:42.923587 1829252 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0731 23:40:42.942311 1829252 logs.go:123] Gathering logs for kube-controller-manager [6d2854e476f196556888fd39fa1c3e23a43223b6bf7632e42e8a2d3e07316f00] ...
I0731 23:40:42.942342 1829252 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 6d2854e476f196556888fd39fa1c3e23a43223b6bf7632e42e8a2d3e07316f00"
I0731 23:40:43.024646 1829252 logs.go:123] Gathering logs for kindnet [bab863fc639de5e0d2e1165a89d0b3b22043e0ffdb80ad3296bca7a7262985f7] ...
I0731 23:40:43.024684 1829252 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 bab863fc639de5e0d2e1165a89d0b3b22043e0ffdb80ad3296bca7a7262985f7"
I0731 23:40:43.086681 1829252 logs.go:123] Gathering logs for CRI-O ...
I0731 23:40:43.086711 1829252 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0731 23:40:43.174577 1829252 logs.go:123] Gathering logs for container status ...
I0731 23:40:43.174613 1829252 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0731 23:40:43.216374 1829252 logs.go:123] Gathering logs for kube-apiserver [46018fe62e056d85a9d92909a3ffe934843c413af90487065b86f79764b6e416] ...
I0731 23:40:43.216401 1829252 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 46018fe62e056d85a9d92909a3ffe934843c413af90487065b86f79764b6e416"
I0731 23:40:43.291210 1829252 logs.go:123] Gathering logs for storage-provisioner [af4a5d8f7ff273f31d82cb997af6a85d6437344b03032e0188e4e18ed9144b92] ...
I0731 23:40:43.291247 1829252 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 af4a5d8f7ff273f31d82cb997af6a85d6437344b03032e0188e4e18ed9144b92"
I0731 23:40:43.333618 1829252 logs.go:123] Gathering logs for storage-provisioner [e7eb6229b113884a77ab02b300c2b453be8b1723c83dc8f8862391ed9ef419e1] ...
I0731 23:40:43.333647 1829252 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e7eb6229b113884a77ab02b300c2b453be8b1723c83dc8f8862391ed9ef419e1"
I0731 23:40:43.373657 1829252 logs.go:123] Gathering logs for kubernetes-dashboard [d6f8ffde1c928670ca20febc0c4a113d8ad3e22267d8fd745d5c54e8cc854a27] ...
I0731 23:40:43.373686 1829252 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 d6f8ffde1c928670ca20febc0c4a113d8ad3e22267d8fd745d5c54e8cc854a27"
I0731 23:40:43.418607 1829252 logs.go:123] Gathering logs for etcd [6854efb05017bc711513167086bed436131771d8c2f42fe3910912ac80224c6c] ...
I0731 23:40:43.418636 1829252 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 6854efb05017bc711513167086bed436131771d8c2f42fe3910912ac80224c6c"
I0731 23:40:43.484482 1829252 logs.go:123] Gathering logs for kube-scheduler [9ea334663167822d57c49e09d75be27e43c4d14410ab00696d0bd381e74ba548] ...
I0731 23:40:43.484516 1829252 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 9ea334663167822d57c49e09d75be27e43c4d14410ab00696d0bd381e74ba548"
I0731 23:40:43.544591 1829252 logs.go:123] Gathering logs for kube-proxy [c21ba7634bd1a874c9ebc36d102421cb8c623f6f4fc40ef723fae526a1693796] ...
I0731 23:40:43.544623 1829252 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 c21ba7634bd1a874c9ebc36d102421cb8c623f6f4fc40ef723fae526a1693796"
I0731 23:40:43.622041 1829252 logs.go:123] Gathering logs for kubelet ...
I0731 23:40:43.622069 1829252 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0731 23:40:43.694432 1829252 logs.go:138] Found kubelet problem: Jul 31 23:35:07 old-k8s-version-130660 kubelet[742]: E0731 23:35:07.593291 742 reflector.go:138] object-"kube-system"/"kindnet-token-crzsj": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kindnet-token-crzsj" is forbidden: User "system:node:old-k8s-version-130660" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-130660' and this object
W0731 23:40:43.694779 1829252 logs.go:138] Found kubelet problem: Jul 31 23:35:07 old-k8s-version-130660 kubelet[742]: E0731 23:35:07.593424 742 reflector.go:138] object-"kube-system"/"storage-provisioner-token-d22vf": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "storage-provisioner-token-d22vf" is forbidden: User "system:node:old-k8s-version-130660" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-130660' and this object
W0731 23:40:43.695038 1829252 logs.go:138] Found kubelet problem: Jul 31 23:35:07 old-k8s-version-130660 kubelet[742]: E0731 23:35:07.593481 742 reflector.go:138] object-"kube-system"/"metrics-server-token-kr52c": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "metrics-server-token-kr52c" is forbidden: User "system:node:old-k8s-version-130660" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-130660' and this object
W0731 23:40:43.695680 1829252 logs.go:138] Found kubelet problem: Jul 31 23:35:07 old-k8s-version-130660 kubelet[742]: E0731 23:35:07.593534 742 reflector.go:138] object-"kube-system"/"kube-proxy-token-fzgtf": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kube-proxy-token-fzgtf" is forbidden: User "system:node:old-k8s-version-130660" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-130660' and this object
W0731 23:40:43.695993 1829252 logs.go:138] Found kubelet problem: Jul 31 23:35:07 old-k8s-version-130660 kubelet[742]: E0731 23:35:07.593592 742 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:old-k8s-version-130660" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-130660' and this object
W0731 23:40:43.697348 1829252 logs.go:138] Found kubelet problem: Jul 31 23:35:07 old-k8s-version-130660 kubelet[742]: E0731 23:35:07.593646 742 reflector.go:138] object-"default"/"default-token-4prkn": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "default-token-4prkn" is forbidden: User "system:node:old-k8s-version-130660" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'old-k8s-version-130660' and this object
W0731 23:40:43.697624 1829252 logs.go:138] Found kubelet problem: Jul 31 23:35:07 old-k8s-version-130660 kubelet[742]: E0731 23:35:07.593719 742 reflector.go:138] object-"kube-system"/"coredns": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:old-k8s-version-130660" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-130660' and this object
W0731 23:40:43.697848 1829252 logs.go:138] Found kubelet problem: Jul 31 23:35:07 old-k8s-version-130660 kubelet[742]: E0731 23:35:07.593768 742 reflector.go:138] object-"kube-system"/"coredns-token-6sgwf": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "coredns-token-6sgwf" is forbidden: User "system:node:old-k8s-version-130660" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-130660' and this object
W0731 23:40:43.710124 1829252 logs.go:138] Found kubelet problem: Jul 31 23:35:09 old-k8s-version-130660 kubelet[742]: E0731 23:35:09.731660 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0731 23:40:43.710762 1829252 logs.go:138] Found kubelet problem: Jul 31 23:35:09 old-k8s-version-130660 kubelet[742]: E0731 23:35:09.980822 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 23:40:43.714635 1829252 logs.go:138] Found kubelet problem: Jul 31 23:35:23 old-k8s-version-130660 kubelet[742]: E0731 23:35:23.912962 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0731 23:40:43.716251 1829252 logs.go:138] Found kubelet problem: Jul 31 23:35:37 old-k8s-version-130660 kubelet[742]: E0731 23:35:37.900150 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 23:40:43.716594 1829252 logs.go:138] Found kubelet problem: Jul 31 23:35:38 old-k8s-version-130660 kubelet[742]: E0731 23:35:38.139768 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
W0731 23:40:43.717077 1829252 logs.go:138] Found kubelet problem: Jul 31 23:35:39 old-k8s-version-130660 kubelet[742]: E0731 23:35:39.142583 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
W0731 23:40:43.717609 1829252 logs.go:138] Found kubelet problem: Jul 31 23:35:42 old-k8s-version-130660 kubelet[742]: E0731 23:35:42.939292 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
W0731 23:40:43.719764 1829252 logs.go:138] Found kubelet problem: Jul 31 23:35:51 old-k8s-version-130660 kubelet[742]: E0731 23:35:51.915245 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0731 23:40:43.720376 1829252 logs.go:138] Found kubelet problem: Jul 31 23:35:55 old-k8s-version-130660 kubelet[742]: E0731 23:35:55.174079 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
W0731 23:40:43.720568 1829252 logs.go:138] Found kubelet problem: Jul 31 23:36:02 old-k8s-version-130660 kubelet[742]: E0731 23:36:02.900602 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 23:40:43.720909 1829252 logs.go:138] Found kubelet problem: Jul 31 23:36:02 old-k8s-version-130660 kubelet[742]: E0731 23:36:02.938961 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
W0731 23:40:43.721129 1829252 logs.go:138] Found kubelet problem: Jul 31 23:36:14 old-k8s-version-130660 kubelet[742]: E0731 23:36:14.900659 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 23:40:43.721793 1829252 logs.go:138] Found kubelet problem: Jul 31 23:36:16 old-k8s-version-130660 kubelet[742]: E0731 23:36:16.237810 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
W0731 23:40:43.722238 1829252 logs.go:138] Found kubelet problem: Jul 31 23:36:22 old-k8s-version-130660 kubelet[742]: E0731 23:36:22.938992 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
W0731 23:40:43.722440 1829252 logs.go:138] Found kubelet problem: Jul 31 23:36:25 old-k8s-version-130660 kubelet[742]: E0731 23:36:25.900141 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 23:40:43.722784 1829252 logs.go:138] Found kubelet problem: Jul 31 23:36:37 old-k8s-version-130660 kubelet[742]: E0731 23:36:37.900048 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
W0731 23:40:43.726823 1829252 logs.go:138] Found kubelet problem: Jul 31 23:36:37 old-k8s-version-130660 kubelet[742]: E0731 23:36:37.913581 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0731 23:40:43.727038 1829252 logs.go:138] Found kubelet problem: Jul 31 23:36:48 old-k8s-version-130660 kubelet[742]: E0731 23:36:48.900800 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 23:40:43.727383 1829252 logs.go:138] Found kubelet problem: Jul 31 23:36:50 old-k8s-version-130660 kubelet[742]: E0731 23:36:50.899714 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
W0731 23:40:43.727574 1829252 logs.go:138] Found kubelet problem: Jul 31 23:37:02 old-k8s-version-130660 kubelet[742]: E0731 23:37:02.901296 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 23:40:43.728202 1829252 logs.go:138] Found kubelet problem: Jul 31 23:37:06 old-k8s-version-130660 kubelet[742]: E0731 23:37:06.310165 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
W0731 23:40:43.728542 1829252 logs.go:138] Found kubelet problem: Jul 31 23:37:12 old-k8s-version-130660 kubelet[742]: E0731 23:37:12.939044 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
W0731 23:40:43.728737 1829252 logs.go:138] Found kubelet problem: Jul 31 23:37:14 old-k8s-version-130660 kubelet[742]: E0731 23:37:14.900812 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 23:40:43.729312 1829252 logs.go:138] Found kubelet problem: Jul 31 23:37:27 old-k8s-version-130660 kubelet[742]: E0731 23:37:27.899533 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
W0731 23:40:43.729512 1829252 logs.go:138] Found kubelet problem: Jul 31 23:37:28 old-k8s-version-130660 kubelet[742]: E0731 23:37:28.900944 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 23:40:43.729863 1829252 logs.go:138] Found kubelet problem: Jul 31 23:37:41 old-k8s-version-130660 kubelet[742]: E0731 23:37:41.899714 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
W0731 23:40:43.730056 1829252 logs.go:138] Found kubelet problem: Jul 31 23:37:42 old-k8s-version-130660 kubelet[742]: E0731 23:37:42.900065 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 23:40:43.730313 1829252 logs.go:138] Found kubelet problem: Jul 31 23:37:54 old-k8s-version-130660 kubelet[742]: E0731 23:37:54.900104 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 23:40:43.730658 1829252 logs.go:138] Found kubelet problem: Jul 31 23:37:55 old-k8s-version-130660 kubelet[742]: E0731 23:37:55.899783 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
W0731 23:40:43.732864 1829252 logs.go:138] Found kubelet problem: Jul 31 23:38:05 old-k8s-version-130660 kubelet[742]: E0731 23:38:05.912798 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0731 23:40:43.733822 1829252 logs.go:138] Found kubelet problem: Jul 31 23:38:10 old-k8s-version-130660 kubelet[742]: E0731 23:38:10.899721 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
W0731 23:40:43.734056 1829252 logs.go:138] Found kubelet problem: Jul 31 23:38:18 old-k8s-version-130660 kubelet[742]: E0731 23:38:18.901024 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 23:40:43.734397 1829252 logs.go:138] Found kubelet problem: Jul 31 23:38:21 old-k8s-version-130660 kubelet[742]: E0731 23:38:21.899662 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
W0731 23:40:43.734588 1829252 logs.go:138] Found kubelet problem: Jul 31 23:38:33 old-k8s-version-130660 kubelet[742]: E0731 23:38:33.900179 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 23:40:43.735701 1829252 logs.go:138] Found kubelet problem: Jul 31 23:38:36 old-k8s-version-130660 kubelet[742]: E0731 23:38:36.433618 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
W0731 23:40:43.736069 1829252 logs.go:138] Found kubelet problem: Jul 31 23:38:42 old-k8s-version-130660 kubelet[742]: E0731 23:38:42.939018 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
W0731 23:40:43.736263 1829252 logs.go:138] Found kubelet problem: Jul 31 23:38:46 old-k8s-version-130660 kubelet[742]: E0731 23:38:46.900616 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 23:40:43.736604 1829252 logs.go:138] Found kubelet problem: Jul 31 23:38:54 old-k8s-version-130660 kubelet[742]: E0731 23:38:54.899746 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
W0731 23:40:43.736845 1829252 logs.go:138] Found kubelet problem: Jul 31 23:39:01 old-k8s-version-130660 kubelet[742]: E0731 23:39:01.900337 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 23:40:43.737255 1829252 logs.go:138] Found kubelet problem: Jul 31 23:39:08 old-k8s-version-130660 kubelet[742]: E0731 23:39:08.899966 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
W0731 23:40:43.737462 1829252 logs.go:138] Found kubelet problem: Jul 31 23:39:14 old-k8s-version-130660 kubelet[742]: E0731 23:39:14.900213 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 23:40:43.737829 1829252 logs.go:138] Found kubelet problem: Jul 31 23:39:20 old-k8s-version-130660 kubelet[742]: E0731 23:39:20.899847 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
W0731 23:40:43.738043 1829252 logs.go:138] Found kubelet problem: Jul 31 23:39:25 old-k8s-version-130660 kubelet[742]: E0731 23:39:25.900329 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 23:40:43.738420 1829252 logs.go:138] Found kubelet problem: Jul 31 23:39:32 old-k8s-version-130660 kubelet[742]: E0731 23:39:32.900100 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
W0731 23:40:43.738641 1829252 logs.go:138] Found kubelet problem: Jul 31 23:39:36 old-k8s-version-130660 kubelet[742]: E0731 23:39:36.900554 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 23:40:43.739002 1829252 logs.go:138] Found kubelet problem: Jul 31 23:39:46 old-k8s-version-130660 kubelet[742]: E0731 23:39:46.899659 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
W0731 23:40:43.739207 1829252 logs.go:138] Found kubelet problem: Jul 31 23:39:47 old-k8s-version-130660 kubelet[742]: E0731 23:39:47.900629 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 23:40:43.739595 1829252 logs.go:138] Found kubelet problem: Jul 31 23:39:57 old-k8s-version-130660 kubelet[742]: E0731 23:39:57.899835 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
W0731 23:40:43.740089 1829252 logs.go:138] Found kubelet problem: Jul 31 23:40:02 old-k8s-version-130660 kubelet[742]: E0731 23:40:02.900337 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 23:40:43.740457 1829252 logs.go:138] Found kubelet problem: Jul 31 23:40:11 old-k8s-version-130660 kubelet[742]: E0731 23:40:11.899717 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
W0731 23:40:43.740670 1829252 logs.go:138] Found kubelet problem: Jul 31 23:40:16 old-k8s-version-130660 kubelet[742]: E0731 23:40:16.900104 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 23:40:43.741031 1829252 logs.go:138] Found kubelet problem: Jul 31 23:40:24 old-k8s-version-130660 kubelet[742]: E0731 23:40:24.899764 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
W0731 23:40:43.741253 1829252 logs.go:138] Found kubelet problem: Jul 31 23:40:27 old-k8s-version-130660 kubelet[742]: E0731 23:40:27.900206 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 23:40:43.741628 1829252 logs.go:138] Found kubelet problem: Jul 31 23:40:37 old-k8s-version-130660 kubelet[742]: E0731 23:40:37.900394 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
W0731 23:40:43.741830 1829252 logs.go:138] Found kubelet problem: Jul 31 23:40:38 old-k8s-version-130660 kubelet[742]: E0731 23:40:38.900915 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
I0731 23:40:43.741846 1829252 logs.go:123] Gathering logs for describe nodes ...
I0731 23:40:43.741863 1829252 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0731 23:40:43.924872 1829252 logs.go:123] Gathering logs for coredns [de1b5cb3d187661a9da8df949ef36da261421dac028ae8e070be86f4226a470b] ...
I0731 23:40:43.924913 1829252 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 de1b5cb3d187661a9da8df949ef36da261421dac028ae8e070be86f4226a470b"
I0731 23:40:43.993229 1829252 out.go:304] Setting ErrFile to fd 2...
I0731 23:40:43.993305 1829252 out.go:338] TERM=,COLORTERM=, which probably does not support color
W0731 23:40:43.993387 1829252 out.go:239] X Problems detected in kubelet:
W0731 23:40:43.993430 1829252 out.go:239] Jul 31 23:40:16 old-k8s-version-130660 kubelet[742]: E0731 23:40:16.900104 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 23:40:43.993462 1829252 out.go:239] Jul 31 23:40:24 old-k8s-version-130660 kubelet[742]: E0731 23:40:24.899764 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
W0731 23:40:43.993512 1829252 out.go:239] Jul 31 23:40:27 old-k8s-version-130660 kubelet[742]: E0731 23:40:27.900206 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0731 23:40:43.993545 1829252 out.go:239] Jul 31 23:40:37 old-k8s-version-130660 kubelet[742]: E0731 23:40:37.900394 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
W0731 23:40:43.993586 1829252 out.go:239] Jul 31 23:40:38 old-k8s-version-130660 kubelet[742]: E0731 23:40:38.900915 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
I0731 23:40:43.993620 1829252 out.go:304] Setting ErrFile to fd 2...
I0731 23:40:43.993640 1829252 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0731 23:40:53.995026 1829252 api_server.go:253] Checking apiserver healthz at https://192.168.76.2:8443/healthz ...
I0731 23:40:54.009309 1829252 api_server.go:279] https://192.168.76.2:8443/healthz returned 200:
ok
I0731 23:40:54.011797 1829252 out.go:177]
W0731 23:40:54.013632 1829252 out.go:239] X Exiting due to K8S_UNHEALTHY_CONTROL_PLANE: wait 6m0s for node: wait for healthy API server: controlPlane never updated to v1.20.0
W0731 23:40:54.013674 1829252 out.go:239] * Suggestion: Control Plane could not update, try minikube delete --all --purge
W0731 23:40:54.013694 1829252 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/11417
W0731 23:40:54.013700 1829252 out.go:239] *
W0731 23:40:54.014777 1829252 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0731 23:40:54.018048 1829252 out.go:177]
==> CRI-O <==
Jul 31 23:38:46 old-k8s-version-130660 crio[634]: time="2024-07-31 23:38:46.899982742Z" level=info msg="Image fake.domain/registry.k8s.io/echoserver:1.4 not found" id=dcf1dee3-8b64-4f71-af31-76ba64cd6c82 name=/runtime.v1alpha2.ImageService/ImageStatus
Jul 31 23:39:01 old-k8s-version-130660 crio[634]: time="2024-07-31 23:39:01.899876571Z" level=info msg="Checking image status: fake.domain/registry.k8s.io/echoserver:1.4" id=88bbc092-7d94-4914-a3a4-cfb636b0bd6f name=/runtime.v1alpha2.ImageService/ImageStatus
Jul 31 23:39:01 old-k8s-version-130660 crio[634]: time="2024-07-31 23:39:01.900112984Z" level=info msg="Image fake.domain/registry.k8s.io/echoserver:1.4 not found" id=88bbc092-7d94-4914-a3a4-cfb636b0bd6f name=/runtime.v1alpha2.ImageService/ImageStatus
Jul 31 23:39:14 old-k8s-version-130660 crio[634]: time="2024-07-31 23:39:14.899751729Z" level=info msg="Checking image status: fake.domain/registry.k8s.io/echoserver:1.4" id=247be0dd-3fb0-4fa2-ba3f-b3c1bd34283f name=/runtime.v1alpha2.ImageService/ImageStatus
Jul 31 23:39:14 old-k8s-version-130660 crio[634]: time="2024-07-31 23:39:14.899991359Z" level=info msg="Image fake.domain/registry.k8s.io/echoserver:1.4 not found" id=247be0dd-3fb0-4fa2-ba3f-b3c1bd34283f name=/runtime.v1alpha2.ImageService/ImageStatus
Jul 31 23:39:25 old-k8s-version-130660 crio[634]: time="2024-07-31 23:39:25.899657311Z" level=info msg="Checking image status: fake.domain/registry.k8s.io/echoserver:1.4" id=7a5ca698-53c8-4392-ac71-c4b3f4311b24 name=/runtime.v1alpha2.ImageService/ImageStatus
Jul 31 23:39:25 old-k8s-version-130660 crio[634]: time="2024-07-31 23:39:25.899903317Z" level=info msg="Image fake.domain/registry.k8s.io/echoserver:1.4 not found" id=7a5ca698-53c8-4392-ac71-c4b3f4311b24 name=/runtime.v1alpha2.ImageService/ImageStatus
Jul 31 23:39:36 old-k8s-version-130660 crio[634]: time="2024-07-31 23:39:36.899668812Z" level=info msg="Checking image status: fake.domain/registry.k8s.io/echoserver:1.4" id=0434eb9e-1d72-4dcf-8e21-37f1439b5dfc name=/runtime.v1alpha2.ImageService/ImageStatus
Jul 31 23:39:36 old-k8s-version-130660 crio[634]: time="2024-07-31 23:39:36.899921808Z" level=info msg="Image fake.domain/registry.k8s.io/echoserver:1.4 not found" id=0434eb9e-1d72-4dcf-8e21-37f1439b5dfc name=/runtime.v1alpha2.ImageService/ImageStatus
Jul 31 23:39:47 old-k8s-version-130660 crio[634]: time="2024-07-31 23:39:47.899686524Z" level=info msg="Checking image status: fake.domain/registry.k8s.io/echoserver:1.4" id=987e2000-23d7-4da5-a35b-a2804223d414 name=/runtime.v1alpha2.ImageService/ImageStatus
Jul 31 23:39:47 old-k8s-version-130660 crio[634]: time="2024-07-31 23:39:47.899937895Z" level=info msg="Image fake.domain/registry.k8s.io/echoserver:1.4 not found" id=987e2000-23d7-4da5-a35b-a2804223d414 name=/runtime.v1alpha2.ImageService/ImageStatus
Jul 31 23:39:58 old-k8s-version-130660 crio[634]: time="2024-07-31 23:39:58.912839497Z" level=info msg="Checking image status: k8s.gcr.io/pause:3.2" id=28d5b8c1-0749-463d-bcf8-8aa969781dd6 name=/runtime.v1alpha2.ImageService/ImageStatus
Jul 31 23:39:58 old-k8s-version-130660 crio[634]: time="2024-07-31 23:39:58.913069117Z" level=info msg="Image status: &ImageStatusResponse{Image:&Image{Id:2a060e2e7101d419352bf82c613158587400be743482d9a537ec4a9d1b4eb93c,RepoTags:[k8s.gcr.io/pause:3.2 registry.k8s.io/pause:3.2],RepoDigests:[k8s.gcr.io/pause@sha256:31d3efd12022ffeffb3146bc10ae8beb890c80ed2f07363515580add7ed47636 k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f registry.k8s.io/pause@sha256:31d3efd12022ffeffb3146bc10ae8beb890c80ed2f07363515580add7ed47636 registry.k8s.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f],Size_:489397,Uid:nil,Username:,Spec:nil,},Info:map[string]string{},}" id=28d5b8c1-0749-463d-bcf8-8aa969781dd6 name=/runtime.v1alpha2.ImageService/ImageStatus
Jul 31 23:40:02 old-k8s-version-130660 crio[634]: time="2024-07-31 23:40:02.899673228Z" level=info msg="Checking image status: fake.domain/registry.k8s.io/echoserver:1.4" id=1eaeb963-6ff6-41ac-bfdf-9e91440753e5 name=/runtime.v1alpha2.ImageService/ImageStatus
Jul 31 23:40:02 old-k8s-version-130660 crio[634]: time="2024-07-31 23:40:02.899928021Z" level=info msg="Image fake.domain/registry.k8s.io/echoserver:1.4 not found" id=1eaeb963-6ff6-41ac-bfdf-9e91440753e5 name=/runtime.v1alpha2.ImageService/ImageStatus
Jul 31 23:40:16 old-k8s-version-130660 crio[634]: time="2024-07-31 23:40:16.899702216Z" level=info msg="Checking image status: fake.domain/registry.k8s.io/echoserver:1.4" id=b2a4ab2b-023e-4bb6-96ef-dcfef381f09f name=/runtime.v1alpha2.ImageService/ImageStatus
Jul 31 23:40:16 old-k8s-version-130660 crio[634]: time="2024-07-31 23:40:16.899941502Z" level=info msg="Image fake.domain/registry.k8s.io/echoserver:1.4 not found" id=b2a4ab2b-023e-4bb6-96ef-dcfef381f09f name=/runtime.v1alpha2.ImageService/ImageStatus
Jul 31 23:40:27 old-k8s-version-130660 crio[634]: time="2024-07-31 23:40:27.899722062Z" level=info msg="Checking image status: fake.domain/registry.k8s.io/echoserver:1.4" id=be5b8575-0edf-4ac4-b3cf-3a88d99d2bea name=/runtime.v1alpha2.ImageService/ImageStatus
Jul 31 23:40:27 old-k8s-version-130660 crio[634]: time="2024-07-31 23:40:27.899973614Z" level=info msg="Image fake.domain/registry.k8s.io/echoserver:1.4 not found" id=be5b8575-0edf-4ac4-b3cf-3a88d99d2bea name=/runtime.v1alpha2.ImageService/ImageStatus
Jul 31 23:40:38 old-k8s-version-130660 crio[634]: time="2024-07-31 23:40:38.900210123Z" level=info msg="Checking image status: fake.domain/registry.k8s.io/echoserver:1.4" id=7de4aa53-93e5-43a9-8e76-8fcdc23369db name=/runtime.v1alpha2.ImageService/ImageStatus
Jul 31 23:40:38 old-k8s-version-130660 crio[634]: time="2024-07-31 23:40:38.900522720Z" level=info msg="Image fake.domain/registry.k8s.io/echoserver:1.4 not found" id=7de4aa53-93e5-43a9-8e76-8fcdc23369db name=/runtime.v1alpha2.ImageService/ImageStatus
Jul 31 23:40:50 old-k8s-version-130660 crio[634]: time="2024-07-31 23:40:50.900421533Z" level=info msg="Checking image status: fake.domain/registry.k8s.io/echoserver:1.4" id=12f3756a-4f78-44f2-8531-e0c0ec728eac name=/runtime.v1alpha2.ImageService/ImageStatus
Jul 31 23:40:50 old-k8s-version-130660 crio[634]: time="2024-07-31 23:40:50.900651349Z" level=info msg="Image fake.domain/registry.k8s.io/echoserver:1.4 not found" id=12f3756a-4f78-44f2-8531-e0c0ec728eac name=/runtime.v1alpha2.ImageService/ImageStatus
Jul 31 23:40:50 old-k8s-version-130660 crio[634]: time="2024-07-31 23:40:50.901447392Z" level=info msg="Pulling image: fake.domain/registry.k8s.io/echoserver:1.4" id=dd767987-3c0b-4561-a664-5472dee7cadf name=/runtime.v1alpha2.ImageService/PullImage
Jul 31 23:40:50 old-k8s-version-130660 crio[634]: time="2024-07-31 23:40:50.904821476Z" level=info msg="Trying to access \"fake.domain/registry.k8s.io/echoserver:1.4\""
==> container status <==
CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID POD
1b7540ca63d79 a90209bb39e3d7b5fc9daf60c17044ea969aaca0333d672d8c7a34c7446e7ff7 2 minutes ago Exited dashboard-metrics-scraper 5 054246d4ac6ae dashboard-metrics-scraper-8d5bb5db8-2djx2
af4a5d8f7ff27 ba04bb24b95753201135cbc420b233c1b0b9fa2e1fd21d28319c348c33fbcde6 5 minutes ago Running storage-provisioner 1 5c2f3c2cc5eea storage-provisioner
d6f8ffde1c928 docker.io/kubernetesui/dashboard@sha256:2e500d29e9d5f4a086b908eb8dfe7ecac57d2ab09d65b24f588b1d449841ef93 5 minutes ago Running kubernetes-dashboard 0 4609e01539fba kubernetes-dashboard-cd95d586-d7gr2
bab863fc639de f42786f8afd2214fc59fbf9a26531806f562488d4a7d7a31e8b5e9ff6289b800 5 minutes ago Running kindnet-cni 0 cb7cb358f1a29 kindnet-mn77z
c21ba7634bd1a 25a5233254979d0678a2db1d15b76b73dc380d81bc5eed93916ba5638b3cd894 5 minutes ago Running kube-proxy 0 e3896281f468c kube-proxy-vsnfm
de1b5cb3d1876 db91994f4ee8f894a1e8a6c1a76f615da8fc3c019300a3686291ce6fcbc57895 5 minutes ago Running coredns 0 f452ead0e2b49 coredns-74ff55c5b-nqxld
e7eb6229b1138 ba04bb24b95753201135cbc420b233c1b0b9fa2e1fd21d28319c348c33fbcde6 5 minutes ago Exited storage-provisioner 0 5c2f3c2cc5eea storage-provisioner
7f31493ecac90 1611cd07b61d57dbbfebe6db242513fd51e1c02d20ba08af17a45837d86a8a8c 5 minutes ago Running busybox 0 d2aef0590fa89 busybox
9ea3346631678 e7605f88f17d6a4c3f083ef9c6f5f19b39f87e4d4406a05a8612b54a6ea57051 5 minutes ago Running kube-scheduler 0 07731dd5a4bbe kube-scheduler-old-k8s-version-130660
46018fe62e056 2c08bbbc02d3aa5dfbf4e79f15c0a61424049288917aa10364464ca1f7de7157 5 minutes ago Running kube-apiserver 0 20b068901f32d kube-apiserver-old-k8s-version-130660
6d2854e476f19 1df8a2b116bd16f7070fd383a6769c8d644b365575e8ffa3e492b84e4f05fc74 5 minutes ago Running kube-controller-manager 0 eb210d4e4b833 kube-controller-manager-old-k8s-version-130660
6854efb05017b 05b738aa1bc6355db8a2ee8639f3631b908286e43f584a3d2ee0c472de033c28 5 minutes ago Running etcd 0 7a6e1e669010a etcd-old-k8s-version-130660
==> coredns [de1b5cb3d187661a9da8df949ef36da261421dac028ae8e070be86f4226a470b] <==
I0731 23:35:40.078080 1 trace.go:116] Trace[1427131847]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125 (started: 2024-07-31 23:35:10.070755712 +0000 UTC m=+0.024212170) (total time: 30.004108197s):
Trace[1427131847]: [30.004108197s] [30.004108197s] END
I0731 23:35:40.078233 1 trace.go:116] Trace[2019727887]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125 (started: 2024-07-31 23:35:10.071295969 +0000 UTC m=+0.024752426) (total time: 30.003555608s):
Trace[2019727887]: [30.003555608s] [30.003555608s] END
E0731 23:35:40.078862 1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to list *v1.Namespace: Get "https://10.96.0.1:443/api/v1/namespaces?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
E0731 23:35:40.078874 1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to list *v1.Service: Get "https://10.96.0.1:443/api/v1/services?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
I0731 23:35:40.078903 1 trace.go:116] Trace[939984059]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125 (started: 2024-07-31 23:35:10.071660759 +0000 UTC m=+0.025117208) (total time: 30.003664146s):
Trace[939984059]: [30.003664146s] [30.003664146s] END
E0731 23:35:40.078939 1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to list *v1.Endpoints: Get "https://10.96.0.1:443/api/v1/endpoints?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
.:53
[INFO] plugin/reload: Running configuration MD5 = b494d968e357ba1b925cee838fbd78ed
CoreDNS-1.7.0
linux/arm64, go1.14.4, f59c03d
[INFO] 127.0.0.1:54533 - 46215 "HINFO IN 2621100387478719196.2366068292622856925. udp 57 false 512" NXDOMAIN qr,rd,ra 57 0.056196008s
[INFO] SIGTERM: Shutting down servers then terminating
[INFO] plugin/health: Going into lameduck mode for 5s
[INFO] plugin/ready: Still waiting on: "kubernetes"
.:53
[INFO] plugin/reload: Running configuration MD5 = b494d968e357ba1b925cee838fbd78ed
CoreDNS-1.7.0
linux/arm64, go1.14.4, f59c03d
[INFO] 127.0.0.1:36222 - 27038 "HINFO IN 1953295842623008160.1100682652371033117. udp 57 false 512" NXDOMAIN qr,rd,ra 57 0.031370362s
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/ready: Still waiting on: "kubernetes"
==> describe nodes <==
Name: old-k8s-version-130660
Roles: control-plane,master
Labels: beta.kubernetes.io/arch=arm64
beta.kubernetes.io/os=linux
kubernetes.io/arch=arm64
kubernetes.io/hostname=old-k8s-version-130660
kubernetes.io/os=linux
minikube.k8s.io/commit=578c9d758a3a1e9afe57056f3521c9dabc3709f1
minikube.k8s.io/name=old-k8s-version-130660
minikube.k8s.io/primary=true
minikube.k8s.io/updated_at=2024_07_31T23_32_32_0700
minikube.k8s.io/version=v1.33.1
node-role.kubernetes.io/control-plane=
node-role.kubernetes.io/master=
Annotations: kubeadm.alpha.kubernetes.io/cri-socket: /var/run/crio/crio.sock
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Wed, 31 Jul 2024 23:32:27 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: old-k8s-version-130660
AcquireTime: <unset>
RenewTime: Wed, 31 Jul 2024 23:40:50 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Wed, 31 Jul 2024 23:36:08 +0000 Wed, 31 Jul 2024 23:32:20 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Wed, 31 Jul 2024 23:36:08 +0000 Wed, 31 Jul 2024 23:32:20 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Wed, 31 Jul 2024 23:36:08 +0000 Wed, 31 Jul 2024 23:32:20 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Wed, 31 Jul 2024 23:36:08 +0000 Wed, 31 Jul 2024 23:33:09 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.76.2
Hostname: old-k8s-version-130660
Capacity:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022364Ki
pods: 110
Allocatable:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022364Ki
pods: 110
System Info:
Machine ID: 8357a49475f8484ca10c4e4c308f4805
System UUID: d80ff0ed-14fa-4145-ac0d-4897475e9a9c
Boot ID: 2daee006-f42a-4cec-a0b1-7137cc9806d6
Kernel Version: 5.15.0-1066-aws
OS Image: Ubuntu 22.04.4 LTS
Operating System: linux
Architecture: arm64
Container Runtime Version: cri-o://1.24.6
Kubelet Version: v1.20.0
Kube-Proxy Version: v1.20.0
PodCIDR: 10.244.0.0/24
PodCIDRs: 10.244.0.0/24
Non-terminated Pods: (12 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits AGE
--------- ---- ------------ ---------- --------------- ------------- ---
default busybox 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 6m38s
kube-system coredns-74ff55c5b-nqxld 100m (5%!)(MISSING) 0 (0%!)(MISSING) 70Mi (0%!)(MISSING) 170Mi (2%!)(MISSING) 8m7s
kube-system etcd-old-k8s-version-130660 100m (5%!)(MISSING) 0 (0%!)(MISSING) 100Mi (1%!)(MISSING) 0 (0%!)(MISSING) 8m16s
kube-system kindnet-mn77z 100m (5%!)(MISSING) 100m (5%!)(MISSING) 50Mi (0%!)(MISSING) 50Mi (0%!)(MISSING) 8m7s
kube-system kube-apiserver-old-k8s-version-130660 250m (12%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 8m16s
kube-system kube-controller-manager-old-k8s-version-130660 200m (10%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 8m16s
kube-system kube-proxy-vsnfm 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 8m7s
kube-system kube-scheduler-old-k8s-version-130660 100m (5%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 8m16s
kube-system metrics-server-9975d5f86-w25p2 100m (5%!)(MISSING) 0 (0%!)(MISSING) 200Mi (2%!)(MISSING) 0 (0%!)(MISSING) 6m27s
kube-system storage-provisioner 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 8m5s
kubernetes-dashboard dashboard-metrics-scraper-8d5bb5db8-2djx2 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 5m29s
kubernetes-dashboard kubernetes-dashboard-cd95d586-d7gr2 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 5m29s
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 950m (47%!)(MISSING) 100m (5%!)(MISSING)
memory 420Mi (5%!)(MISSING) 220Mi (2%!)(MISSING)
ephemeral-storage 100Mi (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-1Gi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-2Mi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-32Mi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-64Ki 0 (0%!)(MISSING) 0 (0%!)(MISSING)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal NodeHasSufficientMemory 8m36s (x6 over 8m36s) kubelet Node old-k8s-version-130660 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 8m36s (x6 over 8m36s) kubelet Node old-k8s-version-130660 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 8m36s (x5 over 8m36s) kubelet Node old-k8s-version-130660 status is now: NodeHasSufficientPID
Normal Starting 8m16s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 8m16s kubelet Node old-k8s-version-130660 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 8m16s kubelet Node old-k8s-version-130660 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 8m16s kubelet Node old-k8s-version-130660 status is now: NodeHasSufficientPID
Normal Starting 8m5s kube-proxy Starting kube-proxy.
Normal NodeReady 7m46s kubelet Node old-k8s-version-130660 status is now: NodeReady
Normal Starting 5m57s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 5m56s (x8 over 5m57s) kubelet Node old-k8s-version-130660 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 5m56s (x8 over 5m57s) kubelet Node old-k8s-version-130660 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 5m56s (x8 over 5m57s) kubelet Node old-k8s-version-130660 status is now: NodeHasSufficientPID
Normal Starting 5m45s kube-proxy Starting kube-proxy.
==> dmesg <==
[ +0.001076] FS-Cache: O-key=[8] 'e9425c0100000000'
[ +0.000699] FS-Cache: N-cookie c=00000066 [p=0000005d fl=2 nc=0 na=1]
[ +0.000926] FS-Cache: N-cookie d=00000000f00cf1f7{9p.inode} n=0000000010dcae3a
[ +0.001066] FS-Cache: N-key=[8] 'e9425c0100000000'
[ +0.003323] FS-Cache: Duplicate cookie detected
[ +0.000714] FS-Cache: O-cookie c=00000060 [p=0000005d fl=226 nc=0 na=1]
[ +0.000965] FS-Cache: O-cookie d=00000000f00cf1f7{9p.inode} n=000000008137feed
[ +0.001033] FS-Cache: O-key=[8] 'e9425c0100000000'
[ +0.000700] FS-Cache: N-cookie c=00000067 [p=0000005d fl=2 nc=0 na=1]
[ +0.000934] FS-Cache: N-cookie d=00000000f00cf1f7{9p.inode} n=000000008229c300
[ +0.001049] FS-Cache: N-key=[8] 'e9425c0100000000'
[ +2.406021] FS-Cache: Duplicate cookie detected
[ +0.000900] FS-Cache: O-cookie c=0000005e [p=0000005d fl=226 nc=0 na=1]
[ +0.000989] FS-Cache: O-cookie d=00000000f00cf1f7{9p.inode} n=000000006a2b576b
[ +0.001058] FS-Cache: O-key=[8] 'e8425c0100000000'
[ +0.000713] FS-Cache: N-cookie c=00000069 [p=0000005d fl=2 nc=0 na=1]
[ +0.000953] FS-Cache: N-cookie d=00000000f00cf1f7{9p.inode} n=0000000010dcae3a
[ +0.001056] FS-Cache: N-key=[8] 'e8425c0100000000'
[ +0.338126] FS-Cache: Duplicate cookie detected
[ +0.000735] FS-Cache: O-cookie c=00000063 [p=0000005d fl=226 nc=0 na=1]
[ +0.001013] FS-Cache: O-cookie d=00000000f00cf1f7{9p.inode} n=00000000b39452db
[ +0.001050] FS-Cache: O-key=[8] 'ee425c0100000000'
[ +0.000704] FS-Cache: N-cookie c=0000006a [p=0000005d fl=2 nc=0 na=1]
[ +0.000939] FS-Cache: N-cookie d=00000000f00cf1f7{9p.inode} n=0000000096d94e31
[ +0.001056] FS-Cache: N-key=[8] 'ee425c0100000000'
==> etcd [6854efb05017bc711513167086bed436131771d8c2f42fe3910912ac80224c6c] <==
2024-07-31 23:36:47.396396 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-31 23:36:57.396497 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-31 23:37:07.396344 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-31 23:37:17.396414 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-31 23:37:27.396411 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-31 23:37:37.396285 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-31 23:37:47.396370 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-31 23:37:57.396473 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-31 23:38:07.396641 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-31 23:38:17.396383 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-31 23:38:27.396338 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-31 23:38:37.396350 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-31 23:38:47.396471 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-31 23:38:57.396329 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-31 23:39:07.396308 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-31 23:39:17.396617 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-31 23:39:27.396428 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-31 23:39:37.396376 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-31 23:39:47.396384 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-31 23:39:57.396818 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-31 23:40:07.396322 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-31 23:40:17.396254 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-31 23:40:27.396337 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-31 23:40:37.396306 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-31 23:40:47.396247 I | etcdserver/api/etcdhttp: /health OK (status code 200)
==> kernel <==
23:40:55 up 7:23, 0 users, load average: 0.95, 1.65, 2.49
Linux old-k8s-version-130660 5.15.0-1066-aws #72~20.04.1-Ubuntu SMP Sat Jul 20 07:44:07 UTC 2024 aarch64 aarch64 aarch64 GNU/Linux
PRETTY_NAME="Ubuntu 22.04.4 LTS"
==> kindnet [bab863fc639de5e0d2e1165a89d0b3b22043e0ffdb80ad3296bca7a7262985f7] <==
I0731 23:38:52.021675 1 main.go:299] handling current node
I0731 23:39:02.021193 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I0731 23:39:02.021230 1 main.go:299] handling current node
I0731 23:39:12.014287 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I0731 23:39:12.014324 1 main.go:299] handling current node
I0731 23:39:22.013724 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I0731 23:39:22.013764 1 main.go:299] handling current node
I0731 23:39:32.021223 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I0731 23:39:32.021353 1 main.go:299] handling current node
I0731 23:39:42.021386 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I0731 23:39:42.021425 1 main.go:299] handling current node
I0731 23:39:52.019131 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I0731 23:39:52.019284 1 main.go:299] handling current node
I0731 23:40:02.023275 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I0731 23:40:02.023391 1 main.go:299] handling current node
I0731 23:40:12.013693 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I0731 23:40:12.013735 1 main.go:299] handling current node
I0731 23:40:22.021175 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I0731 23:40:22.021281 1 main.go:299] handling current node
I0731 23:40:32.021201 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I0731 23:40:32.021237 1 main.go:299] handling current node
I0731 23:40:42.022197 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I0731 23:40:42.022256 1 main.go:299] handling current node
I0731 23:40:52.017287 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I0731 23:40:52.017351 1 main.go:299] handling current node
==> kube-apiserver [46018fe62e056d85a9d92909a3ffe934843c413af90487065b86f79764b6e416] <==
I0731 23:37:38.882034 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0731 23:37:38.882042 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0731 23:38:10.080413 1 client.go:360] parsed scheme: "passthrough"
I0731 23:38:10.080457 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0731 23:38:10.080466 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
W0731 23:38:10.867986 1 handler_proxy.go:102] no RequestInfo found in the context
E0731 23:38:10.868058 1 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I0731 23:38:10.868066 1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
I0731 23:38:51.142601 1 client.go:360] parsed scheme: "passthrough"
I0731 23:38:51.142644 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0731 23:38:51.142653 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0731 23:39:25.957143 1 client.go:360] parsed scheme: "passthrough"
I0731 23:39:25.957185 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0731 23:39:25.957193 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0731 23:40:07.465284 1 client.go:360] parsed scheme: "passthrough"
I0731 23:40:07.465440 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0731 23:40:07.465476 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
W0731 23:40:08.877029 1 handler_proxy.go:102] no RequestInfo found in the context
E0731 23:40:08.877164 1 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I0731 23:40:08.877179 1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
I0731 23:40:37.586805 1 client.go:360] parsed scheme: "passthrough"
I0731 23:40:37.586933 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0731 23:40:37.586967 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
==> kube-controller-manager [6d2854e476f196556888fd39fa1c3e23a43223b6bf7632e42e8a2d3e07316f00] <==
W0731 23:36:32.360586 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0731 23:36:58.400694 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0731 23:37:04.011162 1 request.go:655] Throttling request took 1.047917103s, request: GET:https://192.168.76.2:8443/apis/rbac.authorization.k8s.io/v1beta1?timeout=32s
W0731 23:37:04.862583 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0731 23:37:28.903029 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0731 23:37:36.512961 1 request.go:655] Throttling request took 1.048290503s, request: GET:https://192.168.76.2:8443/apis/extensions/v1beta1?timeout=32s
W0731 23:37:37.364516 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0731 23:37:59.405016 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0731 23:38:09.014778 1 request.go:655] Throttling request took 1.048214158s, request: GET:https://192.168.76.2:8443/apis/extensions/v1beta1?timeout=32s
W0731 23:38:09.866328 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0731 23:38:29.906798 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0731 23:38:41.516784 1 request.go:655] Throttling request took 1.048355477s, request: GET:https://192.168.76.2:8443/apis/apiextensions.k8s.io/v1?timeout=32s
W0731 23:38:42.368195 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0731 23:39:00.408907 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0731 23:39:14.018633 1 request.go:655] Throttling request took 1.048495778s, request: GET:https://192.168.76.2:8443/apis/apiextensions.k8s.io/v1?timeout=32s
W0731 23:39:14.870354 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0731 23:39:30.914765 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0731 23:39:46.520782 1 request.go:655] Throttling request took 1.048469672s, request: GET:https://192.168.76.2:8443/apis/coordination.k8s.io/v1?timeout=32s
W0731 23:39:47.372394 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0731 23:40:01.416826 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0731 23:40:19.022828 1 request.go:655] Throttling request took 1.048300016s, request: GET:https://192.168.76.2:8443/apis/apiextensions.k8s.io/v1beta1?timeout=32s
W0731 23:40:19.874468 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0731 23:40:31.919243 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0731 23:40:51.524885 1 request.go:655] Throttling request took 1.048378163s, request: GET:https://192.168.76.2:8443/apis/scheduling.k8s.io/v1beta1?timeout=32s
W0731 23:40:52.376307 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
==> kube-proxy [c21ba7634bd1a874c9ebc36d102421cb8c623f6f4fc40ef723fae526a1693796] <==
I0731 23:32:50.371923 1 node.go:172] Successfully retrieved node IP: 192.168.76.2
I0731 23:32:50.381291 1 server_others.go:142] kube-proxy node IP is an IPv4 address (192.168.76.2), assume IPv4 operation
W0731 23:32:50.791345 1 server_others.go:578] Unknown proxy mode "", assuming iptables proxy
I0731 23:32:50.791523 1 server_others.go:185] Using iptables Proxier.
I0731 23:32:50.791895 1 server.go:650] Version: v1.20.0
I0731 23:32:50.806445 1 config.go:315] Starting service config controller
I0731 23:32:50.806556 1 shared_informer.go:240] Waiting for caches to sync for service config
I0731 23:32:50.806611 1 config.go:224] Starting endpoint slice config controller
I0731 23:32:50.806669 1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config
I0731 23:32:50.943544 1 shared_informer.go:247] Caches are synced for service config
I0731 23:32:51.006913 1 shared_informer.go:247] Caches are synced for endpoint slice config
I0731 23:35:10.390130 1 node.go:172] Successfully retrieved node IP: 192.168.76.2
I0731 23:35:10.390209 1 server_others.go:142] kube-proxy node IP is an IPv4 address (192.168.76.2), assume IPv4 operation
W0731 23:35:10.410547 1 server_others.go:578] Unknown proxy mode "", assuming iptables proxy
I0731 23:35:10.410636 1 server_others.go:185] Using iptables Proxier.
I0731 23:35:10.410945 1 server.go:650] Version: v1.20.0
I0731 23:35:10.411678 1 config.go:315] Starting service config controller
I0731 23:35:10.411696 1 shared_informer.go:240] Waiting for caches to sync for service config
I0731 23:35:10.411712 1 config.go:224] Starting endpoint slice config controller
I0731 23:35:10.411716 1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config
I0731 23:35:10.511842 1 shared_informer.go:247] Caches are synced for endpoint slice config
I0731 23:35:10.511853 1 shared_informer.go:247] Caches are synced for service config
==> kube-scheduler [9ea334663167822d57c49e09d75be27e43c4d14410ab00696d0bd381e74ba548] <==
E0731 23:32:27.669529 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
E0731 23:32:27.669618 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
E0731 23:32:27.669682 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
E0731 23:32:27.669743 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
E0731 23:32:27.669800 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
E0731 23:32:27.669855 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
E0731 23:32:27.669917 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
E0731 23:32:27.669970 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
E0731 23:32:27.670025 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1beta1.PodDisruptionBudget: failed to list *v1beta1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
E0731 23:32:27.670073 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
E0731 23:32:27.670130 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
E0731 23:32:27.700096 1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
E0731 23:32:28.578195 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
E0731 23:32:28.828228 1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
I0731 23:32:30.738009 1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0731 23:35:02.621448 1 serving.go:331] Generated self-signed cert in-memory
W0731 23:35:07.673442 1 requestheader_controller.go:193] Unable to get configmap/extension-apiserver-authentication in kube-system. Usually fixed by 'kubectl create rolebinding -n kube-system ROLEBINDING_NAME --role=extension-apiserver-authentication-reader --serviceaccount=YOUR_NS:YOUR_SA'
W0731 23:35:07.679740 1 authentication.go:332] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"
W0731 23:35:07.679851 1 authentication.go:333] Continuing without authentication configuration. This may treat all requests as anonymous.
W0731 23:35:07.679880 1 authentication.go:334] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false
I0731 23:35:08.077324 1 configmap_cafile_content.go:202] Starting client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0731 23:35:08.078129 1 secure_serving.go:197] Serving securely on 127.0.0.1:10259
I0731 23:35:08.078516 1 tlsconfig.go:240] Starting DynamicServingCertificateController
I0731 23:35:08.080558 1 shared_informer.go:240] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0731 23:35:08.281060 1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
==> kubelet <==
Jul 31 23:39:32 old-k8s-version-130660 kubelet[742]: I0731 23:39:32.899342 742 scope.go:95] [topologymanager] RemoveContainer - Container ID: 1b7540ca63d793d42628186a8999cc39f9be115888f99c4961663ec84e58c5f2
Jul 31 23:39:32 old-k8s-version-130660 kubelet[742]: E0731 23:39:32.900100 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
Jul 31 23:39:36 old-k8s-version-130660 kubelet[742]: E0731 23:39:36.900554 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jul 31 23:39:46 old-k8s-version-130660 kubelet[742]: I0731 23:39:46.899323 742 scope.go:95] [topologymanager] RemoveContainer - Container ID: 1b7540ca63d793d42628186a8999cc39f9be115888f99c4961663ec84e58c5f2
Jul 31 23:39:46 old-k8s-version-130660 kubelet[742]: E0731 23:39:46.899659 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
Jul 31 23:39:47 old-k8s-version-130660 kubelet[742]: E0731 23:39:47.900629 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jul 31 23:39:57 old-k8s-version-130660 kubelet[742]: I0731 23:39:57.899372 742 scope.go:95] [topologymanager] RemoveContainer - Container ID: 1b7540ca63d793d42628186a8999cc39f9be115888f99c4961663ec84e58c5f2
Jul 31 23:39:57 old-k8s-version-130660 kubelet[742]: E0731 23:39:57.899835 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
Jul 31 23:39:58 old-k8s-version-130660 kubelet[742]: E0731 23:39:58.947686 742 container_manager_linux.go:533] failed to find cgroups of kubelet - cpu and memory cgroup hierarchy not unified. cpu: /docker/113aa41627b627283271b1441f6762c7553c9518cd510a6ea5aeb3e393c5884b, memory: /docker/113aa41627b627283271b1441f6762c7553c9518cd510a6ea5aeb3e393c5884b/system.slice/kubelet.service
Jul 31 23:40:02 old-k8s-version-130660 kubelet[742]: E0731 23:40:02.900337 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jul 31 23:40:11 old-k8s-version-130660 kubelet[742]: I0731 23:40:11.899356 742 scope.go:95] [topologymanager] RemoveContainer - Container ID: 1b7540ca63d793d42628186a8999cc39f9be115888f99c4961663ec84e58c5f2
Jul 31 23:40:11 old-k8s-version-130660 kubelet[742]: E0731 23:40:11.899717 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
Jul 31 23:40:16 old-k8s-version-130660 kubelet[742]: E0731 23:40:16.900104 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jul 31 23:40:24 old-k8s-version-130660 kubelet[742]: I0731 23:40:24.899403 742 scope.go:95] [topologymanager] RemoveContainer - Container ID: 1b7540ca63d793d42628186a8999cc39f9be115888f99c4961663ec84e58c5f2
Jul 31 23:40:24 old-k8s-version-130660 kubelet[742]: E0731 23:40:24.899764 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
Jul 31 23:40:27 old-k8s-version-130660 kubelet[742]: E0731 23:40:27.900206 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jul 31 23:40:37 old-k8s-version-130660 kubelet[742]: I0731 23:40:37.900121 742 scope.go:95] [topologymanager] RemoveContainer - Container ID: 1b7540ca63d793d42628186a8999cc39f9be115888f99c4961663ec84e58c5f2
Jul 31 23:40:37 old-k8s-version-130660 kubelet[742]: E0731 23:40:37.900394 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
Jul 31 23:40:38 old-k8s-version-130660 kubelet[742]: E0731 23:40:38.900915 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jul 31 23:40:50 old-k8s-version-130660 kubelet[742]: I0731 23:40:50.899725 742 scope.go:95] [topologymanager] RemoveContainer - Container ID: 1b7540ca63d793d42628186a8999cc39f9be115888f99c4961663ec84e58c5f2
Jul 31 23:40:50 old-k8s-version-130660 kubelet[742]: E0731 23:40:50.900033 742 pod_workers.go:191] Error syncing pod 62cef1bb-e263-4d9e-8953-1ad4573f338f ("dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2djx2_kubernetes-dashboard(62cef1bb-e263-4d9e-8953-1ad4573f338f)"
Jul 31 23:40:50 old-k8s-version-130660 kubelet[742]: E0731 23:40:50.910039 742 remote_image.go:113] PullImage "fake.domain/registry.k8s.io/echoserver:1.4" from image service failed: rpc error: code = Unknown desc = pinging container registry fake.domain: Get "https://fake.domain/v2/": dial tcp: lookup fake.domain: no such host
Jul 31 23:40:50 old-k8s-version-130660 kubelet[742]: E0731 23:40:50.910095 742 kuberuntime_image.go:51] Pull image "fake.domain/registry.k8s.io/echoserver:1.4" failed: rpc error: code = Unknown desc = pinging container registry fake.domain: Get "https://fake.domain/v2/": dial tcp: lookup fake.domain: no such host
Jul 31 23:40:50 old-k8s-version-130660 kubelet[742]: E0731 23:40:50.910237 742 kuberuntime_manager.go:829] container &Container{Name:metrics-server,Image:fake.domain/registry.k8s.io/echoserver:1.4,Command:[],Args:[--cert-dir=/tmp --secure-port=4443 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --kubelet-use-node-status-port --metric-resolution=60s --kubelet-insecure-tls],WorkingDir:,Ports:[]ContainerPort{ContainerPort{Name:https,HostPort:0,ContainerPort:4443,Protocol:TCP,HostIP:,},},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{cpu: {{100 -3} {<nil>} 100m DecimalSI},memory: {{209715200 0} {<nil>} BinarySI},},},VolumeMounts:[]VolumeMount{VolumeMount{Name:tmp-dir,ReadOnly:false,MountPath:/tmp,SubPath:,MountPropagation:nil,SubPathExpr:,},VolumeMount{Name:metrics-server-token-kr52c,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:&Probe{Handler:Handler{Exec
:nil,HTTPGet:&HTTPGetAction{Path:/livez,Port:{1 0 https},Host:,Scheme:HTTPS,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,},InitialDelaySeconds:0,TimeoutSeconds:1,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,},ReadinessProbe:&Probe{Handler:Handler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/readyz,Port:{1 0 https},Host:,Scheme:HTTPS,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,},InitialDelaySeconds:0,TimeoutSeconds:1,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:*1000,RunAsNonRoot:*true,ReadOnlyRootFilesystem:*true,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,} start failed in pod metrics-server-9975d5f86-w25p2_kube-system(180c0bc
6-049d-49d6-99f7-1e714957a21c): ErrImagePull: rpc error: code = Unknown desc = pinging container registry fake.domain: Get "https://fake.domain/v2/": dial tcp: lookup fake.domain: no such host
Jul 31 23:40:50 old-k8s-version-130660 kubelet[742]: E0731 23:40:50.910265 742 pod_workers.go:191] Error syncing pod 180c0bc6-049d-49d6-99f7-1e714957a21c ("metrics-server-9975d5f86-w25p2_kube-system(180c0bc6-049d-49d6-99f7-1e714957a21c)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
==> kubernetes-dashboard [d6f8ffde1c928670ca20febc0c4a113d8ad3e22267d8fd745d5c54e8cc854a27] <==
2024/07/31 23:35:32 Starting overwatch
2024/07/31 23:35:32 Using namespace: kubernetes-dashboard
2024/07/31 23:35:32 Using in-cluster config to connect to apiserver
2024/07/31 23:35:32 Using secret token for csrf signing
2024/07/31 23:35:32 Initializing csrf token from kubernetes-dashboard-csrf secret
2024/07/31 23:35:32 Empty token. Generating and storing in a secret kubernetes-dashboard-csrf
2024/07/31 23:35:32 Successful initial request to the apiserver, version: v1.20.0
2024/07/31 23:35:32 Generating JWE encryption key
2024/07/31 23:35:32 New synchronizer has been registered: kubernetes-dashboard-key-holder-kubernetes-dashboard. Starting
2024/07/31 23:35:32 Starting secret synchronizer for kubernetes-dashboard-key-holder in namespace kubernetes-dashboard
2024/07/31 23:35:33 Initializing JWE encryption key from synchronized object
2024/07/31 23:35:33 Creating in-cluster Sidecar client
2024/07/31 23:35:33 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/07/31 23:35:33 Serving insecurely on HTTP port: 9090
2024/07/31 23:36:03 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/07/31 23:36:33 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/07/31 23:37:03 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/07/31 23:37:33 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/07/31 23:38:03 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/07/31 23:38:33 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/07/31 23:39:03 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/07/31 23:39:33 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/07/31 23:40:03 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/07/31 23:40:33 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
==> storage-provisioner [af4a5d8f7ff273f31d82cb997af6a85d6437344b03032e0188e4e18ed9144b92] <==
I0731 23:35:40.256455 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
I0731 23:35:40.272246 1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
I0731 23:35:40.272298 1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
I0731 23:35:57.703286 1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
I0731 23:35:57.703455 1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_old-k8s-version-130660_c5fdeed3-ab2e-4cb4-8e19-c738de15768f!
I0731 23:35:57.704829 1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"bfc914c5-d339-44cd-8001-02f9570aee39", APIVersion:"v1", ResourceVersion:"825", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' old-k8s-version-130660_c5fdeed3-ab2e-4cb4-8e19-c738de15768f became leader
I0731 23:35:57.804156 1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_old-k8s-version-130660_c5fdeed3-ab2e-4cb4-8e19-c738de15768f!
==> storage-provisioner [e7eb6229b113884a77ab02b300c2b453be8b1723c83dc8f8862391ed9ef419e1] <==
I0731 23:33:14.768146 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
I0731 23:33:14.835948 1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
I0731 23:33:14.836102 1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
I0731 23:33:14.890243 1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
I0731 23:33:14.890464 1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_old-k8s-version-130660_4ca33899-0055-4da1-b50e-ffa5654739b2!
I0731 23:33:14.897872 1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"bfc914c5-d339-44cd-8001-02f9570aee39", APIVersion:"v1", ResourceVersion:"498", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' old-k8s-version-130660_4ca33899-0055-4da1-b50e-ffa5654739b2 became leader
I0731 23:33:14.991616 1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_old-k8s-version-130660_4ca33899-0055-4da1-b50e-ffa5654739b2!
I0731 23:35:09.805699 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
F0731 23:35:39.807837 1 main.go:39] error getting server version: Get "https://10.96.0.1:443/version?timeout=32s": dial tcp 10.96.0.1:443: i/o timeout
-- /stdout --
helpers_test.go:254: (dbg) Run: out/minikube-linux-arm64 status --format={{.APIServer}} -p old-k8s-version-130660 -n old-k8s-version-130660
helpers_test.go:261: (dbg) Run: kubectl --context old-k8s-version-130660 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:272: non-running pods: metrics-server-9975d5f86-w25p2
helpers_test.go:274: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: describe non-running pods <======
helpers_test.go:277: (dbg) Run: kubectl --context old-k8s-version-130660 describe pod metrics-server-9975d5f86-w25p2
helpers_test.go:277: (dbg) Non-zero exit: kubectl --context old-k8s-version-130660 describe pod metrics-server-9975d5f86-w25p2: exit status 1 (96.845839ms)
** stderr **
Error from server (NotFound): pods "metrics-server-9975d5f86-w25p2" not found
** /stderr **
helpers_test.go:279: kubectl --context old-k8s-version-130660 describe pod metrics-server-9975d5f86-w25p2: exit status 1
--- FAIL: TestStartStop/group/old-k8s-version/serial/SecondStart (374.06s)