=== RUN TestStartStop/group/old-k8s-version/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run: out/minikube-linux-arm64 start -p old-k8s-version-023742 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=containerd --kubernetes-version=v1.20.0
E0314 01:06:38.465535 1963897 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18375-1958430/.minikube/profiles/functional-362954/client.crt: no such file or directory
start_stop_delete_test.go:256: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p old-k8s-version-023742 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=containerd --kubernetes-version=v1.20.0: exit status 80 (6m9.57352381s)
-- stdout --
* [old-k8s-version-023742] minikube v1.32.0 on Ubuntu 20.04 (arm64)
- MINIKUBE_LOCATION=18375
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/18375-1958430/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/18375-1958430/.minikube
- MINIKUBE_BIN=out/minikube-linux-arm64
- MINIKUBE_FORCE_SYSTEMD=
* Kubernetes 1.28.4 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.28.4
* Using the docker driver based on existing profile
* Starting "old-k8s-version-023742" primary control-plane node in "old-k8s-version-023742" cluster
* Pulling base image v0.0.42-1710284843-18375 ...
* Restarting existing docker container for "old-k8s-version-023742" ...
* Preparing Kubernetes v1.20.0 on containerd 1.6.28 ...
* Verifying Kubernetes components...
- Using image gcr.io/k8s-minikube/storage-provisioner:v5
- Using image docker.io/kubernetesui/dashboard:v2.7.0
- Using image registry.k8s.io/echoserver:1.4
- Using image fake.domain/registry.k8s.io/echoserver:1.4
* Some dashboard features require the metrics-server addon. To enable all features please run:
minikube -p old-k8s-version-023742 addons enable metrics-server
* Enabled addons: default-storageclass, storage-provisioner, metrics-server, dashboard
-- /stdout --
** stderr **
I0314 01:06:01.799114 2159335 out.go:291] Setting OutFile to fd 1 ...
I0314 01:06:01.799394 2159335 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0314 01:06:01.799423 2159335 out.go:304] Setting ErrFile to fd 2...
I0314 01:06:01.799443 2159335 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0314 01:06:01.799709 2159335 root.go:338] Updating PATH: /home/jenkins/minikube-integration/18375-1958430/.minikube/bin
I0314 01:06:01.800129 2159335 out.go:298] Setting JSON to false
I0314 01:06:01.801123 2159335 start.go:129] hostinfo: {"hostname":"ip-172-31-31-251","uptime":31712,"bootTime":1710346650,"procs":194,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1055-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"982e3628-3742-4b3e-bb63-ac1b07660ec7"}
I0314 01:06:01.801223 2159335 start.go:139] virtualization:
I0314 01:06:01.804113 2159335 out.go:177] * [old-k8s-version-023742] minikube v1.32.0 on Ubuntu 20.04 (arm64)
I0314 01:06:01.806863 2159335 notify.go:220] Checking for updates...
I0314 01:06:01.806924 2159335 out.go:177] - MINIKUBE_LOCATION=18375
I0314 01:06:01.809402 2159335 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0314 01:06:01.811450 2159335 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/18375-1958430/kubeconfig
I0314 01:06:01.813323 2159335 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/18375-1958430/.minikube
I0314 01:06:01.815649 2159335 out.go:177] - MINIKUBE_BIN=out/minikube-linux-arm64
I0314 01:06:01.817988 2159335 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0314 01:06:01.820381 2159335 config.go:182] Loaded profile config "old-k8s-version-023742": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0
I0314 01:06:01.822874 2159335 out.go:177] * Kubernetes 1.28.4 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.28.4
I0314 01:06:01.825028 2159335 driver.go:392] Setting default libvirt URI to qemu:///system
I0314 01:06:01.859354 2159335 docker.go:122] docker version: linux-25.0.4:Docker Engine - Community
I0314 01:06:01.859463 2159335 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0314 01:06:01.946464 2159335 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:56 OomKillDisable:true NGoroutines:71 SystemTime:2024-03-14 01:06:01.935852922 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1055-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215040000 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:25.0.4 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:ae07eda36dd25f8a1b98dfbf587313b99c0190bb Expected:ae07eda36dd25f8a1b98dfbf587313b99c0190bb} RuncCommit:{ID:v1.1.12-0-g51d5e94 Expected:v1.1.12-0-g51d5e94} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.13.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.24.7]] Warnings:<nil>}}
I0314 01:06:01.946585 2159335 docker.go:295] overlay module found
I0314 01:06:01.949774 2159335 out.go:177] * Using the docker driver based on existing profile
I0314 01:06:01.952901 2159335 start.go:297] selected driver: docker
I0314 01:06:01.952929 2159335 start.go:901] validating driver "docker" against &{Name:old-k8s-version-023742 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1710284843-18375@sha256:d67c38c9fc2ad14c48d95e17cbac49314325db5758d8f7b3de60b927e62ce94f Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-023742 Namespace:default APIServerHAVIP: AP
IServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:fa
lse MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0314 01:06:01.953048 2159335 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0314 01:06:01.953645 2159335 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0314 01:06:02.084812 2159335 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:56 OomKillDisable:true NGoroutines:71 SystemTime:2024-03-14 01:06:02.070327976 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1055-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215040000 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:25.0.4 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:ae07eda36dd25f8a1b98dfbf587313b99c0190bb Expected:ae07eda36dd25f8a1b98dfbf587313b99c0190bb} RuncCommit:{ID:v1.1.12-0-g51d5e94 Expected:v1.1.12-0-g51d5e94} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.13.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.24.7]] Warnings:<nil>}}
I0314 01:06:02.085200 2159335 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0314 01:06:02.085247 2159335 cni.go:84] Creating CNI manager for ""
I0314 01:06:02.085256 2159335 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0314 01:06:02.085296 2159335 start.go:340] cluster config:
{Name:old-k8s-version-023742 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1710284843-18375@sha256:d67c38c9fc2ad14c48d95e17cbac49314325db5758d8f7b3de60b927e62ce94f Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-023742 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local
ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:do
cker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0314 01:06:02.089036 2159335 out.go:177] * Starting "old-k8s-version-023742" primary control-plane node in "old-k8s-version-023742" cluster
I0314 01:06:02.090898 2159335 cache.go:121] Beginning downloading kic base image for docker with containerd
I0314 01:06:02.092783 2159335 out.go:177] * Pulling base image v0.0.42-1710284843-18375 ...
I0314 01:06:02.094898 2159335 preload.go:132] Checking if preload exists for k8s version v1.20.0 and runtime containerd
I0314 01:06:02.094966 2159335 preload.go:147] Found local preload: /home/jenkins/minikube-integration/18375-1958430/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-containerd-overlay2-arm64.tar.lz4
I0314 01:06:02.094977 2159335 cache.go:56] Caching tarball of preloaded images
I0314 01:06:02.095078 2159335 preload.go:173] Found /home/jenkins/minikube-integration/18375-1958430/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-containerd-overlay2-arm64.tar.lz4 in cache, skipping download
I0314 01:06:02.095087 2159335 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on containerd
I0314 01:06:02.095249 2159335 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1710284843-18375@sha256:d67c38c9fc2ad14c48d95e17cbac49314325db5758d8f7b3de60b927e62ce94f in local docker daemon
I0314 01:06:02.095492 2159335 profile.go:142] Saving config to /home/jenkins/minikube-integration/18375-1958430/.minikube/profiles/old-k8s-version-023742/config.json ...
I0314 01:06:02.113781 2159335 image.go:83] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1710284843-18375@sha256:d67c38c9fc2ad14c48d95e17cbac49314325db5758d8f7b3de60b927e62ce94f in local docker daemon, skipping pull
I0314 01:06:02.113804 2159335 cache.go:144] gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1710284843-18375@sha256:d67c38c9fc2ad14c48d95e17cbac49314325db5758d8f7b3de60b927e62ce94f exists in daemon, skipping load
I0314 01:06:02.113828 2159335 cache.go:194] Successfully downloaded all kic artifacts
I0314 01:06:02.113858 2159335 start.go:360] acquireMachinesLock for old-k8s-version-023742: {Name:mk32bdb07109f0a14387bd5220e4855b0638f0fe Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0314 01:06:02.113930 2159335 start.go:364] duration metric: took 51.06µs to acquireMachinesLock for "old-k8s-version-023742"
I0314 01:06:02.113951 2159335 start.go:96] Skipping create...Using existing machine configuration
I0314 01:06:02.113957 2159335 fix.go:54] fixHost starting:
I0314 01:06:02.114230 2159335 cli_runner.go:164] Run: docker container inspect old-k8s-version-023742 --format={{.State.Status}}
I0314 01:06:02.134769 2159335 fix.go:112] recreateIfNeeded on old-k8s-version-023742: state=Stopped err=<nil>
W0314 01:06:02.134796 2159335 fix.go:138] unexpected machine state, will restart: <nil>
I0314 01:06:02.137006 2159335 out.go:177] * Restarting existing docker container for "old-k8s-version-023742" ...
I0314 01:06:02.138792 2159335 cli_runner.go:164] Run: docker start old-k8s-version-023742
I0314 01:06:02.503330 2159335 cli_runner.go:164] Run: docker container inspect old-k8s-version-023742 --format={{.State.Status}}
I0314 01:06:02.545218 2159335 kic.go:430] container "old-k8s-version-023742" state is running.
I0314 01:06:02.545696 2159335 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-023742
I0314 01:06:02.596134 2159335 profile.go:142] Saving config to /home/jenkins/minikube-integration/18375-1958430/.minikube/profiles/old-k8s-version-023742/config.json ...
I0314 01:06:02.596388 2159335 machine.go:94] provisionDockerMachine start ...
I0314 01:06:02.596469 2159335 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-023742
I0314 01:06:02.622109 2159335 main.go:141] libmachine: Using SSH client type: native
I0314 01:06:02.622392 2159335 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e1e00] 0x3e4660 <nil> [] 0s} 127.0.0.1 35336 <nil> <nil>}
I0314 01:06:02.622408 2159335 main.go:141] libmachine: About to run SSH command:
hostname
I0314 01:06:02.623140 2159335 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: EOF
I0314 01:06:05.770837 2159335 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-023742
I0314 01:06:05.770908 2159335 ubuntu.go:169] provisioning hostname "old-k8s-version-023742"
I0314 01:06:05.771027 2159335 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-023742
I0314 01:06:05.796580 2159335 main.go:141] libmachine: Using SSH client type: native
I0314 01:06:05.796934 2159335 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e1e00] 0x3e4660 <nil> [] 0s} 127.0.0.1 35336 <nil> <nil>}
I0314 01:06:05.796954 2159335 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-023742 && echo "old-k8s-version-023742" | sudo tee /etc/hostname
I0314 01:06:05.963722 2159335 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-023742
I0314 01:06:05.963955 2159335 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-023742
I0314 01:06:05.993625 2159335 main.go:141] libmachine: Using SSH client type: native
I0314 01:06:05.993895 2159335 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e1e00] 0x3e4660 <nil> [] 0s} 127.0.0.1 35336 <nil> <nil>}
I0314 01:06:05.993919 2159335 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-023742' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-023742/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-023742' | sudo tee -a /etc/hosts;
fi
fi
I0314 01:06:06.155508 2159335 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0314 01:06:06.155537 2159335 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/18375-1958430/.minikube CaCertPath:/home/jenkins/minikube-integration/18375-1958430/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/18375-1958430/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/18375-1958430/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/18375-1958430/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/18375-1958430/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/18375-1958430/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/18375-1958430/.minikube}
I0314 01:06:06.155586 2159335 ubuntu.go:177] setting up certificates
I0314 01:06:06.155597 2159335 provision.go:84] configureAuth start
I0314 01:06:06.155675 2159335 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-023742
I0314 01:06:06.184846 2159335 provision.go:143] copyHostCerts
I0314 01:06:06.184916 2159335 exec_runner.go:144] found /home/jenkins/minikube-integration/18375-1958430/.minikube/ca.pem, removing ...
I0314 01:06:06.184936 2159335 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18375-1958430/.minikube/ca.pem
I0314 01:06:06.185025 2159335 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18375-1958430/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/18375-1958430/.minikube/ca.pem (1078 bytes)
I0314 01:06:06.185169 2159335 exec_runner.go:144] found /home/jenkins/minikube-integration/18375-1958430/.minikube/cert.pem, removing ...
I0314 01:06:06.185182 2159335 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18375-1958430/.minikube/cert.pem
I0314 01:06:06.185212 2159335 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18375-1958430/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/18375-1958430/.minikube/cert.pem (1123 bytes)
I0314 01:06:06.185277 2159335 exec_runner.go:144] found /home/jenkins/minikube-integration/18375-1958430/.minikube/key.pem, removing ...
I0314 01:06:06.185287 2159335 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18375-1958430/.minikube/key.pem
I0314 01:06:06.185312 2159335 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18375-1958430/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/18375-1958430/.minikube/key.pem (1675 bytes)
I0314 01:06:06.185364 2159335 provision.go:117] generating server cert: /home/jenkins/minikube-integration/18375-1958430/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/18375-1958430/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/18375-1958430/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-023742 san=[127.0.0.1 192.168.76.2 localhost minikube old-k8s-version-023742]
I0314 01:06:06.619178 2159335 provision.go:177] copyRemoteCerts
I0314 01:06:06.619271 2159335 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0314 01:06:06.619320 2159335 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-023742
I0314 01:06:06.636091 2159335 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:35336 SSHKeyPath:/home/jenkins/minikube-integration/18375-1958430/.minikube/machines/old-k8s-version-023742/id_rsa Username:docker}
I0314 01:06:06.745299 2159335 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18375-1958430/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0314 01:06:06.784805 2159335 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18375-1958430/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0314 01:06:06.822728 2159335 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18375-1958430/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0314 01:06:06.849780 2159335 provision.go:87] duration metric: took 694.165925ms to configureAuth
I0314 01:06:06.849809 2159335 ubuntu.go:193] setting minikube options for container-runtime
I0314 01:06:06.850005 2159335 config.go:182] Loaded profile config "old-k8s-version-023742": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0
I0314 01:06:06.850019 2159335 machine.go:97] duration metric: took 4.253619972s to provisionDockerMachine
I0314 01:06:06.850029 2159335 start.go:293] postStartSetup for "old-k8s-version-023742" (driver="docker")
I0314 01:06:06.850042 2159335 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0314 01:06:06.850102 2159335 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0314 01:06:06.850145 2159335 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-023742
I0314 01:06:06.869198 2159335 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:35336 SSHKeyPath:/home/jenkins/minikube-integration/18375-1958430/.minikube/machines/old-k8s-version-023742/id_rsa Username:docker}
I0314 01:06:06.972253 2159335 ssh_runner.go:195] Run: cat /etc/os-release
I0314 01:06:06.977455 2159335 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0314 01:06:06.977496 2159335 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0314 01:06:06.977507 2159335 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0314 01:06:06.977514 2159335 info.go:137] Remote host: Ubuntu 22.04.4 LTS
I0314 01:06:06.977524 2159335 filesync.go:126] Scanning /home/jenkins/minikube-integration/18375-1958430/.minikube/addons for local assets ...
I0314 01:06:06.977585 2159335 filesync.go:126] Scanning /home/jenkins/minikube-integration/18375-1958430/.minikube/files for local assets ...
I0314 01:06:06.977677 2159335 filesync.go:149] local asset: /home/jenkins/minikube-integration/18375-1958430/.minikube/files/etc/ssl/certs/19638972.pem -> 19638972.pem in /etc/ssl/certs
I0314 01:06:06.977820 2159335 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0314 01:06:06.989836 2159335 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18375-1958430/.minikube/files/etc/ssl/certs/19638972.pem --> /etc/ssl/certs/19638972.pem (1708 bytes)
I0314 01:06:07.021272 2159335 start.go:296] duration metric: took 171.224297ms for postStartSetup
I0314 01:06:07.021433 2159335 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0314 01:06:07.021516 2159335 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-023742
I0314 01:06:07.039796 2159335 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:35336 SSHKeyPath:/home/jenkins/minikube-integration/18375-1958430/.minikube/machines/old-k8s-version-023742/id_rsa Username:docker}
I0314 01:06:07.136429 2159335 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I0314 01:06:07.141415 2159335 fix.go:56] duration metric: took 5.027450649s for fixHost
I0314 01:06:07.141436 2159335 start.go:83] releasing machines lock for "old-k8s-version-023742", held for 5.027497106s
I0314 01:06:07.141510 2159335 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-023742
I0314 01:06:07.162841 2159335 ssh_runner.go:195] Run: cat /version.json
I0314 01:06:07.162897 2159335 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-023742
I0314 01:06:07.163141 2159335 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0314 01:06:07.163193 2159335 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-023742
I0314 01:06:07.195084 2159335 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:35336 SSHKeyPath:/home/jenkins/minikube-integration/18375-1958430/.minikube/machines/old-k8s-version-023742/id_rsa Username:docker}
I0314 01:06:07.199178 2159335 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:35336 SSHKeyPath:/home/jenkins/minikube-integration/18375-1958430/.minikube/machines/old-k8s-version-023742/id_rsa Username:docker}
I0314 01:06:07.413595 2159335 ssh_runner.go:195] Run: systemctl --version
I0314 01:06:07.418364 2159335 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I0314 01:06:07.422731 2159335 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
I0314 01:06:07.439904 2159335 cni.go:230] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
I0314 01:06:07.440034 2159335 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0314 01:06:07.449059 2159335 cni.go:259] no active bridge cni configs found in "/etc/cni/net.d" - nothing to disable
I0314 01:06:07.449143 2159335 start.go:494] detecting cgroup driver to use...
I0314 01:06:07.449205 2159335 detect.go:196] detected "cgroupfs" cgroup driver on host os
I0314 01:06:07.449273 2159335 ssh_runner.go:195] Run: sudo systemctl stop -f crio
I0314 01:06:07.464009 2159335 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I0314 01:06:07.478861 2159335 docker.go:217] disabling cri-docker service (if available) ...
I0314 01:06:07.478977 2159335 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0314 01:06:07.493206 2159335 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0314 01:06:07.505967 2159335 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0314 01:06:07.643007 2159335 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0314 01:06:07.759030 2159335 docker.go:233] disabling docker service ...
I0314 01:06:07.759173 2159335 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0314 01:06:07.773103 2159335 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0314 01:06:07.787376 2159335 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0314 01:06:07.896966 2159335 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0314 01:06:08.008490 2159335 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0314 01:06:08.022965 2159335 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock
" | sudo tee /etc/crictl.yaml"
I0314 01:06:08.041442 2159335 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.2"|' /etc/containerd/config.toml"
I0314 01:06:08.052500 2159335 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
I0314 01:06:08.063596 2159335 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...
I0314 01:06:08.063726 2159335 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
I0314 01:06:08.074757 2159335 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0314 01:06:08.086029 2159335 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
I0314 01:06:08.096912 2159335 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0314 01:06:08.107435 2159335 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0314 01:06:08.117172 2159335 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
I0314 01:06:08.127790 2159335 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0314 01:06:08.137654 2159335 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0314 01:06:08.147501 2159335 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0314 01:06:08.260026 2159335 ssh_runner.go:195] Run: sudo systemctl restart containerd
I0314 01:06:08.451885 2159335 start.go:541] Will wait 60s for socket path /run/containerd/containerd.sock
I0314 01:06:08.451964 2159335 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
I0314 01:06:08.456135 2159335 start.go:562] Will wait 60s for crictl version
I0314 01:06:08.456216 2159335 ssh_runner.go:195] Run: which crictl
I0314 01:06:08.459908 2159335 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0314 01:06:08.550727 2159335 start.go:578] Version: 0.1.0
RuntimeName: containerd
RuntimeVersion: 1.6.28
RuntimeApiVersion: v1
I0314 01:06:08.550850 2159335 ssh_runner.go:195] Run: containerd --version
I0314 01:06:08.593090 2159335 ssh_runner.go:195] Run: containerd --version
I0314 01:06:08.622171 2159335 out.go:177] * Preparing Kubernetes v1.20.0 on containerd 1.6.28 ...
I0314 01:06:08.624066 2159335 cli_runner.go:164] Run: docker network inspect old-k8s-version-023742 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0314 01:06:08.646920 2159335 ssh_runner.go:195] Run: grep 192.168.76.1 host.minikube.internal$ /etc/hosts
I0314 01:06:08.651041 2159335 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.76.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0314 01:06:08.664009 2159335 kubeadm.go:877] updating cluster {Name:old-k8s-version-023742 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1710284843-18375@sha256:d67c38c9fc2ad14c48d95e17cbac49314325db5758d8f7b3de60b927e62ce94f Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-023742 Namespace:default APIServerHAVIP: APIServerName:minik
ubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/
home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0314 01:06:08.664142 2159335 preload.go:132] Checking if preload exists for k8s version v1.20.0 and runtime containerd
I0314 01:06:08.664198 2159335 ssh_runner.go:195] Run: sudo crictl images --output json
I0314 01:06:08.711683 2159335 containerd.go:612] all images are preloaded for containerd runtime.
I0314 01:06:08.711704 2159335 containerd.go:519] Images already preloaded, skipping extraction
I0314 01:06:08.711775 2159335 ssh_runner.go:195] Run: sudo crictl images --output json
I0314 01:06:08.756644 2159335 containerd.go:612] all images are preloaded for containerd runtime.
I0314 01:06:08.756712 2159335 cache_images.go:84] Images are preloaded, skipping loading
I0314 01:06:08.756734 2159335 kubeadm.go:928] updating node { 192.168.76.2 8443 v1.20.0 containerd true true} ...
I0314 01:06:08.756889 2159335 kubeadm.go:940] kubelet [Unit]
Wants=containerd.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///run/containerd/containerd.sock --hostname-override=old-k8s-version-023742 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.76.2
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-023742 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0314 01:06:08.756980 2159335 ssh_runner.go:195] Run: sudo crictl info
I0314 01:06:08.802438 2159335 cni.go:84] Creating CNI manager for ""
I0314 01:06:08.802459 2159335 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0314 01:06:08.802469 2159335 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0314 01:06:08.802490 2159335 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.76.2 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-023742 NodeName:old-k8s-version-023742 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.76.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.76.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt
StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0314 01:06:08.802615 2159335 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.76.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /run/containerd/containerd.sock
name: "old-k8s-version-023742"
kubeletExtraArgs:
node-ip: 192.168.76.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.76.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0314 01:06:08.802676 2159335 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0314 01:06:08.811650 2159335 binaries.go:44] Found k8s binaries, skipping transfer
I0314 01:06:08.811790 2159335 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0314 01:06:08.820275 2159335 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (442 bytes)
I0314 01:06:08.838393 2159335 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0314 01:06:08.857961 2159335 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2125 bytes)
I0314 01:06:08.876233 2159335 ssh_runner.go:195] Run: grep 192.168.76.2 control-plane.minikube.internal$ /etc/hosts
I0314 01:06:08.880175 2159335 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.76.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0314 01:06:08.890763 2159335 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0314 01:06:09.012532 2159335 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0314 01:06:09.032945 2159335 certs.go:68] Setting up /home/jenkins/minikube-integration/18375-1958430/.minikube/profiles/old-k8s-version-023742 for IP: 192.168.76.2
I0314 01:06:09.033013 2159335 certs.go:194] generating shared ca certs ...
I0314 01:06:09.033043 2159335 certs.go:226] acquiring lock for ca certs: {Name:mka77573162012513ec65b9398fcff30bed9742a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0314 01:06:09.033244 2159335 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/18375-1958430/.minikube/ca.key
I0314 01:06:09.033335 2159335 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/18375-1958430/.minikube/proxy-client-ca.key
I0314 01:06:09.033362 2159335 certs.go:256] generating profile certs ...
I0314 01:06:09.033502 2159335 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/18375-1958430/.minikube/profiles/old-k8s-version-023742/client.key
I0314 01:06:09.033612 2159335 certs.go:359] skipping valid signed profile cert regeneration for "minikube": /home/jenkins/minikube-integration/18375-1958430/.minikube/profiles/old-k8s-version-023742/apiserver.key.b4e86bd0
I0314 01:06:09.033693 2159335 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/18375-1958430/.minikube/profiles/old-k8s-version-023742/proxy-client.key
I0314 01:06:09.033866 2159335 certs.go:484] found cert: /home/jenkins/minikube-integration/18375-1958430/.minikube/certs/1963897.pem (1338 bytes)
W0314 01:06:09.033927 2159335 certs.go:480] ignoring /home/jenkins/minikube-integration/18375-1958430/.minikube/certs/1963897_empty.pem, impossibly tiny 0 bytes
I0314 01:06:09.033965 2159335 certs.go:484] found cert: /home/jenkins/minikube-integration/18375-1958430/.minikube/certs/ca-key.pem (1679 bytes)
I0314 01:06:09.034018 2159335 certs.go:484] found cert: /home/jenkins/minikube-integration/18375-1958430/.minikube/certs/ca.pem (1078 bytes)
I0314 01:06:09.034076 2159335 certs.go:484] found cert: /home/jenkins/minikube-integration/18375-1958430/.minikube/certs/cert.pem (1123 bytes)
I0314 01:06:09.034139 2159335 certs.go:484] found cert: /home/jenkins/minikube-integration/18375-1958430/.minikube/certs/key.pem (1675 bytes)
I0314 01:06:09.034234 2159335 certs.go:484] found cert: /home/jenkins/minikube-integration/18375-1958430/.minikube/files/etc/ssl/certs/19638972.pem (1708 bytes)
I0314 01:06:09.035404 2159335 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18375-1958430/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0314 01:06:09.062755 2159335 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18375-1958430/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I0314 01:06:09.096498 2159335 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18375-1958430/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0314 01:06:09.133713 2159335 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18375-1958430/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0314 01:06:09.189741 2159335 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18375-1958430/.minikube/profiles/old-k8s-version-023742/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0314 01:06:09.253391 2159335 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18375-1958430/.minikube/profiles/old-k8s-version-023742/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0314 01:06:09.306263 2159335 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18375-1958430/.minikube/profiles/old-k8s-version-023742/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0314 01:06:09.336928 2159335 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18375-1958430/.minikube/profiles/old-k8s-version-023742/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0314 01:06:09.361555 2159335 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18375-1958430/.minikube/certs/1963897.pem --> /usr/share/ca-certificates/1963897.pem (1338 bytes)
I0314 01:06:09.387827 2159335 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18375-1958430/.minikube/files/etc/ssl/certs/19638972.pem --> /usr/share/ca-certificates/19638972.pem (1708 bytes)
I0314 01:06:09.412126 2159335 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18375-1958430/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0314 01:06:09.436520 2159335 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0314 01:06:09.454737 2159335 ssh_runner.go:195] Run: openssl version
I0314 01:06:09.460737 2159335 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0314 01:06:09.470310 2159335 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0314 01:06:09.474358 2159335 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Mar 14 00:21 /usr/share/ca-certificates/minikubeCA.pem
I0314 01:06:09.474421 2159335 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0314 01:06:09.481750 2159335 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0314 01:06:09.490826 2159335 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/1963897.pem && ln -fs /usr/share/ca-certificates/1963897.pem /etc/ssl/certs/1963897.pem"
I0314 01:06:09.500228 2159335 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/1963897.pem
I0314 01:06:09.504319 2159335 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Mar 14 00:26 /usr/share/ca-certificates/1963897.pem
I0314 01:06:09.504385 2159335 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/1963897.pem
I0314 01:06:09.512048 2159335 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/1963897.pem /etc/ssl/certs/51391683.0"
I0314 01:06:09.521607 2159335 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/19638972.pem && ln -fs /usr/share/ca-certificates/19638972.pem /etc/ssl/certs/19638972.pem"
I0314 01:06:09.531032 2159335 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/19638972.pem
I0314 01:06:09.534963 2159335 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Mar 14 00:26 /usr/share/ca-certificates/19638972.pem
I0314 01:06:09.535039 2159335 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/19638972.pem
I0314 01:06:09.542589 2159335 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/19638972.pem /etc/ssl/certs/3ec20f2e.0"
I0314 01:06:09.552196 2159335 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0314 01:06:09.556213 2159335 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
I0314 01:06:09.563311 2159335 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
I0314 01:06:09.570595 2159335 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
I0314 01:06:09.577698 2159335 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
I0314 01:06:09.584825 2159335 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
I0314 01:06:09.591954 2159335 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
I0314 01:06:09.599065 2159335 kubeadm.go:391] StartCluster: {Name:old-k8s-version-023742 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1710284843-18375@sha256:d67c38c9fc2ad14c48d95e17cbac49314325db5758d8f7b3de60b927e62ce94f Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-023742 Namespace:default APIServerHAVIP: APIServerName:minikube
CA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/hom
e/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0314 01:06:09.599177 2159335 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}
I0314 01:06:09.599248 2159335 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0314 01:06:09.666867 2159335 cri.go:89] found id: "7d7e6014fc3038892fc04a7ac247dec3563fd4e1a68251761f5191e67aa3d29c"
I0314 01:06:09.666890 2159335 cri.go:89] found id: "82285fe9aaaa74c2e22e01bd81b5181d6716037e73b00d0bc15879938824a80d"
I0314 01:06:09.666895 2159335 cri.go:89] found id: "36947fb39456b70b586f2321c1589d336fbf8121fcabf5f669409c9680ddc202"
I0314 01:06:09.666899 2159335 cri.go:89] found id: "251c6cdd00905f46268a5714aa17f44694250fe47496912c484048b8908e5650"
I0314 01:06:09.666903 2159335 cri.go:89] found id: "1c0e3f86261a4182fbe7a919791938f3f1b269a39c811b556df8aa8f15b310f1"
I0314 01:06:09.666907 2159335 cri.go:89] found id: "cf476c9051e98ad0797f500808cadc3fa875ce3d5892a9524d352ac49530d1c7"
I0314 01:06:09.666910 2159335 cri.go:89] found id: "89cecf527c72212c9774ad52dd4fdf563d5e162b2b3c0590daf1a40383e5f87c"
I0314 01:06:09.666913 2159335 cri.go:89] found id: "00c36bf0f8362e90a4a6eb52e67b0fde8d3b9e110159c37ce5cff0a34795231b"
I0314 01:06:09.666916 2159335 cri.go:89] found id: ""
I0314 01:06:09.666970 2159335 ssh_runner.go:195] Run: sudo runc --root /run/containerd/runc/k8s.io list -f json
I0314 01:06:09.679915 2159335 cri.go:116] JSON = null
W0314 01:06:09.679959 2159335 kubeadm.go:398] unpause failed: list paused: list returned 0 containers, but ps returned 8
I0314 01:06:09.680023 2159335 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
W0314 01:06:09.689554 2159335 kubeadm.go:404] apiserver tunnel failed: apiserver port not set
I0314 01:06:09.689574 2159335 kubeadm.go:407] found existing configuration files, will attempt cluster restart
I0314 01:06:09.689579 2159335 kubeadm.go:587] restartPrimaryControlPlane start ...
I0314 01:06:09.689630 2159335 ssh_runner.go:195] Run: sudo test -d /data/minikube
I0314 01:06:09.698273 2159335 kubeadm.go:129] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
stdout:
stderr:
I0314 01:06:09.698689 2159335 kubeconfig.go:47] verify endpoint returned: get endpoint: "old-k8s-version-023742" does not appear in /home/jenkins/minikube-integration/18375-1958430/kubeconfig
I0314 01:06:09.698790 2159335 kubeconfig.go:62] /home/jenkins/minikube-integration/18375-1958430/kubeconfig needs updating (will repair): [kubeconfig missing "old-k8s-version-023742" cluster setting kubeconfig missing "old-k8s-version-023742" context setting]
I0314 01:06:09.699077 2159335 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18375-1958430/kubeconfig: {Name:mkdddca847fdd161b32ac7434f6b37d491dbdecd Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0314 01:06:09.700469 2159335 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
I0314 01:06:09.709101 2159335 kubeadm.go:624] The running cluster does not require reconfiguration: 192.168.76.2
I0314 01:06:09.709143 2159335 kubeadm.go:591] duration metric: took 19.558717ms to restartPrimaryControlPlane
I0314 01:06:09.709153 2159335 kubeadm.go:393] duration metric: took 110.096978ms to StartCluster
I0314 01:06:09.709168 2159335 settings.go:142] acquiring lock: {Name:mkb041dc79ae1947b27d39dd7ebbd3bd473ee07d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0314 01:06:09.709251 2159335 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/18375-1958430/kubeconfig
I0314 01:06:09.709941 2159335 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18375-1958430/kubeconfig: {Name:mkdddca847fdd161b32ac7434f6b37d491dbdecd Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0314 01:06:09.710388 2159335 config.go:182] Loaded profile config "old-k8s-version-023742": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0
I0314 01:06:09.710440 2159335 start.go:234] Will wait 6m0s for node &{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}
I0314 01:06:09.714818 2159335 out.go:177] * Verifying Kubernetes components...
I0314 01:06:09.710501 2159335 addons.go:502] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:true default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volumesnapshots:false yakd:false]
I0314 01:06:09.716806 2159335 addons.go:69] Setting dashboard=true in profile "old-k8s-version-023742"
I0314 01:06:09.716864 2159335 addons.go:234] Setting addon dashboard=true in "old-k8s-version-023742"
W0314 01:06:09.716878 2159335 addons.go:243] addon dashboard should already be in state true
I0314 01:06:09.716933 2159335 host.go:66] Checking if "old-k8s-version-023742" exists ...
I0314 01:06:09.717425 2159335 cli_runner.go:164] Run: docker container inspect old-k8s-version-023742 --format={{.State.Status}}
I0314 01:06:09.717598 2159335 addons.go:69] Setting storage-provisioner=true in profile "old-k8s-version-023742"
I0314 01:06:09.717642 2159335 addons.go:234] Setting addon storage-provisioner=true in "old-k8s-version-023742"
W0314 01:06:09.717655 2159335 addons.go:243] addon storage-provisioner should already be in state true
I0314 01:06:09.717678 2159335 host.go:66] Checking if "old-k8s-version-023742" exists ...
I0314 01:06:09.718084 2159335 cli_runner.go:164] Run: docker container inspect old-k8s-version-023742 --format={{.State.Status}}
I0314 01:06:09.720499 2159335 addons.go:69] Setting default-storageclass=true in profile "old-k8s-version-023742"
I0314 01:06:09.720538 2159335 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "old-k8s-version-023742"
I0314 01:06:09.720815 2159335 cli_runner.go:164] Run: docker container inspect old-k8s-version-023742 --format={{.State.Status}}
I0314 01:06:09.735747 2159335 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0314 01:06:09.735913 2159335 addons.go:69] Setting metrics-server=true in profile "old-k8s-version-023742"
I0314 01:06:09.735961 2159335 addons.go:234] Setting addon metrics-server=true in "old-k8s-version-023742"
W0314 01:06:09.735969 2159335 addons.go:243] addon metrics-server should already be in state true
I0314 01:06:09.736001 2159335 host.go:66] Checking if "old-k8s-version-023742" exists ...
I0314 01:06:09.736446 2159335 cli_runner.go:164] Run: docker container inspect old-k8s-version-023742 --format={{.State.Status}}
I0314 01:06:09.798026 2159335 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0314 01:06:09.800206 2159335 out.go:177] - Using image docker.io/kubernetesui/dashboard:v2.7.0
I0314 01:06:09.803424 2159335 out.go:177] - Using image registry.k8s.io/echoserver:1.4
I0314 01:06:09.800364 2159335 addons.go:426] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0314 01:06:09.803371 2159335 addons.go:234] Setting addon default-storageclass=true in "old-k8s-version-023742"
W0314 01:06:09.807273 2159335 addons.go:243] addon default-storageclass should already be in state true
I0314 01:06:09.807313 2159335 host.go:66] Checking if "old-k8s-version-023742" exists ...
I0314 01:06:09.807749 2159335 cli_runner.go:164] Run: docker container inspect old-k8s-version-023742 --format={{.State.Status}}
I0314 01:06:09.807924 2159335 addons.go:426] installing /etc/kubernetes/addons/dashboard-ns.yaml
I0314 01:06:09.807942 2159335 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-ns.yaml (759 bytes)
I0314 01:06:09.807989 2159335 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-023742
I0314 01:06:09.808338 2159335 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0314 01:06:09.808400 2159335 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-023742
I0314 01:06:09.815400 2159335 out.go:177] - Using image fake.domain/registry.k8s.io/echoserver:1.4
I0314 01:06:09.817183 2159335 addons.go:426] installing /etc/kubernetes/addons/metrics-apiservice.yaml
I0314 01:06:09.817205 2159335 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
I0314 01:06:09.817278 2159335 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-023742
I0314 01:06:09.861943 2159335 addons.go:426] installing /etc/kubernetes/addons/storageclass.yaml
I0314 01:06:09.861964 2159335 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0314 01:06:09.862023 2159335 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-023742
I0314 01:06:09.917688 2159335 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:35336 SSHKeyPath:/home/jenkins/minikube-integration/18375-1958430/.minikube/machines/old-k8s-version-023742/id_rsa Username:docker}
I0314 01:06:09.931314 2159335 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:35336 SSHKeyPath:/home/jenkins/minikube-integration/18375-1958430/.minikube/machines/old-k8s-version-023742/id_rsa Username:docker}
I0314 01:06:09.933198 2159335 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:35336 SSHKeyPath:/home/jenkins/minikube-integration/18375-1958430/.minikube/machines/old-k8s-version-023742/id_rsa Username:docker}
I0314 01:06:09.933604 2159335 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:35336 SSHKeyPath:/home/jenkins/minikube-integration/18375-1958430/.minikube/machines/old-k8s-version-023742/id_rsa Username:docker}
I0314 01:06:09.966200 2159335 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0314 01:06:10.022781 2159335 node_ready.go:35] waiting up to 6m0s for node "old-k8s-version-023742" to be "Ready" ...
I0314 01:06:10.119848 2159335 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0314 01:06:10.164504 2159335 addons.go:426] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
I0314 01:06:10.164567 2159335 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1825 bytes)
I0314 01:06:10.186957 2159335 addons.go:426] installing /etc/kubernetes/addons/dashboard-clusterrole.yaml
I0314 01:06:10.187028 2159335 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-clusterrole.yaml (1001 bytes)
I0314 01:06:10.218382 2159335 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0314 01:06:10.254889 2159335 addons.go:426] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
I0314 01:06:10.254966 2159335 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
I0314 01:06:10.270540 2159335 addons.go:426] installing /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml
I0314 01:06:10.270615 2159335 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml (1018 bytes)
I0314 01:06:10.368242 2159335 addons.go:426] installing /etc/kubernetes/addons/metrics-server-service.yaml
I0314 01:06:10.368336 2159335 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
I0314 01:06:10.372336 2159335 addons.go:426] installing /etc/kubernetes/addons/dashboard-configmap.yaml
I0314 01:06:10.372409 2159335 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-configmap.yaml (837 bytes)
W0314 01:06:10.444459 2159335 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0314 01:06:10.444572 2159335 retry.go:31] will retry after 365.310323ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0314 01:06:10.461345 2159335 addons.go:426] installing /etc/kubernetes/addons/dashboard-dp.yaml
I0314 01:06:10.461414 2159335 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-dp.yaml (4201 bytes)
I0314 01:06:10.470111 2159335 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0314 01:06:10.479741 2159335 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0314 01:06:10.479819 2159335 retry.go:31] will retry after 228.204007ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0314 01:06:10.501775 2159335 addons.go:426] installing /etc/kubernetes/addons/dashboard-role.yaml
I0314 01:06:10.501849 2159335 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-role.yaml (1724 bytes)
I0314 01:06:10.571144 2159335 addons.go:426] installing /etc/kubernetes/addons/dashboard-rolebinding.yaml
I0314 01:06:10.571172 2159335 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-rolebinding.yaml (1046 bytes)
W0314 01:06:10.606577 2159335 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0314 01:06:10.606654 2159335 retry.go:31] will retry after 195.742533ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0314 01:06:10.618720 2159335 addons.go:426] installing /etc/kubernetes/addons/dashboard-sa.yaml
I0314 01:06:10.618782 2159335 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-sa.yaml (837 bytes)
I0314 01:06:10.638529 2159335 addons.go:426] installing /etc/kubernetes/addons/dashboard-secret.yaml
I0314 01:06:10.638597 2159335 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-secret.yaml (1389 bytes)
I0314 01:06:10.663907 2159335 addons.go:426] installing /etc/kubernetes/addons/dashboard-svc.yaml
I0314 01:06:10.663976 2159335 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-svc.yaml (1294 bytes)
I0314 01:06:10.688671 2159335 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0314 01:06:10.708844 2159335 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I0314 01:06:10.803158 2159335 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0314 01:06:10.810495 2159335 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0314 01:06:10.847048 2159335 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0314 01:06:10.847122 2159335 retry.go:31] will retry after 247.457439ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0314 01:06:10.966546 2159335 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0314 01:06:10.966619 2159335 retry.go:31] will retry after 209.400234ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0314 01:06:11.095482 2159335 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0314 01:06:11.149231 2159335 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0314 01:06:11.149374 2159335 retry.go:31] will retry after 268.525349ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0314 01:06:11.149325 2159335 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0314 01:06:11.149421 2159335 retry.go:31] will retry after 503.838277ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0314 01:06:11.176587 2159335 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0314 01:06:11.243436 2159335 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0314 01:06:11.243521 2159335 retry.go:31] will retry after 430.94327ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0314 01:06:11.324595 2159335 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0314 01:06:11.324628 2159335 retry.go:31] will retry after 578.367852ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0314 01:06:11.418832 2159335 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0314 01:06:11.509357 2159335 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0314 01:06:11.509405 2159335 retry.go:31] will retry after 374.366956ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0314 01:06:11.654250 2159335 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I0314 01:06:11.675623 2159335 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0314 01:06:11.774565 2159335 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0314 01:06:11.774601 2159335 retry.go:31] will retry after 576.49582ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0314 01:06:11.843659 2159335 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0314 01:06:11.843743 2159335 retry.go:31] will retry after 420.242289ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0314 01:06:11.883998 2159335 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0314 01:06:11.903393 2159335 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0314 01:06:11.999534 2159335 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0314 01:06:11.999644 2159335 retry.go:31] will retry after 1.002966786s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0314 01:06:12.024197 2159335 node_ready.go:53] error getting node "old-k8s-version-023742": Get "https://192.168.76.2:8443/api/v1/nodes/old-k8s-version-023742": dial tcp 192.168.76.2:8443: connect: connection refused
W0314 01:06:12.096444 2159335 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0314 01:06:12.096531 2159335 retry.go:31] will retry after 708.245145ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0314 01:06:12.265027 2159335 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0314 01:06:12.351648 2159335 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0314 01:06:12.363024 2159335 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0314 01:06:12.363055 2159335 retry.go:31] will retry after 1.074678109s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0314 01:06:12.457564 2159335 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0314 01:06:12.457597 2159335 retry.go:31] will retry after 806.717468ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0314 01:06:12.805630 2159335 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0314 01:06:12.906935 2159335 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0314 01:06:12.907015 2159335 retry.go:31] will retry after 1.049363262s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0314 01:06:13.003381 2159335 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0314 01:06:13.105445 2159335 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0314 01:06:13.105527 2159335 retry.go:31] will retry after 1.705682476s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0314 01:06:13.264970 2159335 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0314 01:06:13.365381 2159335 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0314 01:06:13.365428 2159335 retry.go:31] will retry after 1.620220017s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0314 01:06:13.438742 2159335 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0314 01:06:13.538295 2159335 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0314 01:06:13.538336 2159335 retry.go:31] will retry after 1.072906864s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0314 01:06:13.956658 2159335 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0314 01:06:14.060795 2159335 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0314 01:06:14.060848 2159335 retry.go:31] will retry after 1.100901061s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0314 01:06:14.523404 2159335 node_ready.go:53] error getting node "old-k8s-version-023742": Get "https://192.168.76.2:8443/api/v1/nodes/old-k8s-version-023742": dial tcp 192.168.76.2:8443: connect: connection refused
I0314 01:06:14.611795 2159335 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0314 01:06:14.726825 2159335 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0314 01:06:14.726867 2159335 retry.go:31] will retry after 1.374191141s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0314 01:06:14.812220 2159335 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0314 01:06:14.919717 2159335 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0314 01:06:14.919757 2159335 retry.go:31] will retry after 2.193380328s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0314 01:06:14.986029 2159335 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0314 01:06:15.093939 2159335 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0314 01:06:15.094028 2159335 retry.go:31] will retry after 2.348310783s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0314 01:06:15.162173 2159335 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0314 01:06:15.276353 2159335 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0314 01:06:15.276389 2159335 retry.go:31] will retry after 3.780306152s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0314 01:06:16.102162 2159335 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0314 01:06:16.251509 2159335 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0314 01:06:16.251541 2159335 retry.go:31] will retry after 3.238099069s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0314 01:06:17.023397 2159335 node_ready.go:53] error getting node "old-k8s-version-023742": Get "https://192.168.76.2:8443/api/v1/nodes/old-k8s-version-023742": dial tcp 192.168.76.2:8443: connect: connection refused
I0314 01:06:17.113781 2159335 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0314 01:06:17.252979 2159335 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0314 01:06:17.253008 2159335 retry.go:31] will retry after 3.983311784s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0314 01:06:17.443340 2159335 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0314 01:06:17.575323 2159335 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0314 01:06:17.575351 2159335 retry.go:31] will retry after 1.910133483s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0314 01:06:19.057446 2159335 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I0314 01:06:19.486159 2159335 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I0314 01:06:19.490457 2159335 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0314 01:06:21.236889 2159335 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0314 01:06:28.953071 2159335 node_ready.go:49] node "old-k8s-version-023742" has status "Ready":"True"
I0314 01:06:28.953095 2159335 node_ready.go:38] duration metric: took 18.930249632s for node "old-k8s-version-023742" to be "Ready" ...
I0314 01:06:28.953107 2159335 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0314 01:06:29.264257 2159335 pod_ready.go:78] waiting up to 6m0s for pod "coredns-74ff55c5b-m88gl" in "kube-system" namespace to be "Ready" ...
I0314 01:06:29.475817 2159335 pod_ready.go:92] pod "coredns-74ff55c5b-m88gl" in "kube-system" namespace has status "Ready":"True"
I0314 01:06:29.475903 2159335 pod_ready.go:81] duration metric: took 211.542365ms for pod "coredns-74ff55c5b-m88gl" in "kube-system" namespace to be "Ready" ...
I0314 01:06:29.475930 2159335 pod_ready.go:78] waiting up to 6m0s for pod "etcd-old-k8s-version-023742" in "kube-system" namespace to be "Ready" ...
I0314 01:06:29.574411 2159335 pod_ready.go:92] pod "etcd-old-k8s-version-023742" in "kube-system" namespace has status "Ready":"True"
I0314 01:06:29.574487 2159335 pod_ready.go:81] duration metric: took 98.535422ms for pod "etcd-old-k8s-version-023742" in "kube-system" namespace to be "Ready" ...
I0314 01:06:29.574517 2159335 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-old-k8s-version-023742" in "kube-system" namespace to be "Ready" ...
I0314 01:06:30.624782 2159335 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: (11.567292978s)
I0314 01:06:30.946466 2159335 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: (11.460262115s)
I0314 01:06:30.946550 2159335 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (9.70962901s)
I0314 01:06:30.946570 2159335 addons.go:470] Verifying addon metrics-server=true in "old-k8s-version-023742"
I0314 01:06:30.946663 2159335 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: (11.456172942s)
I0314 01:06:30.949240 2159335 out.go:177] * Some dashboard features require the metrics-server addon. To enable all features please run:
minikube -p old-k8s-version-023742 addons enable metrics-server
I0314 01:06:30.952160 2159335 out.go:177] * Enabled addons: default-storageclass, storage-provisioner, metrics-server, dashboard
I0314 01:06:30.954841 2159335 addons.go:505] duration metric: took 21.244334186s for enable addons: enabled=[default-storageclass storage-provisioner metrics-server dashboard]
I0314 01:06:31.580330 2159335 pod_ready.go:102] pod "kube-apiserver-old-k8s-version-023742" in "kube-system" namespace has status "Ready":"False"
I0314 01:06:33.584135 2159335 pod_ready.go:102] pod "kube-apiserver-old-k8s-version-023742" in "kube-system" namespace has status "Ready":"False"
I0314 01:06:36.081989 2159335 pod_ready.go:102] pod "kube-apiserver-old-k8s-version-023742" in "kube-system" namespace has status "Ready":"False"
I0314 01:06:38.581474 2159335 pod_ready.go:92] pod "kube-apiserver-old-k8s-version-023742" in "kube-system" namespace has status "Ready":"True"
I0314 01:06:38.581498 2159335 pod_ready.go:81] duration metric: took 9.006960446s for pod "kube-apiserver-old-k8s-version-023742" in "kube-system" namespace to be "Ready" ...
I0314 01:06:38.581510 2159335 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-old-k8s-version-023742" in "kube-system" namespace to be "Ready" ...
I0314 01:06:40.588608 2159335 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-023742" in "kube-system" namespace has status "Ready":"False"
I0314 01:06:42.589904 2159335 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-023742" in "kube-system" namespace has status "Ready":"False"
I0314 01:06:45.092280 2159335 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-023742" in "kube-system" namespace has status "Ready":"False"
I0314 01:06:47.598419 2159335 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-023742" in "kube-system" namespace has status "Ready":"False"
I0314 01:06:50.094309 2159335 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-023742" in "kube-system" namespace has status "Ready":"False"
I0314 01:06:52.591843 2159335 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-023742" in "kube-system" namespace has status "Ready":"False"
I0314 01:06:55.091817 2159335 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-023742" in "kube-system" namespace has status "Ready":"False"
I0314 01:06:57.102984 2159335 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-023742" in "kube-system" namespace has status "Ready":"False"
I0314 01:06:59.120863 2159335 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-023742" in "kube-system" namespace has status "Ready":"False"
I0314 01:07:01.587841 2159335 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-023742" in "kube-system" namespace has status "Ready":"False"
I0314 01:07:03.588519 2159335 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-023742" in "kube-system" namespace has status "Ready":"False"
I0314 01:07:06.088288 2159335 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-023742" in "kube-system" namespace has status "Ready":"False"
I0314 01:07:08.092006 2159335 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-023742" in "kube-system" namespace has status "Ready":"False"
I0314 01:07:10.588052 2159335 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-023742" in "kube-system" namespace has status "Ready":"False"
I0314 01:07:12.589484 2159335 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-023742" in "kube-system" namespace has status "Ready":"False"
I0314 01:07:15.089593 2159335 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-023742" in "kube-system" namespace has status "Ready":"False"
I0314 01:07:17.588276 2159335 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-023742" in "kube-system" namespace has status "Ready":"False"
I0314 01:07:19.589318 2159335 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-023742" in "kube-system" namespace has status "Ready":"False"
I0314 01:07:22.088460 2159335 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-023742" in "kube-system" namespace has status "Ready":"False"
I0314 01:07:24.588300 2159335 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-023742" in "kube-system" namespace has status "Ready":"False"
I0314 01:07:26.589260 2159335 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-023742" in "kube-system" namespace has status "Ready":"False"
I0314 01:07:29.089477 2159335 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-023742" in "kube-system" namespace has status "Ready":"False"
I0314 01:07:31.587727 2159335 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-023742" in "kube-system" namespace has status "Ready":"False"
I0314 01:07:33.592793 2159335 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-023742" in "kube-system" namespace has status "Ready":"False"
I0314 01:07:36.088446 2159335 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-023742" in "kube-system" namespace has status "Ready":"False"
I0314 01:07:38.588291 2159335 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-023742" in "kube-system" namespace has status "Ready":"False"
I0314 01:07:41.087906 2159335 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-023742" in "kube-system" namespace has status "Ready":"False"
I0314 01:07:43.088400 2159335 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-023742" in "kube-system" namespace has status "Ready":"False"
I0314 01:07:44.088467 2159335 pod_ready.go:92] pod "kube-controller-manager-old-k8s-version-023742" in "kube-system" namespace has status "Ready":"True"
I0314 01:07:44.088496 2159335 pod_ready.go:81] duration metric: took 1m5.506978254s for pod "kube-controller-manager-old-k8s-version-023742" in "kube-system" namespace to be "Ready" ...
I0314 01:07:44.088508 2159335 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-vm5pd" in "kube-system" namespace to be "Ready" ...
I0314 01:07:44.093958 2159335 pod_ready.go:92] pod "kube-proxy-vm5pd" in "kube-system" namespace has status "Ready":"True"
I0314 01:07:44.093985 2159335 pod_ready.go:81] duration metric: took 5.469145ms for pod "kube-proxy-vm5pd" in "kube-system" namespace to be "Ready" ...
I0314 01:07:44.093997 2159335 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-old-k8s-version-023742" in "kube-system" namespace to be "Ready" ...
I0314 01:07:46.100906 2159335 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-023742" in "kube-system" namespace has status "Ready":"False"
I0314 01:07:48.601389 2159335 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-023742" in "kube-system" namespace has status "Ready":"False"
I0314 01:07:51.099734 2159335 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-023742" in "kube-system" namespace has status "Ready":"False"
I0314 01:07:53.101296 2159335 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-023742" in "kube-system" namespace has status "Ready":"False"
I0314 01:07:55.101787 2159335 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-023742" in "kube-system" namespace has status "Ready":"False"
I0314 01:07:57.600299 2159335 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-023742" in "kube-system" namespace has status "Ready":"False"
I0314 01:07:59.106087 2159335 pod_ready.go:92] pod "kube-scheduler-old-k8s-version-023742" in "kube-system" namespace has status "Ready":"True"
I0314 01:07:59.106115 2159335 pod_ready.go:81] duration metric: took 15.012109393s for pod "kube-scheduler-old-k8s-version-023742" in "kube-system" namespace to be "Ready" ...
I0314 01:07:59.106127 2159335 pod_ready.go:78] waiting up to 6m0s for pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace to be "Ready" ...
I0314 01:08:01.112043 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:08:03.113156 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:08:05.613131 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:08:08.113014 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:08:10.113211 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:08:12.614105 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:08:15.113089 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:08:17.614005 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:08:20.113930 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:08:22.613294 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:08:25.112900 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:08:27.612495 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:08:30.114205 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:08:32.612283 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:08:34.612593 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:08:36.613623 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:08:39.113089 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:08:41.612451 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:08:43.613091 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:08:46.116130 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:08:48.612362 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:08:50.612447 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:08:52.612689 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:08:55.113105 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:08:57.612018 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:08:59.612746 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:09:02.113430 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:09:04.612370 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:09:07.113178 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:09:09.612196 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:09:12.113067 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:09:14.612742 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:09:17.112547 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:09:19.612698 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:09:21.612869 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:09:23.617303 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:09:26.113238 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:09:28.114666 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:09:30.612076 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:09:32.612416 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:09:34.612869 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:09:36.613188 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:09:38.613854 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:09:40.680861 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:09:43.112789 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:09:45.128449 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:09:47.611451 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:09:49.615256 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:09:52.112495 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:09:54.612531 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:09:56.612712 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:09:58.616059 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:10:01.113394 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:10:03.612567 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:10:05.612888 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:10:08.112406 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:10:10.113435 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:10:12.114104 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:10:14.613004 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:10:17.112735 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:10:19.613008 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:10:22.121318 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:10:24.612298 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:10:26.613054 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:10:29.112840 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:10:31.163820 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:10:33.611968 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:10:35.612071 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:10:38.112892 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:10:40.113241 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:10:42.116762 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:10:44.612296 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:10:47.112173 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:10:49.114394 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:10:51.611692 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:10:53.612772 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:10:56.112956 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:10:58.612462 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:11:01.113085 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:11:03.612572 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:11:06.112431 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:11:08.612641 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:11:11.112936 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:11:13.613871 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:11:16.112520 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:11:18.113134 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:11:20.114090 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:11:22.611978 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:11:24.618647 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:11:27.113224 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:11:29.611941 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:11:32.111941 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:11:34.114194 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:11:36.611543 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:11:38.624690 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:11:41.112194 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:11:43.112729 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:11:45.125051 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:11:47.612575 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:11:49.613777 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:11:52.112760 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:11:54.613992 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:11:57.113242 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:11:59.112719 2159335 pod_ready.go:81] duration metric: took 4m0.006577259s for pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace to be "Ready" ...
E0314 01:11:59.112744 2159335 pod_ready.go:66] WaitExtra: waitPodCondition: context deadline exceeded
I0314 01:11:59.112753 2159335 pod_ready.go:38] duration metric: took 5m30.159634759s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0314 01:11:59.112778 2159335 api_server.go:52] waiting for apiserver process to appear ...
I0314 01:11:59.112807 2159335 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
I0314 01:11:59.112872 2159335 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0314 01:11:59.158140 2159335 cri.go:89] found id: "fdb44b3f1b8bfa78a5d1d74ef6b0613a584997cf3688d648110b83847d6bfbb7"
I0314 01:11:59.158161 2159335 cri.go:89] found id: "cf476c9051e98ad0797f500808cadc3fa875ce3d5892a9524d352ac49530d1c7"
I0314 01:11:59.158165 2159335 cri.go:89] found id: ""
I0314 01:11:59.158172 2159335 logs.go:276] 2 containers: [fdb44b3f1b8bfa78a5d1d74ef6b0613a584997cf3688d648110b83847d6bfbb7 cf476c9051e98ad0797f500808cadc3fa875ce3d5892a9524d352ac49530d1c7]
I0314 01:11:59.158245 2159335 ssh_runner.go:195] Run: which crictl
I0314 01:11:59.161848 2159335 ssh_runner.go:195] Run: which crictl
I0314 01:11:59.165307 2159335 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
I0314 01:11:59.165397 2159335 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0314 01:11:59.203039 2159335 cri.go:89] found id: "262c4ec2f8f3eb8483e1462b0685a765d10399ebc85e0a7f520af4504e9e469f"
I0314 01:11:59.203063 2159335 cri.go:89] found id: "1c0e3f86261a4182fbe7a919791938f3f1b269a39c811b556df8aa8f15b310f1"
I0314 01:11:59.203067 2159335 cri.go:89] found id: ""
I0314 01:11:59.203075 2159335 logs.go:276] 2 containers: [262c4ec2f8f3eb8483e1462b0685a765d10399ebc85e0a7f520af4504e9e469f 1c0e3f86261a4182fbe7a919791938f3f1b269a39c811b556df8aa8f15b310f1]
I0314 01:11:59.203161 2159335 ssh_runner.go:195] Run: which crictl
I0314 01:11:59.206505 2159335 ssh_runner.go:195] Run: which crictl
I0314 01:11:59.209749 2159335 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
I0314 01:11:59.209832 2159335 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0314 01:11:59.249575 2159335 cri.go:89] found id: "577d3087fa040f93f9110c5070c4732f3d9c28a3063dad9f5fb63d2cb714c5d1"
I0314 01:11:59.249595 2159335 cri.go:89] found id: "7d7e6014fc3038892fc04a7ac247dec3563fd4e1a68251761f5191e67aa3d29c"
I0314 01:11:59.249600 2159335 cri.go:89] found id: ""
I0314 01:11:59.249607 2159335 logs.go:276] 2 containers: [577d3087fa040f93f9110c5070c4732f3d9c28a3063dad9f5fb63d2cb714c5d1 7d7e6014fc3038892fc04a7ac247dec3563fd4e1a68251761f5191e67aa3d29c]
I0314 01:11:59.249661 2159335 ssh_runner.go:195] Run: which crictl
I0314 01:11:59.253180 2159335 ssh_runner.go:195] Run: which crictl
I0314 01:11:59.256325 2159335 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
I0314 01:11:59.256395 2159335 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0314 01:11:59.293600 2159335 cri.go:89] found id: "abe11e046f972c9c239dc5503ce7b4e6abdb261d19262a88ebf1157e26888704"
I0314 01:11:59.293620 2159335 cri.go:89] found id: "89cecf527c72212c9774ad52dd4fdf563d5e162b2b3c0590daf1a40383e5f87c"
I0314 01:11:59.293625 2159335 cri.go:89] found id: ""
I0314 01:11:59.293632 2159335 logs.go:276] 2 containers: [abe11e046f972c9c239dc5503ce7b4e6abdb261d19262a88ebf1157e26888704 89cecf527c72212c9774ad52dd4fdf563d5e162b2b3c0590daf1a40383e5f87c]
I0314 01:11:59.293691 2159335 ssh_runner.go:195] Run: which crictl
I0314 01:11:59.297072 2159335 ssh_runner.go:195] Run: which crictl
I0314 01:11:59.300603 2159335 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
I0314 01:11:59.300711 2159335 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0314 01:11:59.343506 2159335 cri.go:89] found id: "a649cec0099ad8c4f2f59cb4643ea18e343945d9edac27d0c1542055b2ce681c"
I0314 01:11:59.343573 2159335 cri.go:89] found id: "36947fb39456b70b586f2321c1589d336fbf8121fcabf5f669409c9680ddc202"
I0314 01:11:59.343585 2159335 cri.go:89] found id: ""
I0314 01:11:59.343593 2159335 logs.go:276] 2 containers: [a649cec0099ad8c4f2f59cb4643ea18e343945d9edac27d0c1542055b2ce681c 36947fb39456b70b586f2321c1589d336fbf8121fcabf5f669409c9680ddc202]
I0314 01:11:59.343650 2159335 ssh_runner.go:195] Run: which crictl
I0314 01:11:59.347304 2159335 ssh_runner.go:195] Run: which crictl
I0314 01:11:59.350557 2159335 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
I0314 01:11:59.350629 2159335 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0314 01:11:59.391928 2159335 cri.go:89] found id: "c79d313c53d51ee00f93e8076ad26cc072bc1abea5f1a5b6a64db439ffbbd272"
I0314 01:11:59.391991 2159335 cri.go:89] found id: "00c36bf0f8362e90a4a6eb52e67b0fde8d3b9e110159c37ce5cff0a34795231b"
I0314 01:11:59.392003 2159335 cri.go:89] found id: ""
I0314 01:11:59.392011 2159335 logs.go:276] 2 containers: [c79d313c53d51ee00f93e8076ad26cc072bc1abea5f1a5b6a64db439ffbbd272 00c36bf0f8362e90a4a6eb52e67b0fde8d3b9e110159c37ce5cff0a34795231b]
I0314 01:11:59.392078 2159335 ssh_runner.go:195] Run: which crictl
I0314 01:11:59.395688 2159335 ssh_runner.go:195] Run: which crictl
I0314 01:11:59.399092 2159335 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
I0314 01:11:59.399186 2159335 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0314 01:11:59.437453 2159335 cri.go:89] found id: "661201637b62150c5e65fb761af09186766a8c5ee343b157bd78587674493702"
I0314 01:11:59.437476 2159335 cri.go:89] found id: "251c6cdd00905f46268a5714aa17f44694250fe47496912c484048b8908e5650"
I0314 01:11:59.437481 2159335 cri.go:89] found id: ""
I0314 01:11:59.437488 2159335 logs.go:276] 2 containers: [661201637b62150c5e65fb761af09186766a8c5ee343b157bd78587674493702 251c6cdd00905f46268a5714aa17f44694250fe47496912c484048b8908e5650]
I0314 01:11:59.437547 2159335 ssh_runner.go:195] Run: which crictl
I0314 01:11:59.441203 2159335 ssh_runner.go:195] Run: which crictl
I0314 01:11:59.444733 2159335 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
I0314 01:11:59.444868 2159335 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I0314 01:11:59.483655 2159335 cri.go:89] found id: "c83ee544525cae8ae275b356afc7ab3e13354a5bfdc13e46d3bb967974cc4fd4"
I0314 01:11:59.483715 2159335 cri.go:89] found id: ""
I0314 01:11:59.483747 2159335 logs.go:276] 1 containers: [c83ee544525cae8ae275b356afc7ab3e13354a5bfdc13e46d3bb967974cc4fd4]
I0314 01:11:59.483834 2159335 ssh_runner.go:195] Run: which crictl
I0314 01:11:59.487513 2159335 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
I0314 01:11:59.487586 2159335 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0314 01:11:59.527664 2159335 cri.go:89] found id: "0378f91f5f30bc555d7408bc86dd626b1d5ffeb38145d3ee69160c360c8f3416"
I0314 01:11:59.527685 2159335 cri.go:89] found id: "4e7dc51c48baacd42a05abe380200f2d6c242433155f704a890e45913c11586c"
I0314 01:11:59.527690 2159335 cri.go:89] found id: ""
I0314 01:11:59.527697 2159335 logs.go:276] 2 containers: [0378f91f5f30bc555d7408bc86dd626b1d5ffeb38145d3ee69160c360c8f3416 4e7dc51c48baacd42a05abe380200f2d6c242433155f704a890e45913c11586c]
I0314 01:11:59.527760 2159335 ssh_runner.go:195] Run: which crictl
I0314 01:11:59.531427 2159335 ssh_runner.go:195] Run: which crictl
I0314 01:11:59.534848 2159335 logs.go:123] Gathering logs for coredns [7d7e6014fc3038892fc04a7ac247dec3563fd4e1a68251761f5191e67aa3d29c] ...
I0314 01:11:59.534873 2159335 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 7d7e6014fc3038892fc04a7ac247dec3563fd4e1a68251761f5191e67aa3d29c"
I0314 01:11:59.580402 2159335 logs.go:123] Gathering logs for kube-proxy [a649cec0099ad8c4f2f59cb4643ea18e343945d9edac27d0c1542055b2ce681c] ...
I0314 01:11:59.580430 2159335 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 a649cec0099ad8c4f2f59cb4643ea18e343945d9edac27d0c1542055b2ce681c"
I0314 01:11:59.621026 2159335 logs.go:123] Gathering logs for kindnet [251c6cdd00905f46268a5714aa17f44694250fe47496912c484048b8908e5650] ...
I0314 01:11:59.621056 2159335 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 251c6cdd00905f46268a5714aa17f44694250fe47496912c484048b8908e5650"
I0314 01:11:59.659038 2159335 logs.go:123] Gathering logs for kubernetes-dashboard [c83ee544525cae8ae275b356afc7ab3e13354a5bfdc13e46d3bb967974cc4fd4] ...
I0314 01:11:59.659065 2159335 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 c83ee544525cae8ae275b356afc7ab3e13354a5bfdc13e46d3bb967974cc4fd4"
I0314 01:11:59.701741 2159335 logs.go:123] Gathering logs for containerd ...
I0314 01:11:59.701769 2159335 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
I0314 01:11:59.765300 2159335 logs.go:123] Gathering logs for dmesg ...
I0314 01:11:59.765335 2159335 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0314 01:11:59.790417 2159335 logs.go:123] Gathering logs for etcd [262c4ec2f8f3eb8483e1462b0685a765d10399ebc85e0a7f520af4504e9e469f] ...
I0314 01:11:59.790445 2159335 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 262c4ec2f8f3eb8483e1462b0685a765d10399ebc85e0a7f520af4504e9e469f"
I0314 01:11:59.843121 2159335 logs.go:123] Gathering logs for coredns [577d3087fa040f93f9110c5070c4732f3d9c28a3063dad9f5fb63d2cb714c5d1] ...
I0314 01:11:59.843149 2159335 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 577d3087fa040f93f9110c5070c4732f3d9c28a3063dad9f5fb63d2cb714c5d1"
I0314 01:11:59.902029 2159335 logs.go:123] Gathering logs for container status ...
I0314 01:11:59.902056 2159335 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0314 01:11:59.992718 2159335 logs.go:123] Gathering logs for kubelet ...
I0314 01:11:59.992749 2159335 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0314 01:12:00.060282 2159335 logs.go:138] Found kubelet problem: Mar 14 01:06:28 old-k8s-version-023742 kubelet[662]: E0314 01:06:28.974732 662 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:old-k8s-version-023742" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-023742' and this object
W0314 01:12:00.060539 2159335 logs.go:138] Found kubelet problem: Mar 14 01:06:28 old-k8s-version-023742 kubelet[662]: E0314 01:06:28.974970 662 reflector.go:138] object-"kube-system"/"coredns": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:old-k8s-version-023742" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-023742' and this object
W0314 01:12:00.060774 2159335 logs.go:138] Found kubelet problem: Mar 14 01:06:28 old-k8s-version-023742 kubelet[662]: E0314 01:06:28.975144 662 reflector.go:138] object-"kube-system"/"coredns-token-25l2w": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "coredns-token-25l2w" is forbidden: User "system:node:old-k8s-version-023742" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-023742' and this object
W0314 01:12:00.061038 2159335 logs.go:138] Found kubelet problem: Mar 14 01:06:28 old-k8s-version-023742 kubelet[662]: E0314 01:06:28.975368 662 reflector.go:138] object-"kube-system"/"kindnet-token-5q9tx": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kindnet-token-5q9tx" is forbidden: User "system:node:old-k8s-version-023742" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-023742' and this object
W0314 01:12:00.061280 2159335 logs.go:138] Found kubelet problem: Mar 14 01:06:28 old-k8s-version-023742 kubelet[662]: E0314 01:06:28.975944 662 reflector.go:138] object-"kube-system"/"storage-provisioner-token-hcjsf": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "storage-provisioner-token-hcjsf" is forbidden: User "system:node:old-k8s-version-023742" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-023742' and this object
W0314 01:12:00.061494 2159335 logs.go:138] Found kubelet problem: Mar 14 01:06:28 old-k8s-version-023742 kubelet[662]: E0314 01:06:28.979394 662 reflector.go:138] object-"default"/"default-token-rpt2n": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "default-token-rpt2n" is forbidden: User "system:node:old-k8s-version-023742" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'old-k8s-version-023742' and this object
W0314 01:12:00.061719 2159335 logs.go:138] Found kubelet problem: Mar 14 01:06:28 old-k8s-version-023742 kubelet[662]: E0314 01:06:28.980058 662 reflector.go:138] object-"kube-system"/"metrics-server-token-zxqtp": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "metrics-server-token-zxqtp" is forbidden: User "system:node:old-k8s-version-023742" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-023742' and this object
W0314 01:12:00.061941 2159335 logs.go:138] Found kubelet problem: Mar 14 01:06:28 old-k8s-version-023742 kubelet[662]: E0314 01:06:28.980106 662 reflector.go:138] object-"kube-system"/"kube-proxy-token-g2rnq": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kube-proxy-token-g2rnq" is forbidden: User "system:node:old-k8s-version-023742" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-023742' and this object
W0314 01:12:00.070827 2159335 logs.go:138] Found kubelet problem: Mar 14 01:06:31 old-k8s-version-023742 kubelet[662]: E0314 01:06:31.370582 662 pod_workers.go:191] Error syncing pod 320a7d9f-62a0-45d2-b07d-657dc3bd1b28 ("metrics-server-9975d5f86-prnsg_kube-system(320a7d9f-62a0-45d2-b07d-657dc3bd1b28)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0314 01:12:00.073041 2159335 logs.go:138] Found kubelet problem: Mar 14 01:06:32 old-k8s-version-023742 kubelet[662]: E0314 01:06:32.031743 662 pod_workers.go:191] Error syncing pod 320a7d9f-62a0-45d2-b07d-657dc3bd1b28 ("metrics-server-9975d5f86-prnsg_kube-system(320a7d9f-62a0-45d2-b07d-657dc3bd1b28)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0314 01:12:00.075814 2159335 logs.go:138] Found kubelet problem: Mar 14 01:06:46 old-k8s-version-023742 kubelet[662]: E0314 01:06:46.773820 662 pod_workers.go:191] Error syncing pod 320a7d9f-62a0-45d2-b07d-657dc3bd1b28 ("metrics-server-9975d5f86-prnsg_kube-system(320a7d9f-62a0-45d2-b07d-657dc3bd1b28)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0314 01:12:00.076572 2159335 logs.go:138] Found kubelet problem: Mar 14 01:06:48 old-k8s-version-023742 kubelet[662]: E0314 01:06:48.034705 662 reflector.go:138] object-"kubernetes-dashboard"/"kubernetes-dashboard-token-wht5d": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kubernetes-dashboard-token-wht5d" is forbidden: User "system:node:old-k8s-version-023742" cannot list resource "secrets" in API group "" in the namespace "kubernetes-dashboard": no relationship found between node 'old-k8s-version-023742' and this object
W0314 01:12:00.078439 2159335 logs.go:138] Found kubelet problem: Mar 14 01:06:59 old-k8s-version-023742 kubelet[662]: E0314 01:06:59.151608 662 pod_workers.go:191] Error syncing pod 1e66610b-54fb-4a50-b7c1-47326c1c1c70 ("dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"
W0314 01:12:00.078625 2159335 logs.go:138] Found kubelet problem: Mar 14 01:06:59 old-k8s-version-023742 kubelet[662]: E0314 01:06:59.766765 662 pod_workers.go:191] Error syncing pod 320a7d9f-62a0-45d2-b07d-657dc3bd1b28 ("metrics-server-9975d5f86-prnsg_kube-system(320a7d9f-62a0-45d2-b07d-657dc3bd1b28)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0314 01:12:00.078953 2159335 logs.go:138] Found kubelet problem: Mar 14 01:07:00 old-k8s-version-023742 kubelet[662]: E0314 01:07:00.185170 662 pod_workers.go:191] Error syncing pod 1e66610b-54fb-4a50-b7c1-47326c1c1c70 ("dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"
W0314 01:12:00.079500 2159335 logs.go:138] Found kubelet problem: Mar 14 01:07:02 old-k8s-version-023742 kubelet[662]: E0314 01:07:02.195749 662 pod_workers.go:191] Error syncing pod 57373aa5-20c2-4873-b3e0-c1c27570f447 ("storage-provisioner_kube-system(57373aa5-20c2-4873-b3e0-c1c27570f447)"), skipping: failed to "StartContainer" for "storage-provisioner" with CrashLoopBackOff: "back-off 10s restarting failed container=storage-provisioner pod=storage-provisioner_kube-system(57373aa5-20c2-4873-b3e0-c1c27570f447)"
W0314 01:12:00.079839 2159335 logs.go:138] Found kubelet problem: Mar 14 01:07:03 old-k8s-version-023742 kubelet[662]: E0314 01:07:03.347757 662 pod_workers.go:191] Error syncing pod 1e66610b-54fb-4a50-b7c1-47326c1c1c70 ("dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"
W0314 01:12:00.082701 2159335 logs.go:138] Found kubelet problem: Mar 14 01:07:14 old-k8s-version-023742 kubelet[662]: E0314 01:07:14.815543 662 pod_workers.go:191] Error syncing pod 320a7d9f-62a0-45d2-b07d-657dc3bd1b28 ("metrics-server-9975d5f86-prnsg_kube-system(320a7d9f-62a0-45d2-b07d-657dc3bd1b28)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0314 01:12:00.083162 2159335 logs.go:138] Found kubelet problem: Mar 14 01:07:15 old-k8s-version-023742 kubelet[662]: E0314 01:07:15.222109 662 pod_workers.go:191] Error syncing pod 1e66610b-54fb-4a50-b7c1-47326c1c1c70 ("dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"
W0314 01:12:00.083775 2159335 logs.go:138] Found kubelet problem: Mar 14 01:07:23 old-k8s-version-023742 kubelet[662]: E0314 01:07:23.347695 662 pod_workers.go:191] Error syncing pod 1e66610b-54fb-4a50-b7c1-47326c1c1c70 ("dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"
W0314 01:12:00.083984 2159335 logs.go:138] Found kubelet problem: Mar 14 01:07:27 old-k8s-version-023742 kubelet[662]: E0314 01:07:27.771127 662 pod_workers.go:191] Error syncing pod 320a7d9f-62a0-45d2-b07d-657dc3bd1b28 ("metrics-server-9975d5f86-prnsg_kube-system(320a7d9f-62a0-45d2-b07d-657dc3bd1b28)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0314 01:12:00.084571 2159335 logs.go:138] Found kubelet problem: Mar 14 01:07:36 old-k8s-version-023742 kubelet[662]: E0314 01:07:36.268490 662 pod_workers.go:191] Error syncing pod 1e66610b-54fb-4a50-b7c1-47326c1c1c70 ("dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"
W0314 01:12:00.084759 2159335 logs.go:138] Found kubelet problem: Mar 14 01:07:38 old-k8s-version-023742 kubelet[662]: E0314 01:07:38.766381 662 pod_workers.go:191] Error syncing pod 320a7d9f-62a0-45d2-b07d-657dc3bd1b28 ("metrics-server-9975d5f86-prnsg_kube-system(320a7d9f-62a0-45d2-b07d-657dc3bd1b28)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0314 01:12:00.085087 2159335 logs.go:138] Found kubelet problem: Mar 14 01:07:43 old-k8s-version-023742 kubelet[662]: E0314 01:07:43.347263 662 pod_workers.go:191] Error syncing pod 1e66610b-54fb-4a50-b7c1-47326c1c1c70 ("dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"
W0314 01:12:00.085270 2159335 logs.go:138] Found kubelet problem: Mar 14 01:07:52 old-k8s-version-023742 kubelet[662]: E0314 01:07:52.766485 662 pod_workers.go:191] Error syncing pod 320a7d9f-62a0-45d2-b07d-657dc3bd1b28 ("metrics-server-9975d5f86-prnsg_kube-system(320a7d9f-62a0-45d2-b07d-657dc3bd1b28)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0314 01:12:00.085601 2159335 logs.go:138] Found kubelet problem: Mar 14 01:07:56 old-k8s-version-023742 kubelet[662]: E0314 01:07:56.766099 662 pod_workers.go:191] Error syncing pod 1e66610b-54fb-4a50-b7c1-47326c1c1c70 ("dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"
W0314 01:12:00.085925 2159335 logs.go:138] Found kubelet problem: Mar 14 01:08:07 old-k8s-version-023742 kubelet[662]: E0314 01:08:07.770729 662 pod_workers.go:191] Error syncing pod 1e66610b-54fb-4a50-b7c1-47326c1c1c70 ("dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"
W0314 01:12:00.088552 2159335 logs.go:138] Found kubelet problem: Mar 14 01:08:07 old-k8s-version-023742 kubelet[662]: E0314 01:08:07.790467 662 pod_workers.go:191] Error syncing pod 320a7d9f-62a0-45d2-b07d-657dc3bd1b28 ("metrics-server-9975d5f86-prnsg_kube-system(320a7d9f-62a0-45d2-b07d-657dc3bd1b28)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0314 01:12:00.089148 2159335 logs.go:138] Found kubelet problem: Mar 14 01:08:20 old-k8s-version-023742 kubelet[662]: E0314 01:08:20.365151 662 pod_workers.go:191] Error syncing pod 1e66610b-54fb-4a50-b7c1-47326c1c1c70 ("dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"
W0314 01:12:00.089334 2159335 logs.go:138] Found kubelet problem: Mar 14 01:08:20 old-k8s-version-023742 kubelet[662]: E0314 01:08:20.769752 662 pod_workers.go:191] Error syncing pod 320a7d9f-62a0-45d2-b07d-657dc3bd1b28 ("metrics-server-9975d5f86-prnsg_kube-system(320a7d9f-62a0-45d2-b07d-657dc3bd1b28)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0314 01:12:00.089658 2159335 logs.go:138] Found kubelet problem: Mar 14 01:08:23 old-k8s-version-023742 kubelet[662]: E0314 01:08:23.347539 662 pod_workers.go:191] Error syncing pod 1e66610b-54fb-4a50-b7c1-47326c1c1c70 ("dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"
W0314 01:12:00.089844 2159335 logs.go:138] Found kubelet problem: Mar 14 01:08:32 old-k8s-version-023742 kubelet[662]: E0314 01:08:32.767876 662 pod_workers.go:191] Error syncing pod 320a7d9f-62a0-45d2-b07d-657dc3bd1b28 ("metrics-server-9975d5f86-prnsg_kube-system(320a7d9f-62a0-45d2-b07d-657dc3bd1b28)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0314 01:12:00.090188 2159335 logs.go:138] Found kubelet problem: Mar 14 01:08:35 old-k8s-version-023742 kubelet[662]: E0314 01:08:35.771384 662 pod_workers.go:191] Error syncing pod 1e66610b-54fb-4a50-b7c1-47326c1c1c70 ("dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"
W0314 01:12:00.090369 2159335 logs.go:138] Found kubelet problem: Mar 14 01:08:43 old-k8s-version-023742 kubelet[662]: E0314 01:08:43.766453 662 pod_workers.go:191] Error syncing pod 320a7d9f-62a0-45d2-b07d-657dc3bd1b28 ("metrics-server-9975d5f86-prnsg_kube-system(320a7d9f-62a0-45d2-b07d-657dc3bd1b28)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0314 01:12:00.090695 2159335 logs.go:138] Found kubelet problem: Mar 14 01:08:49 old-k8s-version-023742 kubelet[662]: E0314 01:08:49.766428 662 pod_workers.go:191] Error syncing pod 1e66610b-54fb-4a50-b7c1-47326c1c1c70 ("dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"
W0314 01:12:00.090874 2159335 logs.go:138] Found kubelet problem: Mar 14 01:08:58 old-k8s-version-023742 kubelet[662]: E0314 01:08:58.766502 662 pod_workers.go:191] Error syncing pod 320a7d9f-62a0-45d2-b07d-657dc3bd1b28 ("metrics-server-9975d5f86-prnsg_kube-system(320a7d9f-62a0-45d2-b07d-657dc3bd1b28)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0314 01:12:00.091194 2159335 logs.go:138] Found kubelet problem: Mar 14 01:09:02 old-k8s-version-023742 kubelet[662]: E0314 01:09:02.765978 662 pod_workers.go:191] Error syncing pod 1e66610b-54fb-4a50-b7c1-47326c1c1c70 ("dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"
W0314 01:12:00.091387 2159335 logs.go:138] Found kubelet problem: Mar 14 01:09:12 old-k8s-version-023742 kubelet[662]: E0314 01:09:12.766341 662 pod_workers.go:191] Error syncing pod 320a7d9f-62a0-45d2-b07d-657dc3bd1b28 ("metrics-server-9975d5f86-prnsg_kube-system(320a7d9f-62a0-45d2-b07d-657dc3bd1b28)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0314 01:12:00.091707 2159335 logs.go:138] Found kubelet problem: Mar 14 01:09:16 old-k8s-version-023742 kubelet[662]: E0314 01:09:16.766009 662 pod_workers.go:191] Error syncing pod 1e66610b-54fb-4a50-b7c1-47326c1c1c70 ("dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"
W0314 01:12:00.091896 2159335 logs.go:138] Found kubelet problem: Mar 14 01:09:25 old-k8s-version-023742 kubelet[662]: E0314 01:09:25.766322 662 pod_workers.go:191] Error syncing pod 320a7d9f-62a0-45d2-b07d-657dc3bd1b28 ("metrics-server-9975d5f86-prnsg_kube-system(320a7d9f-62a0-45d2-b07d-657dc3bd1b28)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0314 01:12:00.092219 2159335 logs.go:138] Found kubelet problem: Mar 14 01:09:29 old-k8s-version-023742 kubelet[662]: E0314 01:09:29.766880 662 pod_workers.go:191] Error syncing pod 1e66610b-54fb-4a50-b7c1-47326c1c1c70 ("dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"
W0314 01:12:00.094659 2159335 logs.go:138] Found kubelet problem: Mar 14 01:09:36 old-k8s-version-023742 kubelet[662]: E0314 01:09:36.773716 662 pod_workers.go:191] Error syncing pod 320a7d9f-62a0-45d2-b07d-657dc3bd1b28 ("metrics-server-9975d5f86-prnsg_kube-system(320a7d9f-62a0-45d2-b07d-657dc3bd1b28)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0314 01:12:00.095254 2159335 logs.go:138] Found kubelet problem: Mar 14 01:09:41 old-k8s-version-023742 kubelet[662]: E0314 01:09:41.548782 662 pod_workers.go:191] Error syncing pod 1e66610b-54fb-4a50-b7c1-47326c1c1c70 ("dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"
W0314 01:12:00.095595 2159335 logs.go:138] Found kubelet problem: Mar 14 01:09:43 old-k8s-version-023742 kubelet[662]: E0314 01:09:43.347327 662 pod_workers.go:191] Error syncing pod 1e66610b-54fb-4a50-b7c1-47326c1c1c70 ("dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"
W0314 01:12:00.095785 2159335 logs.go:138] Found kubelet problem: Mar 14 01:09:50 old-k8s-version-023742 kubelet[662]: E0314 01:09:50.766966 662 pod_workers.go:191] Error syncing pod 320a7d9f-62a0-45d2-b07d-657dc3bd1b28 ("metrics-server-9975d5f86-prnsg_kube-system(320a7d9f-62a0-45d2-b07d-657dc3bd1b28)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0314 01:12:00.096113 2159335 logs.go:138] Found kubelet problem: Mar 14 01:09:56 old-k8s-version-023742 kubelet[662]: E0314 01:09:56.766015 662 pod_workers.go:191] Error syncing pod 1e66610b-54fb-4a50-b7c1-47326c1c1c70 ("dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"
W0314 01:12:00.096296 2159335 logs.go:138] Found kubelet problem: Mar 14 01:10:04 old-k8s-version-023742 kubelet[662]: E0314 01:10:04.766379 662 pod_workers.go:191] Error syncing pod 320a7d9f-62a0-45d2-b07d-657dc3bd1b28 ("metrics-server-9975d5f86-prnsg_kube-system(320a7d9f-62a0-45d2-b07d-657dc3bd1b28)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0314 01:12:00.096625 2159335 logs.go:138] Found kubelet problem: Mar 14 01:10:10 old-k8s-version-023742 kubelet[662]: E0314 01:10:10.766119 662 pod_workers.go:191] Error syncing pod 1e66610b-54fb-4a50-b7c1-47326c1c1c70 ("dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"
W0314 01:12:00.096809 2159335 logs.go:138] Found kubelet problem: Mar 14 01:10:15 old-k8s-version-023742 kubelet[662]: E0314 01:10:15.767425 662 pod_workers.go:191] Error syncing pod 320a7d9f-62a0-45d2-b07d-657dc3bd1b28 ("metrics-server-9975d5f86-prnsg_kube-system(320a7d9f-62a0-45d2-b07d-657dc3bd1b28)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0314 01:12:00.097131 2159335 logs.go:138] Found kubelet problem: Mar 14 01:10:25 old-k8s-version-023742 kubelet[662]: E0314 01:10:25.766011 662 pod_workers.go:191] Error syncing pod 1e66610b-54fb-4a50-b7c1-47326c1c1c70 ("dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"
W0314 01:12:00.097313 2159335 logs.go:138] Found kubelet problem: Mar 14 01:10:29 old-k8s-version-023742 kubelet[662]: E0314 01:10:29.766425 662 pod_workers.go:191] Error syncing pod 320a7d9f-62a0-45d2-b07d-657dc3bd1b28 ("metrics-server-9975d5f86-prnsg_kube-system(320a7d9f-62a0-45d2-b07d-657dc3bd1b28)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0314 01:12:00.097636 2159335 logs.go:138] Found kubelet problem: Mar 14 01:10:40 old-k8s-version-023742 kubelet[662]: E0314 01:10:40.766016 662 pod_workers.go:191] Error syncing pod 1e66610b-54fb-4a50-b7c1-47326c1c1c70 ("dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"
W0314 01:12:00.097817 2159335 logs.go:138] Found kubelet problem: Mar 14 01:10:43 old-k8s-version-023742 kubelet[662]: E0314 01:10:43.767405 662 pod_workers.go:191] Error syncing pod 320a7d9f-62a0-45d2-b07d-657dc3bd1b28 ("metrics-server-9975d5f86-prnsg_kube-system(320a7d9f-62a0-45d2-b07d-657dc3bd1b28)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0314 01:12:00.098144 2159335 logs.go:138] Found kubelet problem: Mar 14 01:10:54 old-k8s-version-023742 kubelet[662]: E0314 01:10:54.765962 662 pod_workers.go:191] Error syncing pod 1e66610b-54fb-4a50-b7c1-47326c1c1c70 ("dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"
W0314 01:12:00.098344 2159335 logs.go:138] Found kubelet problem: Mar 14 01:10:55 old-k8s-version-023742 kubelet[662]: E0314 01:10:55.766370 662 pod_workers.go:191] Error syncing pod 320a7d9f-62a0-45d2-b07d-657dc3bd1b28 ("metrics-server-9975d5f86-prnsg_kube-system(320a7d9f-62a0-45d2-b07d-657dc3bd1b28)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0314 01:12:00.098533 2159335 logs.go:138] Found kubelet problem: Mar 14 01:11:06 old-k8s-version-023742 kubelet[662]: E0314 01:11:06.766830 662 pod_workers.go:191] Error syncing pod 320a7d9f-62a0-45d2-b07d-657dc3bd1b28 ("metrics-server-9975d5f86-prnsg_kube-system(320a7d9f-62a0-45d2-b07d-657dc3bd1b28)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0314 01:12:00.098861 2159335 logs.go:138] Found kubelet problem: Mar 14 01:11:08 old-k8s-version-023742 kubelet[662]: E0314 01:11:08.765992 662 pod_workers.go:191] Error syncing pod 1e66610b-54fb-4a50-b7c1-47326c1c1c70 ("dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"
W0314 01:12:00.099043 2159335 logs.go:138] Found kubelet problem: Mar 14 01:11:19 old-k8s-version-023742 kubelet[662]: E0314 01:11:19.766986 662 pod_workers.go:191] Error syncing pod 320a7d9f-62a0-45d2-b07d-657dc3bd1b28 ("metrics-server-9975d5f86-prnsg_kube-system(320a7d9f-62a0-45d2-b07d-657dc3bd1b28)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0314 01:12:00.099479 2159335 logs.go:138] Found kubelet problem: Mar 14 01:11:19 old-k8s-version-023742 kubelet[662]: E0314 01:11:19.771307 662 pod_workers.go:191] Error syncing pod 1e66610b-54fb-4a50-b7c1-47326c1c1c70 ("dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"
W0314 01:12:00.099671 2159335 logs.go:138] Found kubelet problem: Mar 14 01:11:31 old-k8s-version-023742 kubelet[662]: E0314 01:11:31.766411 662 pod_workers.go:191] Error syncing pod 320a7d9f-62a0-45d2-b07d-657dc3bd1b28 ("metrics-server-9975d5f86-prnsg_kube-system(320a7d9f-62a0-45d2-b07d-657dc3bd1b28)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0314 01:12:00.100002 2159335 logs.go:138] Found kubelet problem: Mar 14 01:11:31 old-k8s-version-023742 kubelet[662]: E0314 01:11:31.768210 662 pod_workers.go:191] Error syncing pod 1e66610b-54fb-4a50-b7c1-47326c1c1c70 ("dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"
W0314 01:12:00.100332 2159335 logs.go:138] Found kubelet problem: Mar 14 01:11:42 old-k8s-version-023742 kubelet[662]: E0314 01:11:42.766039 662 pod_workers.go:191] Error syncing pod 1e66610b-54fb-4a50-b7c1-47326c1c1c70 ("dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"
W0314 01:12:00.100526 2159335 logs.go:138] Found kubelet problem: Mar 14 01:11:45 old-k8s-version-023742 kubelet[662]: E0314 01:11:45.766829 662 pod_workers.go:191] Error syncing pod 320a7d9f-62a0-45d2-b07d-657dc3bd1b28 ("metrics-server-9975d5f86-prnsg_kube-system(320a7d9f-62a0-45d2-b07d-657dc3bd1b28)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0314 01:12:00.100851 2159335 logs.go:138] Found kubelet problem: Mar 14 01:11:57 old-k8s-version-023742 kubelet[662]: E0314 01:11:57.767790 662 pod_workers.go:191] Error syncing pod 1e66610b-54fb-4a50-b7c1-47326c1c1c70 ("dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"
W0314 01:12:00.101036 2159335 logs.go:138] Found kubelet problem: Mar 14 01:11:59 old-k8s-version-023742 kubelet[662]: E0314 01:11:59.770052 662 pod_workers.go:191] Error syncing pod 320a7d9f-62a0-45d2-b07d-657dc3bd1b28 ("metrics-server-9975d5f86-prnsg_kube-system(320a7d9f-62a0-45d2-b07d-657dc3bd1b28)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
I0314 01:12:00.101050 2159335 logs.go:123] Gathering logs for kube-proxy [36947fb39456b70b586f2321c1589d336fbf8121fcabf5f669409c9680ddc202] ...
I0314 01:12:00.101074 2159335 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 36947fb39456b70b586f2321c1589d336fbf8121fcabf5f669409c9680ddc202"
I0314 01:12:00.174338 2159335 logs.go:123] Gathering logs for storage-provisioner [4e7dc51c48baacd42a05abe380200f2d6c242433155f704a890e45913c11586c] ...
I0314 01:12:00.174402 2159335 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 4e7dc51c48baacd42a05abe380200f2d6c242433155f704a890e45913c11586c"
I0314 01:12:00.342882 2159335 logs.go:123] Gathering logs for kube-controller-manager [c79d313c53d51ee00f93e8076ad26cc072bc1abea5f1a5b6a64db439ffbbd272] ...
I0314 01:12:00.342916 2159335 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 c79d313c53d51ee00f93e8076ad26cc072bc1abea5f1a5b6a64db439ffbbd272"
I0314 01:12:00.504401 2159335 logs.go:123] Gathering logs for kube-controller-manager [00c36bf0f8362e90a4a6eb52e67b0fde8d3b9e110159c37ce5cff0a34795231b] ...
I0314 01:12:00.504488 2159335 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 00c36bf0f8362e90a4a6eb52e67b0fde8d3b9e110159c37ce5cff0a34795231b"
I0314 01:12:00.615545 2159335 logs.go:123] Gathering logs for kindnet [661201637b62150c5e65fb761af09186766a8c5ee343b157bd78587674493702] ...
I0314 01:12:00.615587 2159335 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 661201637b62150c5e65fb761af09186766a8c5ee343b157bd78587674493702"
I0314 01:12:00.668756 2159335 logs.go:123] Gathering logs for storage-provisioner [0378f91f5f30bc555d7408bc86dd626b1d5ffeb38145d3ee69160c360c8f3416] ...
I0314 01:12:00.668788 2159335 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 0378f91f5f30bc555d7408bc86dd626b1d5ffeb38145d3ee69160c360c8f3416"
I0314 01:12:00.713317 2159335 logs.go:123] Gathering logs for kube-apiserver [fdb44b3f1b8bfa78a5d1d74ef6b0613a584997cf3688d648110b83847d6bfbb7] ...
I0314 01:12:00.713344 2159335 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 fdb44b3f1b8bfa78a5d1d74ef6b0613a584997cf3688d648110b83847d6bfbb7"
I0314 01:12:00.787839 2159335 logs.go:123] Gathering logs for kube-apiserver [cf476c9051e98ad0797f500808cadc3fa875ce3d5892a9524d352ac49530d1c7] ...
I0314 01:12:00.787872 2159335 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 cf476c9051e98ad0797f500808cadc3fa875ce3d5892a9524d352ac49530d1c7"
I0314 01:12:00.855002 2159335 logs.go:123] Gathering logs for etcd [1c0e3f86261a4182fbe7a919791938f3f1b269a39c811b556df8aa8f15b310f1] ...
I0314 01:12:00.855046 2159335 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 1c0e3f86261a4182fbe7a919791938f3f1b269a39c811b556df8aa8f15b310f1"
I0314 01:12:00.907768 2159335 logs.go:123] Gathering logs for describe nodes ...
I0314 01:12:00.907808 2159335 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0314 01:12:01.123021 2159335 logs.go:123] Gathering logs for kube-scheduler [abe11e046f972c9c239dc5503ce7b4e6abdb261d19262a88ebf1157e26888704] ...
I0314 01:12:01.123090 2159335 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 abe11e046f972c9c239dc5503ce7b4e6abdb261d19262a88ebf1157e26888704"
I0314 01:12:01.210926 2159335 logs.go:123] Gathering logs for kube-scheduler [89cecf527c72212c9774ad52dd4fdf563d5e162b2b3c0590daf1a40383e5f87c] ...
I0314 01:12:01.210954 2159335 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 89cecf527c72212c9774ad52dd4fdf563d5e162b2b3c0590daf1a40383e5f87c"
I0314 01:12:01.269850 2159335 out.go:304] Setting ErrFile to fd 2...
I0314 01:12:01.270269 2159335 out.go:338] TERM=,COLORTERM=, which probably does not support color
W0314 01:12:01.270366 2159335 out.go:239] X Problems detected in kubelet:
X Problems detected in kubelet:
W0314 01:12:01.270411 2159335 out.go:239] Mar 14 01:11:31 old-k8s-version-023742 kubelet[662]: E0314 01:11:31.768210 662 pod_workers.go:191] Error syncing pod 1e66610b-54fb-4a50-b7c1-47326c1c1c70 ("dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"
Mar 14 01:11:31 old-k8s-version-023742 kubelet[662]: E0314 01:11:31.768210 662 pod_workers.go:191] Error syncing pod 1e66610b-54fb-4a50-b7c1-47326c1c1c70 ("dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"
W0314 01:12:01.270566 2159335 out.go:239] Mar 14 01:11:42 old-k8s-version-023742 kubelet[662]: E0314 01:11:42.766039 662 pod_workers.go:191] Error syncing pod 1e66610b-54fb-4a50-b7c1-47326c1c1c70 ("dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"
Mar 14 01:11:42 old-k8s-version-023742 kubelet[662]: E0314 01:11:42.766039 662 pod_workers.go:191] Error syncing pod 1e66610b-54fb-4a50-b7c1-47326c1c1c70 ("dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"
W0314 01:12:01.270598 2159335 out.go:239] Mar 14 01:11:45 old-k8s-version-023742 kubelet[662]: E0314 01:11:45.766829 662 pod_workers.go:191] Error syncing pod 320a7d9f-62a0-45d2-b07d-657dc3bd1b28 ("metrics-server-9975d5f86-prnsg_kube-system(320a7d9f-62a0-45d2-b07d-657dc3bd1b28)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Mar 14 01:11:45 old-k8s-version-023742 kubelet[662]: E0314 01:11:45.766829 662 pod_workers.go:191] Error syncing pod 320a7d9f-62a0-45d2-b07d-657dc3bd1b28 ("metrics-server-9975d5f86-prnsg_kube-system(320a7d9f-62a0-45d2-b07d-657dc3bd1b28)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0314 01:12:01.270630 2159335 out.go:239] Mar 14 01:11:57 old-k8s-version-023742 kubelet[662]: E0314 01:11:57.767790 662 pod_workers.go:191] Error syncing pod 1e66610b-54fb-4a50-b7c1-47326c1c1c70 ("dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"
Mar 14 01:11:57 old-k8s-version-023742 kubelet[662]: E0314 01:11:57.767790 662 pod_workers.go:191] Error syncing pod 1e66610b-54fb-4a50-b7c1-47326c1c1c70 ("dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"
W0314 01:12:01.270666 2159335 out.go:239] Mar 14 01:11:59 old-k8s-version-023742 kubelet[662]: E0314 01:11:59.770052 662 pod_workers.go:191] Error syncing pod 320a7d9f-62a0-45d2-b07d-657dc3bd1b28 ("metrics-server-9975d5f86-prnsg_kube-system(320a7d9f-62a0-45d2-b07d-657dc3bd1b28)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Mar 14 01:11:59 old-k8s-version-023742 kubelet[662]: E0314 01:11:59.770052 662 pod_workers.go:191] Error syncing pod 320a7d9f-62a0-45d2-b07d-657dc3bd1b28 ("metrics-server-9975d5f86-prnsg_kube-system(320a7d9f-62a0-45d2-b07d-657dc3bd1b28)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
I0314 01:12:01.270709 2159335 out.go:304] Setting ErrFile to fd 2...
I0314 01:12:01.270732 2159335 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0314 01:12:11.271976 2159335 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0314 01:12:11.284381 2159335 api_server.go:72] duration metric: took 6m1.5739088s to wait for apiserver process to appear ...
I0314 01:12:11.284404 2159335 api_server.go:88] waiting for apiserver healthz status ...
I0314 01:12:11.286614 2159335 out.go:177]
W0314 01:12:11.288783 2159335 out.go:239] X Exiting due to GUEST_START: failed to start node: wait 6m0s for node: wait for healthy API server: apiserver healthz never reported healthy: cluster wait timed out during healthz check
X Exiting due to GUEST_START: failed to start node: wait 6m0s for node: wait for healthy API server: apiserver healthz never reported healthy: cluster wait timed out during healthz check
W0314 01:12:11.288808 2159335 out.go:239] *
*
W0314 01:12:11.289707 2159335 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0314 01:12:11.292264 2159335 out.go:177]
** /stderr **
start_stop_delete_test.go:259: failed to start minikube post-stop. args "out/minikube-linux-arm64 start -p old-k8s-version-023742 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=containerd --kubernetes-version=v1.20.0": exit status 80
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: docker inspect <======
helpers_test.go:231: (dbg) Run: docker inspect old-k8s-version-023742
helpers_test.go:235: (dbg) docker inspect old-k8s-version-023742:
-- stdout --
[
{
"Id": "8a6adc8c6a3b6226636e672fe7c844b2396abb72552b50817cef9f2f95db6fcd",
"Created": "2024-03-14T01:03:02.193822222Z",
"Path": "/usr/local/bin/entrypoint",
"Args": [
"/sbin/init"
],
"State": {
"Status": "running",
"Running": true,
"Paused": false,
"Restarting": false,
"OOMKilled": false,
"Dead": false,
"Pid": 2159530,
"ExitCode": 0,
"Error": "",
"StartedAt": "2024-03-14T01:06:02.492594699Z",
"FinishedAt": "2024-03-14T01:06:01.222351113Z"
},
"Image": "sha256:db62270b4bb0cfcde696782f7a6322baca275275e31814ce9fd8998407bf461e",
"ResolvConfPath": "/var/lib/docker/containers/8a6adc8c6a3b6226636e672fe7c844b2396abb72552b50817cef9f2f95db6fcd/resolv.conf",
"HostnamePath": "/var/lib/docker/containers/8a6adc8c6a3b6226636e672fe7c844b2396abb72552b50817cef9f2f95db6fcd/hostname",
"HostsPath": "/var/lib/docker/containers/8a6adc8c6a3b6226636e672fe7c844b2396abb72552b50817cef9f2f95db6fcd/hosts",
"LogPath": "/var/lib/docker/containers/8a6adc8c6a3b6226636e672fe7c844b2396abb72552b50817cef9f2f95db6fcd/8a6adc8c6a3b6226636e672fe7c844b2396abb72552b50817cef9f2f95db6fcd-json.log",
"Name": "/old-k8s-version-023742",
"RestartCount": 0,
"Driver": "overlay2",
"Platform": "linux",
"MountLabel": "",
"ProcessLabel": "",
"AppArmorProfile": "unconfined",
"ExecIDs": null,
"HostConfig": {
"Binds": [
"/lib/modules:/lib/modules:ro",
"old-k8s-version-023742:/var"
],
"ContainerIDFile": "",
"LogConfig": {
"Type": "json-file",
"Config": {}
},
"NetworkMode": "old-k8s-version-023742",
"PortBindings": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
]
},
"RestartPolicy": {
"Name": "no",
"MaximumRetryCount": 0
},
"AutoRemove": false,
"VolumeDriver": "",
"VolumesFrom": null,
"ConsoleSize": [
0,
0
],
"CapAdd": null,
"CapDrop": null,
"CgroupnsMode": "host",
"Dns": [],
"DnsOptions": [],
"DnsSearch": [],
"ExtraHosts": null,
"GroupAdd": null,
"IpcMode": "private",
"Cgroup": "",
"Links": null,
"OomScoreAdj": 0,
"PidMode": "",
"Privileged": true,
"PublishAllPorts": false,
"ReadonlyRootfs": false,
"SecurityOpt": [
"seccomp=unconfined",
"apparmor=unconfined",
"label=disable"
],
"Tmpfs": {
"/run": "",
"/tmp": ""
},
"UTSMode": "",
"UsernsMode": "",
"ShmSize": 67108864,
"Runtime": "runc",
"Isolation": "",
"CpuShares": 0,
"Memory": 2306867200,
"NanoCpus": 2000000000,
"CgroupParent": "",
"BlkioWeight": 0,
"BlkioWeightDevice": [],
"BlkioDeviceReadBps": [],
"BlkioDeviceWriteBps": [],
"BlkioDeviceReadIOps": [],
"BlkioDeviceWriteIOps": [],
"CpuPeriod": 0,
"CpuQuota": 0,
"CpuRealtimePeriod": 0,
"CpuRealtimeRuntime": 0,
"CpusetCpus": "",
"CpusetMems": "",
"Devices": [],
"DeviceCgroupRules": null,
"DeviceRequests": null,
"MemoryReservation": 0,
"MemorySwap": 4613734400,
"MemorySwappiness": null,
"OomKillDisable": false,
"PidsLimit": null,
"Ulimits": [],
"CpuCount": 0,
"CpuPercent": 0,
"IOMaximumIOps": 0,
"IOMaximumBandwidth": 0,
"MaskedPaths": null,
"ReadonlyPaths": null
},
"GraphDriver": {
"Data": {
"LowerDir": "/var/lib/docker/overlay2/be0eff0a50b93012dc27285a987e503aedf0c14138b3a2356a695b78be795ebf-init/diff:/var/lib/docker/overlay2/72e8565c3c6c9dcaff9dab92d595dc2eb0a265ce93caf6066e88703bac9975f6/diff",
"MergedDir": "/var/lib/docker/overlay2/be0eff0a50b93012dc27285a987e503aedf0c14138b3a2356a695b78be795ebf/merged",
"UpperDir": "/var/lib/docker/overlay2/be0eff0a50b93012dc27285a987e503aedf0c14138b3a2356a695b78be795ebf/diff",
"WorkDir": "/var/lib/docker/overlay2/be0eff0a50b93012dc27285a987e503aedf0c14138b3a2356a695b78be795ebf/work"
},
"Name": "overlay2"
},
"Mounts": [
{
"Type": "bind",
"Source": "/lib/modules",
"Destination": "/lib/modules",
"Mode": "ro",
"RW": false,
"Propagation": "rprivate"
},
{
"Type": "volume",
"Name": "old-k8s-version-023742",
"Source": "/var/lib/docker/volumes/old-k8s-version-023742/_data",
"Destination": "/var",
"Driver": "local",
"Mode": "z",
"RW": true,
"Propagation": ""
}
],
"Config": {
"Hostname": "old-k8s-version-023742",
"Domainname": "",
"User": "",
"AttachStdin": false,
"AttachStdout": false,
"AttachStderr": false,
"ExposedPorts": {
"22/tcp": {},
"2376/tcp": {},
"32443/tcp": {},
"5000/tcp": {},
"8443/tcp": {}
},
"Tty": true,
"OpenStdin": false,
"StdinOnce": false,
"Env": [
"container=docker",
"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
],
"Cmd": null,
"Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1710284843-18375@sha256:d67c38c9fc2ad14c48d95e17cbac49314325db5758d8f7b3de60b927e62ce94f",
"Volumes": null,
"WorkingDir": "/",
"Entrypoint": [
"/usr/local/bin/entrypoint",
"/sbin/init"
],
"OnBuild": null,
"Labels": {
"created_by.minikube.sigs.k8s.io": "true",
"mode.minikube.sigs.k8s.io": "old-k8s-version-023742",
"name.minikube.sigs.k8s.io": "old-k8s-version-023742",
"role.minikube.sigs.k8s.io": ""
},
"StopSignal": "SIGRTMIN+3"
},
"NetworkSettings": {
"Bridge": "",
"SandboxID": "d96ca5a25f77e9a398cb32ae420c3a9fe73133b64e38d7bb9e5727de67f6bc78",
"SandboxKey": "/var/run/docker/netns/d96ca5a25f77",
"Ports": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "35336"
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "35335"
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "35332"
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "35334"
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "35333"
}
]
},
"HairpinMode": false,
"LinkLocalIPv6Address": "",
"LinkLocalIPv6PrefixLen": 0,
"SecondaryIPAddresses": null,
"SecondaryIPv6Addresses": null,
"EndpointID": "",
"Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"IPAddress": "",
"IPPrefixLen": 0,
"IPv6Gateway": "",
"MacAddress": "",
"Networks": {
"old-k8s-version-023742": {
"IPAMConfig": {
"IPv4Address": "192.168.76.2"
},
"Links": null,
"Aliases": [
"8a6adc8c6a3b",
"old-k8s-version-023742"
],
"MacAddress": "02:42:c0:a8:4c:02",
"NetworkID": "5947c1200478aa26f99a492a5868230af15cf7ef83578a6127e0bb8034a9b4e4",
"EndpointID": "6f130c18e293bcf1968779fadc61ecfdd96dd3a598905626000a7dd8e4557f81",
"Gateway": "192.168.76.1",
"IPAddress": "192.168.76.2",
"IPPrefixLen": 24,
"IPv6Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"DriverOpts": null,
"DNSNames": [
"old-k8s-version-023742",
"8a6adc8c6a3b"
]
}
}
}
}
]
-- /stdout --
helpers_test.go:239: (dbg) Run: out/minikube-linux-arm64 status --format={{.Host}} -p old-k8s-version-023742 -n old-k8s-version-023742
helpers_test.go:244: <<< TestStartStop/group/old-k8s-version/serial/SecondStart FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: minikube logs <======
helpers_test.go:247: (dbg) Run: out/minikube-linux-arm64 -p old-k8s-version-023742 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-arm64 -p old-k8s-version-023742 logs -n 25: (2.479044874s)
helpers_test.go:252: TestStartStop/group/old-k8s-version/serial/SecondStart logs:
-- stdout --
==> Audit <==
|---------|--------------------------------------------------------|---------------------------|---------|---------|---------------------|---------------------|
| Command | Args | Profile | User | Version | Start Time | End Time |
|---------|--------------------------------------------------------|---------------------------|---------|---------|---------------------|---------------------|
| ssh | -p cilium-355815 sudo find | cilium-355815 | jenkins | v1.32.0 | 14 Mar 24 01:01 UTC | |
| | /etc/crio -type f -exec sh -c | | | | | |
| | 'echo {}; cat {}' \; | | | | | |
| ssh | -p cilium-355815 sudo crio | cilium-355815 | jenkins | v1.32.0 | 14 Mar 24 01:01 UTC | |
| | config | | | | | |
| delete | -p cilium-355815 | cilium-355815 | jenkins | v1.32.0 | 14 Mar 24 01:01 UTC | 14 Mar 24 01:01 UTC |
| start | -p force-systemd-env-008648 | force-systemd-env-008648 | jenkins | v1.32.0 | 14 Mar 24 01:01 UTC | 14 Mar 24 01:02 UTC |
| | --memory=2048 | | | | | |
| | --alsologtostderr | | | | | |
| | -v=5 --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| ssh | force-systemd-flag-804124 | force-systemd-flag-804124 | jenkins | v1.32.0 | 14 Mar 24 01:01 UTC | 14 Mar 24 01:01 UTC |
| | ssh cat | | | | | |
| | /etc/containerd/config.toml | | | | | |
| delete | -p force-systemd-flag-804124 | force-systemd-flag-804124 | jenkins | v1.32.0 | 14 Mar 24 01:01 UTC | 14 Mar 24 01:01 UTC |
| start | -p cert-expiration-798126 | cert-expiration-798126 | jenkins | v1.32.0 | 14 Mar 24 01:01 UTC | 14 Mar 24 01:02 UTC |
| | --memory=2048 | | | | | |
| | --cert-expiration=3m | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| ssh | force-systemd-env-008648 | force-systemd-env-008648 | jenkins | v1.32.0 | 14 Mar 24 01:02 UTC | 14 Mar 24 01:02 UTC |
| | ssh cat | | | | | |
| | /etc/containerd/config.toml | | | | | |
| delete | -p force-systemd-env-008648 | force-systemd-env-008648 | jenkins | v1.32.0 | 14 Mar 24 01:02 UTC | 14 Mar 24 01:02 UTC |
| start | -p cert-options-449029 | cert-options-449029 | jenkins | v1.32.0 | 14 Mar 24 01:02 UTC | 14 Mar 24 01:02 UTC |
| | --memory=2048 | | | | | |
| | --apiserver-ips=127.0.0.1 | | | | | |
| | --apiserver-ips=192.168.15.15 | | | | | |
| | --apiserver-names=localhost | | | | | |
| | --apiserver-names=www.google.com | | | | | |
| | --apiserver-port=8555 | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| ssh | cert-options-449029 ssh | cert-options-449029 | jenkins | v1.32.0 | 14 Mar 24 01:02 UTC | 14 Mar 24 01:02 UTC |
| | openssl x509 -text -noout -in | | | | | |
| | /var/lib/minikube/certs/apiserver.crt | | | | | |
| ssh | -p cert-options-449029 -- sudo | cert-options-449029 | jenkins | v1.32.0 | 14 Mar 24 01:02 UTC | 14 Mar 24 01:02 UTC |
| | cat /etc/kubernetes/admin.conf | | | | | |
| delete | -p cert-options-449029 | cert-options-449029 | jenkins | v1.32.0 | 14 Mar 24 01:02 UTC | 14 Mar 24 01:02 UTC |
| start | -p old-k8s-version-023742 | old-k8s-version-023742 | jenkins | v1.32.0 | 14 Mar 24 01:02 UTC | 14 Mar 24 01:05 UTC |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --kvm-network=default | | | | | |
| | --kvm-qemu-uri=qemu:///system | | | | | |
| | --disable-driver-mounts | | | | | |
| | --keep-context=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --kubernetes-version=v1.20.0 | | | | | |
| start | -p cert-expiration-798126 | cert-expiration-798126 | jenkins | v1.32.0 | 14 Mar 24 01:05 UTC | 14 Mar 24 01:05 UTC |
| | --memory=2048 | | | | | |
| | --cert-expiration=8760h | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| delete | -p cert-expiration-798126 | cert-expiration-798126 | jenkins | v1.32.0 | 14 Mar 24 01:05 UTC | 14 Mar 24 01:05 UTC |
| start | -p no-preload-183952 | no-preload-183952 | jenkins | v1.32.0 | 14 Mar 24 01:05 UTC | 14 Mar 24 01:06 UTC |
| | --memory=2200 --alsologtostderr | | | | | |
| | --wait=true --preload=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --kubernetes-version=v1.29.0-rc.2 | | | | | |
| addons | enable metrics-server -p old-k8s-version-023742 | old-k8s-version-023742 | jenkins | v1.32.0 | 14 Mar 24 01:05 UTC | 14 Mar 24 01:05 UTC |
| | --images=MetricsServer=registry.k8s.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| stop | -p old-k8s-version-023742 | old-k8s-version-023742 | jenkins | v1.32.0 | 14 Mar 24 01:05 UTC | 14 Mar 24 01:06 UTC |
| | --alsologtostderr -v=3 | | | | | |
| addons | enable dashboard -p old-k8s-version-023742 | old-k8s-version-023742 | jenkins | v1.32.0 | 14 Mar 24 01:06 UTC | 14 Mar 24 01:06 UTC |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| start | -p old-k8s-version-023742 | old-k8s-version-023742 | jenkins | v1.32.0 | 14 Mar 24 01:06 UTC | |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --kvm-network=default | | | | | |
| | --kvm-qemu-uri=qemu:///system | | | | | |
| | --disable-driver-mounts | | | | | |
| | --keep-context=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --kubernetes-version=v1.20.0 | | | | | |
| addons | enable metrics-server -p no-preload-183952 | no-preload-183952 | jenkins | v1.32.0 | 14 Mar 24 01:07 UTC | 14 Mar 24 01:07 UTC |
| | --images=MetricsServer=registry.k8s.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| stop | -p no-preload-183952 | no-preload-183952 | jenkins | v1.32.0 | 14 Mar 24 01:07 UTC | 14 Mar 24 01:07 UTC |
| | --alsologtostderr -v=3 | | | | | |
| addons | enable dashboard -p no-preload-183952 | no-preload-183952 | jenkins | v1.32.0 | 14 Mar 24 01:07 UTC | 14 Mar 24 01:07 UTC |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| start | -p no-preload-183952 | no-preload-183952 | jenkins | v1.32.0 | 14 Mar 24 01:07 UTC | 14 Mar 24 01:12 UTC |
| | --memory=2200 --alsologtostderr | | | | | |
| | --wait=true --preload=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --kubernetes-version=v1.29.0-rc.2 | | | | | |
|---------|--------------------------------------------------------|---------------------------|---------|---------|---------------------|---------------------|
==> Last Start <==
Log file created at: 2024/03/14 01:07:20
Running on machine: ip-172-31-31-251
Binary: Built with gc go1.22.1 for linux/arm64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I0314 01:07:20.494226 2164567 out.go:291] Setting OutFile to fd 1 ...
I0314 01:07:20.494533 2164567 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0314 01:07:20.494561 2164567 out.go:304] Setting ErrFile to fd 2...
I0314 01:07:20.494580 2164567 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0314 01:07:20.494862 2164567 root.go:338] Updating PATH: /home/jenkins/minikube-integration/18375-1958430/.minikube/bin
I0314 01:07:20.495326 2164567 out.go:298] Setting JSON to false
I0314 01:07:20.496531 2164567 start.go:129] hostinfo: {"hostname":"ip-172-31-31-251","uptime":31791,"bootTime":1710346650,"procs":234,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1055-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"982e3628-3742-4b3e-bb63-ac1b07660ec7"}
I0314 01:07:20.496641 2164567 start.go:139] virtualization:
I0314 01:07:20.499717 2164567 out.go:177] * [no-preload-183952] minikube v1.32.0 on Ubuntu 20.04 (arm64)
I0314 01:07:20.501897 2164567 out.go:177] - MINIKUBE_LOCATION=18375
I0314 01:07:20.503741 2164567 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0314 01:07:20.501987 2164567 notify.go:220] Checking for updates...
I0314 01:07:20.505563 2164567 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/18375-1958430/kubeconfig
I0314 01:07:20.507308 2164567 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/18375-1958430/.minikube
I0314 01:07:20.509472 2164567 out.go:177] - MINIKUBE_BIN=out/minikube-linux-arm64
I0314 01:07:20.511157 2164567 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0314 01:07:20.513465 2164567 config.go:182] Loaded profile config "no-preload-183952": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.29.0-rc.2
I0314 01:07:20.514041 2164567 driver.go:392] Setting default libvirt URI to qemu:///system
I0314 01:07:20.538127 2164567 docker.go:122] docker version: linux-25.0.4:Docker Engine - Community
I0314 01:07:20.539280 2164567 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0314 01:07:20.611615 2164567 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:38 OomKillDisable:true NGoroutines:56 SystemTime:2024-03-14 01:07:20.601822751 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1055-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215040000 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:25.0.4 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:ae07eda36dd25f8a1b98dfbf587313b99c0190bb Expected:ae07eda36dd25f8a1b98dfbf587313b99c0190bb} RuncCommit:{ID:v1.1.12-0-g51d5e94 Expected:v1.1.12-0-g51d5e94} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.13.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.24.7]] Warnings:<nil>}}
I0314 01:07:20.611726 2164567 docker.go:295] overlay module found
I0314 01:07:20.614158 2164567 out.go:177] * Using the docker driver based on existing profile
I0314 01:07:20.616481 2164567 start.go:297] selected driver: docker
I0314 01:07:20.616500 2164567 start.go:901] validating driver "docker" against &{Name:no-preload-183952 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1710284843-18375@sha256:d67c38c9fc2ad14c48d95e17cbac49314325db5758d8f7b3de60b927e62ce94f Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.29.0-rc.2 ClusterName:no-preload-183952 Namespace:default APIServerHAVIP: APISer
verName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.29.0-rc.2 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:f
alse MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0314 01:07:20.616609 2164567 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0314 01:07:20.617242 2164567 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0314 01:07:20.680391 2164567 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:38 OomKillDisable:true NGoroutines:56 SystemTime:2024-03-14 01:07:20.670315491 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1055-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215040000 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:25.0.4 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:ae07eda36dd25f8a1b98dfbf587313b99c0190bb Expected:ae07eda36dd25f8a1b98dfbf587313b99c0190bb} RuncCommit:{ID:v1.1.12-0-g51d5e94 Expected:v1.1.12-0-g51d5e94} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.13.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.24.7]] Warnings:<nil>}}
I0314 01:07:20.680779 2164567 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0314 01:07:20.680836 2164567 cni.go:84] Creating CNI manager for ""
I0314 01:07:20.680851 2164567 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0314 01:07:20.680890 2164567 start.go:340] cluster config:
{Name:no-preload-183952 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1710284843-18375@sha256:d67c38c9fc2ad14c48d95e17cbac49314325db5758d8f7b3de60b927e62ce94f Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.29.0-rc.2 ClusterName:no-preload-183952 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Con
tainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.29.0-rc.2 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:d
ocker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0314 01:07:20.684490 2164567 out.go:177] * Starting "no-preload-183952" primary control-plane node in "no-preload-183952" cluster
I0314 01:07:20.686319 2164567 cache.go:121] Beginning downloading kic base image for docker with containerd
I0314 01:07:20.689561 2164567 out.go:177] * Pulling base image v0.0.42-1710284843-18375 ...
I0314 01:07:20.691673 2164567 preload.go:132] Checking if preload exists for k8s version v1.29.0-rc.2 and runtime containerd
I0314 01:07:20.691760 2164567 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1710284843-18375@sha256:d67c38c9fc2ad14c48d95e17cbac49314325db5758d8f7b3de60b927e62ce94f in local docker daemon
I0314 01:07:20.691828 2164567 profile.go:142] Saving config to /home/jenkins/minikube-integration/18375-1958430/.minikube/profiles/no-preload-183952/config.json ...
I0314 01:07:20.692124 2164567 cache.go:107] acquiring lock: {Name:mk9076275c27269851883446f180b6c88e0e34b3 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0314 01:07:20.692210 2164567 cache.go:115] /home/jenkins/minikube-integration/18375-1958430/.minikube/cache/images/arm64/gcr.io/k8s-minikube/storage-provisioner_v5 exists
I0314 01:07:20.692224 2164567 cache.go:96] cache image "gcr.io/k8s-minikube/storage-provisioner:v5" -> "/home/jenkins/minikube-integration/18375-1958430/.minikube/cache/images/arm64/gcr.io/k8s-minikube/storage-provisioner_v5" took 106.453µs
I0314 01:07:20.692236 2164567 cache.go:80] save to tar file gcr.io/k8s-minikube/storage-provisioner:v5 -> /home/jenkins/minikube-integration/18375-1958430/.minikube/cache/images/arm64/gcr.io/k8s-minikube/storage-provisioner_v5 succeeded
I0314 01:07:20.692247 2164567 cache.go:107] acquiring lock: {Name:mk33701ed146320ecb5b030a5b8a235bd520bfa8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0314 01:07:20.692283 2164567 cache.go:115] /home/jenkins/minikube-integration/18375-1958430/.minikube/cache/images/arm64/registry.k8s.io/kube-apiserver_v1.29.0-rc.2 exists
I0314 01:07:20.692293 2164567 cache.go:96] cache image "registry.k8s.io/kube-apiserver:v1.29.0-rc.2" -> "/home/jenkins/minikube-integration/18375-1958430/.minikube/cache/images/arm64/registry.k8s.io/kube-apiserver_v1.29.0-rc.2" took 47.073µs
I0314 01:07:20.692300 2164567 cache.go:80] save to tar file registry.k8s.io/kube-apiserver:v1.29.0-rc.2 -> /home/jenkins/minikube-integration/18375-1958430/.minikube/cache/images/arm64/registry.k8s.io/kube-apiserver_v1.29.0-rc.2 succeeded
I0314 01:07:20.692316 2164567 cache.go:107] acquiring lock: {Name:mk103ce4979b80deb101d187f9b92f91885fbf1f Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0314 01:07:20.692348 2164567 cache.go:115] /home/jenkins/minikube-integration/18375-1958430/.minikube/cache/images/arm64/registry.k8s.io/kube-controller-manager_v1.29.0-rc.2 exists
I0314 01:07:20.692358 2164567 cache.go:96] cache image "registry.k8s.io/kube-controller-manager:v1.29.0-rc.2" -> "/home/jenkins/minikube-integration/18375-1958430/.minikube/cache/images/arm64/registry.k8s.io/kube-controller-manager_v1.29.0-rc.2" took 42.929µs
I0314 01:07:20.692365 2164567 cache.go:80] save to tar file registry.k8s.io/kube-controller-manager:v1.29.0-rc.2 -> /home/jenkins/minikube-integration/18375-1958430/.minikube/cache/images/arm64/registry.k8s.io/kube-controller-manager_v1.29.0-rc.2 succeeded
I0314 01:07:20.692387 2164567 cache.go:107] acquiring lock: {Name:mkbd985a4e1662f9c76328f20a1ae9e6eb39610a Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0314 01:07:20.692420 2164567 cache.go:115] /home/jenkins/minikube-integration/18375-1958430/.minikube/cache/images/arm64/registry.k8s.io/kube-scheduler_v1.29.0-rc.2 exists
I0314 01:07:20.692434 2164567 cache.go:96] cache image "registry.k8s.io/kube-scheduler:v1.29.0-rc.2" -> "/home/jenkins/minikube-integration/18375-1958430/.minikube/cache/images/arm64/registry.k8s.io/kube-scheduler_v1.29.0-rc.2" took 50.79µs
I0314 01:07:20.692443 2164567 cache.go:80] save to tar file registry.k8s.io/kube-scheduler:v1.29.0-rc.2 -> /home/jenkins/minikube-integration/18375-1958430/.minikube/cache/images/arm64/registry.k8s.io/kube-scheduler_v1.29.0-rc.2 succeeded
I0314 01:07:20.692453 2164567 cache.go:107] acquiring lock: {Name:mkb001bca41d226abe8506f20cba7913fddcb978 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0314 01:07:20.692481 2164567 cache.go:115] /home/jenkins/minikube-integration/18375-1958430/.minikube/cache/images/arm64/registry.k8s.io/kube-proxy_v1.29.0-rc.2 exists
I0314 01:07:20.692490 2164567 cache.go:96] cache image "registry.k8s.io/kube-proxy:v1.29.0-rc.2" -> "/home/jenkins/minikube-integration/18375-1958430/.minikube/cache/images/arm64/registry.k8s.io/kube-proxy_v1.29.0-rc.2" took 39.073µs
I0314 01:07:20.692497 2164567 cache.go:80] save to tar file registry.k8s.io/kube-proxy:v1.29.0-rc.2 -> /home/jenkins/minikube-integration/18375-1958430/.minikube/cache/images/arm64/registry.k8s.io/kube-proxy_v1.29.0-rc.2 succeeded
I0314 01:07:20.692509 2164567 cache.go:107] acquiring lock: {Name:mk4f8cf35660d779ac271ad118033be8cca86330 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0314 01:07:20.692539 2164567 cache.go:115] /home/jenkins/minikube-integration/18375-1958430/.minikube/cache/images/arm64/registry.k8s.io/pause_3.9 exists
I0314 01:07:20.692547 2164567 cache.go:96] cache image "registry.k8s.io/pause:3.9" -> "/home/jenkins/minikube-integration/18375-1958430/.minikube/cache/images/arm64/registry.k8s.io/pause_3.9" took 39.885µs
I0314 01:07:20.692553 2164567 cache.go:80] save to tar file registry.k8s.io/pause:3.9 -> /home/jenkins/minikube-integration/18375-1958430/.minikube/cache/images/arm64/registry.k8s.io/pause_3.9 succeeded
I0314 01:07:20.692562 2164567 cache.go:107] acquiring lock: {Name:mk67605906e0166e04ed33849590b5f204e4af14 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0314 01:07:20.692600 2164567 cache.go:115] /home/jenkins/minikube-integration/18375-1958430/.minikube/cache/images/arm64/registry.k8s.io/etcd_3.5.10-0 exists
I0314 01:07:20.692609 2164567 cache.go:96] cache image "registry.k8s.io/etcd:3.5.10-0" -> "/home/jenkins/minikube-integration/18375-1958430/.minikube/cache/images/arm64/registry.k8s.io/etcd_3.5.10-0" took 48.081µs
I0314 01:07:20.692615 2164567 cache.go:80] save to tar file registry.k8s.io/etcd:3.5.10-0 -> /home/jenkins/minikube-integration/18375-1958430/.minikube/cache/images/arm64/registry.k8s.io/etcd_3.5.10-0 succeeded
I0314 01:07:20.692629 2164567 cache.go:107] acquiring lock: {Name:mk0a4f58c844215558398a5d5fba22e104bd8d7e Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0314 01:07:20.692668 2164567 cache.go:115] /home/jenkins/minikube-integration/18375-1958430/.minikube/cache/images/arm64/registry.k8s.io/coredns/coredns_v1.11.1 exists
I0314 01:07:20.692677 2164567 cache.go:96] cache image "registry.k8s.io/coredns/coredns:v1.11.1" -> "/home/jenkins/minikube-integration/18375-1958430/.minikube/cache/images/arm64/registry.k8s.io/coredns/coredns_v1.11.1" took 48.672µs
I0314 01:07:20.692683 2164567 cache.go:80] save to tar file registry.k8s.io/coredns/coredns:v1.11.1 -> /home/jenkins/minikube-integration/18375-1958430/.minikube/cache/images/arm64/registry.k8s.io/coredns/coredns_v1.11.1 succeeded
I0314 01:07:20.692689 2164567 cache.go:87] Successfully saved all images to host disk.
I0314 01:07:20.709286 2164567 image.go:83] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1710284843-18375@sha256:d67c38c9fc2ad14c48d95e17cbac49314325db5758d8f7b3de60b927e62ce94f in local docker daemon, skipping pull
I0314 01:07:20.709311 2164567 cache.go:144] gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1710284843-18375@sha256:d67c38c9fc2ad14c48d95e17cbac49314325db5758d8f7b3de60b927e62ce94f exists in daemon, skipping load
I0314 01:07:20.709332 2164567 cache.go:194] Successfully downloaded all kic artifacts
I0314 01:07:20.709368 2164567 start.go:360] acquireMachinesLock for no-preload-183952: {Name:mkdd7bf00e096cf6fdef968a43e851f795b4a633 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0314 01:07:20.709430 2164567 start.go:364] duration metric: took 44.776µs to acquireMachinesLock for "no-preload-183952"
I0314 01:07:20.709450 2164567 start.go:96] Skipping create...Using existing machine configuration
I0314 01:07:20.709456 2164567 fix.go:54] fixHost starting:
I0314 01:07:20.709743 2164567 cli_runner.go:164] Run: docker container inspect no-preload-183952 --format={{.State.Status}}
I0314 01:07:20.726090 2164567 fix.go:112] recreateIfNeeded on no-preload-183952: state=Stopped err=<nil>
W0314 01:07:20.726125 2164567 fix.go:138] unexpected machine state, will restart: <nil>
I0314 01:07:20.730422 2164567 out.go:177] * Restarting existing docker container for "no-preload-183952" ...
I0314 01:07:17.588276 2159335 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-023742" in "kube-system" namespace has status "Ready":"False"
I0314 01:07:19.589318 2159335 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-023742" in "kube-system" namespace has status "Ready":"False"
I0314 01:07:20.732939 2164567 cli_runner.go:164] Run: docker start no-preload-183952
I0314 01:07:21.053617 2164567 cli_runner.go:164] Run: docker container inspect no-preload-183952 --format={{.State.Status}}
I0314 01:07:21.093994 2164567 kic.go:430] container "no-preload-183952" state is running.
I0314 01:07:21.094398 2164567 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" no-preload-183952
I0314 01:07:21.121583 2164567 profile.go:142] Saving config to /home/jenkins/minikube-integration/18375-1958430/.minikube/profiles/no-preload-183952/config.json ...
I0314 01:07:21.121950 2164567 machine.go:94] provisionDockerMachine start ...
I0314 01:07:21.122140 2164567 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-183952
I0314 01:07:21.145400 2164567 main.go:141] libmachine: Using SSH client type: native
I0314 01:07:21.145664 2164567 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e1e00] 0x3e4660 <nil> [] 0s} 127.0.0.1 35341 <nil> <nil>}
I0314 01:07:21.145673 2164567 main.go:141] libmachine: About to run SSH command:
hostname
I0314 01:07:21.146568 2164567 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: EOF
I0314 01:07:24.286740 2164567 main.go:141] libmachine: SSH cmd err, output: <nil>: no-preload-183952
I0314 01:07:24.286763 2164567 ubuntu.go:169] provisioning hostname "no-preload-183952"
I0314 01:07:24.286837 2164567 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-183952
I0314 01:07:24.303920 2164567 main.go:141] libmachine: Using SSH client type: native
I0314 01:07:24.304183 2164567 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e1e00] 0x3e4660 <nil> [] 0s} 127.0.0.1 35341 <nil> <nil>}
I0314 01:07:24.304200 2164567 main.go:141] libmachine: About to run SSH command:
sudo hostname no-preload-183952 && echo "no-preload-183952" | sudo tee /etc/hostname
I0314 01:07:24.460672 2164567 main.go:141] libmachine: SSH cmd err, output: <nil>: no-preload-183952
I0314 01:07:24.460752 2164567 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-183952
I0314 01:07:24.484941 2164567 main.go:141] libmachine: Using SSH client type: native
I0314 01:07:24.485201 2164567 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e1e00] 0x3e4660 <nil> [] 0s} 127.0.0.1 35341 <nil> <nil>}
I0314 01:07:24.485224 2164567 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sno-preload-183952' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 no-preload-183952/g' /etc/hosts;
else
echo '127.0.1.1 no-preload-183952' | sudo tee -a /etc/hosts;
fi
fi
I0314 01:07:24.635370 2164567 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0314 01:07:24.635433 2164567 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/18375-1958430/.minikube CaCertPath:/home/jenkins/minikube-integration/18375-1958430/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/18375-1958430/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/18375-1958430/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/18375-1958430/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/18375-1958430/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/18375-1958430/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/18375-1958430/.minikube}
I0314 01:07:24.635508 2164567 ubuntu.go:177] setting up certificates
I0314 01:07:24.635540 2164567 provision.go:84] configureAuth start
I0314 01:07:24.635617 2164567 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" no-preload-183952
I0314 01:07:24.655059 2164567 provision.go:143] copyHostCerts
I0314 01:07:24.655125 2164567 exec_runner.go:144] found /home/jenkins/minikube-integration/18375-1958430/.minikube/ca.pem, removing ...
I0314 01:07:24.655140 2164567 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18375-1958430/.minikube/ca.pem
I0314 01:07:24.655325 2164567 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18375-1958430/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/18375-1958430/.minikube/ca.pem (1078 bytes)
I0314 01:07:24.655486 2164567 exec_runner.go:144] found /home/jenkins/minikube-integration/18375-1958430/.minikube/cert.pem, removing ...
I0314 01:07:24.655498 2164567 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18375-1958430/.minikube/cert.pem
I0314 01:07:24.655574 2164567 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18375-1958430/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/18375-1958430/.minikube/cert.pem (1123 bytes)
I0314 01:07:24.655694 2164567 exec_runner.go:144] found /home/jenkins/minikube-integration/18375-1958430/.minikube/key.pem, removing ...
I0314 01:07:24.655706 2164567 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18375-1958430/.minikube/key.pem
I0314 01:07:24.655735 2164567 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18375-1958430/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/18375-1958430/.minikube/key.pem (1675 bytes)
I0314 01:07:24.655801 2164567 provision.go:117] generating server cert: /home/jenkins/minikube-integration/18375-1958430/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/18375-1958430/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/18375-1958430/.minikube/certs/ca-key.pem org=jenkins.no-preload-183952 san=[127.0.0.1 192.168.85.2 localhost minikube no-preload-183952]
I0314 01:07:25.097864 2164567 provision.go:177] copyRemoteCerts
I0314 01:07:25.097943 2164567 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0314 01:07:25.098025 2164567 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-183952
I0314 01:07:25.122991 2164567 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:35341 SSHKeyPath:/home/jenkins/minikube-integration/18375-1958430/.minikube/machines/no-preload-183952/id_rsa Username:docker}
I0314 01:07:25.226567 2164567 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18375-1958430/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0314 01:07:25.253063 2164567 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18375-1958430/.minikube/machines/server.pem --> /etc/docker/server.pem (1220 bytes)
I0314 01:07:25.279505 2164567 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18375-1958430/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0314 01:07:25.305843 2164567 provision.go:87] duration metric: took 670.257775ms to configureAuth
I0314 01:07:25.305871 2164567 ubuntu.go:193] setting minikube options for container-runtime
I0314 01:07:25.306116 2164567 config.go:182] Loaded profile config "no-preload-183952": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.29.0-rc.2
I0314 01:07:25.306143 2164567 machine.go:97] duration metric: took 4.18418088s to provisionDockerMachine
I0314 01:07:25.306165 2164567 start.go:293] postStartSetup for "no-preload-183952" (driver="docker")
I0314 01:07:25.306185 2164567 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0314 01:07:25.306268 2164567 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0314 01:07:25.306332 2164567 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-183952
I0314 01:07:25.322637 2164567 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:35341 SSHKeyPath:/home/jenkins/minikube-integration/18375-1958430/.minikube/machines/no-preload-183952/id_rsa Username:docker}
I0314 01:07:25.424623 2164567 ssh_runner.go:195] Run: cat /etc/os-release
I0314 01:07:25.427834 2164567 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0314 01:07:25.427877 2164567 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0314 01:07:25.427908 2164567 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0314 01:07:25.427920 2164567 info.go:137] Remote host: Ubuntu 22.04.4 LTS
I0314 01:07:25.427930 2164567 filesync.go:126] Scanning /home/jenkins/minikube-integration/18375-1958430/.minikube/addons for local assets ...
I0314 01:07:25.427999 2164567 filesync.go:126] Scanning /home/jenkins/minikube-integration/18375-1958430/.minikube/files for local assets ...
I0314 01:07:25.428096 2164567 filesync.go:149] local asset: /home/jenkins/minikube-integration/18375-1958430/.minikube/files/etc/ssl/certs/19638972.pem -> 19638972.pem in /etc/ssl/certs
I0314 01:07:25.428209 2164567 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0314 01:07:25.436882 2164567 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18375-1958430/.minikube/files/etc/ssl/certs/19638972.pem --> /etc/ssl/certs/19638972.pem (1708 bytes)
I0314 01:07:25.461936 2164567 start.go:296] duration metric: took 155.748847ms for postStartSetup
I0314 01:07:25.462016 2164567 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0314 01:07:25.462061 2164567 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-183952
I0314 01:07:25.478151 2164567 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:35341 SSHKeyPath:/home/jenkins/minikube-integration/18375-1958430/.minikube/machines/no-preload-183952/id_rsa Username:docker}
I0314 01:07:22.088460 2159335 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-023742" in "kube-system" namespace has status "Ready":"False"
I0314 01:07:24.588300 2159335 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-023742" in "kube-system" namespace has status "Ready":"False"
I0314 01:07:26.589260 2159335 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-023742" in "kube-system" namespace has status "Ready":"False"
I0314 01:07:25.573118 2164567 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I0314 01:07:25.583801 2164567 fix.go:56] duration metric: took 4.874338564s for fixHost
I0314 01:07:25.583906 2164567 start.go:83] releasing machines lock for "no-preload-183952", held for 4.874463166s
I0314 01:07:25.584043 2164567 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" no-preload-183952
I0314 01:07:25.606858 2164567 ssh_runner.go:195] Run: cat /version.json
I0314 01:07:25.606940 2164567 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-183952
I0314 01:07:25.606859 2164567 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0314 01:07:25.607020 2164567 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-183952
I0314 01:07:25.635698 2164567 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:35341 SSHKeyPath:/home/jenkins/minikube-integration/18375-1958430/.minikube/machines/no-preload-183952/id_rsa Username:docker}
I0314 01:07:25.648690 2164567 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:35341 SSHKeyPath:/home/jenkins/minikube-integration/18375-1958430/.minikube/machines/no-preload-183952/id_rsa Username:docker}
I0314 01:07:25.865024 2164567 ssh_runner.go:195] Run: systemctl --version
I0314 01:07:25.869630 2164567 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I0314 01:07:25.874221 2164567 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
I0314 01:07:25.892867 2164567 cni.go:230] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
I0314 01:07:25.892991 2164567 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0314 01:07:25.902008 2164567 cni.go:259] no active bridge cni configs found in "/etc/cni/net.d" - nothing to disable
I0314 01:07:25.902030 2164567 start.go:494] detecting cgroup driver to use...
I0314 01:07:25.902061 2164567 detect.go:196] detected "cgroupfs" cgroup driver on host os
I0314 01:07:25.902109 2164567 ssh_runner.go:195] Run: sudo systemctl stop -f crio
I0314 01:07:25.916658 2164567 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I0314 01:07:25.929516 2164567 docker.go:217] disabling cri-docker service (if available) ...
I0314 01:07:25.929592 2164567 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0314 01:07:25.942904 2164567 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0314 01:07:25.955194 2164567 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0314 01:07:26.052261 2164567 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0314 01:07:26.152887 2164567 docker.go:233] disabling docker service ...
I0314 01:07:26.152954 2164567 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0314 01:07:26.166461 2164567 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0314 01:07:26.179675 2164567 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0314 01:07:26.274269 2164567 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0314 01:07:26.368820 2164567 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0314 01:07:26.380779 2164567 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///run/containerd/containerd.sock
" | sudo tee /etc/crictl.yaml"
I0314 01:07:26.399278 2164567 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.9"|' /etc/containerd/config.toml"
I0314 01:07:26.410872 2164567 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
I0314 01:07:26.421146 2164567 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...
I0314 01:07:26.421238 2164567 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
I0314 01:07:26.431426 2164567 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0314 01:07:26.441654 2164567 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
I0314 01:07:26.452564 2164567 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0314 01:07:26.463191 2164567 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0314 01:07:26.473015 2164567 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
I0314 01:07:26.483507 2164567 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0314 01:07:26.493164 2164567 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0314 01:07:26.502456 2164567 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0314 01:07:26.593112 2164567 ssh_runner.go:195] Run: sudo systemctl restart containerd
I0314 01:07:26.745936 2164567 start.go:541] Will wait 60s for socket path /run/containerd/containerd.sock
I0314 01:07:26.746005 2164567 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
I0314 01:07:26.750477 2164567 start.go:562] Will wait 60s for crictl version
I0314 01:07:26.750563 2164567 ssh_runner.go:195] Run: which crictl
I0314 01:07:26.754195 2164567 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0314 01:07:26.798341 2164567 start.go:578] Version: 0.1.0
RuntimeName: containerd
RuntimeVersion: 1.6.28
RuntimeApiVersion: v1
I0314 01:07:26.798413 2164567 ssh_runner.go:195] Run: containerd --version
I0314 01:07:26.828556 2164567 ssh_runner.go:195] Run: containerd --version
I0314 01:07:26.855515 2164567 out.go:177] * Preparing Kubernetes v1.29.0-rc.2 on containerd 1.6.28 ...
I0314 01:07:26.857221 2164567 cli_runner.go:164] Run: docker network inspect no-preload-183952 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0314 01:07:26.873259 2164567 ssh_runner.go:195] Run: grep 192.168.85.1 host.minikube.internal$ /etc/hosts
I0314 01:07:26.877227 2164567 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.85.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0314 01:07:26.888651 2164567 kubeadm.go:877] updating cluster {Name:no-preload-183952 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1710284843-18375@sha256:d67c38c9fc2ad14c48d95e17cbac49314325db5758d8f7b3de60b927e62ce94f Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.29.0-rc.2 ClusterName:no-preload-183952 Namespace:default APIServerHAVIP: APIServerName:minikubeC
A APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.29.0-rc.2 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:
/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0314 01:07:26.888783 2164567 preload.go:132] Checking if preload exists for k8s version v1.29.0-rc.2 and runtime containerd
I0314 01:07:26.888836 2164567 ssh_runner.go:195] Run: sudo crictl images --output json
I0314 01:07:26.930315 2164567 containerd.go:612] all images are preloaded for containerd runtime.
I0314 01:07:26.930338 2164567 cache_images.go:84] Images are preloaded, skipping loading
I0314 01:07:26.930347 2164567 kubeadm.go:928] updating node { 192.168.85.2 8443 v1.29.0-rc.2 containerd true true} ...
I0314 01:07:26.930451 2164567 kubeadm.go:940] kubelet [Unit]
Wants=containerd.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.29.0-rc.2/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=no-preload-183952 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.85.2
[Install]
config:
{KubernetesVersion:v1.29.0-rc.2 ClusterName:no-preload-183952 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0314 01:07:26.930525 2164567 ssh_runner.go:195] Run: sudo crictl info
I0314 01:07:26.974874 2164567 cni.go:84] Creating CNI manager for ""
I0314 01:07:26.974903 2164567 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0314 01:07:26.974913 2164567 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0314 01:07:26.974937 2164567 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.85.2 APIServerPort:8443 KubernetesVersion:v1.29.0-rc.2 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:no-preload-183952 NodeName:no-preload-183952 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.85.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.85.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt Stati
cPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///run/containerd/containerd.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I0314 01:07:26.975072 2164567 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta3
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.85.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///run/containerd/containerd.sock
name: "no-preload-183952"
kubeletExtraArgs:
node-ip: 192.168.85.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta3
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.85.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.29.0-rc.2
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
containerRuntimeEndpoint: unix:///run/containerd/containerd.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%!"(MISSING)
nodefs.inodesFree: "0%!"(MISSING)
imagefs.available: "0%!"(MISSING)
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0314 01:07:26.975145 2164567 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.29.0-rc.2
I0314 01:07:26.985577 2164567 binaries.go:44] Found k8s binaries, skipping transfer
I0314 01:07:26.985654 2164567 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0314 01:07:26.994696 2164567 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (326 bytes)
I0314 01:07:27.016959 2164567 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (357 bytes)
I0314 01:07:27.037144 2164567 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2176 bytes)
I0314 01:07:27.057977 2164567 ssh_runner.go:195] Run: grep 192.168.85.2 control-plane.minikube.internal$ /etc/hosts
I0314 01:07:27.062154 2164567 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.85.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0314 01:07:27.074694 2164567 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0314 01:07:27.171236 2164567 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0314 01:07:27.186130 2164567 certs.go:68] Setting up /home/jenkins/minikube-integration/18375-1958430/.minikube/profiles/no-preload-183952 for IP: 192.168.85.2
I0314 01:07:27.186206 2164567 certs.go:194] generating shared ca certs ...
I0314 01:07:27.186236 2164567 certs.go:226] acquiring lock for ca certs: {Name:mka77573162012513ec65b9398fcff30bed9742a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0314 01:07:27.186447 2164567 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/18375-1958430/.minikube/ca.key
I0314 01:07:27.186525 2164567 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/18375-1958430/.minikube/proxy-client-ca.key
I0314 01:07:27.186560 2164567 certs.go:256] generating profile certs ...
I0314 01:07:27.186702 2164567 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/18375-1958430/.minikube/profiles/no-preload-183952/client.key
I0314 01:07:27.186823 2164567 certs.go:359] skipping valid signed profile cert regeneration for "minikube": /home/jenkins/minikube-integration/18375-1958430/.minikube/profiles/no-preload-183952/apiserver.key.df3dc527
I0314 01:07:27.186937 2164567 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/18375-1958430/.minikube/profiles/no-preload-183952/proxy-client.key
I0314 01:07:27.187096 2164567 certs.go:484] found cert: /home/jenkins/minikube-integration/18375-1958430/.minikube/certs/1963897.pem (1338 bytes)
W0314 01:07:27.187150 2164567 certs.go:480] ignoring /home/jenkins/minikube-integration/18375-1958430/.minikube/certs/1963897_empty.pem, impossibly tiny 0 bytes
I0314 01:07:27.187172 2164567 certs.go:484] found cert: /home/jenkins/minikube-integration/18375-1958430/.minikube/certs/ca-key.pem (1679 bytes)
I0314 01:07:27.187243 2164567 certs.go:484] found cert: /home/jenkins/minikube-integration/18375-1958430/.minikube/certs/ca.pem (1078 bytes)
I0314 01:07:27.187298 2164567 certs.go:484] found cert: /home/jenkins/minikube-integration/18375-1958430/.minikube/certs/cert.pem (1123 bytes)
I0314 01:07:27.187329 2164567 certs.go:484] found cert: /home/jenkins/minikube-integration/18375-1958430/.minikube/certs/key.pem (1675 bytes)
I0314 01:07:27.187380 2164567 certs.go:484] found cert: /home/jenkins/minikube-integration/18375-1958430/.minikube/files/etc/ssl/certs/19638972.pem (1708 bytes)
I0314 01:07:27.188059 2164567 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18375-1958430/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0314 01:07:27.223542 2164567 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18375-1958430/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I0314 01:07:27.253020 2164567 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18375-1958430/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0314 01:07:27.281774 2164567 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18375-1958430/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0314 01:07:27.314985 2164567 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18375-1958430/.minikube/profiles/no-preload-183952/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1424 bytes)
I0314 01:07:27.361450 2164567 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18375-1958430/.minikube/profiles/no-preload-183952/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0314 01:07:27.393334 2164567 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18375-1958430/.minikube/profiles/no-preload-183952/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0314 01:07:27.424493 2164567 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18375-1958430/.minikube/profiles/no-preload-183952/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0314 01:07:27.461312 2164567 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18375-1958430/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0314 01:07:27.487959 2164567 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18375-1958430/.minikube/certs/1963897.pem --> /usr/share/ca-certificates/1963897.pem (1338 bytes)
I0314 01:07:27.528032 2164567 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18375-1958430/.minikube/files/etc/ssl/certs/19638972.pem --> /usr/share/ca-certificates/19638972.pem (1708 bytes)
I0314 01:07:27.554797 2164567 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0314 01:07:27.573065 2164567 ssh_runner.go:195] Run: openssl version
I0314 01:07:27.581473 2164567 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0314 01:07:27.593874 2164567 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0314 01:07:27.600916 2164567 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Mar 14 00:21 /usr/share/ca-certificates/minikubeCA.pem
I0314 01:07:27.600991 2164567 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0314 01:07:27.609613 2164567 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0314 01:07:27.619328 2164567 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/1963897.pem && ln -fs /usr/share/ca-certificates/1963897.pem /etc/ssl/certs/1963897.pem"
I0314 01:07:27.629265 2164567 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/1963897.pem
I0314 01:07:27.633298 2164567 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Mar 14 00:26 /usr/share/ca-certificates/1963897.pem
I0314 01:07:27.633365 2164567 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/1963897.pem
I0314 01:07:27.640682 2164567 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/1963897.pem /etc/ssl/certs/51391683.0"
I0314 01:07:27.651100 2164567 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/19638972.pem && ln -fs /usr/share/ca-certificates/19638972.pem /etc/ssl/certs/19638972.pem"
I0314 01:07:27.660927 2164567 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/19638972.pem
I0314 01:07:27.664580 2164567 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Mar 14 00:26 /usr/share/ca-certificates/19638972.pem
I0314 01:07:27.664689 2164567 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/19638972.pem
I0314 01:07:27.672113 2164567 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/19638972.pem /etc/ssl/certs/3ec20f2e.0"
I0314 01:07:27.681305 2164567 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0314 01:07:27.685054 2164567 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
I0314 01:07:27.691956 2164567 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
I0314 01:07:27.699377 2164567 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
I0314 01:07:27.706371 2164567 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
I0314 01:07:27.713876 2164567 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
I0314 01:07:27.721098 2164567 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
I0314 01:07:27.728218 2164567 kubeadm.go:391] StartCluster: {Name:no-preload-183952 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1710284843-18375@sha256:d67c38c9fc2ad14c48d95e17cbac49314325db5758d8f7b3de60b927e62ce94f Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.29.0-rc.2 ClusterName:no-preload-183952 Namespace:default APIServerHAVIP: APIServerName:minikubeCA A
PIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.29.0-rc.2 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/ho
me/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0314 01:07:27.728317 2164567 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}
I0314 01:07:27.728401 2164567 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0314 01:07:27.779704 2164567 cri.go:89] found id: "fce51585db2ccb145151be13dcfb93f128f9c83b3d5057ed298f4c72a4923602"
I0314 01:07:27.779728 2164567 cri.go:89] found id: "2d000a4f5e324dc6ef2641ef49e48ce29f1951ae66fae9eba1637086079d822f"
I0314 01:07:27.779733 2164567 cri.go:89] found id: "cc215e61bd827ccb6ef08e1b6233fc18ffe5891ca3a98ae8b0d074ab971850cd"
I0314 01:07:27.779743 2164567 cri.go:89] found id: "5b506479b9f8549a1328dcd0ed478bc43502c6dc60ed26325977136263ab523c"
I0314 01:07:27.779746 2164567 cri.go:89] found id: "dedbba40a1e0160ff417b93d3e8c30371b7d47b139e6891c9e49311c61cb963a"
I0314 01:07:27.779750 2164567 cri.go:89] found id: "f879b7c53550f5f73f52a19c81373092a43f07fa2c0eab968e4ca6e842db66ad"
I0314 01:07:27.779756 2164567 cri.go:89] found id: "4b18a1225338f6b055a8ed1e1d1fdf13dc3e26f2d1c4e57dacd35453fb92208b"
I0314 01:07:27.779759 2164567 cri.go:89] found id: "35a448a37fe417bd5ef90a5f2619fd285e7f7b440884d6ac9bf11cbb9b611a8f"
I0314 01:07:27.779762 2164567 cri.go:89] found id: ""
I0314 01:07:27.779820 2164567 ssh_runner.go:195] Run: sudo runc --root /run/containerd/runc/k8s.io list -f json
I0314 01:07:27.807738 2164567 cri.go:116] JSON = null
W0314 01:07:27.807787 2164567 kubeadm.go:398] unpause failed: list paused: list returned 0 containers, but ps returned 8
I0314 01:07:27.807871 2164567 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
W0314 01:07:27.820391 2164567 kubeadm.go:404] apiserver tunnel failed: apiserver port not set
I0314 01:07:27.820459 2164567 kubeadm.go:407] found existing configuration files, will attempt cluster restart
I0314 01:07:27.820478 2164567 kubeadm.go:587] restartPrimaryControlPlane start ...
I0314 01:07:27.820579 2164567 ssh_runner.go:195] Run: sudo test -d /data/minikube
I0314 01:07:27.834599 2164567 kubeadm.go:129] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
stdout:
stderr:
I0314 01:07:27.835412 2164567 kubeconfig.go:47] verify endpoint returned: get endpoint: "no-preload-183952" does not appear in /home/jenkins/minikube-integration/18375-1958430/kubeconfig
I0314 01:07:27.835789 2164567 kubeconfig.go:62] /home/jenkins/minikube-integration/18375-1958430/kubeconfig needs updating (will repair): [kubeconfig missing "no-preload-183952" cluster setting kubeconfig missing "no-preload-183952" context setting]
I0314 01:07:27.836394 2164567 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18375-1958430/kubeconfig: {Name:mkdddca847fdd161b32ac7434f6b37d491dbdecd Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0314 01:07:27.838061 2164567 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
I0314 01:07:27.851413 2164567 kubeadm.go:624] The running cluster does not require reconfiguration: 192.168.85.2
I0314 01:07:27.851491 2164567 kubeadm.go:591] duration metric: took 30.991125ms to restartPrimaryControlPlane
I0314 01:07:27.851515 2164567 kubeadm.go:393] duration metric: took 123.30567ms to StartCluster
I0314 01:07:27.851566 2164567 settings.go:142] acquiring lock: {Name:mkb041dc79ae1947b27d39dd7ebbd3bd473ee07d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0314 01:07:27.851655 2164567 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/18375-1958430/kubeconfig
I0314 01:07:27.852738 2164567 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18375-1958430/kubeconfig: {Name:mkdddca847fdd161b32ac7434f6b37d491dbdecd Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0314 01:07:27.853025 2164567 start.go:234] Will wait 6m0s for node &{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.29.0-rc.2 ContainerRuntime:containerd ControlPlane:true Worker:true}
I0314 01:07:27.855376 2164567 out.go:177] * Verifying Kubernetes components...
I0314 01:07:27.853539 2164567 addons.go:502] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:true default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volumesnapshots:false yakd:false]
I0314 01:07:27.853634 2164567 config.go:182] Loaded profile config "no-preload-183952": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.29.0-rc.2
I0314 01:07:27.857560 2164567 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0314 01:07:27.857689 2164567 addons.go:69] Setting storage-provisioner=true in profile "no-preload-183952"
I0314 01:07:27.857728 2164567 addons.go:234] Setting addon storage-provisioner=true in "no-preload-183952"
W0314 01:07:27.857763 2164567 addons.go:243] addon storage-provisioner should already be in state true
I0314 01:07:27.857806 2164567 host.go:66] Checking if "no-preload-183952" exists ...
I0314 01:07:27.858225 2164567 addons.go:69] Setting default-storageclass=true in profile "no-preload-183952"
I0314 01:07:27.858295 2164567 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "no-preload-183952"
I0314 01:07:27.858699 2164567 cli_runner.go:164] Run: docker container inspect no-preload-183952 --format={{.State.Status}}
I0314 01:07:27.858899 2164567 addons.go:69] Setting metrics-server=true in profile "no-preload-183952"
I0314 01:07:27.858951 2164567 addons.go:234] Setting addon metrics-server=true in "no-preload-183952"
W0314 01:07:27.858971 2164567 addons.go:243] addon metrics-server should already be in state true
I0314 01:07:27.859357 2164567 host.go:66] Checking if "no-preload-183952" exists ...
I0314 01:07:27.859100 2164567 cli_runner.go:164] Run: docker container inspect no-preload-183952 --format={{.State.Status}}
I0314 01:07:27.859114 2164567 addons.go:69] Setting dashboard=true in profile "no-preload-183952"
I0314 01:07:27.860307 2164567 addons.go:234] Setting addon dashboard=true in "no-preload-183952"
W0314 01:07:27.860317 2164567 addons.go:243] addon dashboard should already be in state true
I0314 01:07:27.860341 2164567 host.go:66] Checking if "no-preload-183952" exists ...
I0314 01:07:27.860727 2164567 cli_runner.go:164] Run: docker container inspect no-preload-183952 --format={{.State.Status}}
I0314 01:07:27.863495 2164567 cli_runner.go:164] Run: docker container inspect no-preload-183952 --format={{.State.Status}}
I0314 01:07:27.930700 2164567 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0314 01:07:27.929380 2164567 addons.go:234] Setting addon default-storageclass=true in "no-preload-183952"
I0314 01:07:27.935037 2164567 out.go:177] - Using image docker.io/kubernetesui/dashboard:v2.7.0
I0314 01:07:27.932965 2164567 out.go:177] - Using image fake.domain/registry.k8s.io/echoserver:1.4
W0314 01:07:27.933079 2164567 addons.go:243] addon default-storageclass should already be in state true
I0314 01:07:27.934251 2164567 addons.go:426] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0314 01:07:27.937739 2164567 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0314 01:07:27.937817 2164567 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-183952
I0314 01:07:27.942550 2164567 addons.go:426] installing /etc/kubernetes/addons/metrics-apiservice.yaml
I0314 01:07:27.942573 2164567 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
I0314 01:07:27.942644 2164567 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-183952
I0314 01:07:27.944454 2164567 out.go:177] - Using image registry.k8s.io/echoserver:1.4
I0314 01:07:27.938373 2164567 host.go:66] Checking if "no-preload-183952" exists ...
I0314 01:07:27.956160 2164567 cli_runner.go:164] Run: docker container inspect no-preload-183952 --format={{.State.Status}}
I0314 01:07:27.956516 2164567 addons.go:426] installing /etc/kubernetes/addons/dashboard-ns.yaml
I0314 01:07:27.956530 2164567 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-ns.yaml (759 bytes)
I0314 01:07:27.956576 2164567 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-183952
I0314 01:07:27.985756 2164567 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:35341 SSHKeyPath:/home/jenkins/minikube-integration/18375-1958430/.minikube/machines/no-preload-183952/id_rsa Username:docker}
I0314 01:07:28.019009 2164567 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:35341 SSHKeyPath:/home/jenkins/minikube-integration/18375-1958430/.minikube/machines/no-preload-183952/id_rsa Username:docker}
I0314 01:07:28.026897 2164567 addons.go:426] installing /etc/kubernetes/addons/storageclass.yaml
I0314 01:07:28.026919 2164567 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0314 01:07:28.026995 2164567 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-183952
I0314 01:07:28.038264 2164567 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:35341 SSHKeyPath:/home/jenkins/minikube-integration/18375-1958430/.minikube/machines/no-preload-183952/id_rsa Username:docker}
I0314 01:07:28.062221 2164567 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:35341 SSHKeyPath:/home/jenkins/minikube-integration/18375-1958430/.minikube/machines/no-preload-183952/id_rsa Username:docker}
I0314 01:07:28.110141 2164567 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0314 01:07:28.251805 2164567 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0314 01:07:28.280220 2164567 node_ready.go:35] waiting up to 6m0s for node "no-preload-183952" to be "Ready" ...
I0314 01:07:28.387475 2164567 addons.go:426] installing /etc/kubernetes/addons/dashboard-clusterrole.yaml
I0314 01:07:28.387527 2164567 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-clusterrole.yaml (1001 bytes)
I0314 01:07:28.430031 2164567 addons.go:426] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
I0314 01:07:28.430094 2164567 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1825 bytes)
I0314 01:07:28.488954 2164567 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0314 01:07:28.508292 2164567 addons.go:426] installing /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml
I0314 01:07:28.508323 2164567 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml (1018 bytes)
I0314 01:07:28.532220 2164567 addons.go:426] installing /etc/kubernetes/addons/dashboard-configmap.yaml
I0314 01:07:28.532259 2164567 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-configmap.yaml (837 bytes)
W0314 01:07:28.624793 2164567 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storage-provisioner.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp 127.0.0.1:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
I0314 01:07:28.624834 2164567 retry.go:31] will retry after 337.812583ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storage-provisioner.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp 127.0.0.1:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
I0314 01:07:28.660024 2164567 addons.go:426] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
I0314 01:07:28.660052 2164567 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
I0314 01:07:28.756604 2164567 addons.go:426] installing /etc/kubernetes/addons/dashboard-dp.yaml
I0314 01:07:28.756630 2164567 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-dp.yaml (4201 bytes)
I0314 01:07:28.819779 2164567 addons.go:426] installing /etc/kubernetes/addons/metrics-server-service.yaml
I0314 01:07:28.819806 2164567 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
I0314 01:07:28.923667 2164567 addons.go:426] installing /etc/kubernetes/addons/dashboard-role.yaml
I0314 01:07:28.923695 2164567 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-role.yaml (1724 bytes)
I0314 01:07:28.941246 2164567 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0314 01:07:28.963556 2164567 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I0314 01:07:29.061616 2164567 addons.go:426] installing /etc/kubernetes/addons/dashboard-rolebinding.yaml
I0314 01:07:29.061644 2164567 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-rolebinding.yaml (1046 bytes)
I0314 01:07:29.185222 2164567 addons.go:426] installing /etc/kubernetes/addons/dashboard-sa.yaml
I0314 01:07:29.185248 2164567 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-sa.yaml (837 bytes)
I0314 01:07:29.412568 2164567 addons.go:426] installing /etc/kubernetes/addons/dashboard-secret.yaml
I0314 01:07:29.412598 2164567 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-secret.yaml (1389 bytes)
I0314 01:07:29.451801 2164567 addons.go:426] installing /etc/kubernetes/addons/dashboard-svc.yaml
I0314 01:07:29.451828 2164567 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-svc.yaml (1294 bytes)
I0314 01:07:29.520335 2164567 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0314 01:07:29.089477 2159335 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-023742" in "kube-system" namespace has status "Ready":"False"
I0314 01:07:31.587727 2159335 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-023742" in "kube-system" namespace has status "Ready":"False"
I0314 01:07:34.167773 2164567 node_ready.go:49] node "no-preload-183952" has status "Ready":"True"
I0314 01:07:34.167807 2164567 node_ready.go:38] duration metric: took 5.887546451s for node "no-preload-183952" to be "Ready" ...
I0314 01:07:34.167817 2164567 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0314 01:07:34.187955 2164567 pod_ready.go:78] waiting up to 6m0s for pod "coredns-76f75df574-b679l" in "kube-system" namespace to be "Ready" ...
I0314 01:07:34.201476 2164567 pod_ready.go:92] pod "coredns-76f75df574-b679l" in "kube-system" namespace has status "Ready":"True"
I0314 01:07:34.201503 2164567 pod_ready.go:81] duration metric: took 13.515783ms for pod "coredns-76f75df574-b679l" in "kube-system" namespace to be "Ready" ...
I0314 01:07:34.201523 2164567 pod_ready.go:78] waiting up to 6m0s for pod "etcd-no-preload-183952" in "kube-system" namespace to be "Ready" ...
I0314 01:07:34.247603 2164567 pod_ready.go:92] pod "etcd-no-preload-183952" in "kube-system" namespace has status "Ready":"True"
I0314 01:07:34.247638 2164567 pod_ready.go:81] duration metric: took 46.105798ms for pod "etcd-no-preload-183952" in "kube-system" namespace to be "Ready" ...
I0314 01:07:34.247654 2164567 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-no-preload-183952" in "kube-system" namespace to be "Ready" ...
I0314 01:07:34.272018 2164567 pod_ready.go:92] pod "kube-apiserver-no-preload-183952" in "kube-system" namespace has status "Ready":"True"
I0314 01:07:34.272050 2164567 pod_ready.go:81] duration metric: took 24.388251ms for pod "kube-apiserver-no-preload-183952" in "kube-system" namespace to be "Ready" ...
I0314 01:07:34.272065 2164567 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-no-preload-183952" in "kube-system" namespace to be "Ready" ...
I0314 01:07:34.278387 2164567 pod_ready.go:92] pod "kube-controller-manager-no-preload-183952" in "kube-system" namespace has status "Ready":"True"
I0314 01:07:34.278426 2164567 pod_ready.go:81] duration metric: took 6.352536ms for pod "kube-controller-manager-no-preload-183952" in "kube-system" namespace to be "Ready" ...
I0314 01:07:34.278438 2164567 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-h2xc2" in "kube-system" namespace to be "Ready" ...
I0314 01:07:34.372676 2164567 pod_ready.go:92] pod "kube-proxy-h2xc2" in "kube-system" namespace has status "Ready":"True"
I0314 01:07:34.372710 2164567 pod_ready.go:81] duration metric: took 94.263548ms for pod "kube-proxy-h2xc2" in "kube-system" namespace to be "Ready" ...
I0314 01:07:34.372723 2164567 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-no-preload-183952" in "kube-system" namespace to be "Ready" ...
I0314 01:07:34.683227 2164567 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (6.194213562s)
I0314 01:07:33.592793 2159335 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-023742" in "kube-system" namespace has status "Ready":"False"
I0314 01:07:36.088446 2159335 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-023742" in "kube-system" namespace has status "Ready":"False"
I0314 01:07:36.380854 2164567 pod_ready.go:102] pod "kube-scheduler-no-preload-183952" in "kube-system" namespace has status "Ready":"False"
I0314 01:07:37.039651 2164567 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (8.098355473s)
I0314 01:07:37.039722 2164567 addons.go:470] Verifying addon metrics-server=true in "no-preload-183952"
I0314 01:07:37.148671 2164567 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: (8.185065466s)
I0314 01:07:37.279995 2164567 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: (7.759585812s)
I0314 01:07:37.282312 2164567 out.go:177] * Some dashboard features require the metrics-server addon. To enable all features please run:
minikube -p no-preload-183952 addons enable metrics-server
I0314 01:07:37.284290 2164567 out.go:177] * Enabled addons: default-storageclass, metrics-server, storage-provisioner, dashboard
I0314 01:07:37.286172 2164567 addons.go:505] duration metric: took 9.432632203s for enable addons: enabled=[default-storageclass metrics-server storage-provisioner dashboard]
I0314 01:07:38.878710 2164567 pod_ready.go:102] pod "kube-scheduler-no-preload-183952" in "kube-system" namespace has status "Ready":"False"
I0314 01:07:38.588291 2159335 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-023742" in "kube-system" namespace has status "Ready":"False"
I0314 01:07:41.087906 2159335 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-023742" in "kube-system" namespace has status "Ready":"False"
I0314 01:07:40.878808 2164567 pod_ready.go:102] pod "kube-scheduler-no-preload-183952" in "kube-system" namespace has status "Ready":"False"
I0314 01:07:42.879296 2164567 pod_ready.go:102] pod "kube-scheduler-no-preload-183952" in "kube-system" namespace has status "Ready":"False"
I0314 01:07:45.379791 2164567 pod_ready.go:102] pod "kube-scheduler-no-preload-183952" in "kube-system" namespace has status "Ready":"False"
I0314 01:07:43.088400 2159335 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-023742" in "kube-system" namespace has status "Ready":"False"
I0314 01:07:44.088467 2159335 pod_ready.go:92] pod "kube-controller-manager-old-k8s-version-023742" in "kube-system" namespace has status "Ready":"True"
I0314 01:07:44.088496 2159335 pod_ready.go:81] duration metric: took 1m5.506978254s for pod "kube-controller-manager-old-k8s-version-023742" in "kube-system" namespace to be "Ready" ...
I0314 01:07:44.088508 2159335 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-vm5pd" in "kube-system" namespace to be "Ready" ...
I0314 01:07:44.093958 2159335 pod_ready.go:92] pod "kube-proxy-vm5pd" in "kube-system" namespace has status "Ready":"True"
I0314 01:07:44.093985 2159335 pod_ready.go:81] duration metric: took 5.469145ms for pod "kube-proxy-vm5pd" in "kube-system" namespace to be "Ready" ...
I0314 01:07:44.093997 2159335 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-old-k8s-version-023742" in "kube-system" namespace to be "Ready" ...
I0314 01:07:46.100906 2159335 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-023742" in "kube-system" namespace has status "Ready":"False"
I0314 01:07:47.435428 2164567 pod_ready.go:102] pod "kube-scheduler-no-preload-183952" in "kube-system" namespace has status "Ready":"False"
I0314 01:07:48.380337 2164567 pod_ready.go:92] pod "kube-scheduler-no-preload-183952" in "kube-system" namespace has status "Ready":"True"
I0314 01:07:48.380358 2164567 pod_ready.go:81] duration metric: took 14.007627605s for pod "kube-scheduler-no-preload-183952" in "kube-system" namespace to be "Ready" ...
I0314 01:07:48.380369 2164567 pod_ready.go:78] waiting up to 6m0s for pod "metrics-server-57f55c9bc5-hk6xd" in "kube-system" namespace to be "Ready" ...
I0314 01:07:50.387003 2164567 pod_ready.go:102] pod "metrics-server-57f55c9bc5-hk6xd" in "kube-system" namespace has status "Ready":"False"
I0314 01:07:48.601389 2159335 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-023742" in "kube-system" namespace has status "Ready":"False"
I0314 01:07:51.099734 2159335 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-023742" in "kube-system" namespace has status "Ready":"False"
I0314 01:07:52.387181 2164567 pod_ready.go:102] pod "metrics-server-57f55c9bc5-hk6xd" in "kube-system" namespace has status "Ready":"False"
I0314 01:07:54.387729 2164567 pod_ready.go:102] pod "metrics-server-57f55c9bc5-hk6xd" in "kube-system" namespace has status "Ready":"False"
I0314 01:07:53.101296 2159335 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-023742" in "kube-system" namespace has status "Ready":"False"
I0314 01:07:55.101787 2159335 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-023742" in "kube-system" namespace has status "Ready":"False"
I0314 01:07:56.887470 2164567 pod_ready.go:102] pod "metrics-server-57f55c9bc5-hk6xd" in "kube-system" namespace has status "Ready":"False"
I0314 01:07:59.387378 2164567 pod_ready.go:102] pod "metrics-server-57f55c9bc5-hk6xd" in "kube-system" namespace has status "Ready":"False"
I0314 01:07:57.600299 2159335 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-023742" in "kube-system" namespace has status "Ready":"False"
I0314 01:07:59.106087 2159335 pod_ready.go:92] pod "kube-scheduler-old-k8s-version-023742" in "kube-system" namespace has status "Ready":"True"
I0314 01:07:59.106115 2159335 pod_ready.go:81] duration metric: took 15.012109393s for pod "kube-scheduler-old-k8s-version-023742" in "kube-system" namespace to be "Ready" ...
I0314 01:07:59.106127 2159335 pod_ready.go:78] waiting up to 6m0s for pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace to be "Ready" ...
I0314 01:08:01.112043 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:08:01.387562 2164567 pod_ready.go:102] pod "metrics-server-57f55c9bc5-hk6xd" in "kube-system" namespace has status "Ready":"False"
I0314 01:08:03.887282 2164567 pod_ready.go:102] pod "metrics-server-57f55c9bc5-hk6xd" in "kube-system" namespace has status "Ready":"False"
I0314 01:08:03.113156 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:08:05.613131 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:08:06.387319 2164567 pod_ready.go:102] pod "metrics-server-57f55c9bc5-hk6xd" in "kube-system" namespace has status "Ready":"False"
I0314 01:08:08.887539 2164567 pod_ready.go:102] pod "metrics-server-57f55c9bc5-hk6xd" in "kube-system" namespace has status "Ready":"False"
I0314 01:08:08.113014 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:08:10.113211 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:08:11.386615 2164567 pod_ready.go:102] pod "metrics-server-57f55c9bc5-hk6xd" in "kube-system" namespace has status "Ready":"False"
I0314 01:08:13.387493 2164567 pod_ready.go:102] pod "metrics-server-57f55c9bc5-hk6xd" in "kube-system" namespace has status "Ready":"False"
I0314 01:08:12.614105 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:08:15.113089 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:08:15.886396 2164567 pod_ready.go:102] pod "metrics-server-57f55c9bc5-hk6xd" in "kube-system" namespace has status "Ready":"False"
I0314 01:08:17.887031 2164567 pod_ready.go:102] pod "metrics-server-57f55c9bc5-hk6xd" in "kube-system" namespace has status "Ready":"False"
I0314 01:08:19.887635 2164567 pod_ready.go:102] pod "metrics-server-57f55c9bc5-hk6xd" in "kube-system" namespace has status "Ready":"False"
I0314 01:08:17.614005 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:08:20.113930 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:08:22.387006 2164567 pod_ready.go:102] pod "metrics-server-57f55c9bc5-hk6xd" in "kube-system" namespace has status "Ready":"False"
I0314 01:08:24.387437 2164567 pod_ready.go:102] pod "metrics-server-57f55c9bc5-hk6xd" in "kube-system" namespace has status "Ready":"False"
I0314 01:08:22.613294 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:08:25.112900 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:08:26.387815 2164567 pod_ready.go:102] pod "metrics-server-57f55c9bc5-hk6xd" in "kube-system" namespace has status "Ready":"False"
I0314 01:08:28.886694 2164567 pod_ready.go:102] pod "metrics-server-57f55c9bc5-hk6xd" in "kube-system" namespace has status "Ready":"False"
I0314 01:08:27.612495 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:08:30.114205 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:08:30.887780 2164567 pod_ready.go:102] pod "metrics-server-57f55c9bc5-hk6xd" in "kube-system" namespace has status "Ready":"False"
I0314 01:08:33.386831 2164567 pod_ready.go:102] pod "metrics-server-57f55c9bc5-hk6xd" in "kube-system" namespace has status "Ready":"False"
I0314 01:08:35.387404 2164567 pod_ready.go:102] pod "metrics-server-57f55c9bc5-hk6xd" in "kube-system" namespace has status "Ready":"False"
I0314 01:08:32.612283 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:08:34.612593 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:08:36.613623 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:08:37.887560 2164567 pod_ready.go:102] pod "metrics-server-57f55c9bc5-hk6xd" in "kube-system" namespace has status "Ready":"False"
I0314 01:08:40.386816 2164567 pod_ready.go:102] pod "metrics-server-57f55c9bc5-hk6xd" in "kube-system" namespace has status "Ready":"False"
I0314 01:08:39.113089 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:08:41.612451 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:08:42.387159 2164567 pod_ready.go:102] pod "metrics-server-57f55c9bc5-hk6xd" in "kube-system" namespace has status "Ready":"False"
I0314 01:08:44.887374 2164567 pod_ready.go:102] pod "metrics-server-57f55c9bc5-hk6xd" in "kube-system" namespace has status "Ready":"False"
I0314 01:08:43.613091 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:08:46.116130 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:08:47.387962 2164567 pod_ready.go:102] pod "metrics-server-57f55c9bc5-hk6xd" in "kube-system" namespace has status "Ready":"False"
I0314 01:08:49.887170 2164567 pod_ready.go:102] pod "metrics-server-57f55c9bc5-hk6xd" in "kube-system" namespace has status "Ready":"False"
I0314 01:08:48.612362 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:08:50.612447 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:08:51.888356 2164567 pod_ready.go:102] pod "metrics-server-57f55c9bc5-hk6xd" in "kube-system" namespace has status "Ready":"False"
I0314 01:08:54.386984 2164567 pod_ready.go:102] pod "metrics-server-57f55c9bc5-hk6xd" in "kube-system" namespace has status "Ready":"False"
I0314 01:08:52.612689 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:08:55.113105 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:08:56.887523 2164567 pod_ready.go:102] pod "metrics-server-57f55c9bc5-hk6xd" in "kube-system" namespace has status "Ready":"False"
I0314 01:08:58.888011 2164567 pod_ready.go:102] pod "metrics-server-57f55c9bc5-hk6xd" in "kube-system" namespace has status "Ready":"False"
I0314 01:08:57.612018 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:08:59.612746 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:09:01.387679 2164567 pod_ready.go:102] pod "metrics-server-57f55c9bc5-hk6xd" in "kube-system" namespace has status "Ready":"False"
I0314 01:09:03.887039 2164567 pod_ready.go:102] pod "metrics-server-57f55c9bc5-hk6xd" in "kube-system" namespace has status "Ready":"False"
I0314 01:09:02.113430 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:09:04.612370 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:09:05.887869 2164567 pod_ready.go:102] pod "metrics-server-57f55c9bc5-hk6xd" in "kube-system" namespace has status "Ready":"False"
I0314 01:09:08.387250 2164567 pod_ready.go:102] pod "metrics-server-57f55c9bc5-hk6xd" in "kube-system" namespace has status "Ready":"False"
I0314 01:09:10.388097 2164567 pod_ready.go:102] pod "metrics-server-57f55c9bc5-hk6xd" in "kube-system" namespace has status "Ready":"False"
I0314 01:09:07.113178 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:09:09.612196 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:09:12.886944 2164567 pod_ready.go:102] pod "metrics-server-57f55c9bc5-hk6xd" in "kube-system" namespace has status "Ready":"False"
I0314 01:09:15.386918 2164567 pod_ready.go:102] pod "metrics-server-57f55c9bc5-hk6xd" in "kube-system" namespace has status "Ready":"False"
I0314 01:09:12.113067 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:09:14.612742 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:09:17.887326 2164567 pod_ready.go:102] pod "metrics-server-57f55c9bc5-hk6xd" in "kube-system" namespace has status "Ready":"False"
I0314 01:09:20.387845 2164567 pod_ready.go:102] pod "metrics-server-57f55c9bc5-hk6xd" in "kube-system" namespace has status "Ready":"False"
I0314 01:09:17.112547 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:09:19.612698 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:09:21.612869 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:09:22.887476 2164567 pod_ready.go:102] pod "metrics-server-57f55c9bc5-hk6xd" in "kube-system" namespace has status "Ready":"False"
I0314 01:09:25.389335 2164567 pod_ready.go:102] pod "metrics-server-57f55c9bc5-hk6xd" in "kube-system" namespace has status "Ready":"False"
I0314 01:09:23.617303 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:09:26.113238 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:09:27.887020 2164567 pod_ready.go:102] pod "metrics-server-57f55c9bc5-hk6xd" in "kube-system" namespace has status "Ready":"False"
I0314 01:09:29.887285 2164567 pod_ready.go:102] pod "metrics-server-57f55c9bc5-hk6xd" in "kube-system" namespace has status "Ready":"False"
I0314 01:09:28.114666 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:09:30.612076 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:09:32.387495 2164567 pod_ready.go:102] pod "metrics-server-57f55c9bc5-hk6xd" in "kube-system" namespace has status "Ready":"False"
I0314 01:09:34.388112 2164567 pod_ready.go:102] pod "metrics-server-57f55c9bc5-hk6xd" in "kube-system" namespace has status "Ready":"False"
I0314 01:09:32.612416 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:09:34.612869 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:09:36.613188 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:09:36.388145 2164567 pod_ready.go:102] pod "metrics-server-57f55c9bc5-hk6xd" in "kube-system" namespace has status "Ready":"False"
I0314 01:09:38.886874 2164567 pod_ready.go:102] pod "metrics-server-57f55c9bc5-hk6xd" in "kube-system" namespace has status "Ready":"False"
I0314 01:09:38.613854 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:09:40.680861 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:09:40.887708 2164567 pod_ready.go:102] pod "metrics-server-57f55c9bc5-hk6xd" in "kube-system" namespace has status "Ready":"False"
I0314 01:09:43.386550 2164567 pod_ready.go:102] pod "metrics-server-57f55c9bc5-hk6xd" in "kube-system" namespace has status "Ready":"False"
I0314 01:09:45.389402 2164567 pod_ready.go:102] pod "metrics-server-57f55c9bc5-hk6xd" in "kube-system" namespace has status "Ready":"False"
I0314 01:09:43.112789 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:09:45.128449 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:09:47.887089 2164567 pod_ready.go:102] pod "metrics-server-57f55c9bc5-hk6xd" in "kube-system" namespace has status "Ready":"False"
I0314 01:09:49.888177 2164567 pod_ready.go:102] pod "metrics-server-57f55c9bc5-hk6xd" in "kube-system" namespace has status "Ready":"False"
I0314 01:09:47.611451 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:09:49.615256 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:09:52.387158 2164567 pod_ready.go:102] pod "metrics-server-57f55c9bc5-hk6xd" in "kube-system" namespace has status "Ready":"False"
I0314 01:09:54.886211 2164567 pod_ready.go:102] pod "metrics-server-57f55c9bc5-hk6xd" in "kube-system" namespace has status "Ready":"False"
I0314 01:09:52.112495 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:09:54.612531 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:09:56.612712 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:09:56.887188 2164567 pod_ready.go:102] pod "metrics-server-57f55c9bc5-hk6xd" in "kube-system" namespace has status "Ready":"False"
I0314 01:09:59.386541 2164567 pod_ready.go:102] pod "metrics-server-57f55c9bc5-hk6xd" in "kube-system" namespace has status "Ready":"False"
I0314 01:09:58.616059 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:10:01.113394 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:10:01.387343 2164567 pod_ready.go:102] pod "metrics-server-57f55c9bc5-hk6xd" in "kube-system" namespace has status "Ready":"False"
I0314 01:10:03.886778 2164567 pod_ready.go:102] pod "metrics-server-57f55c9bc5-hk6xd" in "kube-system" namespace has status "Ready":"False"
I0314 01:10:03.612567 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:10:05.612888 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:10:05.886894 2164567 pod_ready.go:102] pod "metrics-server-57f55c9bc5-hk6xd" in "kube-system" namespace has status "Ready":"False"
I0314 01:10:07.888205 2164567 pod_ready.go:102] pod "metrics-server-57f55c9bc5-hk6xd" in "kube-system" namespace has status "Ready":"False"
I0314 01:10:10.386524 2164567 pod_ready.go:102] pod "metrics-server-57f55c9bc5-hk6xd" in "kube-system" namespace has status "Ready":"False"
I0314 01:10:08.112406 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:10:10.113435 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:10:12.386719 2164567 pod_ready.go:102] pod "metrics-server-57f55c9bc5-hk6xd" in "kube-system" namespace has status "Ready":"False"
I0314 01:10:14.386808 2164567 pod_ready.go:102] pod "metrics-server-57f55c9bc5-hk6xd" in "kube-system" namespace has status "Ready":"False"
I0314 01:10:12.114104 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:10:14.613004 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:10:16.387502 2164567 pod_ready.go:102] pod "metrics-server-57f55c9bc5-hk6xd" in "kube-system" namespace has status "Ready":"False"
I0314 01:10:18.387556 2164567 pod_ready.go:102] pod "metrics-server-57f55c9bc5-hk6xd" in "kube-system" namespace has status "Ready":"False"
I0314 01:10:17.112735 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:10:19.613008 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:10:20.886834 2164567 pod_ready.go:102] pod "metrics-server-57f55c9bc5-hk6xd" in "kube-system" namespace has status "Ready":"False"
I0314 01:10:22.886910 2164567 pod_ready.go:102] pod "metrics-server-57f55c9bc5-hk6xd" in "kube-system" namespace has status "Ready":"False"
I0314 01:10:24.887488 2164567 pod_ready.go:102] pod "metrics-server-57f55c9bc5-hk6xd" in "kube-system" namespace has status "Ready":"False"
I0314 01:10:22.121318 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:10:24.612298 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:10:26.613054 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:10:27.387036 2164567 pod_ready.go:102] pod "metrics-server-57f55c9bc5-hk6xd" in "kube-system" namespace has status "Ready":"False"
I0314 01:10:29.887271 2164567 pod_ready.go:102] pod "metrics-server-57f55c9bc5-hk6xd" in "kube-system" namespace has status "Ready":"False"
I0314 01:10:29.112840 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:10:31.163820 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:10:32.386651 2164567 pod_ready.go:102] pod "metrics-server-57f55c9bc5-hk6xd" in "kube-system" namespace has status "Ready":"False"
I0314 01:10:34.887022 2164567 pod_ready.go:102] pod "metrics-server-57f55c9bc5-hk6xd" in "kube-system" namespace has status "Ready":"False"
I0314 01:10:33.611968 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:10:35.612071 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:10:37.386871 2164567 pod_ready.go:102] pod "metrics-server-57f55c9bc5-hk6xd" in "kube-system" namespace has status "Ready":"False"
I0314 01:10:39.886406 2164567 pod_ready.go:102] pod "metrics-server-57f55c9bc5-hk6xd" in "kube-system" namespace has status "Ready":"False"
I0314 01:10:38.112892 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:10:40.113241 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:10:41.886512 2164567 pod_ready.go:102] pod "metrics-server-57f55c9bc5-hk6xd" in "kube-system" namespace has status "Ready":"False"
I0314 01:10:44.386946 2164567 pod_ready.go:102] pod "metrics-server-57f55c9bc5-hk6xd" in "kube-system" namespace has status "Ready":"False"
I0314 01:10:42.116762 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:10:44.612296 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:10:46.886412 2164567 pod_ready.go:102] pod "metrics-server-57f55c9bc5-hk6xd" in "kube-system" namespace has status "Ready":"False"
I0314 01:10:48.887110 2164567 pod_ready.go:102] pod "metrics-server-57f55c9bc5-hk6xd" in "kube-system" namespace has status "Ready":"False"
I0314 01:10:47.112173 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:10:49.114394 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:10:51.611692 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:10:51.387022 2164567 pod_ready.go:102] pod "metrics-server-57f55c9bc5-hk6xd" in "kube-system" namespace has status "Ready":"False"
I0314 01:10:53.886902 2164567 pod_ready.go:102] pod "metrics-server-57f55c9bc5-hk6xd" in "kube-system" namespace has status "Ready":"False"
I0314 01:10:53.612772 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:10:56.112956 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:10:56.387146 2164567 pod_ready.go:102] pod "metrics-server-57f55c9bc5-hk6xd" in "kube-system" namespace has status "Ready":"False"
I0314 01:10:58.886494 2164567 pod_ready.go:102] pod "metrics-server-57f55c9bc5-hk6xd" in "kube-system" namespace has status "Ready":"False"
I0314 01:10:58.612462 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:11:01.113085 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:11:00.886737 2164567 pod_ready.go:102] pod "metrics-server-57f55c9bc5-hk6xd" in "kube-system" namespace has status "Ready":"False"
I0314 01:11:03.386363 2164567 pod_ready.go:102] pod "metrics-server-57f55c9bc5-hk6xd" in "kube-system" namespace has status "Ready":"False"
I0314 01:11:05.386837 2164567 pod_ready.go:102] pod "metrics-server-57f55c9bc5-hk6xd" in "kube-system" namespace has status "Ready":"False"
I0314 01:11:03.612572 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:11:06.112431 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:11:07.886728 2164567 pod_ready.go:102] pod "metrics-server-57f55c9bc5-hk6xd" in "kube-system" namespace has status "Ready":"False"
I0314 01:11:10.386573 2164567 pod_ready.go:102] pod "metrics-server-57f55c9bc5-hk6xd" in "kube-system" namespace has status "Ready":"False"
I0314 01:11:08.612641 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:11:11.112936 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:11:12.386846 2164567 pod_ready.go:102] pod "metrics-server-57f55c9bc5-hk6xd" in "kube-system" namespace has status "Ready":"False"
I0314 01:11:14.388063 2164567 pod_ready.go:102] pod "metrics-server-57f55c9bc5-hk6xd" in "kube-system" namespace has status "Ready":"False"
I0314 01:11:13.613871 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:11:16.112520 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:11:16.886435 2164567 pod_ready.go:102] pod "metrics-server-57f55c9bc5-hk6xd" in "kube-system" namespace has status "Ready":"False"
I0314 01:11:18.887242 2164567 pod_ready.go:102] pod "metrics-server-57f55c9bc5-hk6xd" in "kube-system" namespace has status "Ready":"False"
I0314 01:11:18.113134 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:11:20.114090 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:11:21.387960 2164567 pod_ready.go:102] pod "metrics-server-57f55c9bc5-hk6xd" in "kube-system" namespace has status "Ready":"False"
I0314 01:11:23.886894 2164567 pod_ready.go:102] pod "metrics-server-57f55c9bc5-hk6xd" in "kube-system" namespace has status "Ready":"False"
I0314 01:11:22.611978 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:11:24.618647 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:11:26.387241 2164567 pod_ready.go:102] pod "metrics-server-57f55c9bc5-hk6xd" in "kube-system" namespace has status "Ready":"False"
I0314 01:11:28.886834 2164567 pod_ready.go:102] pod "metrics-server-57f55c9bc5-hk6xd" in "kube-system" namespace has status "Ready":"False"
I0314 01:11:27.113224 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:11:29.611941 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:11:30.887460 2164567 pod_ready.go:102] pod "metrics-server-57f55c9bc5-hk6xd" in "kube-system" namespace has status "Ready":"False"
I0314 01:11:33.386893 2164567 pod_ready.go:102] pod "metrics-server-57f55c9bc5-hk6xd" in "kube-system" namespace has status "Ready":"False"
I0314 01:11:32.111941 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:11:34.114194 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:11:36.611543 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:11:35.886331 2164567 pod_ready.go:102] pod "metrics-server-57f55c9bc5-hk6xd" in "kube-system" namespace has status "Ready":"False"
I0314 01:11:37.886975 2164567 pod_ready.go:102] pod "metrics-server-57f55c9bc5-hk6xd" in "kube-system" namespace has status "Ready":"False"
I0314 01:11:40.386944 2164567 pod_ready.go:102] pod "metrics-server-57f55c9bc5-hk6xd" in "kube-system" namespace has status "Ready":"False"
I0314 01:11:38.624690 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:11:41.112194 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:11:42.387245 2164567 pod_ready.go:102] pod "metrics-server-57f55c9bc5-hk6xd" in "kube-system" namespace has status "Ready":"False"
I0314 01:11:44.886999 2164567 pod_ready.go:102] pod "metrics-server-57f55c9bc5-hk6xd" in "kube-system" namespace has status "Ready":"False"
I0314 01:11:43.112729 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:11:45.125051 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:11:47.389104 2164567 pod_ready.go:102] pod "metrics-server-57f55c9bc5-hk6xd" in "kube-system" namespace has status "Ready":"False"
I0314 01:11:48.387655 2164567 pod_ready.go:81] duration metric: took 4m0.00727494s for pod "metrics-server-57f55c9bc5-hk6xd" in "kube-system" namespace to be "Ready" ...
E0314 01:11:48.387682 2164567 pod_ready.go:66] WaitExtra: waitPodCondition: context deadline exceeded
I0314 01:11:48.387701 2164567 pod_ready.go:38] duration metric: took 4m14.219872314s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0314 01:11:48.387715 2164567 api_server.go:52] waiting for apiserver process to appear ...
I0314 01:11:48.387745 2164567 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
I0314 01:11:48.387821 2164567 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0314 01:11:48.435303 2164567 cri.go:89] found id: "83e70fac6fc9f0a4771305e9540a6589461cc3a2484f50ba174557b1f4dd17a6"
I0314 01:11:48.435330 2164567 cri.go:89] found id: "35a448a37fe417bd5ef90a5f2619fd285e7f7b440884d6ac9bf11cbb9b611a8f"
I0314 01:11:48.435337 2164567 cri.go:89] found id: ""
I0314 01:11:48.435345 2164567 logs.go:276] 2 containers: [83e70fac6fc9f0a4771305e9540a6589461cc3a2484f50ba174557b1f4dd17a6 35a448a37fe417bd5ef90a5f2619fd285e7f7b440884d6ac9bf11cbb9b611a8f]
I0314 01:11:48.435424 2164567 ssh_runner.go:195] Run: which crictl
I0314 01:11:48.439114 2164567 ssh_runner.go:195] Run: which crictl
I0314 01:11:48.442788 2164567 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
I0314 01:11:48.442872 2164567 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0314 01:11:48.486625 2164567 cri.go:89] found id: "edd6991f7b2f89493036abb17b74cda6026808614734286a5086dd892d4d83f4"
I0314 01:11:48.486647 2164567 cri.go:89] found id: "4b18a1225338f6b055a8ed1e1d1fdf13dc3e26f2d1c4e57dacd35453fb92208b"
I0314 01:11:48.486653 2164567 cri.go:89] found id: ""
I0314 01:11:48.486661 2164567 logs.go:276] 2 containers: [edd6991f7b2f89493036abb17b74cda6026808614734286a5086dd892d4d83f4 4b18a1225338f6b055a8ed1e1d1fdf13dc3e26f2d1c4e57dacd35453fb92208b]
I0314 01:11:48.486720 2164567 ssh_runner.go:195] Run: which crictl
I0314 01:11:48.491928 2164567 ssh_runner.go:195] Run: which crictl
I0314 01:11:48.495470 2164567 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
I0314 01:11:48.495554 2164567 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0314 01:11:48.536471 2164567 cri.go:89] found id: "f951ff206e24865e25fedf9d07490b40ff93469bd720cec184189041d9aebee0"
I0314 01:11:48.536494 2164567 cri.go:89] found id: "fce51585db2ccb145151be13dcfb93f128f9c83b3d5057ed298f4c72a4923602"
I0314 01:11:48.536499 2164567 cri.go:89] found id: ""
I0314 01:11:48.536507 2164567 logs.go:276] 2 containers: [f951ff206e24865e25fedf9d07490b40ff93469bd720cec184189041d9aebee0 fce51585db2ccb145151be13dcfb93f128f9c83b3d5057ed298f4c72a4923602]
I0314 01:11:48.536584 2164567 ssh_runner.go:195] Run: which crictl
I0314 01:11:48.540813 2164567 ssh_runner.go:195] Run: which crictl
I0314 01:11:48.544961 2164567 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
I0314 01:11:48.545049 2164567 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0314 01:11:48.581919 2164567 cri.go:89] found id: "1831385fcf3d81ce237870ecb4323a71c6f6032b775571ce1bfd9b1aa401f240"
I0314 01:11:48.581939 2164567 cri.go:89] found id: "f879b7c53550f5f73f52a19c81373092a43f07fa2c0eab968e4ca6e842db66ad"
I0314 01:11:48.581944 2164567 cri.go:89] found id: ""
I0314 01:11:48.581951 2164567 logs.go:276] 2 containers: [1831385fcf3d81ce237870ecb4323a71c6f6032b775571ce1bfd9b1aa401f240 f879b7c53550f5f73f52a19c81373092a43f07fa2c0eab968e4ca6e842db66ad]
I0314 01:11:48.582008 2164567 ssh_runner.go:195] Run: which crictl
I0314 01:11:48.585775 2164567 ssh_runner.go:195] Run: which crictl
I0314 01:11:48.589347 2164567 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
I0314 01:11:48.589448 2164567 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0314 01:11:48.639954 2164567 cri.go:89] found id: "785351628119d6ad774adc88f0d82526af3626432b44b411d9c17da27d8784d1"
I0314 01:11:48.639991 2164567 cri.go:89] found id: "5b506479b9f8549a1328dcd0ed478bc43502c6dc60ed26325977136263ab523c"
I0314 01:11:48.639996 2164567 cri.go:89] found id: ""
I0314 01:11:48.640004 2164567 logs.go:276] 2 containers: [785351628119d6ad774adc88f0d82526af3626432b44b411d9c17da27d8784d1 5b506479b9f8549a1328dcd0ed478bc43502c6dc60ed26325977136263ab523c]
I0314 01:11:48.640095 2164567 ssh_runner.go:195] Run: which crictl
I0314 01:11:48.643855 2164567 ssh_runner.go:195] Run: which crictl
I0314 01:11:48.647443 2164567 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
I0314 01:11:48.647511 2164567 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0314 01:11:48.691880 2164567 cri.go:89] found id: "989c71405847bd5f227e2c830feb302d068f9ba20658db76cdd765f46c08880f"
I0314 01:11:48.691900 2164567 cri.go:89] found id: "dedbba40a1e0160ff417b93d3e8c30371b7d47b139e6891c9e49311c61cb963a"
I0314 01:11:48.691904 2164567 cri.go:89] found id: ""
I0314 01:11:48.691912 2164567 logs.go:276] 2 containers: [989c71405847bd5f227e2c830feb302d068f9ba20658db76cdd765f46c08880f dedbba40a1e0160ff417b93d3e8c30371b7d47b139e6891c9e49311c61cb963a]
I0314 01:11:48.691966 2164567 ssh_runner.go:195] Run: which crictl
I0314 01:11:48.699850 2164567 ssh_runner.go:195] Run: which crictl
I0314 01:11:48.704329 2164567 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
I0314 01:11:48.704434 2164567 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0314 01:11:48.741931 2164567 cri.go:89] found id: "4a9251917031e35e335bf4d8b0a039d7e6d52c246bb42616850a1b8ac39049af"
I0314 01:11:48.741991 2164567 cri.go:89] found id: "2d000a4f5e324dc6ef2641ef49e48ce29f1951ae66fae9eba1637086079d822f"
I0314 01:11:48.742010 2164567 cri.go:89] found id: ""
I0314 01:11:48.742042 2164567 logs.go:276] 2 containers: [4a9251917031e35e335bf4d8b0a039d7e6d52c246bb42616850a1b8ac39049af 2d000a4f5e324dc6ef2641ef49e48ce29f1951ae66fae9eba1637086079d822f]
I0314 01:11:48.742119 2164567 ssh_runner.go:195] Run: which crictl
I0314 01:11:48.746396 2164567 ssh_runner.go:195] Run: which crictl
I0314 01:11:48.749952 2164567 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
I0314 01:11:48.750052 2164567 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0314 01:11:48.791030 2164567 cri.go:89] found id: "4f2288296aec7700bd2c07880a695239698b441d793a71041c1b77e5e2605cf4"
I0314 01:11:48.791055 2164567 cri.go:89] found id: "ab9f905640559b9ba4c07f291aa488bc62ba2563d3e461c125a650b1b9613d8f"
I0314 01:11:48.791059 2164567 cri.go:89] found id: ""
I0314 01:11:48.791067 2164567 logs.go:276] 2 containers: [4f2288296aec7700bd2c07880a695239698b441d793a71041c1b77e5e2605cf4 ab9f905640559b9ba4c07f291aa488bc62ba2563d3e461c125a650b1b9613d8f]
I0314 01:11:48.791140 2164567 ssh_runner.go:195] Run: which crictl
I0314 01:11:48.794783 2164567 ssh_runner.go:195] Run: which crictl
I0314 01:11:48.798344 2164567 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
I0314 01:11:48.798418 2164567 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I0314 01:11:48.844369 2164567 cri.go:89] found id: "f87d7177a951ec4f55aba7a435db0cc522f86ad118288135c55ea54eb077660a"
I0314 01:11:48.844444 2164567 cri.go:89] found id: ""
I0314 01:11:48.844469 2164567 logs.go:276] 1 containers: [f87d7177a951ec4f55aba7a435db0cc522f86ad118288135c55ea54eb077660a]
I0314 01:11:48.844559 2164567 ssh_runner.go:195] Run: which crictl
I0314 01:11:48.848604 2164567 logs.go:123] Gathering logs for coredns [f951ff206e24865e25fedf9d07490b40ff93469bd720cec184189041d9aebee0] ...
I0314 01:11:48.848677 2164567 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 f951ff206e24865e25fedf9d07490b40ff93469bd720cec184189041d9aebee0"
I0314 01:11:48.902774 2164567 logs.go:123] Gathering logs for kube-proxy [5b506479b9f8549a1328dcd0ed478bc43502c6dc60ed26325977136263ab523c] ...
I0314 01:11:48.902803 2164567 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 5b506479b9f8549a1328dcd0ed478bc43502c6dc60ed26325977136263ab523c"
I0314 01:11:48.950625 2164567 logs.go:123] Gathering logs for kube-controller-manager [989c71405847bd5f227e2c830feb302d068f9ba20658db76cdd765f46c08880f] ...
I0314 01:11:48.950655 2164567 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 989c71405847bd5f227e2c830feb302d068f9ba20658db76cdd765f46c08880f"
I0314 01:11:49.015633 2164567 logs.go:123] Gathering logs for dmesg ...
I0314 01:11:49.015668 2164567 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0314 01:11:49.035807 2164567 logs.go:123] Gathering logs for etcd [4b18a1225338f6b055a8ed1e1d1fdf13dc3e26f2d1c4e57dacd35453fb92208b] ...
I0314 01:11:49.035839 2164567 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 4b18a1225338f6b055a8ed1e1d1fdf13dc3e26f2d1c4e57dacd35453fb92208b"
I0314 01:11:49.086580 2164567 logs.go:123] Gathering logs for kube-scheduler [1831385fcf3d81ce237870ecb4323a71c6f6032b775571ce1bfd9b1aa401f240] ...
I0314 01:11:49.086613 2164567 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 1831385fcf3d81ce237870ecb4323a71c6f6032b775571ce1bfd9b1aa401f240"
I0314 01:11:49.136295 2164567 logs.go:123] Gathering logs for kube-apiserver [35a448a37fe417bd5ef90a5f2619fd285e7f7b440884d6ac9bf11cbb9b611a8f] ...
I0314 01:11:49.136328 2164567 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 35a448a37fe417bd5ef90a5f2619fd285e7f7b440884d6ac9bf11cbb9b611a8f"
I0314 01:11:49.201133 2164567 logs.go:123] Gathering logs for kube-apiserver [83e70fac6fc9f0a4771305e9540a6589461cc3a2484f50ba174557b1f4dd17a6] ...
I0314 01:11:49.201162 2164567 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 83e70fac6fc9f0a4771305e9540a6589461cc3a2484f50ba174557b1f4dd17a6"
I0314 01:11:49.255233 2164567 logs.go:123] Gathering logs for kube-scheduler [f879b7c53550f5f73f52a19c81373092a43f07fa2c0eab968e4ca6e842db66ad] ...
I0314 01:11:49.255264 2164567 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 f879b7c53550f5f73f52a19c81373092a43f07fa2c0eab968e4ca6e842db66ad"
I0314 01:11:49.296441 2164567 logs.go:123] Gathering logs for kube-proxy [785351628119d6ad774adc88f0d82526af3626432b44b411d9c17da27d8784d1] ...
I0314 01:11:49.296468 2164567 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 785351628119d6ad774adc88f0d82526af3626432b44b411d9c17da27d8784d1"
I0314 01:11:49.337849 2164567 logs.go:123] Gathering logs for storage-provisioner [ab9f905640559b9ba4c07f291aa488bc62ba2563d3e461c125a650b1b9613d8f] ...
I0314 01:11:49.337877 2164567 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 ab9f905640559b9ba4c07f291aa488bc62ba2563d3e461c125a650b1b9613d8f"
I0314 01:11:49.381238 2164567 logs.go:123] Gathering logs for kubernetes-dashboard [f87d7177a951ec4f55aba7a435db0cc522f86ad118288135c55ea54eb077660a] ...
I0314 01:11:49.381267 2164567 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 f87d7177a951ec4f55aba7a435db0cc522f86ad118288135c55ea54eb077660a"
I0314 01:11:49.429871 2164567 logs.go:123] Gathering logs for containerd ...
I0314 01:11:49.429901 2164567 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
I0314 01:11:49.501362 2164567 logs.go:123] Gathering logs for kubelet ...
I0314 01:11:49.501403 2164567 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0314 01:11:49.578568 2164567 logs.go:123] Gathering logs for etcd [edd6991f7b2f89493036abb17b74cda6026808614734286a5086dd892d4d83f4] ...
I0314 01:11:49.578604 2164567 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 edd6991f7b2f89493036abb17b74cda6026808614734286a5086dd892d4d83f4"
I0314 01:11:49.628532 2164567 logs.go:123] Gathering logs for coredns [fce51585db2ccb145151be13dcfb93f128f9c83b3d5057ed298f4c72a4923602] ...
I0314 01:11:49.628561 2164567 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 fce51585db2ccb145151be13dcfb93f128f9c83b3d5057ed298f4c72a4923602"
I0314 01:11:49.680248 2164567 logs.go:123] Gathering logs for kube-controller-manager [dedbba40a1e0160ff417b93d3e8c30371b7d47b139e6891c9e49311c61cb963a] ...
I0314 01:11:49.680281 2164567 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 dedbba40a1e0160ff417b93d3e8c30371b7d47b139e6891c9e49311c61cb963a"
I0314 01:11:49.746183 2164567 logs.go:123] Gathering logs for kindnet [4a9251917031e35e335bf4d8b0a039d7e6d52c246bb42616850a1b8ac39049af] ...
I0314 01:11:49.746235 2164567 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 4a9251917031e35e335bf4d8b0a039d7e6d52c246bb42616850a1b8ac39049af"
I0314 01:11:49.800998 2164567 logs.go:123] Gathering logs for kindnet [2d000a4f5e324dc6ef2641ef49e48ce29f1951ae66fae9eba1637086079d822f] ...
I0314 01:11:49.801032 2164567 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 2d000a4f5e324dc6ef2641ef49e48ce29f1951ae66fae9eba1637086079d822f"
I0314 01:11:49.841666 2164567 logs.go:123] Gathering logs for storage-provisioner [4f2288296aec7700bd2c07880a695239698b441d793a71041c1b77e5e2605cf4] ...
I0314 01:11:49.841697 2164567 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 4f2288296aec7700bd2c07880a695239698b441d793a71041c1b77e5e2605cf4"
I0314 01:11:49.901849 2164567 logs.go:123] Gathering logs for container status ...
I0314 01:11:49.901926 2164567 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0314 01:11:49.967719 2164567 logs.go:123] Gathering logs for describe nodes ...
I0314 01:11:49.967747 2164567 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0314 01:11:47.612575 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:11:49.613777 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:11:52.641248 2164567 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0314 01:11:52.653698 2164567 api_server.go:72] duration metric: took 4m24.800611548s to wait for apiserver process to appear ...
I0314 01:11:52.653723 2164567 api_server.go:88] waiting for apiserver healthz status ...
I0314 01:11:52.653761 2164567 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
I0314 01:11:52.653821 2164567 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0314 01:11:52.692179 2164567 cri.go:89] found id: "83e70fac6fc9f0a4771305e9540a6589461cc3a2484f50ba174557b1f4dd17a6"
I0314 01:11:52.692203 2164567 cri.go:89] found id: "35a448a37fe417bd5ef90a5f2619fd285e7f7b440884d6ac9bf11cbb9b611a8f"
I0314 01:11:52.692208 2164567 cri.go:89] found id: ""
I0314 01:11:52.692216 2164567 logs.go:276] 2 containers: [83e70fac6fc9f0a4771305e9540a6589461cc3a2484f50ba174557b1f4dd17a6 35a448a37fe417bd5ef90a5f2619fd285e7f7b440884d6ac9bf11cbb9b611a8f]
I0314 01:11:52.692275 2164567 ssh_runner.go:195] Run: which crictl
I0314 01:11:52.695938 2164567 ssh_runner.go:195] Run: which crictl
I0314 01:11:52.699539 2164567 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
I0314 01:11:52.699627 2164567 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0314 01:11:52.748070 2164567 cri.go:89] found id: "edd6991f7b2f89493036abb17b74cda6026808614734286a5086dd892d4d83f4"
I0314 01:11:52.748091 2164567 cri.go:89] found id: "4b18a1225338f6b055a8ed1e1d1fdf13dc3e26f2d1c4e57dacd35453fb92208b"
I0314 01:11:52.748096 2164567 cri.go:89] found id: ""
I0314 01:11:52.748102 2164567 logs.go:276] 2 containers: [edd6991f7b2f89493036abb17b74cda6026808614734286a5086dd892d4d83f4 4b18a1225338f6b055a8ed1e1d1fdf13dc3e26f2d1c4e57dacd35453fb92208b]
I0314 01:11:52.748179 2164567 ssh_runner.go:195] Run: which crictl
I0314 01:11:52.752784 2164567 ssh_runner.go:195] Run: which crictl
I0314 01:11:52.756259 2164567 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
I0314 01:11:52.756374 2164567 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0314 01:11:52.795957 2164567 cri.go:89] found id: "f951ff206e24865e25fedf9d07490b40ff93469bd720cec184189041d9aebee0"
I0314 01:11:52.795978 2164567 cri.go:89] found id: "fce51585db2ccb145151be13dcfb93f128f9c83b3d5057ed298f4c72a4923602"
I0314 01:11:52.795984 2164567 cri.go:89] found id: ""
I0314 01:11:52.795991 2164567 logs.go:276] 2 containers: [f951ff206e24865e25fedf9d07490b40ff93469bd720cec184189041d9aebee0 fce51585db2ccb145151be13dcfb93f128f9c83b3d5057ed298f4c72a4923602]
I0314 01:11:52.796079 2164567 ssh_runner.go:195] Run: which crictl
I0314 01:11:52.800034 2164567 ssh_runner.go:195] Run: which crictl
I0314 01:11:52.803732 2164567 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
I0314 01:11:52.803811 2164567 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0314 01:11:52.844829 2164567 cri.go:89] found id: "1831385fcf3d81ce237870ecb4323a71c6f6032b775571ce1bfd9b1aa401f240"
I0314 01:11:52.844849 2164567 cri.go:89] found id: "f879b7c53550f5f73f52a19c81373092a43f07fa2c0eab968e4ca6e842db66ad"
I0314 01:11:52.844854 2164567 cri.go:89] found id: ""
I0314 01:11:52.844862 2164567 logs.go:276] 2 containers: [1831385fcf3d81ce237870ecb4323a71c6f6032b775571ce1bfd9b1aa401f240 f879b7c53550f5f73f52a19c81373092a43f07fa2c0eab968e4ca6e842db66ad]
I0314 01:11:52.844917 2164567 ssh_runner.go:195] Run: which crictl
I0314 01:11:52.848797 2164567 ssh_runner.go:195] Run: which crictl
I0314 01:11:52.855450 2164567 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
I0314 01:11:52.855596 2164567 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0314 01:11:52.899817 2164567 cri.go:89] found id: "785351628119d6ad774adc88f0d82526af3626432b44b411d9c17da27d8784d1"
I0314 01:11:52.899838 2164567 cri.go:89] found id: "5b506479b9f8549a1328dcd0ed478bc43502c6dc60ed26325977136263ab523c"
I0314 01:11:52.899843 2164567 cri.go:89] found id: ""
I0314 01:11:52.899851 2164567 logs.go:276] 2 containers: [785351628119d6ad774adc88f0d82526af3626432b44b411d9c17da27d8784d1 5b506479b9f8549a1328dcd0ed478bc43502c6dc60ed26325977136263ab523c]
I0314 01:11:52.899908 2164567 ssh_runner.go:195] Run: which crictl
I0314 01:11:52.903968 2164567 ssh_runner.go:195] Run: which crictl
I0314 01:11:52.907447 2164567 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
I0314 01:11:52.907523 2164567 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0314 01:11:52.947271 2164567 cri.go:89] found id: "989c71405847bd5f227e2c830feb302d068f9ba20658db76cdd765f46c08880f"
I0314 01:11:52.947292 2164567 cri.go:89] found id: "dedbba40a1e0160ff417b93d3e8c30371b7d47b139e6891c9e49311c61cb963a"
I0314 01:11:52.947297 2164567 cri.go:89] found id: ""
I0314 01:11:52.947304 2164567 logs.go:276] 2 containers: [989c71405847bd5f227e2c830feb302d068f9ba20658db76cdd765f46c08880f dedbba40a1e0160ff417b93d3e8c30371b7d47b139e6891c9e49311c61cb963a]
I0314 01:11:52.947386 2164567 ssh_runner.go:195] Run: which crictl
I0314 01:11:52.951288 2164567 ssh_runner.go:195] Run: which crictl
I0314 01:11:52.956202 2164567 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
I0314 01:11:52.956317 2164567 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0314 01:11:53.004173 2164567 cri.go:89] found id: "4a9251917031e35e335bf4d8b0a039d7e6d52c246bb42616850a1b8ac39049af"
I0314 01:11:53.004208 2164567 cri.go:89] found id: "2d000a4f5e324dc6ef2641ef49e48ce29f1951ae66fae9eba1637086079d822f"
I0314 01:11:53.004213 2164567 cri.go:89] found id: ""
I0314 01:11:53.004221 2164567 logs.go:276] 2 containers: [4a9251917031e35e335bf4d8b0a039d7e6d52c246bb42616850a1b8ac39049af 2d000a4f5e324dc6ef2641ef49e48ce29f1951ae66fae9eba1637086079d822f]
I0314 01:11:53.004325 2164567 ssh_runner.go:195] Run: which crictl
I0314 01:11:53.008487 2164567 ssh_runner.go:195] Run: which crictl
I0314 01:11:53.012244 2164567 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
I0314 01:11:53.012372 2164567 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0314 01:11:53.050843 2164567 cri.go:89] found id: "4f2288296aec7700bd2c07880a695239698b441d793a71041c1b77e5e2605cf4"
I0314 01:11:53.050908 2164567 cri.go:89] found id: "ab9f905640559b9ba4c07f291aa488bc62ba2563d3e461c125a650b1b9613d8f"
I0314 01:11:53.050931 2164567 cri.go:89] found id: ""
I0314 01:11:53.050953 2164567 logs.go:276] 2 containers: [4f2288296aec7700bd2c07880a695239698b441d793a71041c1b77e5e2605cf4 ab9f905640559b9ba4c07f291aa488bc62ba2563d3e461c125a650b1b9613d8f]
I0314 01:11:53.051028 2164567 ssh_runner.go:195] Run: which crictl
I0314 01:11:53.054829 2164567 ssh_runner.go:195] Run: which crictl
I0314 01:11:53.058593 2164567 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
I0314 01:11:53.058728 2164567 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I0314 01:11:53.097581 2164567 cri.go:89] found id: "f87d7177a951ec4f55aba7a435db0cc522f86ad118288135c55ea54eb077660a"
I0314 01:11:53.097603 2164567 cri.go:89] found id: ""
I0314 01:11:53.097611 2164567 logs.go:276] 1 containers: [f87d7177a951ec4f55aba7a435db0cc522f86ad118288135c55ea54eb077660a]
I0314 01:11:53.097696 2164567 ssh_runner.go:195] Run: which crictl
I0314 01:11:53.101615 2164567 logs.go:123] Gathering logs for etcd [edd6991f7b2f89493036abb17b74cda6026808614734286a5086dd892d4d83f4] ...
I0314 01:11:53.101657 2164567 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 edd6991f7b2f89493036abb17b74cda6026808614734286a5086dd892d4d83f4"
I0314 01:11:53.147841 2164567 logs.go:123] Gathering logs for kube-scheduler [1831385fcf3d81ce237870ecb4323a71c6f6032b775571ce1bfd9b1aa401f240] ...
I0314 01:11:53.147874 2164567 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 1831385fcf3d81ce237870ecb4323a71c6f6032b775571ce1bfd9b1aa401f240"
I0314 01:11:53.190297 2164567 logs.go:123] Gathering logs for kube-proxy [785351628119d6ad774adc88f0d82526af3626432b44b411d9c17da27d8784d1] ...
I0314 01:11:53.190327 2164567 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 785351628119d6ad774adc88f0d82526af3626432b44b411d9c17da27d8784d1"
I0314 01:11:53.227874 2164567 logs.go:123] Gathering logs for kube-proxy [5b506479b9f8549a1328dcd0ed478bc43502c6dc60ed26325977136263ab523c] ...
I0314 01:11:53.227905 2164567 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 5b506479b9f8549a1328dcd0ed478bc43502c6dc60ed26325977136263ab523c"
I0314 01:11:53.265697 2164567 logs.go:123] Gathering logs for storage-provisioner [ab9f905640559b9ba4c07f291aa488bc62ba2563d3e461c125a650b1b9613d8f] ...
I0314 01:11:53.265727 2164567 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 ab9f905640559b9ba4c07f291aa488bc62ba2563d3e461c125a650b1b9613d8f"
I0314 01:11:53.310103 2164567 logs.go:123] Gathering logs for kubelet ...
I0314 01:11:53.310130 2164567 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0314 01:11:53.386250 2164567 logs.go:123] Gathering logs for dmesg ...
I0314 01:11:53.386289 2164567 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0314 01:11:53.412257 2164567 logs.go:123] Gathering logs for describe nodes ...
I0314 01:11:53.412290 2164567 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0314 01:11:53.542829 2164567 logs.go:123] Gathering logs for kube-apiserver [83e70fac6fc9f0a4771305e9540a6589461cc3a2484f50ba174557b1f4dd17a6] ...
I0314 01:11:53.542926 2164567 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 83e70fac6fc9f0a4771305e9540a6589461cc3a2484f50ba174557b1f4dd17a6"
I0314 01:11:53.599849 2164567 logs.go:123] Gathering logs for kube-apiserver [35a448a37fe417bd5ef90a5f2619fd285e7f7b440884d6ac9bf11cbb9b611a8f] ...
I0314 01:11:53.599885 2164567 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 35a448a37fe417bd5ef90a5f2619fd285e7f7b440884d6ac9bf11cbb9b611a8f"
I0314 01:11:53.650101 2164567 logs.go:123] Gathering logs for kube-scheduler [f879b7c53550f5f73f52a19c81373092a43f07fa2c0eab968e4ca6e842db66ad] ...
I0314 01:11:53.650134 2164567 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 f879b7c53550f5f73f52a19c81373092a43f07fa2c0eab968e4ca6e842db66ad"
I0314 01:11:53.692094 2164567 logs.go:123] Gathering logs for kindnet [4a9251917031e35e335bf4d8b0a039d7e6d52c246bb42616850a1b8ac39049af] ...
I0314 01:11:53.692122 2164567 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 4a9251917031e35e335bf4d8b0a039d7e6d52c246bb42616850a1b8ac39049af"
I0314 01:11:53.737288 2164567 logs.go:123] Gathering logs for kindnet [2d000a4f5e324dc6ef2641ef49e48ce29f1951ae66fae9eba1637086079d822f] ...
I0314 01:11:53.737319 2164567 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 2d000a4f5e324dc6ef2641ef49e48ce29f1951ae66fae9eba1637086079d822f"
I0314 01:11:53.780846 2164567 logs.go:123] Gathering logs for storage-provisioner [4f2288296aec7700bd2c07880a695239698b441d793a71041c1b77e5e2605cf4] ...
I0314 01:11:53.780876 2164567 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 4f2288296aec7700bd2c07880a695239698b441d793a71041c1b77e5e2605cf4"
I0314 01:11:53.824385 2164567 logs.go:123] Gathering logs for kubernetes-dashboard [f87d7177a951ec4f55aba7a435db0cc522f86ad118288135c55ea54eb077660a] ...
I0314 01:11:53.824413 2164567 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 f87d7177a951ec4f55aba7a435db0cc522f86ad118288135c55ea54eb077660a"
I0314 01:11:53.872487 2164567 logs.go:123] Gathering logs for kube-controller-manager [989c71405847bd5f227e2c830feb302d068f9ba20658db76cdd765f46c08880f] ...
I0314 01:11:53.872517 2164567 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 989c71405847bd5f227e2c830feb302d068f9ba20658db76cdd765f46c08880f"
I0314 01:11:53.935251 2164567 logs.go:123] Gathering logs for kube-controller-manager [dedbba40a1e0160ff417b93d3e8c30371b7d47b139e6891c9e49311c61cb963a] ...
I0314 01:11:53.935284 2164567 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 dedbba40a1e0160ff417b93d3e8c30371b7d47b139e6891c9e49311c61cb963a"
I0314 01:11:54.008834 2164567 logs.go:123] Gathering logs for containerd ...
I0314 01:11:54.008871 2164567 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
I0314 01:11:54.075598 2164567 logs.go:123] Gathering logs for etcd [4b18a1225338f6b055a8ed1e1d1fdf13dc3e26f2d1c4e57dacd35453fb92208b] ...
I0314 01:11:54.075639 2164567 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 4b18a1225338f6b055a8ed1e1d1fdf13dc3e26f2d1c4e57dacd35453fb92208b"
I0314 01:11:54.140283 2164567 logs.go:123] Gathering logs for coredns [f951ff206e24865e25fedf9d07490b40ff93469bd720cec184189041d9aebee0] ...
I0314 01:11:54.140316 2164567 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 f951ff206e24865e25fedf9d07490b40ff93469bd720cec184189041d9aebee0"
I0314 01:11:54.191701 2164567 logs.go:123] Gathering logs for coredns [fce51585db2ccb145151be13dcfb93f128f9c83b3d5057ed298f4c72a4923602] ...
I0314 01:11:54.191735 2164567 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 fce51585db2ccb145151be13dcfb93f128f9c83b3d5057ed298f4c72a4923602"
I0314 01:11:54.240460 2164567 logs.go:123] Gathering logs for container status ...
I0314 01:11:54.240493 2164567 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0314 01:11:52.112760 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:11:54.613992 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:11:56.810101 2164567 api_server.go:253] Checking apiserver healthz at https://192.168.85.2:8443/healthz ...
I0314 01:11:56.818426 2164567 api_server.go:279] https://192.168.85.2:8443/healthz returned 200:
ok
I0314 01:11:56.819859 2164567 api_server.go:141] control plane version: v1.29.0-rc.2
I0314 01:11:56.819885 2164567 api_server.go:131] duration metric: took 4.166154215s to wait for apiserver health ...
I0314 01:11:56.819893 2164567 system_pods.go:43] waiting for kube-system pods to appear ...
I0314 01:11:56.819915 2164567 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
I0314 01:11:56.820017 2164567 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0314 01:11:56.872334 2164567 cri.go:89] found id: "83e70fac6fc9f0a4771305e9540a6589461cc3a2484f50ba174557b1f4dd17a6"
I0314 01:11:56.872369 2164567 cri.go:89] found id: "35a448a37fe417bd5ef90a5f2619fd285e7f7b440884d6ac9bf11cbb9b611a8f"
I0314 01:11:56.872375 2164567 cri.go:89] found id: ""
I0314 01:11:56.872383 2164567 logs.go:276] 2 containers: [83e70fac6fc9f0a4771305e9540a6589461cc3a2484f50ba174557b1f4dd17a6 35a448a37fe417bd5ef90a5f2619fd285e7f7b440884d6ac9bf11cbb9b611a8f]
I0314 01:11:56.872456 2164567 ssh_runner.go:195] Run: which crictl
I0314 01:11:56.876181 2164567 ssh_runner.go:195] Run: which crictl
I0314 01:11:56.879922 2164567 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
I0314 01:11:56.879994 2164567 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0314 01:11:56.922114 2164567 cri.go:89] found id: "edd6991f7b2f89493036abb17b74cda6026808614734286a5086dd892d4d83f4"
I0314 01:11:56.922136 2164567 cri.go:89] found id: "4b18a1225338f6b055a8ed1e1d1fdf13dc3e26f2d1c4e57dacd35453fb92208b"
I0314 01:11:56.922141 2164567 cri.go:89] found id: ""
I0314 01:11:56.922163 2164567 logs.go:276] 2 containers: [edd6991f7b2f89493036abb17b74cda6026808614734286a5086dd892d4d83f4 4b18a1225338f6b055a8ed1e1d1fdf13dc3e26f2d1c4e57dacd35453fb92208b]
I0314 01:11:56.922245 2164567 ssh_runner.go:195] Run: which crictl
I0314 01:11:56.926094 2164567 ssh_runner.go:195] Run: which crictl
I0314 01:11:56.929799 2164567 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
I0314 01:11:56.929901 2164567 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0314 01:11:56.968442 2164567 cri.go:89] found id: "f951ff206e24865e25fedf9d07490b40ff93469bd720cec184189041d9aebee0"
I0314 01:11:56.968463 2164567 cri.go:89] found id: "fce51585db2ccb145151be13dcfb93f128f9c83b3d5057ed298f4c72a4923602"
I0314 01:11:56.968468 2164567 cri.go:89] found id: ""
I0314 01:11:56.968476 2164567 logs.go:276] 2 containers: [f951ff206e24865e25fedf9d07490b40ff93469bd720cec184189041d9aebee0 fce51585db2ccb145151be13dcfb93f128f9c83b3d5057ed298f4c72a4923602]
I0314 01:11:56.968562 2164567 ssh_runner.go:195] Run: which crictl
I0314 01:11:56.972410 2164567 ssh_runner.go:195] Run: which crictl
I0314 01:11:56.976728 2164567 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
I0314 01:11:56.976822 2164567 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0314 01:11:57.018304 2164567 cri.go:89] found id: "1831385fcf3d81ce237870ecb4323a71c6f6032b775571ce1bfd9b1aa401f240"
I0314 01:11:57.018326 2164567 cri.go:89] found id: "f879b7c53550f5f73f52a19c81373092a43f07fa2c0eab968e4ca6e842db66ad"
I0314 01:11:57.018332 2164567 cri.go:89] found id: ""
I0314 01:11:57.018339 2164567 logs.go:276] 2 containers: [1831385fcf3d81ce237870ecb4323a71c6f6032b775571ce1bfd9b1aa401f240 f879b7c53550f5f73f52a19c81373092a43f07fa2c0eab968e4ca6e842db66ad]
I0314 01:11:57.018426 2164567 ssh_runner.go:195] Run: which crictl
I0314 01:11:57.022688 2164567 ssh_runner.go:195] Run: which crictl
I0314 01:11:57.027150 2164567 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
I0314 01:11:57.027284 2164567 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0314 01:11:57.074795 2164567 cri.go:89] found id: "785351628119d6ad774adc88f0d82526af3626432b44b411d9c17da27d8784d1"
I0314 01:11:57.074825 2164567 cri.go:89] found id: "5b506479b9f8549a1328dcd0ed478bc43502c6dc60ed26325977136263ab523c"
I0314 01:11:57.074830 2164567 cri.go:89] found id: ""
I0314 01:11:57.074845 2164567 logs.go:276] 2 containers: [785351628119d6ad774adc88f0d82526af3626432b44b411d9c17da27d8784d1 5b506479b9f8549a1328dcd0ed478bc43502c6dc60ed26325977136263ab523c]
I0314 01:11:57.074915 2164567 ssh_runner.go:195] Run: which crictl
I0314 01:11:57.079429 2164567 ssh_runner.go:195] Run: which crictl
I0314 01:11:57.083908 2164567 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
I0314 01:11:57.083988 2164567 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0314 01:11:57.131994 2164567 cri.go:89] found id: "989c71405847bd5f227e2c830feb302d068f9ba20658db76cdd765f46c08880f"
I0314 01:11:57.132017 2164567 cri.go:89] found id: "dedbba40a1e0160ff417b93d3e8c30371b7d47b139e6891c9e49311c61cb963a"
I0314 01:11:57.132022 2164567 cri.go:89] found id: ""
I0314 01:11:57.132029 2164567 logs.go:276] 2 containers: [989c71405847bd5f227e2c830feb302d068f9ba20658db76cdd765f46c08880f dedbba40a1e0160ff417b93d3e8c30371b7d47b139e6891c9e49311c61cb963a]
I0314 01:11:57.132089 2164567 ssh_runner.go:195] Run: which crictl
I0314 01:11:57.136043 2164567 ssh_runner.go:195] Run: which crictl
I0314 01:11:57.140277 2164567 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
I0314 01:11:57.140404 2164567 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0314 01:11:57.183416 2164567 cri.go:89] found id: "4a9251917031e35e335bf4d8b0a039d7e6d52c246bb42616850a1b8ac39049af"
I0314 01:11:57.183438 2164567 cri.go:89] found id: "2d000a4f5e324dc6ef2641ef49e48ce29f1951ae66fae9eba1637086079d822f"
I0314 01:11:57.183443 2164567 cri.go:89] found id: ""
I0314 01:11:57.183450 2164567 logs.go:276] 2 containers: [4a9251917031e35e335bf4d8b0a039d7e6d52c246bb42616850a1b8ac39049af 2d000a4f5e324dc6ef2641ef49e48ce29f1951ae66fae9eba1637086079d822f]
I0314 01:11:57.183507 2164567 ssh_runner.go:195] Run: which crictl
I0314 01:11:57.187360 2164567 ssh_runner.go:195] Run: which crictl
I0314 01:11:57.191010 2164567 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
I0314 01:11:57.191098 2164567 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I0314 01:11:57.236121 2164567 cri.go:89] found id: "f87d7177a951ec4f55aba7a435db0cc522f86ad118288135c55ea54eb077660a"
I0314 01:11:57.236188 2164567 cri.go:89] found id: ""
I0314 01:11:57.236203 2164567 logs.go:276] 1 containers: [f87d7177a951ec4f55aba7a435db0cc522f86ad118288135c55ea54eb077660a]
I0314 01:11:57.236268 2164567 ssh_runner.go:195] Run: which crictl
I0314 01:11:57.240157 2164567 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
I0314 01:11:57.240230 2164567 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0314 01:11:57.279792 2164567 cri.go:89] found id: "4f2288296aec7700bd2c07880a695239698b441d793a71041c1b77e5e2605cf4"
I0314 01:11:57.279835 2164567 cri.go:89] found id: "ab9f905640559b9ba4c07f291aa488bc62ba2563d3e461c125a650b1b9613d8f"
I0314 01:11:57.279840 2164567 cri.go:89] found id: ""
I0314 01:11:57.279847 2164567 logs.go:276] 2 containers: [4f2288296aec7700bd2c07880a695239698b441d793a71041c1b77e5e2605cf4 ab9f905640559b9ba4c07f291aa488bc62ba2563d3e461c125a650b1b9613d8f]
I0314 01:11:57.279923 2164567 ssh_runner.go:195] Run: which crictl
I0314 01:11:57.283585 2164567 ssh_runner.go:195] Run: which crictl
I0314 01:11:57.287068 2164567 logs.go:123] Gathering logs for kube-apiserver [83e70fac6fc9f0a4771305e9540a6589461cc3a2484f50ba174557b1f4dd17a6] ...
I0314 01:11:57.287092 2164567 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 83e70fac6fc9f0a4771305e9540a6589461cc3a2484f50ba174557b1f4dd17a6"
I0314 01:11:57.354684 2164567 logs.go:123] Gathering logs for kube-scheduler [f879b7c53550f5f73f52a19c81373092a43f07fa2c0eab968e4ca6e842db66ad] ...
I0314 01:11:57.354875 2164567 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 f879b7c53550f5f73f52a19c81373092a43f07fa2c0eab968e4ca6e842db66ad"
I0314 01:11:57.395125 2164567 logs.go:123] Gathering logs for kube-controller-manager [989c71405847bd5f227e2c830feb302d068f9ba20658db76cdd765f46c08880f] ...
I0314 01:11:57.395152 2164567 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 989c71405847bd5f227e2c830feb302d068f9ba20658db76cdd765f46c08880f"
I0314 01:11:57.454958 2164567 logs.go:123] Gathering logs for kindnet [2d000a4f5e324dc6ef2641ef49e48ce29f1951ae66fae9eba1637086079d822f] ...
I0314 01:11:57.454991 2164567 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 2d000a4f5e324dc6ef2641ef49e48ce29f1951ae66fae9eba1637086079d822f"
I0314 01:11:57.491878 2164567 logs.go:123] Gathering logs for storage-provisioner [ab9f905640559b9ba4c07f291aa488bc62ba2563d3e461c125a650b1b9613d8f] ...
I0314 01:11:57.491905 2164567 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 ab9f905640559b9ba4c07f291aa488bc62ba2563d3e461c125a650b1b9613d8f"
I0314 01:11:57.529340 2164567 logs.go:123] Gathering logs for kubelet ...
I0314 01:11:57.529370 2164567 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0314 01:11:57.605640 2164567 logs.go:123] Gathering logs for kube-apiserver [35a448a37fe417bd5ef90a5f2619fd285e7f7b440884d6ac9bf11cbb9b611a8f] ...
I0314 01:11:57.605679 2164567 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 35a448a37fe417bd5ef90a5f2619fd285e7f7b440884d6ac9bf11cbb9b611a8f"
I0314 01:11:57.663096 2164567 logs.go:123] Gathering logs for coredns [f951ff206e24865e25fedf9d07490b40ff93469bd720cec184189041d9aebee0] ...
I0314 01:11:57.663127 2164567 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 f951ff206e24865e25fedf9d07490b40ff93469bd720cec184189041d9aebee0"
I0314 01:11:57.705627 2164567 logs.go:123] Gathering logs for container status ...
I0314 01:11:57.705656 2164567 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0314 01:11:57.749919 2164567 logs.go:123] Gathering logs for dmesg ...
I0314 01:11:57.749954 2164567 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0314 01:11:57.774608 2164567 logs.go:123] Gathering logs for describe nodes ...
I0314 01:11:57.774682 2164567 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0314 01:11:57.921180 2164567 logs.go:123] Gathering logs for etcd [edd6991f7b2f89493036abb17b74cda6026808614734286a5086dd892d4d83f4] ...
I0314 01:11:57.921213 2164567 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 edd6991f7b2f89493036abb17b74cda6026808614734286a5086dd892d4d83f4"
I0314 01:11:57.974100 2164567 logs.go:123] Gathering logs for kube-proxy [5b506479b9f8549a1328dcd0ed478bc43502c6dc60ed26325977136263ab523c] ...
I0314 01:11:57.974130 2164567 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 5b506479b9f8549a1328dcd0ed478bc43502c6dc60ed26325977136263ab523c"
I0314 01:11:58.017633 2164567 logs.go:123] Gathering logs for kindnet [4a9251917031e35e335bf4d8b0a039d7e6d52c246bb42616850a1b8ac39049af] ...
I0314 01:11:58.017717 2164567 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 4a9251917031e35e335bf4d8b0a039d7e6d52c246bb42616850a1b8ac39049af"
I0314 01:11:58.065294 2164567 logs.go:123] Gathering logs for kubernetes-dashboard [f87d7177a951ec4f55aba7a435db0cc522f86ad118288135c55ea54eb077660a] ...
I0314 01:11:58.065324 2164567 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 f87d7177a951ec4f55aba7a435db0cc522f86ad118288135c55ea54eb077660a"
I0314 01:11:58.113334 2164567 logs.go:123] Gathering logs for containerd ...
I0314 01:11:58.113359 2164567 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
I0314 01:11:58.177812 2164567 logs.go:123] Gathering logs for etcd [4b18a1225338f6b055a8ed1e1d1fdf13dc3e26f2d1c4e57dacd35453fb92208b] ...
I0314 01:11:58.177849 2164567 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 4b18a1225338f6b055a8ed1e1d1fdf13dc3e26f2d1c4e57dacd35453fb92208b"
I0314 01:11:58.225875 2164567 logs.go:123] Gathering logs for coredns [fce51585db2ccb145151be13dcfb93f128f9c83b3d5057ed298f4c72a4923602] ...
I0314 01:11:58.225905 2164567 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 fce51585db2ccb145151be13dcfb93f128f9c83b3d5057ed298f4c72a4923602"
I0314 01:11:58.292330 2164567 logs.go:123] Gathering logs for kube-scheduler [1831385fcf3d81ce237870ecb4323a71c6f6032b775571ce1bfd9b1aa401f240] ...
I0314 01:11:58.292359 2164567 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 1831385fcf3d81ce237870ecb4323a71c6f6032b775571ce1bfd9b1aa401f240"
I0314 01:11:58.348687 2164567 logs.go:123] Gathering logs for kube-proxy [785351628119d6ad774adc88f0d82526af3626432b44b411d9c17da27d8784d1] ...
I0314 01:11:58.348722 2164567 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 785351628119d6ad774adc88f0d82526af3626432b44b411d9c17da27d8784d1"
I0314 01:11:58.391006 2164567 logs.go:123] Gathering logs for kube-controller-manager [dedbba40a1e0160ff417b93d3e8c30371b7d47b139e6891c9e49311c61cb963a] ...
I0314 01:11:58.391033 2164567 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 dedbba40a1e0160ff417b93d3e8c30371b7d47b139e6891c9e49311c61cb963a"
I0314 01:11:58.447997 2164567 logs.go:123] Gathering logs for storage-provisioner [4f2288296aec7700bd2c07880a695239698b441d793a71041c1b77e5e2605cf4] ...
I0314 01:11:58.448033 2164567 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 4f2288296aec7700bd2c07880a695239698b441d793a71041c1b77e5e2605cf4"
I0314 01:12:00.996775 2164567 system_pods.go:59] 9 kube-system pods found
I0314 01:12:00.996893 2164567 system_pods.go:61] "coredns-76f75df574-b679l" [a8613488-4868-46b5-87c7-cfb9393c5067] Running
I0314 01:12:00.996917 2164567 system_pods.go:61] "etcd-no-preload-183952" [463211fe-6381-4a32-971f-6670ad9ab255] Running
I0314 01:12:00.996938 2164567 system_pods.go:61] "kindnet-889cc" [0e1acc6d-a249-46e2-89e4-f213ac85b312] Running
I0314 01:12:00.996967 2164567 system_pods.go:61] "kube-apiserver-no-preload-183952" [01a9effa-64f4-4d5c-99a6-5ba546d57dd1] Running
I0314 01:12:00.996988 2164567 system_pods.go:61] "kube-controller-manager-no-preload-183952" [427f665d-a800-401d-8fbc-fc6cfb574ebc] Running
I0314 01:12:00.997006 2164567 system_pods.go:61] "kube-proxy-h2xc2" [1d2e62a6-bcb8-406f-8028-e27659e92061] Running
I0314 01:12:00.997026 2164567 system_pods.go:61] "kube-scheduler-no-preload-183952" [d0655f60-196e-4e20-b738-13e2c6c93488] Running
I0314 01:12:00.997057 2164567 system_pods.go:61] "metrics-server-57f55c9bc5-hk6xd" [aea50b1c-2546-4ae8-b466-7b98beded458] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0314 01:12:00.997079 2164567 system_pods.go:61] "storage-provisioner" [ce4f8840-68d4-4fdb-9d98-10eb7b0a6e13] Running
I0314 01:12:00.997103 2164567 system_pods.go:74] duration metric: took 4.177203101s to wait for pod list to return data ...
I0314 01:12:00.997132 2164567 default_sa.go:34] waiting for default service account to be created ...
I0314 01:12:01.003476 2164567 default_sa.go:45] found service account: "default"
I0314 01:12:01.003502 2164567 default_sa.go:55] duration metric: took 6.34932ms for default service account to be created ...
I0314 01:12:01.003513 2164567 system_pods.go:116] waiting for k8s-apps to be running ...
I0314 01:12:01.012101 2164567 system_pods.go:86] 9 kube-system pods found
I0314 01:12:01.012204 2164567 system_pods.go:89] "coredns-76f75df574-b679l" [a8613488-4868-46b5-87c7-cfb9393c5067] Running
I0314 01:12:01.012229 2164567 system_pods.go:89] "etcd-no-preload-183952" [463211fe-6381-4a32-971f-6670ad9ab255] Running
I0314 01:12:01.012250 2164567 system_pods.go:89] "kindnet-889cc" [0e1acc6d-a249-46e2-89e4-f213ac85b312] Running
I0314 01:12:01.012271 2164567 system_pods.go:89] "kube-apiserver-no-preload-183952" [01a9effa-64f4-4d5c-99a6-5ba546d57dd1] Running
I0314 01:12:01.012292 2164567 system_pods.go:89] "kube-controller-manager-no-preload-183952" [427f665d-a800-401d-8fbc-fc6cfb574ebc] Running
I0314 01:12:01.012313 2164567 system_pods.go:89] "kube-proxy-h2xc2" [1d2e62a6-bcb8-406f-8028-e27659e92061] Running
I0314 01:12:01.012332 2164567 system_pods.go:89] "kube-scheduler-no-preload-183952" [d0655f60-196e-4e20-b738-13e2c6c93488] Running
I0314 01:12:01.012357 2164567 system_pods.go:89] "metrics-server-57f55c9bc5-hk6xd" [aea50b1c-2546-4ae8-b466-7b98beded458] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0314 01:12:01.012383 2164567 system_pods.go:89] "storage-provisioner" [ce4f8840-68d4-4fdb-9d98-10eb7b0a6e13] Running
I0314 01:12:01.012415 2164567 system_pods.go:126] duration metric: took 8.894601ms to wait for k8s-apps to be running ...
I0314 01:12:01.012443 2164567 system_svc.go:44] waiting for kubelet service to be running ....
I0314 01:12:01.012520 2164567 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0314 01:12:01.031440 2164567 system_svc.go:56] duration metric: took 18.988555ms WaitForService to wait for kubelet
I0314 01:12:01.031515 2164567 kubeadm.go:576] duration metric: took 4m33.178431843s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0314 01:12:01.031551 2164567 node_conditions.go:102] verifying NodePressure condition ...
I0314 01:12:01.039637 2164567 node_conditions.go:122] node storage ephemeral capacity is 203034800Ki
I0314 01:12:01.039720 2164567 node_conditions.go:123] node cpu capacity is 2
I0314 01:12:01.039748 2164567 node_conditions.go:105] duration metric: took 8.176632ms to run NodePressure ...
I0314 01:12:01.039773 2164567 start.go:240] waiting for startup goroutines ...
I0314 01:12:01.039807 2164567 start.go:245] waiting for cluster config update ...
I0314 01:12:01.039832 2164567 start.go:254] writing updated cluster config ...
I0314 01:12:01.040149 2164567 ssh_runner.go:195] Run: rm -f paused
I0314 01:12:01.135241 2164567 start.go:600] kubectl: 1.29.2, cluster: 1.29.0-rc.2 (minor skew: 0)
I0314 01:12:01.142209 2164567 out.go:177] * Done! kubectl is now configured to use "no-preload-183952" cluster and "default" namespace by default
I0314 01:11:57.113242 2159335 pod_ready.go:102] pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace has status "Ready":"False"
I0314 01:11:59.112719 2159335 pod_ready.go:81] duration metric: took 4m0.006577259s for pod "metrics-server-9975d5f86-prnsg" in "kube-system" namespace to be "Ready" ...
E0314 01:11:59.112744 2159335 pod_ready.go:66] WaitExtra: waitPodCondition: context deadline exceeded
I0314 01:11:59.112753 2159335 pod_ready.go:38] duration metric: took 5m30.159634759s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0314 01:11:59.112778 2159335 api_server.go:52] waiting for apiserver process to appear ...
I0314 01:11:59.112807 2159335 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
I0314 01:11:59.112872 2159335 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0314 01:11:59.158140 2159335 cri.go:89] found id: "fdb44b3f1b8bfa78a5d1d74ef6b0613a584997cf3688d648110b83847d6bfbb7"
I0314 01:11:59.158161 2159335 cri.go:89] found id: "cf476c9051e98ad0797f500808cadc3fa875ce3d5892a9524d352ac49530d1c7"
I0314 01:11:59.158165 2159335 cri.go:89] found id: ""
I0314 01:11:59.158172 2159335 logs.go:276] 2 containers: [fdb44b3f1b8bfa78a5d1d74ef6b0613a584997cf3688d648110b83847d6bfbb7 cf476c9051e98ad0797f500808cadc3fa875ce3d5892a9524d352ac49530d1c7]
I0314 01:11:59.158245 2159335 ssh_runner.go:195] Run: which crictl
I0314 01:11:59.161848 2159335 ssh_runner.go:195] Run: which crictl
I0314 01:11:59.165307 2159335 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
I0314 01:11:59.165397 2159335 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0314 01:11:59.203039 2159335 cri.go:89] found id: "262c4ec2f8f3eb8483e1462b0685a765d10399ebc85e0a7f520af4504e9e469f"
I0314 01:11:59.203063 2159335 cri.go:89] found id: "1c0e3f86261a4182fbe7a919791938f3f1b269a39c811b556df8aa8f15b310f1"
I0314 01:11:59.203067 2159335 cri.go:89] found id: ""
I0314 01:11:59.203075 2159335 logs.go:276] 2 containers: [262c4ec2f8f3eb8483e1462b0685a765d10399ebc85e0a7f520af4504e9e469f 1c0e3f86261a4182fbe7a919791938f3f1b269a39c811b556df8aa8f15b310f1]
I0314 01:11:59.203161 2159335 ssh_runner.go:195] Run: which crictl
I0314 01:11:59.206505 2159335 ssh_runner.go:195] Run: which crictl
I0314 01:11:59.209749 2159335 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
I0314 01:11:59.209832 2159335 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0314 01:11:59.249575 2159335 cri.go:89] found id: "577d3087fa040f93f9110c5070c4732f3d9c28a3063dad9f5fb63d2cb714c5d1"
I0314 01:11:59.249595 2159335 cri.go:89] found id: "7d7e6014fc3038892fc04a7ac247dec3563fd4e1a68251761f5191e67aa3d29c"
I0314 01:11:59.249600 2159335 cri.go:89] found id: ""
I0314 01:11:59.249607 2159335 logs.go:276] 2 containers: [577d3087fa040f93f9110c5070c4732f3d9c28a3063dad9f5fb63d2cb714c5d1 7d7e6014fc3038892fc04a7ac247dec3563fd4e1a68251761f5191e67aa3d29c]
I0314 01:11:59.249661 2159335 ssh_runner.go:195] Run: which crictl
I0314 01:11:59.253180 2159335 ssh_runner.go:195] Run: which crictl
I0314 01:11:59.256325 2159335 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
I0314 01:11:59.256395 2159335 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0314 01:11:59.293600 2159335 cri.go:89] found id: "abe11e046f972c9c239dc5503ce7b4e6abdb261d19262a88ebf1157e26888704"
I0314 01:11:59.293620 2159335 cri.go:89] found id: "89cecf527c72212c9774ad52dd4fdf563d5e162b2b3c0590daf1a40383e5f87c"
I0314 01:11:59.293625 2159335 cri.go:89] found id: ""
I0314 01:11:59.293632 2159335 logs.go:276] 2 containers: [abe11e046f972c9c239dc5503ce7b4e6abdb261d19262a88ebf1157e26888704 89cecf527c72212c9774ad52dd4fdf563d5e162b2b3c0590daf1a40383e5f87c]
I0314 01:11:59.293691 2159335 ssh_runner.go:195] Run: which crictl
I0314 01:11:59.297072 2159335 ssh_runner.go:195] Run: which crictl
I0314 01:11:59.300603 2159335 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
I0314 01:11:59.300711 2159335 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0314 01:11:59.343506 2159335 cri.go:89] found id: "a649cec0099ad8c4f2f59cb4643ea18e343945d9edac27d0c1542055b2ce681c"
I0314 01:11:59.343573 2159335 cri.go:89] found id: "36947fb39456b70b586f2321c1589d336fbf8121fcabf5f669409c9680ddc202"
I0314 01:11:59.343585 2159335 cri.go:89] found id: ""
I0314 01:11:59.343593 2159335 logs.go:276] 2 containers: [a649cec0099ad8c4f2f59cb4643ea18e343945d9edac27d0c1542055b2ce681c 36947fb39456b70b586f2321c1589d336fbf8121fcabf5f669409c9680ddc202]
I0314 01:11:59.343650 2159335 ssh_runner.go:195] Run: which crictl
I0314 01:11:59.347304 2159335 ssh_runner.go:195] Run: which crictl
I0314 01:11:59.350557 2159335 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
I0314 01:11:59.350629 2159335 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0314 01:11:59.391928 2159335 cri.go:89] found id: "c79d313c53d51ee00f93e8076ad26cc072bc1abea5f1a5b6a64db439ffbbd272"
I0314 01:11:59.391991 2159335 cri.go:89] found id: "00c36bf0f8362e90a4a6eb52e67b0fde8d3b9e110159c37ce5cff0a34795231b"
I0314 01:11:59.392003 2159335 cri.go:89] found id: ""
I0314 01:11:59.392011 2159335 logs.go:276] 2 containers: [c79d313c53d51ee00f93e8076ad26cc072bc1abea5f1a5b6a64db439ffbbd272 00c36bf0f8362e90a4a6eb52e67b0fde8d3b9e110159c37ce5cff0a34795231b]
I0314 01:11:59.392078 2159335 ssh_runner.go:195] Run: which crictl
I0314 01:11:59.395688 2159335 ssh_runner.go:195] Run: which crictl
I0314 01:11:59.399092 2159335 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
I0314 01:11:59.399186 2159335 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0314 01:11:59.437453 2159335 cri.go:89] found id: "661201637b62150c5e65fb761af09186766a8c5ee343b157bd78587674493702"
I0314 01:11:59.437476 2159335 cri.go:89] found id: "251c6cdd00905f46268a5714aa17f44694250fe47496912c484048b8908e5650"
I0314 01:11:59.437481 2159335 cri.go:89] found id: ""
I0314 01:11:59.437488 2159335 logs.go:276] 2 containers: [661201637b62150c5e65fb761af09186766a8c5ee343b157bd78587674493702 251c6cdd00905f46268a5714aa17f44694250fe47496912c484048b8908e5650]
I0314 01:11:59.437547 2159335 ssh_runner.go:195] Run: which crictl
I0314 01:11:59.441203 2159335 ssh_runner.go:195] Run: which crictl
I0314 01:11:59.444733 2159335 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
I0314 01:11:59.444868 2159335 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I0314 01:11:59.483655 2159335 cri.go:89] found id: "c83ee544525cae8ae275b356afc7ab3e13354a5bfdc13e46d3bb967974cc4fd4"
I0314 01:11:59.483715 2159335 cri.go:89] found id: ""
I0314 01:11:59.483747 2159335 logs.go:276] 1 containers: [c83ee544525cae8ae275b356afc7ab3e13354a5bfdc13e46d3bb967974cc4fd4]
I0314 01:11:59.483834 2159335 ssh_runner.go:195] Run: which crictl
I0314 01:11:59.487513 2159335 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
I0314 01:11:59.487586 2159335 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0314 01:11:59.527664 2159335 cri.go:89] found id: "0378f91f5f30bc555d7408bc86dd626b1d5ffeb38145d3ee69160c360c8f3416"
I0314 01:11:59.527685 2159335 cri.go:89] found id: "4e7dc51c48baacd42a05abe380200f2d6c242433155f704a890e45913c11586c"
I0314 01:11:59.527690 2159335 cri.go:89] found id: ""
I0314 01:11:59.527697 2159335 logs.go:276] 2 containers: [0378f91f5f30bc555d7408bc86dd626b1d5ffeb38145d3ee69160c360c8f3416 4e7dc51c48baacd42a05abe380200f2d6c242433155f704a890e45913c11586c]
I0314 01:11:59.527760 2159335 ssh_runner.go:195] Run: which crictl
I0314 01:11:59.531427 2159335 ssh_runner.go:195] Run: which crictl
I0314 01:11:59.534848 2159335 logs.go:123] Gathering logs for coredns [7d7e6014fc3038892fc04a7ac247dec3563fd4e1a68251761f5191e67aa3d29c] ...
I0314 01:11:59.534873 2159335 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 7d7e6014fc3038892fc04a7ac247dec3563fd4e1a68251761f5191e67aa3d29c"
I0314 01:11:59.580402 2159335 logs.go:123] Gathering logs for kube-proxy [a649cec0099ad8c4f2f59cb4643ea18e343945d9edac27d0c1542055b2ce681c] ...
I0314 01:11:59.580430 2159335 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 a649cec0099ad8c4f2f59cb4643ea18e343945d9edac27d0c1542055b2ce681c"
I0314 01:11:59.621026 2159335 logs.go:123] Gathering logs for kindnet [251c6cdd00905f46268a5714aa17f44694250fe47496912c484048b8908e5650] ...
I0314 01:11:59.621056 2159335 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 251c6cdd00905f46268a5714aa17f44694250fe47496912c484048b8908e5650"
I0314 01:11:59.659038 2159335 logs.go:123] Gathering logs for kubernetes-dashboard [c83ee544525cae8ae275b356afc7ab3e13354a5bfdc13e46d3bb967974cc4fd4] ...
I0314 01:11:59.659065 2159335 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 c83ee544525cae8ae275b356afc7ab3e13354a5bfdc13e46d3bb967974cc4fd4"
I0314 01:11:59.701741 2159335 logs.go:123] Gathering logs for containerd ...
I0314 01:11:59.701769 2159335 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
I0314 01:11:59.765300 2159335 logs.go:123] Gathering logs for dmesg ...
I0314 01:11:59.765335 2159335 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0314 01:11:59.790417 2159335 logs.go:123] Gathering logs for etcd [262c4ec2f8f3eb8483e1462b0685a765d10399ebc85e0a7f520af4504e9e469f] ...
I0314 01:11:59.790445 2159335 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 262c4ec2f8f3eb8483e1462b0685a765d10399ebc85e0a7f520af4504e9e469f"
I0314 01:11:59.843121 2159335 logs.go:123] Gathering logs for coredns [577d3087fa040f93f9110c5070c4732f3d9c28a3063dad9f5fb63d2cb714c5d1] ...
I0314 01:11:59.843149 2159335 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 577d3087fa040f93f9110c5070c4732f3d9c28a3063dad9f5fb63d2cb714c5d1"
I0314 01:11:59.902029 2159335 logs.go:123] Gathering logs for container status ...
I0314 01:11:59.902056 2159335 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0314 01:11:59.992718 2159335 logs.go:123] Gathering logs for kubelet ...
I0314 01:11:59.992749 2159335 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0314 01:12:00.060282 2159335 logs.go:138] Found kubelet problem: Mar 14 01:06:28 old-k8s-version-023742 kubelet[662]: E0314 01:06:28.974732 662 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:old-k8s-version-023742" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-023742' and this object
W0314 01:12:00.060539 2159335 logs.go:138] Found kubelet problem: Mar 14 01:06:28 old-k8s-version-023742 kubelet[662]: E0314 01:06:28.974970 662 reflector.go:138] object-"kube-system"/"coredns": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:old-k8s-version-023742" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-023742' and this object
W0314 01:12:00.060774 2159335 logs.go:138] Found kubelet problem: Mar 14 01:06:28 old-k8s-version-023742 kubelet[662]: E0314 01:06:28.975144 662 reflector.go:138] object-"kube-system"/"coredns-token-25l2w": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "coredns-token-25l2w" is forbidden: User "system:node:old-k8s-version-023742" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-023742' and this object
W0314 01:12:00.061038 2159335 logs.go:138] Found kubelet problem: Mar 14 01:06:28 old-k8s-version-023742 kubelet[662]: E0314 01:06:28.975368 662 reflector.go:138] object-"kube-system"/"kindnet-token-5q9tx": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kindnet-token-5q9tx" is forbidden: User "system:node:old-k8s-version-023742" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-023742' and this object
W0314 01:12:00.061280 2159335 logs.go:138] Found kubelet problem: Mar 14 01:06:28 old-k8s-version-023742 kubelet[662]: E0314 01:06:28.975944 662 reflector.go:138] object-"kube-system"/"storage-provisioner-token-hcjsf": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "storage-provisioner-token-hcjsf" is forbidden: User "system:node:old-k8s-version-023742" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-023742' and this object
W0314 01:12:00.061494 2159335 logs.go:138] Found kubelet problem: Mar 14 01:06:28 old-k8s-version-023742 kubelet[662]: E0314 01:06:28.979394 662 reflector.go:138] object-"default"/"default-token-rpt2n": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "default-token-rpt2n" is forbidden: User "system:node:old-k8s-version-023742" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'old-k8s-version-023742' and this object
W0314 01:12:00.061719 2159335 logs.go:138] Found kubelet problem: Mar 14 01:06:28 old-k8s-version-023742 kubelet[662]: E0314 01:06:28.980058 662 reflector.go:138] object-"kube-system"/"metrics-server-token-zxqtp": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "metrics-server-token-zxqtp" is forbidden: User "system:node:old-k8s-version-023742" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-023742' and this object
W0314 01:12:00.061941 2159335 logs.go:138] Found kubelet problem: Mar 14 01:06:28 old-k8s-version-023742 kubelet[662]: E0314 01:06:28.980106 662 reflector.go:138] object-"kube-system"/"kube-proxy-token-g2rnq": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kube-proxy-token-g2rnq" is forbidden: User "system:node:old-k8s-version-023742" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-023742' and this object
W0314 01:12:00.070827 2159335 logs.go:138] Found kubelet problem: Mar 14 01:06:31 old-k8s-version-023742 kubelet[662]: E0314 01:06:31.370582 662 pod_workers.go:191] Error syncing pod 320a7d9f-62a0-45d2-b07d-657dc3bd1b28 ("metrics-server-9975d5f86-prnsg_kube-system(320a7d9f-62a0-45d2-b07d-657dc3bd1b28)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0314 01:12:00.073041 2159335 logs.go:138] Found kubelet problem: Mar 14 01:06:32 old-k8s-version-023742 kubelet[662]: E0314 01:06:32.031743 662 pod_workers.go:191] Error syncing pod 320a7d9f-62a0-45d2-b07d-657dc3bd1b28 ("metrics-server-9975d5f86-prnsg_kube-system(320a7d9f-62a0-45d2-b07d-657dc3bd1b28)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0314 01:12:00.075814 2159335 logs.go:138] Found kubelet problem: Mar 14 01:06:46 old-k8s-version-023742 kubelet[662]: E0314 01:06:46.773820 662 pod_workers.go:191] Error syncing pod 320a7d9f-62a0-45d2-b07d-657dc3bd1b28 ("metrics-server-9975d5f86-prnsg_kube-system(320a7d9f-62a0-45d2-b07d-657dc3bd1b28)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0314 01:12:00.076572 2159335 logs.go:138] Found kubelet problem: Mar 14 01:06:48 old-k8s-version-023742 kubelet[662]: E0314 01:06:48.034705 662 reflector.go:138] object-"kubernetes-dashboard"/"kubernetes-dashboard-token-wht5d": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kubernetes-dashboard-token-wht5d" is forbidden: User "system:node:old-k8s-version-023742" cannot list resource "secrets" in API group "" in the namespace "kubernetes-dashboard": no relationship found between node 'old-k8s-version-023742' and this object
W0314 01:12:00.078439 2159335 logs.go:138] Found kubelet problem: Mar 14 01:06:59 old-k8s-version-023742 kubelet[662]: E0314 01:06:59.151608 662 pod_workers.go:191] Error syncing pod 1e66610b-54fb-4a50-b7c1-47326c1c1c70 ("dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"
W0314 01:12:00.078625 2159335 logs.go:138] Found kubelet problem: Mar 14 01:06:59 old-k8s-version-023742 kubelet[662]: E0314 01:06:59.766765 662 pod_workers.go:191] Error syncing pod 320a7d9f-62a0-45d2-b07d-657dc3bd1b28 ("metrics-server-9975d5f86-prnsg_kube-system(320a7d9f-62a0-45d2-b07d-657dc3bd1b28)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0314 01:12:00.078953 2159335 logs.go:138] Found kubelet problem: Mar 14 01:07:00 old-k8s-version-023742 kubelet[662]: E0314 01:07:00.185170 662 pod_workers.go:191] Error syncing pod 1e66610b-54fb-4a50-b7c1-47326c1c1c70 ("dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"
W0314 01:12:00.079500 2159335 logs.go:138] Found kubelet problem: Mar 14 01:07:02 old-k8s-version-023742 kubelet[662]: E0314 01:07:02.195749 662 pod_workers.go:191] Error syncing pod 57373aa5-20c2-4873-b3e0-c1c27570f447 ("storage-provisioner_kube-system(57373aa5-20c2-4873-b3e0-c1c27570f447)"), skipping: failed to "StartContainer" for "storage-provisioner" with CrashLoopBackOff: "back-off 10s restarting failed container=storage-provisioner pod=storage-provisioner_kube-system(57373aa5-20c2-4873-b3e0-c1c27570f447)"
W0314 01:12:00.079839 2159335 logs.go:138] Found kubelet problem: Mar 14 01:07:03 old-k8s-version-023742 kubelet[662]: E0314 01:07:03.347757 662 pod_workers.go:191] Error syncing pod 1e66610b-54fb-4a50-b7c1-47326c1c1c70 ("dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"
W0314 01:12:00.082701 2159335 logs.go:138] Found kubelet problem: Mar 14 01:07:14 old-k8s-version-023742 kubelet[662]: E0314 01:07:14.815543 662 pod_workers.go:191] Error syncing pod 320a7d9f-62a0-45d2-b07d-657dc3bd1b28 ("metrics-server-9975d5f86-prnsg_kube-system(320a7d9f-62a0-45d2-b07d-657dc3bd1b28)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0314 01:12:00.083162 2159335 logs.go:138] Found kubelet problem: Mar 14 01:07:15 old-k8s-version-023742 kubelet[662]: E0314 01:07:15.222109 662 pod_workers.go:191] Error syncing pod 1e66610b-54fb-4a50-b7c1-47326c1c1c70 ("dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"
W0314 01:12:00.083775 2159335 logs.go:138] Found kubelet problem: Mar 14 01:07:23 old-k8s-version-023742 kubelet[662]: E0314 01:07:23.347695 662 pod_workers.go:191] Error syncing pod 1e66610b-54fb-4a50-b7c1-47326c1c1c70 ("dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"
W0314 01:12:00.083984 2159335 logs.go:138] Found kubelet problem: Mar 14 01:07:27 old-k8s-version-023742 kubelet[662]: E0314 01:07:27.771127 662 pod_workers.go:191] Error syncing pod 320a7d9f-62a0-45d2-b07d-657dc3bd1b28 ("metrics-server-9975d5f86-prnsg_kube-system(320a7d9f-62a0-45d2-b07d-657dc3bd1b28)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0314 01:12:00.084571 2159335 logs.go:138] Found kubelet problem: Mar 14 01:07:36 old-k8s-version-023742 kubelet[662]: E0314 01:07:36.268490 662 pod_workers.go:191] Error syncing pod 1e66610b-54fb-4a50-b7c1-47326c1c1c70 ("dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"
W0314 01:12:00.084759 2159335 logs.go:138] Found kubelet problem: Mar 14 01:07:38 old-k8s-version-023742 kubelet[662]: E0314 01:07:38.766381 662 pod_workers.go:191] Error syncing pod 320a7d9f-62a0-45d2-b07d-657dc3bd1b28 ("metrics-server-9975d5f86-prnsg_kube-system(320a7d9f-62a0-45d2-b07d-657dc3bd1b28)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0314 01:12:00.085087 2159335 logs.go:138] Found kubelet problem: Mar 14 01:07:43 old-k8s-version-023742 kubelet[662]: E0314 01:07:43.347263 662 pod_workers.go:191] Error syncing pod 1e66610b-54fb-4a50-b7c1-47326c1c1c70 ("dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"
W0314 01:12:00.085270 2159335 logs.go:138] Found kubelet problem: Mar 14 01:07:52 old-k8s-version-023742 kubelet[662]: E0314 01:07:52.766485 662 pod_workers.go:191] Error syncing pod 320a7d9f-62a0-45d2-b07d-657dc3bd1b28 ("metrics-server-9975d5f86-prnsg_kube-system(320a7d9f-62a0-45d2-b07d-657dc3bd1b28)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0314 01:12:00.085601 2159335 logs.go:138] Found kubelet problem: Mar 14 01:07:56 old-k8s-version-023742 kubelet[662]: E0314 01:07:56.766099 662 pod_workers.go:191] Error syncing pod 1e66610b-54fb-4a50-b7c1-47326c1c1c70 ("dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"
W0314 01:12:00.085925 2159335 logs.go:138] Found kubelet problem: Mar 14 01:08:07 old-k8s-version-023742 kubelet[662]: E0314 01:08:07.770729 662 pod_workers.go:191] Error syncing pod 1e66610b-54fb-4a50-b7c1-47326c1c1c70 ("dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"
W0314 01:12:00.088552 2159335 logs.go:138] Found kubelet problem: Mar 14 01:08:07 old-k8s-version-023742 kubelet[662]: E0314 01:08:07.790467 662 pod_workers.go:191] Error syncing pod 320a7d9f-62a0-45d2-b07d-657dc3bd1b28 ("metrics-server-9975d5f86-prnsg_kube-system(320a7d9f-62a0-45d2-b07d-657dc3bd1b28)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0314 01:12:00.089148 2159335 logs.go:138] Found kubelet problem: Mar 14 01:08:20 old-k8s-version-023742 kubelet[662]: E0314 01:08:20.365151 662 pod_workers.go:191] Error syncing pod 1e66610b-54fb-4a50-b7c1-47326c1c1c70 ("dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"
W0314 01:12:00.089334 2159335 logs.go:138] Found kubelet problem: Mar 14 01:08:20 old-k8s-version-023742 kubelet[662]: E0314 01:08:20.769752 662 pod_workers.go:191] Error syncing pod 320a7d9f-62a0-45d2-b07d-657dc3bd1b28 ("metrics-server-9975d5f86-prnsg_kube-system(320a7d9f-62a0-45d2-b07d-657dc3bd1b28)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0314 01:12:00.089658 2159335 logs.go:138] Found kubelet problem: Mar 14 01:08:23 old-k8s-version-023742 kubelet[662]: E0314 01:08:23.347539 662 pod_workers.go:191] Error syncing pod 1e66610b-54fb-4a50-b7c1-47326c1c1c70 ("dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"
W0314 01:12:00.089844 2159335 logs.go:138] Found kubelet problem: Mar 14 01:08:32 old-k8s-version-023742 kubelet[662]: E0314 01:08:32.767876 662 pod_workers.go:191] Error syncing pod 320a7d9f-62a0-45d2-b07d-657dc3bd1b28 ("metrics-server-9975d5f86-prnsg_kube-system(320a7d9f-62a0-45d2-b07d-657dc3bd1b28)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0314 01:12:00.090188 2159335 logs.go:138] Found kubelet problem: Mar 14 01:08:35 old-k8s-version-023742 kubelet[662]: E0314 01:08:35.771384 662 pod_workers.go:191] Error syncing pod 1e66610b-54fb-4a50-b7c1-47326c1c1c70 ("dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"
W0314 01:12:00.090369 2159335 logs.go:138] Found kubelet problem: Mar 14 01:08:43 old-k8s-version-023742 kubelet[662]: E0314 01:08:43.766453 662 pod_workers.go:191] Error syncing pod 320a7d9f-62a0-45d2-b07d-657dc3bd1b28 ("metrics-server-9975d5f86-prnsg_kube-system(320a7d9f-62a0-45d2-b07d-657dc3bd1b28)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0314 01:12:00.090695 2159335 logs.go:138] Found kubelet problem: Mar 14 01:08:49 old-k8s-version-023742 kubelet[662]: E0314 01:08:49.766428 662 pod_workers.go:191] Error syncing pod 1e66610b-54fb-4a50-b7c1-47326c1c1c70 ("dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"
W0314 01:12:00.090874 2159335 logs.go:138] Found kubelet problem: Mar 14 01:08:58 old-k8s-version-023742 kubelet[662]: E0314 01:08:58.766502 662 pod_workers.go:191] Error syncing pod 320a7d9f-62a0-45d2-b07d-657dc3bd1b28 ("metrics-server-9975d5f86-prnsg_kube-system(320a7d9f-62a0-45d2-b07d-657dc3bd1b28)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0314 01:12:00.091194 2159335 logs.go:138] Found kubelet problem: Mar 14 01:09:02 old-k8s-version-023742 kubelet[662]: E0314 01:09:02.765978 662 pod_workers.go:191] Error syncing pod 1e66610b-54fb-4a50-b7c1-47326c1c1c70 ("dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"
W0314 01:12:00.091387 2159335 logs.go:138] Found kubelet problem: Mar 14 01:09:12 old-k8s-version-023742 kubelet[662]: E0314 01:09:12.766341 662 pod_workers.go:191] Error syncing pod 320a7d9f-62a0-45d2-b07d-657dc3bd1b28 ("metrics-server-9975d5f86-prnsg_kube-system(320a7d9f-62a0-45d2-b07d-657dc3bd1b28)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0314 01:12:00.091707 2159335 logs.go:138] Found kubelet problem: Mar 14 01:09:16 old-k8s-version-023742 kubelet[662]: E0314 01:09:16.766009 662 pod_workers.go:191] Error syncing pod 1e66610b-54fb-4a50-b7c1-47326c1c1c70 ("dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"
W0314 01:12:00.091896 2159335 logs.go:138] Found kubelet problem: Mar 14 01:09:25 old-k8s-version-023742 kubelet[662]: E0314 01:09:25.766322 662 pod_workers.go:191] Error syncing pod 320a7d9f-62a0-45d2-b07d-657dc3bd1b28 ("metrics-server-9975d5f86-prnsg_kube-system(320a7d9f-62a0-45d2-b07d-657dc3bd1b28)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0314 01:12:00.092219 2159335 logs.go:138] Found kubelet problem: Mar 14 01:09:29 old-k8s-version-023742 kubelet[662]: E0314 01:09:29.766880 662 pod_workers.go:191] Error syncing pod 1e66610b-54fb-4a50-b7c1-47326c1c1c70 ("dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"
W0314 01:12:00.094659 2159335 logs.go:138] Found kubelet problem: Mar 14 01:09:36 old-k8s-version-023742 kubelet[662]: E0314 01:09:36.773716 662 pod_workers.go:191] Error syncing pod 320a7d9f-62a0-45d2-b07d-657dc3bd1b28 ("metrics-server-9975d5f86-prnsg_kube-system(320a7d9f-62a0-45d2-b07d-657dc3bd1b28)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0314 01:12:00.095254 2159335 logs.go:138] Found kubelet problem: Mar 14 01:09:41 old-k8s-version-023742 kubelet[662]: E0314 01:09:41.548782 662 pod_workers.go:191] Error syncing pod 1e66610b-54fb-4a50-b7c1-47326c1c1c70 ("dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"
W0314 01:12:00.095595 2159335 logs.go:138] Found kubelet problem: Mar 14 01:09:43 old-k8s-version-023742 kubelet[662]: E0314 01:09:43.347327 662 pod_workers.go:191] Error syncing pod 1e66610b-54fb-4a50-b7c1-47326c1c1c70 ("dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"
W0314 01:12:00.095785 2159335 logs.go:138] Found kubelet problem: Mar 14 01:09:50 old-k8s-version-023742 kubelet[662]: E0314 01:09:50.766966 662 pod_workers.go:191] Error syncing pod 320a7d9f-62a0-45d2-b07d-657dc3bd1b28 ("metrics-server-9975d5f86-prnsg_kube-system(320a7d9f-62a0-45d2-b07d-657dc3bd1b28)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0314 01:12:00.096113 2159335 logs.go:138] Found kubelet problem: Mar 14 01:09:56 old-k8s-version-023742 kubelet[662]: E0314 01:09:56.766015 662 pod_workers.go:191] Error syncing pod 1e66610b-54fb-4a50-b7c1-47326c1c1c70 ("dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"
W0314 01:12:00.096296 2159335 logs.go:138] Found kubelet problem: Mar 14 01:10:04 old-k8s-version-023742 kubelet[662]: E0314 01:10:04.766379 662 pod_workers.go:191] Error syncing pod 320a7d9f-62a0-45d2-b07d-657dc3bd1b28 ("metrics-server-9975d5f86-prnsg_kube-system(320a7d9f-62a0-45d2-b07d-657dc3bd1b28)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0314 01:12:00.096625 2159335 logs.go:138] Found kubelet problem: Mar 14 01:10:10 old-k8s-version-023742 kubelet[662]: E0314 01:10:10.766119 662 pod_workers.go:191] Error syncing pod 1e66610b-54fb-4a50-b7c1-47326c1c1c70 ("dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"
W0314 01:12:00.096809 2159335 logs.go:138] Found kubelet problem: Mar 14 01:10:15 old-k8s-version-023742 kubelet[662]: E0314 01:10:15.767425 662 pod_workers.go:191] Error syncing pod 320a7d9f-62a0-45d2-b07d-657dc3bd1b28 ("metrics-server-9975d5f86-prnsg_kube-system(320a7d9f-62a0-45d2-b07d-657dc3bd1b28)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0314 01:12:00.097131 2159335 logs.go:138] Found kubelet problem: Mar 14 01:10:25 old-k8s-version-023742 kubelet[662]: E0314 01:10:25.766011 662 pod_workers.go:191] Error syncing pod 1e66610b-54fb-4a50-b7c1-47326c1c1c70 ("dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"
W0314 01:12:00.097313 2159335 logs.go:138] Found kubelet problem: Mar 14 01:10:29 old-k8s-version-023742 kubelet[662]: E0314 01:10:29.766425 662 pod_workers.go:191] Error syncing pod 320a7d9f-62a0-45d2-b07d-657dc3bd1b28 ("metrics-server-9975d5f86-prnsg_kube-system(320a7d9f-62a0-45d2-b07d-657dc3bd1b28)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0314 01:12:00.097636 2159335 logs.go:138] Found kubelet problem: Mar 14 01:10:40 old-k8s-version-023742 kubelet[662]: E0314 01:10:40.766016 662 pod_workers.go:191] Error syncing pod 1e66610b-54fb-4a50-b7c1-47326c1c1c70 ("dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"
W0314 01:12:00.097817 2159335 logs.go:138] Found kubelet problem: Mar 14 01:10:43 old-k8s-version-023742 kubelet[662]: E0314 01:10:43.767405 662 pod_workers.go:191] Error syncing pod 320a7d9f-62a0-45d2-b07d-657dc3bd1b28 ("metrics-server-9975d5f86-prnsg_kube-system(320a7d9f-62a0-45d2-b07d-657dc3bd1b28)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0314 01:12:00.098144 2159335 logs.go:138] Found kubelet problem: Mar 14 01:10:54 old-k8s-version-023742 kubelet[662]: E0314 01:10:54.765962 662 pod_workers.go:191] Error syncing pod 1e66610b-54fb-4a50-b7c1-47326c1c1c70 ("dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"
W0314 01:12:00.098344 2159335 logs.go:138] Found kubelet problem: Mar 14 01:10:55 old-k8s-version-023742 kubelet[662]: E0314 01:10:55.766370 662 pod_workers.go:191] Error syncing pod 320a7d9f-62a0-45d2-b07d-657dc3bd1b28 ("metrics-server-9975d5f86-prnsg_kube-system(320a7d9f-62a0-45d2-b07d-657dc3bd1b28)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0314 01:12:00.098533 2159335 logs.go:138] Found kubelet problem: Mar 14 01:11:06 old-k8s-version-023742 kubelet[662]: E0314 01:11:06.766830 662 pod_workers.go:191] Error syncing pod 320a7d9f-62a0-45d2-b07d-657dc3bd1b28 ("metrics-server-9975d5f86-prnsg_kube-system(320a7d9f-62a0-45d2-b07d-657dc3bd1b28)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0314 01:12:00.098861 2159335 logs.go:138] Found kubelet problem: Mar 14 01:11:08 old-k8s-version-023742 kubelet[662]: E0314 01:11:08.765992 662 pod_workers.go:191] Error syncing pod 1e66610b-54fb-4a50-b7c1-47326c1c1c70 ("dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"
W0314 01:12:00.099043 2159335 logs.go:138] Found kubelet problem: Mar 14 01:11:19 old-k8s-version-023742 kubelet[662]: E0314 01:11:19.766986 662 pod_workers.go:191] Error syncing pod 320a7d9f-62a0-45d2-b07d-657dc3bd1b28 ("metrics-server-9975d5f86-prnsg_kube-system(320a7d9f-62a0-45d2-b07d-657dc3bd1b28)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0314 01:12:00.099479 2159335 logs.go:138] Found kubelet problem: Mar 14 01:11:19 old-k8s-version-023742 kubelet[662]: E0314 01:11:19.771307 662 pod_workers.go:191] Error syncing pod 1e66610b-54fb-4a50-b7c1-47326c1c1c70 ("dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"
W0314 01:12:00.099671 2159335 logs.go:138] Found kubelet problem: Mar 14 01:11:31 old-k8s-version-023742 kubelet[662]: E0314 01:11:31.766411 662 pod_workers.go:191] Error syncing pod 320a7d9f-62a0-45d2-b07d-657dc3bd1b28 ("metrics-server-9975d5f86-prnsg_kube-system(320a7d9f-62a0-45d2-b07d-657dc3bd1b28)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0314 01:12:00.100002 2159335 logs.go:138] Found kubelet problem: Mar 14 01:11:31 old-k8s-version-023742 kubelet[662]: E0314 01:11:31.768210 662 pod_workers.go:191] Error syncing pod 1e66610b-54fb-4a50-b7c1-47326c1c1c70 ("dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"
W0314 01:12:00.100332 2159335 logs.go:138] Found kubelet problem: Mar 14 01:11:42 old-k8s-version-023742 kubelet[662]: E0314 01:11:42.766039 662 pod_workers.go:191] Error syncing pod 1e66610b-54fb-4a50-b7c1-47326c1c1c70 ("dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"
W0314 01:12:00.100526 2159335 logs.go:138] Found kubelet problem: Mar 14 01:11:45 old-k8s-version-023742 kubelet[662]: E0314 01:11:45.766829 662 pod_workers.go:191] Error syncing pod 320a7d9f-62a0-45d2-b07d-657dc3bd1b28 ("metrics-server-9975d5f86-prnsg_kube-system(320a7d9f-62a0-45d2-b07d-657dc3bd1b28)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0314 01:12:00.100851 2159335 logs.go:138] Found kubelet problem: Mar 14 01:11:57 old-k8s-version-023742 kubelet[662]: E0314 01:11:57.767790 662 pod_workers.go:191] Error syncing pod 1e66610b-54fb-4a50-b7c1-47326c1c1c70 ("dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"
W0314 01:12:00.101036 2159335 logs.go:138] Found kubelet problem: Mar 14 01:11:59 old-k8s-version-023742 kubelet[662]: E0314 01:11:59.770052 662 pod_workers.go:191] Error syncing pod 320a7d9f-62a0-45d2-b07d-657dc3bd1b28 ("metrics-server-9975d5f86-prnsg_kube-system(320a7d9f-62a0-45d2-b07d-657dc3bd1b28)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
I0314 01:12:00.101050 2159335 logs.go:123] Gathering logs for kube-proxy [36947fb39456b70b586f2321c1589d336fbf8121fcabf5f669409c9680ddc202] ...
I0314 01:12:00.101074 2159335 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 36947fb39456b70b586f2321c1589d336fbf8121fcabf5f669409c9680ddc202"
I0314 01:12:00.174338 2159335 logs.go:123] Gathering logs for storage-provisioner [4e7dc51c48baacd42a05abe380200f2d6c242433155f704a890e45913c11586c] ...
I0314 01:12:00.174402 2159335 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 4e7dc51c48baacd42a05abe380200f2d6c242433155f704a890e45913c11586c"
I0314 01:12:00.342882 2159335 logs.go:123] Gathering logs for kube-controller-manager [c79d313c53d51ee00f93e8076ad26cc072bc1abea5f1a5b6a64db439ffbbd272] ...
I0314 01:12:00.342916 2159335 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 c79d313c53d51ee00f93e8076ad26cc072bc1abea5f1a5b6a64db439ffbbd272"
I0314 01:12:00.504401 2159335 logs.go:123] Gathering logs for kube-controller-manager [00c36bf0f8362e90a4a6eb52e67b0fde8d3b9e110159c37ce5cff0a34795231b] ...
I0314 01:12:00.504488 2159335 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 00c36bf0f8362e90a4a6eb52e67b0fde8d3b9e110159c37ce5cff0a34795231b"
I0314 01:12:00.615545 2159335 logs.go:123] Gathering logs for kindnet [661201637b62150c5e65fb761af09186766a8c5ee343b157bd78587674493702] ...
I0314 01:12:00.615587 2159335 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 661201637b62150c5e65fb761af09186766a8c5ee343b157bd78587674493702"
I0314 01:12:00.668756 2159335 logs.go:123] Gathering logs for storage-provisioner [0378f91f5f30bc555d7408bc86dd626b1d5ffeb38145d3ee69160c360c8f3416] ...
I0314 01:12:00.668788 2159335 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 0378f91f5f30bc555d7408bc86dd626b1d5ffeb38145d3ee69160c360c8f3416"
I0314 01:12:00.713317 2159335 logs.go:123] Gathering logs for kube-apiserver [fdb44b3f1b8bfa78a5d1d74ef6b0613a584997cf3688d648110b83847d6bfbb7] ...
I0314 01:12:00.713344 2159335 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 fdb44b3f1b8bfa78a5d1d74ef6b0613a584997cf3688d648110b83847d6bfbb7"
I0314 01:12:00.787839 2159335 logs.go:123] Gathering logs for kube-apiserver [cf476c9051e98ad0797f500808cadc3fa875ce3d5892a9524d352ac49530d1c7] ...
I0314 01:12:00.787872 2159335 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 cf476c9051e98ad0797f500808cadc3fa875ce3d5892a9524d352ac49530d1c7"
I0314 01:12:00.855002 2159335 logs.go:123] Gathering logs for etcd [1c0e3f86261a4182fbe7a919791938f3f1b269a39c811b556df8aa8f15b310f1] ...
I0314 01:12:00.855046 2159335 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 1c0e3f86261a4182fbe7a919791938f3f1b269a39c811b556df8aa8f15b310f1"
I0314 01:12:00.907768 2159335 logs.go:123] Gathering logs for describe nodes ...
I0314 01:12:00.907808 2159335 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0314 01:12:01.123021 2159335 logs.go:123] Gathering logs for kube-scheduler [abe11e046f972c9c239dc5503ce7b4e6abdb261d19262a88ebf1157e26888704] ...
I0314 01:12:01.123090 2159335 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 abe11e046f972c9c239dc5503ce7b4e6abdb261d19262a88ebf1157e26888704"
I0314 01:12:01.210926 2159335 logs.go:123] Gathering logs for kube-scheduler [89cecf527c72212c9774ad52dd4fdf563d5e162b2b3c0590daf1a40383e5f87c] ...
I0314 01:12:01.210954 2159335 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 89cecf527c72212c9774ad52dd4fdf563d5e162b2b3c0590daf1a40383e5f87c"
I0314 01:12:01.269850 2159335 out.go:304] Setting ErrFile to fd 2...
I0314 01:12:01.270269 2159335 out.go:338] TERM=,COLORTERM=, which probably does not support color
W0314 01:12:01.270366 2159335 out.go:239] X Problems detected in kubelet:
W0314 01:12:01.270411 2159335 out.go:239] Mar 14 01:11:31 old-k8s-version-023742 kubelet[662]: E0314 01:11:31.768210 662 pod_workers.go:191] Error syncing pod 1e66610b-54fb-4a50-b7c1-47326c1c1c70 ("dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"
W0314 01:12:01.270566 2159335 out.go:239] Mar 14 01:11:42 old-k8s-version-023742 kubelet[662]: E0314 01:11:42.766039 662 pod_workers.go:191] Error syncing pod 1e66610b-54fb-4a50-b7c1-47326c1c1c70 ("dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"
W0314 01:12:01.270598 2159335 out.go:239] Mar 14 01:11:45 old-k8s-version-023742 kubelet[662]: E0314 01:11:45.766829 662 pod_workers.go:191] Error syncing pod 320a7d9f-62a0-45d2-b07d-657dc3bd1b28 ("metrics-server-9975d5f86-prnsg_kube-system(320a7d9f-62a0-45d2-b07d-657dc3bd1b28)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0314 01:12:01.270630 2159335 out.go:239] Mar 14 01:11:57 old-k8s-version-023742 kubelet[662]: E0314 01:11:57.767790 662 pod_workers.go:191] Error syncing pod 1e66610b-54fb-4a50-b7c1-47326c1c1c70 ("dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"
W0314 01:12:01.270666 2159335 out.go:239] Mar 14 01:11:59 old-k8s-version-023742 kubelet[662]: E0314 01:11:59.770052 662 pod_workers.go:191] Error syncing pod 320a7d9f-62a0-45d2-b07d-657dc3bd1b28 ("metrics-server-9975d5f86-prnsg_kube-system(320a7d9f-62a0-45d2-b07d-657dc3bd1b28)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
I0314 01:12:01.270709 2159335 out.go:304] Setting ErrFile to fd 2...
I0314 01:12:01.270732 2159335 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0314 01:12:11.271976 2159335 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0314 01:12:11.284381 2159335 api_server.go:72] duration metric: took 6m1.5739088s to wait for apiserver process to appear ...
I0314 01:12:11.284404 2159335 api_server.go:88] waiting for apiserver healthz status ...
I0314 01:12:11.286614 2159335 out.go:177]
W0314 01:12:11.288783 2159335 out.go:239] X Exiting due to GUEST_START: failed to start node: wait 6m0s for node: wait for healthy API server: apiserver healthz never reported healthy: cluster wait timed out during healthz check
W0314 01:12:11.288808 2159335 out.go:239] *
W0314 01:12:11.289707 2159335 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0314 01:12:11.292264 2159335 out.go:177]
==> container status <==
CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID POD
e4fbd91b78323 523cad1a4df73 2 minutes ago Exited dashboard-metrics-scraper 5 8399c885f589f dashboard-metrics-scraper-8d5bb5db8-fm8cx
0378f91f5f30b ba04bb24b9575 4 minutes ago Running storage-provisioner 2 32e2ec7df0e20 storage-provisioner
c83ee544525ca 20b332c9a70d8 5 minutes ago Running kubernetes-dashboard 0 d421b8398143b kubernetes-dashboard-cd95d586-s2g5f
577d3087fa040 db91994f4ee8f 5 minutes ago Running coredns 1 a9a250465824c coredns-74ff55c5b-m88gl
661201637b621 4740c1948d3fc 5 minutes ago Running kindnet-cni 1 c9cfaef11fbd1 kindnet-jfzdr
a649cec0099ad 25a5233254979 5 minutes ago Running kube-proxy 1 7a9d3a40b5580 kube-proxy-vm5pd
4e7dc51c48baa ba04bb24b9575 5 minutes ago Exited storage-provisioner 1 32e2ec7df0e20 storage-provisioner
78ce9d358e225 1611cd07b61d5 5 minutes ago Running busybox 1 1c94cf4d45d0b busybox
c79d313c53d51 1df8a2b116bd1 5 minutes ago Running kube-controller-manager 1 7b095ba6dd479 kube-controller-manager-old-k8s-version-023742
abe11e046f972 e7605f88f17d6 5 minutes ago Running kube-scheduler 1 9d0d979f67202 kube-scheduler-old-k8s-version-023742
fdb44b3f1b8bf 2c08bbbc02d3a 5 minutes ago Running kube-apiserver 1 5f121f8e35507 kube-apiserver-old-k8s-version-023742
262c4ec2f8f3e 05b738aa1bc63 5 minutes ago Running etcd 1 deb84b9c2b9c7 etcd-old-k8s-version-023742
d4ad6ee64f7c4 1611cd07b61d5 6 minutes ago Exited busybox 0 adfb65cc50f1b busybox
7d7e6014fc303 db91994f4ee8f 7 minutes ago Exited coredns 0 025d918c8bc5b coredns-74ff55c5b-m88gl
36947fb39456b 25a5233254979 8 minutes ago Exited kube-proxy 0 1b83d268fb35d kube-proxy-vm5pd
251c6cdd00905 4740c1948d3fc 8 minutes ago Exited kindnet-cni 0 bcf6a121da458 kindnet-jfzdr
1c0e3f86261a4 05b738aa1bc63 8 minutes ago Exited etcd 0 ff6d90560202c etcd-old-k8s-version-023742
cf476c9051e98 2c08bbbc02d3a 8 minutes ago Exited kube-apiserver 0 311fb18c2a9b0 kube-apiserver-old-k8s-version-023742
89cecf527c722 e7605f88f17d6 8 minutes ago Exited kube-scheduler 0 778182a8a7f1f kube-scheduler-old-k8s-version-023742
00c36bf0f8362 1df8a2b116bd1 8 minutes ago Exited kube-controller-manager 0 914c29becbcdb kube-controller-manager-old-k8s-version-023742
==> containerd <==
Mar 14 01:08:07 old-k8s-version-023742 containerd[567]: time="2024-03-14T01:08:07.784320527Z" level=info msg="trying next host" error="failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host" host=fake.domain
Mar 14 01:08:07 old-k8s-version-023742 containerd[567]: time="2024-03-14T01:08:07.787167090Z" level=error msg="PullImage \"fake.domain/registry.k8s.io/echoserver:1.4\" failed" error="failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
Mar 14 01:08:19 old-k8s-version-023742 containerd[567]: time="2024-03-14T01:08:19.768816549Z" level=info msg="CreateContainer within sandbox \"8399c885f589f2767fc9cdd73e585f663ae679a7be81b3433802c10fc4c890f6\" for container &ContainerMetadata{Name:dashboard-metrics-scraper,Attempt:4,}"
Mar 14 01:08:19 old-k8s-version-023742 containerd[567]: time="2024-03-14T01:08:19.786173409Z" level=info msg="CreateContainer within sandbox \"8399c885f589f2767fc9cdd73e585f663ae679a7be81b3433802c10fc4c890f6\" for &ContainerMetadata{Name:dashboard-metrics-scraper,Attempt:4,} returns container id \"55044ea4156380a347c03c212af316ff6c69a097699a9d2f0b2d9708a8a19642\""
Mar 14 01:08:19 old-k8s-version-023742 containerd[567]: time="2024-03-14T01:08:19.786630522Z" level=info msg="StartContainer for \"55044ea4156380a347c03c212af316ff6c69a097699a9d2f0b2d9708a8a19642\""
Mar 14 01:08:19 old-k8s-version-023742 containerd[567]: time="2024-03-14T01:08:19.876925856Z" level=info msg="StartContainer for \"55044ea4156380a347c03c212af316ff6c69a097699a9d2f0b2d9708a8a19642\" returns successfully"
Mar 14 01:08:19 old-k8s-version-023742 containerd[567]: time="2024-03-14T01:08:19.909649967Z" level=info msg="shim disconnected" id=55044ea4156380a347c03c212af316ff6c69a097699a9d2f0b2d9708a8a19642
Mar 14 01:08:19 old-k8s-version-023742 containerd[567]: time="2024-03-14T01:08:19.909710282Z" level=warning msg="cleaning up after shim disconnected" id=55044ea4156380a347c03c212af316ff6c69a097699a9d2f0b2d9708a8a19642 namespace=k8s.io
Mar 14 01:08:19 old-k8s-version-023742 containerd[567]: time="2024-03-14T01:08:19.909722295Z" level=info msg="cleaning up dead shim"
Mar 14 01:08:19 old-k8s-version-023742 containerd[567]: time="2024-03-14T01:08:19.918434012Z" level=warning msg="cleanup warnings time=\"2024-03-14T01:08:19Z\" level=info msg=\"starting signal loop\" namespace=k8s.io pid=2966 runtime=io.containerd.runc.v2\n"
Mar 14 01:08:20 old-k8s-version-023742 containerd[567]: time="2024-03-14T01:08:20.367917094Z" level=info msg="RemoveContainer for \"910d74720fd8c39a2dde9276b2ef5e6ce23ae019daf35b7bc9d6d64f360d6bda\""
Mar 14 01:08:20 old-k8s-version-023742 containerd[567]: time="2024-03-14T01:08:20.390434694Z" level=info msg="RemoveContainer for \"910d74720fd8c39a2dde9276b2ef5e6ce23ae019daf35b7bc9d6d64f360d6bda\" returns successfully"
Mar 14 01:09:36 old-k8s-version-023742 containerd[567]: time="2024-03-14T01:09:36.766846204Z" level=info msg="PullImage \"fake.domain/registry.k8s.io/echoserver:1.4\""
Mar 14 01:09:36 old-k8s-version-023742 containerd[567]: time="2024-03-14T01:09:36.771502684Z" level=info msg="trying next host" error="failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host" host=fake.domain
Mar 14 01:09:36 old-k8s-version-023742 containerd[567]: time="2024-03-14T01:09:36.773225907Z" level=error msg="PullImage \"fake.domain/registry.k8s.io/echoserver:1.4\" failed" error="failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
Mar 14 01:09:40 old-k8s-version-023742 containerd[567]: time="2024-03-14T01:09:40.768602744Z" level=info msg="CreateContainer within sandbox \"8399c885f589f2767fc9cdd73e585f663ae679a7be81b3433802c10fc4c890f6\" for container &ContainerMetadata{Name:dashboard-metrics-scraper,Attempt:5,}"
Mar 14 01:09:40 old-k8s-version-023742 containerd[567]: time="2024-03-14T01:09:40.784405431Z" level=info msg="CreateContainer within sandbox \"8399c885f589f2767fc9cdd73e585f663ae679a7be81b3433802c10fc4c890f6\" for &ContainerMetadata{Name:dashboard-metrics-scraper,Attempt:5,} returns container id \"e4fbd91b78323ad88694e984c4cc9e04e2445d86c81406ea301892cae622ebb9\""
Mar 14 01:09:40 old-k8s-version-023742 containerd[567]: time="2024-03-14T01:09:40.785536181Z" level=info msg="StartContainer for \"e4fbd91b78323ad88694e984c4cc9e04e2445d86c81406ea301892cae622ebb9\""
Mar 14 01:09:40 old-k8s-version-023742 containerd[567]: time="2024-03-14T01:09:40.854682252Z" level=info msg="StartContainer for \"e4fbd91b78323ad88694e984c4cc9e04e2445d86c81406ea301892cae622ebb9\" returns successfully"
Mar 14 01:09:40 old-k8s-version-023742 containerd[567]: time="2024-03-14T01:09:40.898335405Z" level=info msg="shim disconnected" id=e4fbd91b78323ad88694e984c4cc9e04e2445d86c81406ea301892cae622ebb9
Mar 14 01:09:40 old-k8s-version-023742 containerd[567]: time="2024-03-14T01:09:40.898401636Z" level=warning msg="cleaning up after shim disconnected" id=e4fbd91b78323ad88694e984c4cc9e04e2445d86c81406ea301892cae622ebb9 namespace=k8s.io
Mar 14 01:09:40 old-k8s-version-023742 containerd[567]: time="2024-03-14T01:09:40.898415486Z" level=info msg="cleaning up dead shim"
Mar 14 01:09:40 old-k8s-version-023742 containerd[567]: time="2024-03-14T01:09:40.907143483Z" level=warning msg="cleanup warnings time=\"2024-03-14T01:09:40Z\" level=info msg=\"starting signal loop\" namespace=k8s.io pid=3202 runtime=io.containerd.runc.v2\n"
Mar 14 01:09:41 old-k8s-version-023742 containerd[567]: time="2024-03-14T01:09:41.550235455Z" level=info msg="RemoveContainer for \"55044ea4156380a347c03c212af316ff6c69a097699a9d2f0b2d9708a8a19642\""
Mar 14 01:09:41 old-k8s-version-023742 containerd[567]: time="2024-03-14T01:09:41.556865191Z" level=info msg="RemoveContainer for \"55044ea4156380a347c03c212af316ff6c69a097699a9d2f0b2d9708a8a19642\" returns successfully"
==> coredns [577d3087fa040f93f9110c5070c4732f3d9c28a3063dad9f5fb63d2cb714c5d1] <==
[INFO] plugin/ready: Still waiting on: "kubernetes"
.:53
[INFO] plugin/reload: Running configuration MD5 = b494d968e357ba1b925cee838fbd78ed
CoreDNS-1.7.0
linux/arm64, go1.14.4, f59c03d
[INFO] 127.0.0.1:49019 - 18033 "HINFO IN 8693237155408371918.2373665137395487600. udp 57 false 512" NXDOMAIN qr,rd,ra 57 0.023531222s
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/ready: Still waiting on: "kubernetes"
I0314 01:07:03.115479 1 trace.go:116] Trace[2019727887]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125 (started: 2024-03-14 01:06:33.110757946 +0000 UTC m=+0.029739785) (total time: 30.004594998s):
Trace[2019727887]: [30.004594998s] [30.004594998s] END
E0314 01:07:03.115525 1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to list *v1.Service: Get "https://10.96.0.1:443/api/v1/services?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
I0314 01:07:03.115642 1 trace.go:116] Trace[939984059]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125 (started: 2024-03-14 01:06:33.115328527 +0000 UTC m=+0.034310366) (total time: 30.000302437s):
Trace[939984059]: [30.000302437s] [30.000302437s] END
E0314 01:07:03.115653 1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to list *v1.Endpoints: Get "https://10.96.0.1:443/api/v1/endpoints?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
I0314 01:07:03.115949 1 trace.go:116] Trace[911902081]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125 (started: 2024-03-14 01:06:33.115602208 +0000 UTC m=+0.034584039) (total time: 30.000327905s):
Trace[911902081]: [30.000327905s] [30.000327905s] END
E0314 01:07:03.115960 1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to list *v1.Namespace: Get "https://10.96.0.1:443/api/v1/namespaces?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
==> coredns [7d7e6014fc3038892fc04a7ac247dec3563fd4e1a68251761f5191e67aa3d29c] <==
.:53
[INFO] plugin/reload: Running configuration MD5 = b494d968e357ba1b925cee838fbd78ed
CoreDNS-1.7.0
linux/arm64, go1.14.4, f59c03d
[INFO] 127.0.0.1:53628 - 24383 "HINFO IN 1330114024086565693.6852890089546377471. udp 57 false 512" NXDOMAIN qr,rd,ra 57 0.012593262s
==> describe nodes <==
Name: old-k8s-version-023742
Roles: control-plane,master
Labels: beta.kubernetes.io/arch=arm64
beta.kubernetes.io/os=linux
kubernetes.io/arch=arm64
kubernetes.io/hostname=old-k8s-version-023742
kubernetes.io/os=linux
minikube.k8s.io/commit=eceebabcbdee8f7e371d6df61e2829908b6c6abe
minikube.k8s.io/name=old-k8s-version-023742
minikube.k8s.io/primary=true
minikube.k8s.io/updated_at=2024_03_14T01_03_38_0700
minikube.k8s.io/version=v1.32.0
node-role.kubernetes.io/control-plane=
node-role.kubernetes.io/master=
Annotations: kubeadm.alpha.kubernetes.io/cri-socket: /run/containerd/containerd.sock
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Thu, 14 Mar 2024 01:03:34 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: old-k8s-version-023742
AcquireTime: <unset>
RenewTime: Thu, 14 Mar 2024 01:12:12 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Thu, 14 Mar 2024 01:07:19 +0000 Thu, 14 Mar 2024 01:03:27 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Thu, 14 Mar 2024 01:07:19 +0000 Thu, 14 Mar 2024 01:03:27 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Thu, 14 Mar 2024 01:07:19 +0000 Thu, 14 Mar 2024 01:03:27 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Thu, 14 Mar 2024 01:07:19 +0000 Thu, 14 Mar 2024 01:03:53 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.76.2
Hostname: old-k8s-version-023742
Capacity:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022500Ki
pods: 110
Allocatable:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022500Ki
pods: 110
System Info:
Machine ID: f52f9fec265543c4b12231dd14316f16
System UUID: efb625a7-7f64-4859-8e8f-772c6b8b7889
Boot ID: ae603cd7-e506-4ea2-a0e0-984864774a93
Kernel Version: 5.15.0-1055-aws
OS Image: Ubuntu 22.04.4 LTS
Operating System: linux
Architecture: arm64
Container Runtime Version: containerd://1.6.28
Kubelet Version: v1.20.0
Kube-Proxy Version: v1.20.0
PodCIDR: 10.244.0.0/24
PodCIDRs: 10.244.0.0/24
Non-terminated Pods: (12 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits AGE
--------- ---- ------------ ---------- --------------- ------------- ---
default busybox 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 6m35s
kube-system coredns-74ff55c5b-m88gl 100m (5%!)(MISSING) 0 (0%!)(MISSING) 70Mi (0%!)(MISSING) 170Mi (2%!)(MISSING) 8m20s
kube-system etcd-old-k8s-version-023742 100m (5%!)(MISSING) 0 (0%!)(MISSING) 100Mi (1%!)(MISSING) 0 (0%!)(MISSING) 8m27s
kube-system kindnet-jfzdr 100m (5%!)(MISSING) 100m (5%!)(MISSING) 50Mi (0%!)(MISSING) 50Mi (0%!)(MISSING) 8m20s
kube-system kube-apiserver-old-k8s-version-023742 250m (12%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 8m27s
kube-system kube-controller-manager-old-k8s-version-023742 200m (10%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 8m27s
kube-system kube-proxy-vm5pd 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 8m20s
kube-system kube-scheduler-old-k8s-version-023742 100m (5%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 8m27s
kube-system metrics-server-9975d5f86-prnsg 100m (5%!)(MISSING) 0 (0%!)(MISSING) 200Mi (2%!)(MISSING) 0 (0%!)(MISSING) 6m24s
kube-system storage-provisioner 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 8m19s
kubernetes-dashboard dashboard-metrics-scraper-8d5bb5db8-fm8cx 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 5m26s
kubernetes-dashboard kubernetes-dashboard-cd95d586-s2g5f 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 5m26s
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 950m (47%!)(MISSING) 100m (5%!)(MISSING)
memory 420Mi (5%!)(MISSING) 220Mi (2%!)(MISSING)
ephemeral-storage 100Mi (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-1Gi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-2Mi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-32Mi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-64Ki 0 (0%!)(MISSING) 0 (0%!)(MISSING)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal NodeHasSufficientMemory 8m47s (x4 over 8m47s) kubelet Node old-k8s-version-023742 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 8m47s (x4 over 8m47s) kubelet Node old-k8s-version-023742 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 8m47s (x4 over 8m47s) kubelet Node old-k8s-version-023742 status is now: NodeHasSufficientPID
Normal Starting 8m27s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 8m27s kubelet Node old-k8s-version-023742 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 8m27s kubelet Node old-k8s-version-023742 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 8m27s kubelet Node old-k8s-version-023742 status is now: NodeHasSufficientPID
Normal NodeAllocatableEnforced 8m27s kubelet Updated Node Allocatable limit across pods
Normal NodeReady 8m20s kubelet Node old-k8s-version-023742 status is now: NodeReady
Normal Starting 8m19s kube-proxy Starting kube-proxy.
Normal Starting 5m56s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 5m56s (x8 over 5m56s) kubelet Node old-k8s-version-023742 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 5m56s (x8 over 5m56s) kubelet Node old-k8s-version-023742 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 5m56s (x7 over 5m56s) kubelet Node old-k8s-version-023742 status is now: NodeHasSufficientPID
Normal NodeAllocatableEnforced 5m56s kubelet Updated Node Allocatable limit across pods
Normal Starting 5m40s kube-proxy Starting kube-proxy.
==> dmesg <==
[ +0.001209] FS-Cache: N-cookie c=00000078 [p=0000006f fl=2 nc=0 na=1]
[ +0.001054] FS-Cache: N-cookie d=00000000dfa10ab5{9p.inode} n=00000000a50362d2
[ +0.001151] FS-Cache: N-key=[8] '13455c0100000000'
[ +0.002651] FS-Cache: Duplicate cookie detected
[ +0.000691] FS-Cache: O-cookie c=00000072 [p=0000006f fl=226 nc=0 na=1]
[ +0.001082] FS-Cache: O-cookie d=00000000dfa10ab5{9p.inode} n=000000009688ab1c
[ +0.001075] FS-Cache: O-key=[8] '13455c0100000000'
[ +0.000721] FS-Cache: N-cookie c=00000079 [p=0000006f fl=2 nc=0 na=1]
[ +0.000962] FS-Cache: N-cookie d=00000000dfa10ab5{9p.inode} n=00000000287e5f22
[ +0.001127] FS-Cache: N-key=[8] '13455c0100000000'
[ +2.832003] FS-Cache: Duplicate cookie detected
[ +0.000710] FS-Cache: O-cookie c=00000070 [p=0000006f fl=226 nc=0 na=1]
[ +0.001058] FS-Cache: O-cookie d=00000000dfa10ab5{9p.inode} n=000000002897a5bc
[ +0.001057] FS-Cache: O-key=[8] '12455c0100000000'
[ +0.000800] FS-Cache: N-cookie c=0000007b [p=0000006f fl=2 nc=0 na=1]
[ +0.001025] FS-Cache: N-cookie d=00000000dfa10ab5{9p.inode} n=00000000473ae0a8
[ +0.001093] FS-Cache: N-key=[8] '12455c0100000000'
[ +0.405755] FS-Cache: Duplicate cookie detected
[ +0.000783] FS-Cache: O-cookie c=00000075 [p=0000006f fl=226 nc=0 na=1]
[ +0.001051] FS-Cache: O-cookie d=00000000dfa10ab5{9p.inode} n=000000002e6030fa
[ +0.001195] FS-Cache: O-key=[8] '19455c0100000000'
[ +0.000795] FS-Cache: N-cookie c=0000007c [p=0000006f fl=2 nc=0 na=1]
[ +0.000968] FS-Cache: N-cookie d=00000000dfa10ab5{9p.inode} n=00000000a50362d2
[ +0.001117] FS-Cache: N-key=[8] '19455c0100000000'
[Mar14 00:59] overlayfs: failed to resolve '/var/lib/containerd/io.containerd.snapshotter.v1.overlayfs/snapshots/25/fs': -2
==> etcd [1c0e3f86261a4182fbe7a919791938f3f1b269a39c811b556df8aa8f15b310f1] <==
raft2024/03/14 01:03:28 INFO: ea7e25599daad906 received MsgVoteResp from ea7e25599daad906 at term 2
raft2024/03/14 01:03:28 INFO: ea7e25599daad906 became leader at term 2
raft2024/03/14 01:03:28 INFO: raft.node: ea7e25599daad906 elected leader ea7e25599daad906 at term 2
2024-03-14 01:03:28.111348 I | etcdserver: published {Name:old-k8s-version-023742 ClientURLs:[https://192.168.76.2:2379]} to cluster 6f20f2c4b2fb5f8a
2024-03-14 01:03:28.111855 I | embed: ready to serve client requests
2024-03-14 01:03:28.112997 I | etcdserver: setting up the initial cluster version to 3.4
2024-03-14 01:03:28.114532 I | embed: ready to serve client requests
2024-03-14 01:03:28.119641 I | embed: serving client requests on 127.0.0.1:2379
2024-03-14 01:03:28.135085 I | embed: serving client requests on 192.168.76.2:2379
2024-03-14 01:03:28.151244 N | etcdserver/membership: set the initial cluster version to 3.4
2024-03-14 01:03:28.151529 I | etcdserver/api: enabled capabilities for version 3.4
2024-03-14 01:03:37.009537 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-14 01:03:48.874818 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-14 01:03:50.962939 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-14 01:04:00.963156 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-14 01:04:10.963085 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-14 01:04:20.963113 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-14 01:04:30.963126 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-14 01:04:40.963057 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-14 01:04:50.963233 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-14 01:05:00.963069 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-14 01:05:10.963227 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-14 01:05:20.963051 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-14 01:05:30.963332 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-14 01:05:40.963143 I | etcdserver/api/etcdhttp: /health OK (status code 200)
==> etcd [262c4ec2f8f3eb8483e1462b0685a765d10399ebc85e0a7f520af4504e9e469f] <==
2024-03-14 01:08:06.278137 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-14 01:08:16.278254 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-14 01:08:26.278098 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-14 01:08:36.278195 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-14 01:08:46.278063 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-14 01:08:56.278113 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-14 01:09:06.278235 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-14 01:09:16.278147 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-14 01:09:26.278282 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-14 01:09:36.278182 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-14 01:09:46.278160 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-14 01:09:56.278217 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-14 01:10:06.278109 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-14 01:10:16.278124 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-14 01:10:26.278143 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-14 01:10:36.278050 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-14 01:10:46.278144 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-14 01:10:56.278089 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-14 01:11:06.278155 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-14 01:11:16.278357 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-14 01:11:26.278267 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-14 01:11:36.278327 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-14 01:11:46.278142 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-14 01:11:56.278179 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-14 01:12:06.278192 I | etcdserver/api/etcdhttp: /health OK (status code 200)
==> kernel <==
01:12:13 up 8:54, 0 users, load average: 0.24, 1.61, 2.25
Linux old-k8s-version-023742 5.15.0-1055-aws #60~20.04.1-Ubuntu SMP Thu Feb 22 15:54:21 UTC 2024 aarch64 aarch64 aarch64 GNU/Linux
PRETTY_NAME="Ubuntu 22.04.4 LTS"
==> kindnet [251c6cdd00905f46268a5714aa17f44694250fe47496912c484048b8908e5650] <==
I0314 01:03:53.890191 1 main.go:102] connected to apiserver: https://10.96.0.1:443
I0314 01:03:53.890256 1 main.go:107] hostIP = 192.168.76.2
podIP = 192.168.76.2
I0314 01:03:53.890370 1 main.go:116] setting mtu 1500 for CNI
I0314 01:03:53.890380 1 main.go:146] kindnetd IP family: "ipv4"
I0314 01:03:53.890392 1 main.go:150] noMask IPv4 subnets: [10.244.0.0/16]
I0314 01:04:24.121474 1 main.go:191] Failed to get nodes, retrying after error: Get "https://10.96.0.1:443/api/v1/nodes": dial tcp 10.96.0.1:443: i/o timeout
I0314 01:04:24.135706 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0314 01:04:24.135742 1 main.go:227] handling current node
I0314 01:04:34.154401 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0314 01:04:34.154515 1 main.go:227] handling current node
I0314 01:04:44.175454 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0314 01:04:44.175483 1 main.go:227] handling current node
I0314 01:04:54.188178 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0314 01:04:54.188207 1 main.go:227] handling current node
I0314 01:05:04.209211 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0314 01:05:04.209243 1 main.go:227] handling current node
I0314 01:05:14.229594 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0314 01:05:14.229635 1 main.go:227] handling current node
I0314 01:05:24.233610 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0314 01:05:24.233639 1 main.go:227] handling current node
I0314 01:05:34.266625 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0314 01:05:34.266659 1 main.go:227] handling current node
I0314 01:05:44.279149 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0314 01:05:44.279473 1 main.go:227] handling current node
==> kindnet [661201637b62150c5e65fb761af09186766a8c5ee343b157bd78587674493702] <==
I0314 01:10:04.022272 1 main.go:227] handling current node
I0314 01:10:14.043888 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0314 01:10:14.043916 1 main.go:227] handling current node
I0314 01:10:24.056219 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0314 01:10:24.056248 1 main.go:227] handling current node
I0314 01:10:34.060169 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0314 01:10:34.060207 1 main.go:227] handling current node
I0314 01:10:44.081036 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0314 01:10:44.081065 1 main.go:227] handling current node
I0314 01:10:54.100492 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0314 01:10:54.100526 1 main.go:227] handling current node
I0314 01:11:04.124493 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0314 01:11:04.124525 1 main.go:227] handling current node
I0314 01:11:14.135557 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0314 01:11:14.135839 1 main.go:227] handling current node
I0314 01:11:24.153588 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0314 01:11:24.153617 1 main.go:227] handling current node
I0314 01:11:34.164460 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0314 01:11:34.164491 1 main.go:227] handling current node
I0314 01:11:44.176129 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0314 01:11:44.176169 1 main.go:227] handling current node
I0314 01:11:54.188397 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0314 01:11:54.188431 1 main.go:227] handling current node
I0314 01:12:04.205964 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0314 01:12:04.205993 1 main.go:227] handling current node
==> kube-apiserver [cf476c9051e98ad0797f500808cadc3fa875ce3d5892a9524d352ac49530d1c7] <==
I0314 01:03:35.397396 1 storage_scheduling.go:132] created PriorityClass system-cluster-critical with value 2000000000
I0314 01:03:35.397419 1 storage_scheduling.go:148] all system priority classes are created successfully or already exist.
I0314 01:03:35.886154 1 controller.go:606] quota admission added evaluator for: roles.rbac.authorization.k8s.io
I0314 01:03:35.940898 1 controller.go:606] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io
W0314 01:03:36.083445 1 lease.go:233] Resetting endpoints for master service "kubernetes" to [192.168.76.2]
I0314 01:03:36.088814 1 controller.go:606] quota admission added evaluator for: endpoints
I0314 01:03:36.095951 1 controller.go:606] quota admission added evaluator for: endpointslices.discovery.k8s.io
I0314 01:03:37.017793 1 controller.go:606] quota admission added evaluator for: serviceaccounts
I0314 01:03:37.567500 1 controller.go:606] quota admission added evaluator for: deployments.apps
I0314 01:03:37.685103 1 controller.go:606] quota admission added evaluator for: daemonsets.apps
I0314 01:03:46.090127 1 controller.go:606] quota admission added evaluator for: leases.coordination.k8s.io
I0314 01:03:53.003061 1 controller.go:606] quota admission added evaluator for: controllerrevisions.apps
I0314 01:03:53.012640 1 controller.go:606] quota admission added evaluator for: replicasets.apps
I0314 01:03:59.495561 1 client.go:360] parsed scheme: "passthrough"
I0314 01:03:59.495608 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0314 01:03:59.495617 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0314 01:04:42.580998 1 client.go:360] parsed scheme: "passthrough"
I0314 01:04:42.581046 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0314 01:04:42.581054 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0314 01:05:12.948919 1 client.go:360] parsed scheme: "passthrough"
I0314 01:05:12.948966 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0314 01:05:12.949001 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0314 01:05:47.367401 1 client.go:360] parsed scheme: "passthrough"
I0314 01:05:47.367442 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0314 01:05:47.367450 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
==> kube-apiserver [fdb44b3f1b8bfa78a5d1d74ef6b0613a584997cf3688d648110b83847d6bfbb7] <==
I0314 01:08:49.084190 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0314 01:08:49.084199 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0314 01:09:24.271464 1 client.go:360] parsed scheme: "passthrough"
I0314 01:09:24.271512 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0314 01:09:24.271521 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
W0314 01:09:31.929674 1 handler_proxy.go:102] no RequestInfo found in the context
E0314 01:09:31.929789 1 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I0314 01:09:31.929830 1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
I0314 01:10:03.588184 1 client.go:360] parsed scheme: "passthrough"
I0314 01:10:03.588358 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0314 01:10:03.588396 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0314 01:10:45.860086 1 client.go:360] parsed scheme: "passthrough"
I0314 01:10:45.860345 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0314 01:10:45.860486 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0314 01:11:29.043938 1 client.go:360] parsed scheme: "passthrough"
I0314 01:11:29.043982 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0314 01:11:29.043992 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
W0314 01:11:30.009632 1 handler_proxy.go:102] no RequestInfo found in the context
E0314 01:11:30.009725 1 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I0314 01:11:30.009737 1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
I0314 01:12:01.098772 1 client.go:360] parsed scheme: "passthrough"
I0314 01:12:01.098934 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0314 01:12:01.098949 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
==> kube-controller-manager [00c36bf0f8362e90a4a6eb52e67b0fde8d3b9e110159c37ce5cff0a34795231b] <==
I0314 01:03:53.005791 1 shared_informer.go:247] Caches are synced for PVC protection
E0314 01:03:53.008203 1 clusterroleaggregation_controller.go:181] admin failed with : Operation cannot be fulfilled on clusterroles.rbac.authorization.k8s.io "admin": the object has been modified; please apply your changes to the latest version and try again
I0314 01:03:53.008953 1 shared_informer.go:247] Caches are synced for endpoint_slice
E0314 01:03:53.028753 1 clusterroleaggregation_controller.go:181] edit failed with : Operation cannot be fulfilled on clusterroles.rbac.authorization.k8s.io "edit": the object has been modified; please apply your changes to the latest version and try again
I0314 01:03:53.034126 1 event.go:291] "Event occurred" object="kube-system/coredns" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set coredns-74ff55c5b to 2"
I0314 01:03:53.059613 1 shared_informer.go:247] Caches are synced for attach detach
I0314 01:03:53.069776 1 shared_informer.go:247] Caches are synced for PV protection
I0314 01:03:53.081622 1 event.go:291] "Event occurred" object="kube-system/kube-proxy" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kube-proxy-vm5pd"
I0314 01:03:53.090589 1 event.go:291] "Event occurred" object="kube-system/kindnet" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kindnet-jfzdr"
I0314 01:03:53.091992 1 event.go:291] "Event occurred" object="kube-system/coredns-74ff55c5b" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-74ff55c5b-qzm6v"
I0314 01:03:53.110914 1 shared_informer.go:247] Caches are synced for bootstrap_signer
I0314 01:03:53.117643 1 shared_informer.go:247] Caches are synced for expand
I0314 01:03:53.146205 1 shared_informer.go:247] Caches are synced for crt configmap
I0314 01:03:53.161353 1 shared_informer.go:247] Caches are synced for resource quota
I0314 01:03:53.172312 1 shared_informer.go:247] Caches are synced for resource quota
I0314 01:03:53.208986 1 event.go:291] "Event occurred" object="kube-system/coredns-74ff55c5b" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-74ff55c5b-m88gl"
I0314 01:03:53.223092 1 shared_informer.go:247] Caches are synced for persistent volume
I0314 01:03:53.352887 1 shared_informer.go:240] Waiting for caches to sync for garbage collector
I0314 01:03:53.613729 1 shared_informer.go:247] Caches are synced for garbage collector
I0314 01:03:53.613791 1 garbagecollector.go:151] Garbage collector: all resource monitors have synced. Proceeding to collect garbage
I0314 01:03:53.653059 1 shared_informer.go:247] Caches are synced for garbage collector
I0314 01:03:54.467334 1 event.go:291] "Event occurred" object="kube-system/coredns" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled down replica set coredns-74ff55c5b to 1"
I0314 01:03:54.493739 1 event.go:291] "Event occurred" object="kube-system/coredns-74ff55c5b" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulDelete" message="Deleted pod: coredns-74ff55c5b-qzm6v"
I0314 01:03:57.925351 1 node_lifecycle_controller.go:1222] Controller detected that some Nodes are Ready. Exiting master disruption mode.
I0314 01:05:48.361021 1 event.go:291] "Event occurred" object="kube-system/metrics-server" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set metrics-server-9975d5f86 to 1"
==> kube-controller-manager [c79d313c53d51ee00f93e8076ad26cc072bc1abea5f1a5b6a64db439ffbbd272] <==
W0314 01:07:53.392223 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0314 01:08:19.421316 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0314 01:08:25.042672 1 request.go:655] Throttling request took 1.04839733s, request: GET:https://192.168.76.2:8443/apis/apiextensions.k8s.io/v1beta1?timeout=32s
W0314 01:08:25.894129 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0314 01:08:49.923150 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0314 01:08:57.544490 1 request.go:655] Throttling request took 1.048266937s, request: GET:https://192.168.76.2:8443/apis/extensions/v1beta1?timeout=32s
W0314 01:08:58.396010 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0314 01:09:20.488040 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0314 01:09:30.047004 1 request.go:655] Throttling request took 1.045607386s, request: GET:https://192.168.76.2:8443/apis/extensions/v1beta1?timeout=32s
W0314 01:09:30.897723 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0314 01:09:50.989943 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0314 01:10:02.548113 1 request.go:655] Throttling request took 1.048366715s, request: GET:https://192.168.76.2:8443/apis/certificates.k8s.io/v1beta1?timeout=32s
W0314 01:10:03.399641 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0314 01:10:21.508817 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0314 01:10:35.050184 1 request.go:655] Throttling request took 1.043303273s, request: GET:https://192.168.76.2:8443/apis/extensions/v1beta1?timeout=32s
W0314 01:10:35.901494 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0314 01:10:52.010179 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0314 01:11:07.551868 1 request.go:655] Throttling request took 1.048328885s, request: GET:https://192.168.76.2:8443/apis/coordination.k8s.io/v1?timeout=32s
W0314 01:11:08.403310 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0314 01:11:22.512098 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0314 01:11:40.053775 1 request.go:655] Throttling request took 1.047475149s, request: GET:https://192.168.76.2:8443/apis/authorization.k8s.io/v1beta1?timeout=32s
W0314 01:11:40.905256 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0314 01:11:53.014344 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0314 01:12:12.555720 1 request.go:655] Throttling request took 1.048112168s, request: GET:https://192.168.76.2:8443/apis/extensions/v1beta1?timeout=32s
W0314 01:12:13.409987 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
==> kube-proxy [36947fb39456b70b586f2321c1589d336fbf8121fcabf5f669409c9680ddc202] <==
I0314 01:03:54.689508 1 node.go:172] Successfully retrieved node IP: 192.168.76.2
I0314 01:03:54.689804 1 server_others.go:142] kube-proxy node IP is an IPv4 address (192.168.76.2), assume IPv4 operation
W0314 01:03:54.712712 1 server_others.go:578] Unknown proxy mode "", assuming iptables proxy
I0314 01:03:54.713007 1 server_others.go:185] Using iptables Proxier.
I0314 01:03:54.713689 1 server.go:650] Version: v1.20.0
I0314 01:03:54.714430 1 config.go:224] Starting endpoint slice config controller
I0314 01:03:54.714447 1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config
I0314 01:03:54.714577 1 config.go:315] Starting service config controller
I0314 01:03:54.714590 1 shared_informer.go:240] Waiting for caches to sync for service config
I0314 01:03:54.814534 1 shared_informer.go:247] Caches are synced for endpoint slice config
I0314 01:03:54.814613 1 shared_informer.go:247] Caches are synced for service config
==> kube-proxy [a649cec0099ad8c4f2f59cb4643ea18e343945d9edac27d0c1542055b2ce681c] <==
I0314 01:06:33.065342 1 node.go:172] Successfully retrieved node IP: 192.168.76.2
I0314 01:06:33.065420 1 server_others.go:142] kube-proxy node IP is an IPv4 address (192.168.76.2), assume IPv4 operation
W0314 01:06:33.123753 1 server_others.go:578] Unknown proxy mode "", assuming iptables proxy
I0314 01:06:33.123845 1 server_others.go:185] Using iptables Proxier.
I0314 01:06:33.124084 1 server.go:650] Version: v1.20.0
I0314 01:06:33.124586 1 config.go:315] Starting service config controller
I0314 01:06:33.124624 1 shared_informer.go:240] Waiting for caches to sync for service config
I0314 01:06:33.125582 1 config.go:224] Starting endpoint slice config controller
I0314 01:06:33.125592 1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config
I0314 01:06:33.227300 1 shared_informer.go:247] Caches are synced for endpoint slice config
I0314 01:06:33.227363 1 shared_informer.go:247] Caches are synced for service config
==> kube-scheduler [89cecf527c72212c9774ad52dd4fdf563d5e162b2b3c0590daf1a40383e5f87c] <==
W0314 01:03:34.529473 1 requestheader_controller.go:193] Unable to get configmap/extension-apiserver-authentication in kube-system. Usually fixed by 'kubectl create rolebinding -n kube-system ROLEBINDING_NAME --role=extension-apiserver-authentication-reader --serviceaccount=YOUR_NS:YOUR_SA'
W0314 01:03:34.530656 1 authentication.go:332] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"
W0314 01:03:34.530690 1 authentication.go:333] Continuing without authentication configuration. This may treat all requests as anonymous.
W0314 01:03:34.530696 1 authentication.go:334] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false
I0314 01:03:34.607745 1 secure_serving.go:197] Serving securely on 127.0.0.1:10259
I0314 01:03:34.608625 1 configmap_cafile_content.go:202] Starting client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0314 01:03:34.610333 1 shared_informer.go:240] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0314 01:03:34.610547 1 tlsconfig.go:240] Starting DynamicServingCertificateController
E0314 01:03:34.658931 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
E0314 01:03:34.659340 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
E0314 01:03:34.659591 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
E0314 01:03:34.659814 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
E0314 01:03:34.660057 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
E0314 01:03:34.660308 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1beta1.PodDisruptionBudget: failed to list *v1beta1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
E0314 01:03:34.660565 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
E0314 01:03:34.660858 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
E0314 01:03:34.661079 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
E0314 01:03:34.661330 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
E0314 01:03:34.661570 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
E0314 01:03:34.671855 1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
E0314 01:03:35.510334 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
E0314 01:03:35.583820 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
E0314 01:03:35.623429 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
E0314 01:03:35.720747 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
I0314 01:03:36.110698 1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
==> kube-scheduler [abe11e046f972c9c239dc5503ce7b4e6abdb261d19262a88ebf1157e26888704] <==
I0314 01:06:24.545939 1 serving.go:331] Generated self-signed cert in-memory
W0314 01:06:28.918936 1 requestheader_controller.go:193] Unable to get configmap/extension-apiserver-authentication in kube-system. Usually fixed by 'kubectl create rolebinding -n kube-system ROLEBINDING_NAME --role=extension-apiserver-authentication-reader --serviceaccount=YOUR_NS:YOUR_SA'
W0314 01:06:28.919063 1 authentication.go:332] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"
W0314 01:06:28.919079 1 authentication.go:333] Continuing without authentication configuration. This may treat all requests as anonymous.
W0314 01:06:28.919086 1 authentication.go:334] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false
I0314 01:06:29.238675 1 secure_serving.go:197] Serving securely on 127.0.0.1:10259
I0314 01:06:29.240716 1 configmap_cafile_content.go:202] Starting client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0314 01:06:29.240734 1 shared_informer.go:240] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0314 01:06:29.240750 1 tlsconfig.go:240] Starting DynamicServingCertificateController
I0314 01:06:29.340818 1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
==> kubelet <==
Mar 14 01:10:25 old-k8s-version-023742 kubelet[662]: E0314 01:10:25.766011 662 pod_workers.go:191] Error syncing pod 1e66610b-54fb-4a50-b7c1-47326c1c1c70 ("dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"
Mar 14 01:10:29 old-k8s-version-023742 kubelet[662]: E0314 01:10:29.766425 662 pod_workers.go:191] Error syncing pod 320a7d9f-62a0-45d2-b07d-657dc3bd1b28 ("metrics-server-9975d5f86-prnsg_kube-system(320a7d9f-62a0-45d2-b07d-657dc3bd1b28)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Mar 14 01:10:40 old-k8s-version-023742 kubelet[662]: I0314 01:10:40.765657 662 scope.go:95] [topologymanager] RemoveContainer - Container ID: e4fbd91b78323ad88694e984c4cc9e04e2445d86c81406ea301892cae622ebb9
Mar 14 01:10:40 old-k8s-version-023742 kubelet[662]: E0314 01:10:40.766016 662 pod_workers.go:191] Error syncing pod 1e66610b-54fb-4a50-b7c1-47326c1c1c70 ("dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"
Mar 14 01:10:43 old-k8s-version-023742 kubelet[662]: E0314 01:10:43.767405 662 pod_workers.go:191] Error syncing pod 320a7d9f-62a0-45d2-b07d-657dc3bd1b28 ("metrics-server-9975d5f86-prnsg_kube-system(320a7d9f-62a0-45d2-b07d-657dc3bd1b28)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Mar 14 01:10:54 old-k8s-version-023742 kubelet[662]: I0314 01:10:54.765632 662 scope.go:95] [topologymanager] RemoveContainer - Container ID: e4fbd91b78323ad88694e984c4cc9e04e2445d86c81406ea301892cae622ebb9
Mar 14 01:10:54 old-k8s-version-023742 kubelet[662]: E0314 01:10:54.765962 662 pod_workers.go:191] Error syncing pod 1e66610b-54fb-4a50-b7c1-47326c1c1c70 ("dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"
Mar 14 01:10:55 old-k8s-version-023742 kubelet[662]: E0314 01:10:55.766370 662 pod_workers.go:191] Error syncing pod 320a7d9f-62a0-45d2-b07d-657dc3bd1b28 ("metrics-server-9975d5f86-prnsg_kube-system(320a7d9f-62a0-45d2-b07d-657dc3bd1b28)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Mar 14 01:11:06 old-k8s-version-023742 kubelet[662]: E0314 01:11:06.766830 662 pod_workers.go:191] Error syncing pod 320a7d9f-62a0-45d2-b07d-657dc3bd1b28 ("metrics-server-9975d5f86-prnsg_kube-system(320a7d9f-62a0-45d2-b07d-657dc3bd1b28)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Mar 14 01:11:08 old-k8s-version-023742 kubelet[662]: I0314 01:11:08.765654 662 scope.go:95] [topologymanager] RemoveContainer - Container ID: e4fbd91b78323ad88694e984c4cc9e04e2445d86c81406ea301892cae622ebb9
Mar 14 01:11:08 old-k8s-version-023742 kubelet[662]: E0314 01:11:08.765992 662 pod_workers.go:191] Error syncing pod 1e66610b-54fb-4a50-b7c1-47326c1c1c70 ("dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"
Mar 14 01:11:19 old-k8s-version-023742 kubelet[662]: E0314 01:11:19.766986 662 pod_workers.go:191] Error syncing pod 320a7d9f-62a0-45d2-b07d-657dc3bd1b28 ("metrics-server-9975d5f86-prnsg_kube-system(320a7d9f-62a0-45d2-b07d-657dc3bd1b28)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Mar 14 01:11:19 old-k8s-version-023742 kubelet[662]: I0314 01:11:19.769874 662 scope.go:95] [topologymanager] RemoveContainer - Container ID: e4fbd91b78323ad88694e984c4cc9e04e2445d86c81406ea301892cae622ebb9
Mar 14 01:11:19 old-k8s-version-023742 kubelet[662]: E0314 01:11:19.771307 662 pod_workers.go:191] Error syncing pod 1e66610b-54fb-4a50-b7c1-47326c1c1c70 ("dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"
Mar 14 01:11:31 old-k8s-version-023742 kubelet[662]: E0314 01:11:31.766411 662 pod_workers.go:191] Error syncing pod 320a7d9f-62a0-45d2-b07d-657dc3bd1b28 ("metrics-server-9975d5f86-prnsg_kube-system(320a7d9f-62a0-45d2-b07d-657dc3bd1b28)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Mar 14 01:11:31 old-k8s-version-023742 kubelet[662]: I0314 01:11:31.767728 662 scope.go:95] [topologymanager] RemoveContainer - Container ID: e4fbd91b78323ad88694e984c4cc9e04e2445d86c81406ea301892cae622ebb9
Mar 14 01:11:31 old-k8s-version-023742 kubelet[662]: E0314 01:11:31.768210 662 pod_workers.go:191] Error syncing pod 1e66610b-54fb-4a50-b7c1-47326c1c1c70 ("dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"
Mar 14 01:11:42 old-k8s-version-023742 kubelet[662]: I0314 01:11:42.765698 662 scope.go:95] [topologymanager] RemoveContainer - Container ID: e4fbd91b78323ad88694e984c4cc9e04e2445d86c81406ea301892cae622ebb9
Mar 14 01:11:42 old-k8s-version-023742 kubelet[662]: E0314 01:11:42.766039 662 pod_workers.go:191] Error syncing pod 1e66610b-54fb-4a50-b7c1-47326c1c1c70 ("dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"
Mar 14 01:11:45 old-k8s-version-023742 kubelet[662]: E0314 01:11:45.766829 662 pod_workers.go:191] Error syncing pod 320a7d9f-62a0-45d2-b07d-657dc3bd1b28 ("metrics-server-9975d5f86-prnsg_kube-system(320a7d9f-62a0-45d2-b07d-657dc3bd1b28)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Mar 14 01:11:57 old-k8s-version-023742 kubelet[662]: I0314 01:11:57.766884 662 scope.go:95] [topologymanager] RemoveContainer - Container ID: e4fbd91b78323ad88694e984c4cc9e04e2445d86c81406ea301892cae622ebb9
Mar 14 01:11:57 old-k8s-version-023742 kubelet[662]: E0314 01:11:57.767790 662 pod_workers.go:191] Error syncing pod 1e66610b-54fb-4a50-b7c1-47326c1c1c70 ("dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"
Mar 14 01:11:59 old-k8s-version-023742 kubelet[662]: E0314 01:11:59.770052 662 pod_workers.go:191] Error syncing pod 320a7d9f-62a0-45d2-b07d-657dc3bd1b28 ("metrics-server-9975d5f86-prnsg_kube-system(320a7d9f-62a0-45d2-b07d-657dc3bd1b28)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Mar 14 01:12:08 old-k8s-version-023742 kubelet[662]: I0314 01:12:08.765688 662 scope.go:95] [topologymanager] RemoveContainer - Container ID: e4fbd91b78323ad88694e984c4cc9e04e2445d86c81406ea301892cae622ebb9
Mar 14 01:12:08 old-k8s-version-023742 kubelet[662]: E0314 01:12:08.766045 662 pod_workers.go:191] Error syncing pod 1e66610b-54fb-4a50-b7c1-47326c1c1c70 ("dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-fm8cx_kubernetes-dashboard(1e66610b-54fb-4a50-b7c1-47326c1c1c70)"
==> kubernetes-dashboard [c83ee544525cae8ae275b356afc7ab3e13354a5bfdc13e46d3bb967974cc4fd4] <==
2024/03/14 01:06:53 Using namespace: kubernetes-dashboard
2024/03/14 01:06:53 Using in-cluster config to connect to apiserver
2024/03/14 01:06:53 Using secret token for csrf signing
2024/03/14 01:06:53 Initializing csrf token from kubernetes-dashboard-csrf secret
2024/03/14 01:06:53 Empty token. Generating and storing in a secret kubernetes-dashboard-csrf
2024/03/14 01:06:53 Successful initial request to the apiserver, version: v1.20.0
2024/03/14 01:06:53 Generating JWE encryption key
2024/03/14 01:06:53 New synchronizer has been registered: kubernetes-dashboard-key-holder-kubernetes-dashboard. Starting
2024/03/14 01:06:53 Starting secret synchronizer for kubernetes-dashboard-key-holder in namespace kubernetes-dashboard
2024/03/14 01:06:53 Initializing JWE encryption key from synchronized object
2024/03/14 01:06:53 Creating in-cluster Sidecar client
2024/03/14 01:06:53 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/03/14 01:06:53 Serving insecurely on HTTP port: 9090
2024/03/14 01:07:23 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/03/14 01:07:53 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/03/14 01:08:23 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/03/14 01:08:53 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/03/14 01:09:23 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/03/14 01:09:53 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/03/14 01:10:23 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/03/14 01:10:53 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/03/14 01:11:23 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/03/14 01:11:53 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/03/14 01:06:53 Starting overwatch
==> storage-provisioner [0378f91f5f30bc555d7408bc86dd626b1d5ffeb38145d3ee69160c360c8f3416] <==
I0314 01:07:16.856517 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
I0314 01:07:16.883501 1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
I0314 01:07:16.883718 1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
I0314 01:07:34.402249 1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
I0314 01:07:34.403528 1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_old-k8s-version-023742_56ab5019-fa74-4ba9-b03f-aaf50b0afd68!
I0314 01:07:34.419734 1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"e8feff7c-5e36-4fc4-849d-81ec2bc2ebd0", APIVersion:"v1", ResourceVersion:"870", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' old-k8s-version-023742_56ab5019-fa74-4ba9-b03f-aaf50b0afd68 became leader
I0314 01:07:34.504469 1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_old-k8s-version-023742_56ab5019-fa74-4ba9-b03f-aaf50b0afd68!
==> storage-provisioner [4e7dc51c48baacd42a05abe380200f2d6c242433155f704a890e45913c11586c] <==
I0314 01:06:31.241345 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
F0314 01:07:01.243879 1 main.go:39] error getting server version: Get "https://10.96.0.1:443/version?timeout=32s": dial tcp 10.96.0.1:443: i/o timeout
-- /stdout --
helpers_test.go:254: (dbg) Run: out/minikube-linux-arm64 status --format={{.APIServer}} -p old-k8s-version-023742 -n old-k8s-version-023742
helpers_test.go:261: (dbg) Run: kubectl --context old-k8s-version-023742 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:272: non-running pods: metrics-server-9975d5f86-prnsg
helpers_test.go:274: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: describe non-running pods <======
helpers_test.go:277: (dbg) Run: kubectl --context old-k8s-version-023742 describe pod metrics-server-9975d5f86-prnsg
helpers_test.go:277: (dbg) Non-zero exit: kubectl --context old-k8s-version-023742 describe pod metrics-server-9975d5f86-prnsg: exit status 1 (141.589698ms)
** stderr **
Error from server (NotFound): pods "metrics-server-9975d5f86-prnsg" not found
** /stderr **
helpers_test.go:279: kubectl --context old-k8s-version-023742 describe pod metrics-server-9975d5f86-prnsg: exit status 1
--- FAIL: TestStartStop/group/old-k8s-version/serial/SecondStart (373.45s)