=== RUN TestStartStop/group/old-k8s-version/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run: out/minikube-linux-arm64 start -p old-k8s-version-571339 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=containerd --kubernetes-version=v1.20.0
E0312 00:20:14.658052 987686 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18358-982285/.minikube/profiles/functional-270400/client.crt: no such file or directory
start_stop_delete_test.go:256: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p old-k8s-version-571339 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=containerd --kubernetes-version=v1.20.0: exit status 80 (6m9.238080962s)
-- stdout --
* [old-k8s-version-571339] minikube v1.32.0 on Ubuntu 20.04 (arm64)
- MINIKUBE_LOCATION=18358
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/18358-982285/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/18358-982285/.minikube
- MINIKUBE_BIN=out/minikube-linux-arm64
- MINIKUBE_FORCE_SYSTEMD=
* Kubernetes 1.28.4 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.28.4
* Using the docker driver based on existing profile
* Starting "old-k8s-version-571339" primary control-plane node in "old-k8s-version-571339" cluster
* Pulling base image v0.0.42-1708944392-18244 ...
* Restarting existing docker container for "old-k8s-version-571339" ...
* Preparing Kubernetes v1.20.0 on containerd 1.6.28 ...
* Verifying Kubernetes components...
- Using image registry.k8s.io/echoserver:1.4
- Using image docker.io/kubernetesui/dashboard:v2.7.0
- Using image gcr.io/k8s-minikube/storage-provisioner:v5
- Using image fake.domain/registry.k8s.io/echoserver:1.4
* Some dashboard features require the metrics-server addon. To enable all features please run:
minikube -p old-k8s-version-571339 addons enable metrics-server
* Enabled addons: metrics-server, dashboard, storage-provisioner, default-storageclass
-- /stdout --
** stderr **
I0312 00:19:27.924280 1183642 out.go:291] Setting OutFile to fd 1 ...
I0312 00:19:27.924506 1183642 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0312 00:19:27.924518 1183642 out.go:304] Setting ErrFile to fd 2...
I0312 00:19:27.924524 1183642 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0312 00:19:27.924768 1183642 root.go:338] Updating PATH: /home/jenkins/minikube-integration/18358-982285/.minikube/bin
I0312 00:19:27.925169 1183642 out.go:298] Setting JSON to false
I0312 00:19:27.926137 1183642 start.go:129] hostinfo: {"hostname":"ip-172-31-29-130","uptime":18116,"bootTime":1710184652,"procs":182,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1055-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"36adf542-ef4f-4e2d-a0c8-6868d1383ff9"}
I0312 00:19:27.926215 1183642 start.go:139] virtualization:
I0312 00:19:27.930803 1183642 out.go:177] * [old-k8s-version-571339] minikube v1.32.0 on Ubuntu 20.04 (arm64)
I0312 00:19:27.933757 1183642 out.go:177] - MINIKUBE_LOCATION=18358
I0312 00:19:27.936016 1183642 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0312 00:19:27.933825 1183642 notify.go:220] Checking for updates...
I0312 00:19:27.939834 1183642 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/18358-982285/kubeconfig
I0312 00:19:27.942103 1183642 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/18358-982285/.minikube
I0312 00:19:27.943914 1183642 out.go:177] - MINIKUBE_BIN=out/minikube-linux-arm64
I0312 00:19:27.946058 1183642 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0312 00:19:27.949050 1183642 config.go:182] Loaded profile config "old-k8s-version-571339": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0
I0312 00:19:27.951626 1183642 out.go:177] * Kubernetes 1.28.4 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.28.4
I0312 00:19:27.953547 1183642 driver.go:392] Setting default libvirt URI to qemu:///system
I0312 00:19:27.977831 1183642 docker.go:122] docker version: linux-25.0.4:Docker Engine - Community
I0312 00:19:27.977955 1183642 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0312 00:19:28.064538 1183642 info.go:266] docker info: {ID:U5VK:ZNT5:35M3:FHLW:Q7TL:ELFX:BNAG:AV4T:UD2H:SK5L:SEJV:SJJL Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:56 OomKillDisable:true NGoroutines:71 SystemTime:2024-03-12 00:19:28.053909653 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1055-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215040000 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-29-130 Labels:[] ExperimentalBuild:false ServerVersion:25.0.4 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:ae07eda36dd25f8a1b98dfbf587313b99c0190bb Expected:ae07eda36dd25f8a1b98dfbf587313b99c0190bb} RuncCommit:{ID:v1.1.12-0-g51d5e94 Expected:v1.1.12-0-g51d5e94} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.13.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.24.7]] Warnings:<nil>}}
I0312 00:19:28.064659 1183642 docker.go:295] overlay module found
I0312 00:19:28.067182 1183642 out.go:177] * Using the docker driver based on existing profile
I0312 00:19:28.072192 1183642 start.go:297] selected driver: docker
I0312 00:19:28.072216 1183642 start.go:901] validating driver "docker" against &{Name:old-k8s-version-571339 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-571339 Namespace:default APIServerHAVIP: AP
IServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:fa
lse MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0312 00:19:28.072343 1183642 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0312 00:19:28.072961 1183642 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0312 00:19:28.164679 1183642 info.go:266] docker info: {ID:U5VK:ZNT5:35M3:FHLW:Q7TL:ELFX:BNAG:AV4T:UD2H:SK5L:SEJV:SJJL Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:56 OomKillDisable:true NGoroutines:71 SystemTime:2024-03-12 00:19:28.152268647 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1055-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215040000 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-29-130 Labels:[] ExperimentalBuild:false ServerVersion:25.0.4 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:ae07eda36dd25f8a1b98dfbf587313b99c0190bb Expected:ae07eda36dd25f8a1b98dfbf587313b99c0190bb} RuncCommit:{ID:v1.1.12-0-g51d5e94 Expected:v1.1.12-0-g51d5e94} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.13.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.24.7]] Warnings:<nil>}}
I0312 00:19:28.165153 1183642 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0312 00:19:28.165212 1183642 cni.go:84] Creating CNI manager for ""
I0312 00:19:28.165228 1183642 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0312 00:19:28.165296 1183642 start.go:340] cluster config:
{Name:old-k8s-version-571339 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-571339 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local
ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:do
cker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0312 00:19:28.167817 1183642 out.go:177] * Starting "old-k8s-version-571339" primary control-plane node in "old-k8s-version-571339" cluster
I0312 00:19:28.170083 1183642 cache.go:121] Beginning downloading kic base image for docker with containerd
I0312 00:19:28.172190 1183642 out.go:177] * Pulling base image v0.0.42-1708944392-18244 ...
I0312 00:19:28.174376 1183642 preload.go:132] Checking if preload exists for k8s version v1.20.0 and runtime containerd
I0312 00:19:28.174453 1183642 preload.go:147] Found local preload: /home/jenkins/minikube-integration/18358-982285/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-containerd-overlay2-arm64.tar.lz4
I0312 00:19:28.174467 1183642 cache.go:56] Caching tarball of preloaded images
I0312 00:19:28.174572 1183642 preload.go:173] Found /home/jenkins/minikube-integration/18358-982285/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-containerd-overlay2-arm64.tar.lz4 in cache, skipping download
I0312 00:19:28.174587 1183642 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on containerd
I0312 00:19:28.174725 1183642 profile.go:142] Saving config to /home/jenkins/minikube-integration/18358-982285/.minikube/profiles/old-k8s-version-571339/config.json ...
I0312 00:19:28.174975 1183642 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 in local docker daemon
I0312 00:19:28.206957 1183642 image.go:83] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 in local docker daemon, skipping pull
I0312 00:19:28.206990 1183642 cache.go:144] gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 exists in daemon, skipping load
I0312 00:19:28.207012 1183642 cache.go:194] Successfully downloaded all kic artifacts
I0312 00:19:28.207053 1183642 start.go:360] acquireMachinesLock for old-k8s-version-571339: {Name:mkef158f105a604472ef9e86e18cdf6a70ef4ce3 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0312 00:19:28.207146 1183642 start.go:364] duration metric: took 55.613µs to acquireMachinesLock for "old-k8s-version-571339"
I0312 00:19:28.207178 1183642 start.go:96] Skipping create...Using existing machine configuration
I0312 00:19:28.207196 1183642 fix.go:54] fixHost starting:
I0312 00:19:28.207598 1183642 cli_runner.go:164] Run: docker container inspect old-k8s-version-571339 --format={{.State.Status}}
I0312 00:19:28.229618 1183642 fix.go:112] recreateIfNeeded on old-k8s-version-571339: state=Stopped err=<nil>
W0312 00:19:28.229652 1183642 fix.go:138] unexpected machine state, will restart: <nil>
I0312 00:19:28.231988 1183642 out.go:177] * Restarting existing docker container for "old-k8s-version-571339" ...
I0312 00:19:28.233805 1183642 cli_runner.go:164] Run: docker start old-k8s-version-571339
I0312 00:19:28.627032 1183642 cli_runner.go:164] Run: docker container inspect old-k8s-version-571339 --format={{.State.Status}}
I0312 00:19:28.651517 1183642 kic.go:430] container "old-k8s-version-571339" state is running.
I0312 00:19:28.653571 1183642 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-571339
I0312 00:19:28.677176 1183642 profile.go:142] Saving config to /home/jenkins/minikube-integration/18358-982285/.minikube/profiles/old-k8s-version-571339/config.json ...
I0312 00:19:28.677431 1183642 machine.go:94] provisionDockerMachine start ...
I0312 00:19:28.677519 1183642 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-571339
I0312 00:19:28.702685 1183642 main.go:141] libmachine: Using SSH client type: native
I0312 00:19:28.703494 1183642 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e1ca0] 0x3e4500 <nil> [] 0s} 127.0.0.1 34197 <nil> <nil>}
I0312 00:19:28.703518 1183642 main.go:141] libmachine: About to run SSH command:
hostname
I0312 00:19:28.704764 1183642 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: EOF
I0312 00:19:31.836283 1183642 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-571339
I0312 00:19:31.836310 1183642 ubuntu.go:169] provisioning hostname "old-k8s-version-571339"
I0312 00:19:31.836386 1183642 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-571339
I0312 00:19:31.857338 1183642 main.go:141] libmachine: Using SSH client type: native
I0312 00:19:31.857587 1183642 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e1ca0] 0x3e4500 <nil> [] 0s} 127.0.0.1 34197 <nil> <nil>}
I0312 00:19:31.857598 1183642 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-571339 && echo "old-k8s-version-571339" | sudo tee /etc/hostname
I0312 00:19:32.010688 1183642 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-571339
I0312 00:19:32.010787 1183642 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-571339
I0312 00:19:32.028650 1183642 main.go:141] libmachine: Using SSH client type: native
I0312 00:19:32.028903 1183642 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e1ca0] 0x3e4500 <nil> [] 0s} 127.0.0.1 34197 <nil> <nil>}
I0312 00:19:32.028926 1183642 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-571339' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-571339/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-571339' | sudo tee -a /etc/hosts;
fi
fi
I0312 00:19:32.177325 1183642 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0312 00:19:32.177354 1183642 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/18358-982285/.minikube CaCertPath:/home/jenkins/minikube-integration/18358-982285/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/18358-982285/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/18358-982285/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/18358-982285/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/18358-982285/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/18358-982285/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/18358-982285/.minikube}
I0312 00:19:32.177384 1183642 ubuntu.go:177] setting up certificates
I0312 00:19:32.177396 1183642 provision.go:84] configureAuth start
I0312 00:19:32.177468 1183642 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-571339
I0312 00:19:32.192670 1183642 provision.go:143] copyHostCerts
I0312 00:19:32.192746 1183642 exec_runner.go:144] found /home/jenkins/minikube-integration/18358-982285/.minikube/ca.pem, removing ...
I0312 00:19:32.192765 1183642 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18358-982285/.minikube/ca.pem
I0312 00:19:32.192842 1183642 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18358-982285/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/18358-982285/.minikube/ca.pem (1082 bytes)
I0312 00:19:32.192952 1183642 exec_runner.go:144] found /home/jenkins/minikube-integration/18358-982285/.minikube/cert.pem, removing ...
I0312 00:19:32.192962 1183642 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18358-982285/.minikube/cert.pem
I0312 00:19:32.192995 1183642 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18358-982285/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/18358-982285/.minikube/cert.pem (1123 bytes)
I0312 00:19:32.193059 1183642 exec_runner.go:144] found /home/jenkins/minikube-integration/18358-982285/.minikube/key.pem, removing ...
I0312 00:19:32.193067 1183642 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18358-982285/.minikube/key.pem
I0312 00:19:32.193092 1183642 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18358-982285/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/18358-982285/.minikube/key.pem (1679 bytes)
I0312 00:19:32.193152 1183642 provision.go:117] generating server cert: /home/jenkins/minikube-integration/18358-982285/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/18358-982285/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/18358-982285/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-571339 san=[127.0.0.1 192.168.76.2 localhost minikube old-k8s-version-571339]
I0312 00:19:32.748994 1183642 provision.go:177] copyRemoteCerts
I0312 00:19:32.749071 1183642 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0312 00:19:32.749116 1183642 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-571339
I0312 00:19:32.766733 1183642 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34197 SSHKeyPath:/home/jenkins/minikube-integration/18358-982285/.minikube/machines/old-k8s-version-571339/id_rsa Username:docker}
I0312 00:19:32.870089 1183642 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18358-982285/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
I0312 00:19:32.897561 1183642 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18358-982285/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0312 00:19:32.931157 1183642 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18358-982285/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0312 00:19:32.960805 1183642 provision.go:87] duration metric: took 783.395542ms to configureAuth
I0312 00:19:32.960835 1183642 ubuntu.go:193] setting minikube options for container-runtime
I0312 00:19:32.961029 1183642 config.go:182] Loaded profile config "old-k8s-version-571339": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0
I0312 00:19:32.961042 1183642 machine.go:97] duration metric: took 4.283592657s to provisionDockerMachine
I0312 00:19:32.961049 1183642 start.go:293] postStartSetup for "old-k8s-version-571339" (driver="docker")
I0312 00:19:32.961060 1183642 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0312 00:19:32.961114 1183642 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0312 00:19:32.961157 1183642 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-571339
I0312 00:19:32.982707 1183642 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34197 SSHKeyPath:/home/jenkins/minikube-integration/18358-982285/.minikube/machines/old-k8s-version-571339/id_rsa Username:docker}
I0312 00:19:33.082502 1183642 ssh_runner.go:195] Run: cat /etc/os-release
I0312 00:19:33.086901 1183642 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0312 00:19:33.086941 1183642 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0312 00:19:33.086952 1183642 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0312 00:19:33.086959 1183642 info.go:137] Remote host: Ubuntu 22.04.3 LTS
I0312 00:19:33.086969 1183642 filesync.go:126] Scanning /home/jenkins/minikube-integration/18358-982285/.minikube/addons for local assets ...
I0312 00:19:33.087028 1183642 filesync.go:126] Scanning /home/jenkins/minikube-integration/18358-982285/.minikube/files for local assets ...
I0312 00:19:33.087120 1183642 filesync.go:149] local asset: /home/jenkins/minikube-integration/18358-982285/.minikube/files/etc/ssl/certs/9876862.pem -> 9876862.pem in /etc/ssl/certs
I0312 00:19:33.087233 1183642 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0312 00:19:33.098729 1183642 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18358-982285/.minikube/files/etc/ssl/certs/9876862.pem --> /etc/ssl/certs/9876862.pem (1708 bytes)
I0312 00:19:33.141404 1183642 start.go:296] duration metric: took 180.339073ms for postStartSetup
I0312 00:19:33.141497 1183642 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0312 00:19:33.141542 1183642 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-571339
I0312 00:19:33.187766 1183642 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34197 SSHKeyPath:/home/jenkins/minikube-integration/18358-982285/.minikube/machines/old-k8s-version-571339/id_rsa Username:docker}
I0312 00:19:33.311261 1183642 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I0312 00:19:33.317997 1183642 fix.go:56] duration metric: took 5.110802277s for fixHost
I0312 00:19:33.318022 1183642 start.go:83] releasing machines lock for "old-k8s-version-571339", held for 5.110863658s
I0312 00:19:33.318100 1183642 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-571339
I0312 00:19:33.351266 1183642 ssh_runner.go:195] Run: cat /version.json
I0312 00:19:33.351341 1183642 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-571339
I0312 00:19:33.353924 1183642 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0312 00:19:33.353977 1183642 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-571339
I0312 00:19:33.427590 1183642 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34197 SSHKeyPath:/home/jenkins/minikube-integration/18358-982285/.minikube/machines/old-k8s-version-571339/id_rsa Username:docker}
I0312 00:19:33.433781 1183642 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34197 SSHKeyPath:/home/jenkins/minikube-integration/18358-982285/.minikube/machines/old-k8s-version-571339/id_rsa Username:docker}
I0312 00:19:33.677828 1183642 ssh_runner.go:195] Run: systemctl --version
I0312 00:19:33.682693 1183642 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I0312 00:19:33.688098 1183642 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
I0312 00:19:33.710359 1183642 cni.go:230] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
I0312 00:19:33.710437 1183642 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0312 00:19:33.724954 1183642 cni.go:259] no active bridge cni configs found in "/etc/cni/net.d" - nothing to disable
I0312 00:19:33.724984 1183642 start.go:494] detecting cgroup driver to use...
I0312 00:19:33.725017 1183642 detect.go:196] detected "cgroupfs" cgroup driver on host os
I0312 00:19:33.725070 1183642 ssh_runner.go:195] Run: sudo systemctl stop -f crio
I0312 00:19:33.750631 1183642 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I0312 00:19:33.766262 1183642 docker.go:217] disabling cri-docker service (if available) ...
I0312 00:19:33.766351 1183642 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0312 00:19:33.782626 1183642 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0312 00:19:33.797267 1183642 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0312 00:19:33.985612 1183642 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0312 00:19:34.101386 1183642 docker.go:233] disabling docker service ...
I0312 00:19:34.101456 1183642 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0312 00:19:34.114888 1183642 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0312 00:19:34.128343 1183642 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0312 00:19:34.232573 1183642 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0312 00:19:34.346098 1183642 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0312 00:19:34.358365 1183642 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock
" | sudo tee /etc/crictl.yaml"
I0312 00:19:34.377113 1183642 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.2"|' /etc/containerd/config.toml"
I0312 00:19:34.388697 1183642 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
I0312 00:19:34.399165 1183642 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...
I0312 00:19:34.399229 1183642 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
I0312 00:19:34.409946 1183642 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0312 00:19:34.420764 1183642 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
I0312 00:19:34.431392 1183642 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0312 00:19:34.441865 1183642 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0312 00:19:34.451784 1183642 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
I0312 00:19:34.463271 1183642 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0312 00:19:34.472980 1183642 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0312 00:19:34.482556 1183642 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0312 00:19:34.595530 1183642 ssh_runner.go:195] Run: sudo systemctl restart containerd
I0312 00:19:34.837578 1183642 start.go:541] Will wait 60s for socket path /run/containerd/containerd.sock
I0312 00:19:34.837648 1183642 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
I0312 00:19:34.844030 1183642 start.go:562] Will wait 60s for crictl version
I0312 00:19:34.844092 1183642 ssh_runner.go:195] Run: which crictl
I0312 00:19:34.848343 1183642 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0312 00:19:34.935920 1183642 start.go:578] Version: 0.1.0
RuntimeName: containerd
RuntimeVersion: 1.6.28
RuntimeApiVersion: v1
I0312 00:19:34.936059 1183642 ssh_runner.go:195] Run: containerd --version
I0312 00:19:34.964366 1183642 ssh_runner.go:195] Run: containerd --version
I0312 00:19:34.999773 1183642 out.go:177] * Preparing Kubernetes v1.20.0 on containerd 1.6.28 ...
I0312 00:19:35.002361 1183642 cli_runner.go:164] Run: docker network inspect old-k8s-version-571339 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0312 00:19:35.020656 1183642 ssh_runner.go:195] Run: grep 192.168.76.1 host.minikube.internal$ /etc/hosts
I0312 00:19:35.025659 1183642 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.76.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0312 00:19:35.042393 1183642 kubeadm.go:877] updating cluster {Name:old-k8s-version-571339 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-571339 Namespace:default APIServerHAVIP: APIServerName:minik
ubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/
home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0312 00:19:35.042518 1183642 preload.go:132] Checking if preload exists for k8s version v1.20.0 and runtime containerd
I0312 00:19:35.042628 1183642 ssh_runner.go:195] Run: sudo crictl images --output json
I0312 00:19:35.094948 1183642 containerd.go:612] all images are preloaded for containerd runtime.
I0312 00:19:35.094971 1183642 containerd.go:519] Images already preloaded, skipping extraction
I0312 00:19:35.095041 1183642 ssh_runner.go:195] Run: sudo crictl images --output json
I0312 00:19:35.146471 1183642 containerd.go:612] all images are preloaded for containerd runtime.
I0312 00:19:35.146493 1183642 cache_images.go:84] Images are preloaded, skipping loading
I0312 00:19:35.146501 1183642 kubeadm.go:928] updating node { 192.168.76.2 8443 v1.20.0 containerd true true} ...
I0312 00:19:35.146660 1183642 kubeadm.go:940] kubelet [Unit]
Wants=containerd.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///run/containerd/containerd.sock --hostname-override=old-k8s-version-571339 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.76.2
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-571339 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0312 00:19:35.146730 1183642 ssh_runner.go:195] Run: sudo crictl info
I0312 00:19:35.193322 1183642 cni.go:84] Creating CNI manager for ""
I0312 00:19:35.193394 1183642 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0312 00:19:35.193416 1183642 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0312 00:19:35.193451 1183642 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.76.2 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-571339 NodeName:old-k8s-version-571339 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.76.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.76.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt
StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0312 00:19:35.193759 1183642 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.76.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /run/containerd/containerd.sock
name: "old-k8s-version-571339"
kubeletExtraArgs:
node-ip: 192.168.76.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.76.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0312 00:19:35.193874 1183642 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0312 00:19:35.204222 1183642 binaries.go:44] Found k8s binaries, skipping transfer
I0312 00:19:35.204293 1183642 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0312 00:19:35.213835 1183642 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (442 bytes)
I0312 00:19:35.234130 1183642 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0312 00:19:35.254832 1183642 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2125 bytes)
I0312 00:19:35.273678 1183642 ssh_runner.go:195] Run: grep 192.168.76.2 control-plane.minikube.internal$ /etc/hosts
I0312 00:19:35.277716 1183642 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.76.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0312 00:19:35.288999 1183642 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0312 00:19:35.399931 1183642 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0312 00:19:35.415821 1183642 certs.go:68] Setting up /home/jenkins/minikube-integration/18358-982285/.minikube/profiles/old-k8s-version-571339 for IP: 192.168.76.2
I0312 00:19:35.415900 1183642 certs.go:194] generating shared ca certs ...
I0312 00:19:35.415931 1183642 certs.go:226] acquiring lock for ca certs: {Name:mk0a8924146da92e76e9ff4162540f84539e9725 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0312 00:19:35.416113 1183642 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/18358-982285/.minikube/ca.key
I0312 00:19:35.416207 1183642 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/18358-982285/.minikube/proxy-client-ca.key
I0312 00:19:35.416234 1183642 certs.go:256] generating profile certs ...
I0312 00:19:35.416368 1183642 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/18358-982285/.minikube/profiles/old-k8s-version-571339/client.key
I0312 00:19:35.416474 1183642 certs.go:359] skipping valid signed profile cert regeneration for "minikube": /home/jenkins/minikube-integration/18358-982285/.minikube/profiles/old-k8s-version-571339/apiserver.key.01e96a04
I0312 00:19:35.416554 1183642 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/18358-982285/.minikube/profiles/old-k8s-version-571339/proxy-client.key
I0312 00:19:35.416715 1183642 certs.go:484] found cert: /home/jenkins/minikube-integration/18358-982285/.minikube/certs/987686.pem (1338 bytes)
W0312 00:19:35.416776 1183642 certs.go:480] ignoring /home/jenkins/minikube-integration/18358-982285/.minikube/certs/987686_empty.pem, impossibly tiny 0 bytes
I0312 00:19:35.416799 1183642 certs.go:484] found cert: /home/jenkins/minikube-integration/18358-982285/.minikube/certs/ca-key.pem (1675 bytes)
I0312 00:19:35.416855 1183642 certs.go:484] found cert: /home/jenkins/minikube-integration/18358-982285/.minikube/certs/ca.pem (1082 bytes)
I0312 00:19:35.416915 1183642 certs.go:484] found cert: /home/jenkins/minikube-integration/18358-982285/.minikube/certs/cert.pem (1123 bytes)
I0312 00:19:35.416961 1183642 certs.go:484] found cert: /home/jenkins/minikube-integration/18358-982285/.minikube/certs/key.pem (1679 bytes)
I0312 00:19:35.417039 1183642 certs.go:484] found cert: /home/jenkins/minikube-integration/18358-982285/.minikube/files/etc/ssl/certs/9876862.pem (1708 bytes)
I0312 00:19:35.417964 1183642 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18358-982285/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0312 00:19:35.463161 1183642 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18358-982285/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I0312 00:19:35.513407 1183642 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18358-982285/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0312 00:19:35.562220 1183642 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18358-982285/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0312 00:19:35.610311 1183642 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18358-982285/.minikube/profiles/old-k8s-version-571339/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0312 00:19:35.649554 1183642 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18358-982285/.minikube/profiles/old-k8s-version-571339/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0312 00:19:35.706934 1183642 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18358-982285/.minikube/profiles/old-k8s-version-571339/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0312 00:19:35.734164 1183642 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18358-982285/.minikube/profiles/old-k8s-version-571339/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0312 00:19:35.764765 1183642 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18358-982285/.minikube/certs/987686.pem --> /usr/share/ca-certificates/987686.pem (1338 bytes)
I0312 00:19:35.794696 1183642 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18358-982285/.minikube/files/etc/ssl/certs/9876862.pem --> /usr/share/ca-certificates/9876862.pem (1708 bytes)
I0312 00:19:35.825221 1183642 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18358-982285/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0312 00:19:35.854490 1183642 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0312 00:19:35.874924 1183642 ssh_runner.go:195] Run: openssl version
I0312 00:19:35.880869 1183642 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/987686.pem && ln -fs /usr/share/ca-certificates/987686.pem /etc/ssl/certs/987686.pem"
I0312 00:19:35.891073 1183642 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/987686.pem
I0312 00:19:35.895051 1183642 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Mar 11 23:40 /usr/share/ca-certificates/987686.pem
I0312 00:19:35.895124 1183642 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/987686.pem
I0312 00:19:35.902374 1183642 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/987686.pem /etc/ssl/certs/51391683.0"
I0312 00:19:35.912271 1183642 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/9876862.pem && ln -fs /usr/share/ca-certificates/9876862.pem /etc/ssl/certs/9876862.pem"
I0312 00:19:35.922962 1183642 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/9876862.pem
I0312 00:19:35.927834 1183642 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Mar 11 23:40 /usr/share/ca-certificates/9876862.pem
I0312 00:19:35.927902 1183642 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/9876862.pem
I0312 00:19:35.935387 1183642 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/9876862.pem /etc/ssl/certs/3ec20f2e.0"
I0312 00:19:35.946258 1183642 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0312 00:19:35.957604 1183642 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0312 00:19:35.961834 1183642 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Mar 11 23:34 /usr/share/ca-certificates/minikubeCA.pem
I0312 00:19:35.961904 1183642 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0312 00:19:35.970507 1183642 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0312 00:19:35.981249 1183642 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0312 00:19:35.985360 1183642 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
I0312 00:19:35.993799 1183642 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
I0312 00:19:36.002332 1183642 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
I0312 00:19:36.010909 1183642 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
I0312 00:19:36.020176 1183642 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
I0312 00:19:36.028628 1183642 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
I0312 00:19:36.036345 1183642 kubeadm.go:391] StartCluster: {Name:old-k8s-version-571339 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-571339 Namespace:default APIServerHAVIP: APIServerName:minikube
CA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/hom
e/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0312 00:19:36.036454 1183642 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}
I0312 00:19:36.036516 1183642 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0312 00:19:36.089711 1183642 cri.go:89] found id: "91ba0f1087505b74193c749143407b360ca52adeb6c8e6fed4c64111ff7ac963"
I0312 00:19:36.089749 1183642 cri.go:89] found id: "346ceec7d05caebb387531f35c381d5bed2ff6773b755619cd586b41e6efadd8"
I0312 00:19:36.089754 1183642 cri.go:89] found id: "1a5414516a6e0b5fd6faf9a04f4428d130258262f60692b0dffc8b7ffc8541a6"
I0312 00:19:36.089758 1183642 cri.go:89] found id: "8abc9a2fec8f5340e92089f46c5ff2bf798571fbcb6c7ce9545d0e353715bed4"
I0312 00:19:36.089761 1183642 cri.go:89] found id: "00fea42a626bc543839c933d2b36dd4155e2329531f2c8a74fa65079753377a9"
I0312 00:19:36.089765 1183642 cri.go:89] found id: "c3f64500c09efd7fdf78260f3bef5ed1adaefa3e3a847a7540726cbee6bd042f"
I0312 00:19:36.089768 1183642 cri.go:89] found id: "ac83611721f7a3d26415ed5ae3625edece62f8bd00bc9a63ce61ffa2ad2c9fbc"
I0312 00:19:36.089771 1183642 cri.go:89] found id: "022154a50546e744b25648ac078a4535c3a97e91f97547e8008e89235fd126f5"
I0312 00:19:36.089775 1183642 cri.go:89] found id: ""
I0312 00:19:36.089832 1183642 ssh_runner.go:195] Run: sudo runc --root /run/containerd/runc/k8s.io list -f json
I0312 00:19:36.110477 1183642 cri.go:116] JSON = null
W0312 00:19:36.110530 1183642 kubeadm.go:398] unpause failed: list paused: list returned 0 containers, but ps returned 8
I0312 00:19:36.110615 1183642 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
W0312 00:19:36.120924 1183642 kubeadm.go:404] apiserver tunnel failed: apiserver port not set
I0312 00:19:36.120950 1183642 kubeadm.go:407] found existing configuration files, will attempt cluster restart
I0312 00:19:36.120956 1183642 kubeadm.go:587] restartPrimaryControlPlane start ...
I0312 00:19:36.121012 1183642 ssh_runner.go:195] Run: sudo test -d /data/minikube
I0312 00:19:36.130926 1183642 kubeadm.go:129] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
stdout:
stderr:
I0312 00:19:36.131453 1183642 kubeconfig.go:47] verify endpoint returned: get endpoint: "old-k8s-version-571339" does not appear in /home/jenkins/minikube-integration/18358-982285/kubeconfig
I0312 00:19:36.131570 1183642 kubeconfig.go:62] /home/jenkins/minikube-integration/18358-982285/kubeconfig needs updating (will repair): [kubeconfig missing "old-k8s-version-571339" cluster setting kubeconfig missing "old-k8s-version-571339" context setting]
I0312 00:19:36.131865 1183642 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18358-982285/kubeconfig: {Name:mk502765d2bd81c45b0b0cd22382df706d40c442 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0312 00:19:36.133058 1183642 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
I0312 00:19:36.144065 1183642 kubeadm.go:624] The running cluster does not require reconfiguration: 192.168.76.2
I0312 00:19:36.144103 1183642 kubeadm.go:591] duration metric: took 23.141667ms to restartPrimaryControlPlane
I0312 00:19:36.144114 1183642 kubeadm.go:393] duration metric: took 107.779355ms to StartCluster
I0312 00:19:36.144130 1183642 settings.go:142] acquiring lock: {Name:mk66549f73c966ba6f23af9cfb4fef2b1aaf9da2 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0312 00:19:36.144201 1183642 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/18358-982285/kubeconfig
I0312 00:19:36.145498 1183642 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18358-982285/kubeconfig: {Name:mk502765d2bd81c45b0b0cd22382df706d40c442 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0312 00:19:36.145941 1183642 config.go:182] Loaded profile config "old-k8s-version-571339": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0
I0312 00:19:36.145997 1183642 start.go:234] Will wait 6m0s for node &{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}
I0312 00:19:36.152050 1183642 out.go:177] * Verifying Kubernetes components...
I0312 00:19:36.146062 1183642 addons.go:502] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:true default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volumesnapshots:false yakd:false]
I0312 00:19:36.152139 1183642 addons.go:69] Setting dashboard=true in profile "old-k8s-version-571339"
I0312 00:19:36.152173 1183642 addons.go:234] Setting addon dashboard=true in "old-k8s-version-571339"
W0312 00:19:36.152189 1183642 addons.go:243] addon dashboard should already be in state true
I0312 00:19:36.152225 1183642 host.go:66] Checking if "old-k8s-version-571339" exists ...
I0312 00:19:36.152702 1183642 cli_runner.go:164] Run: docker container inspect old-k8s-version-571339 --format={{.State.Status}}
I0312 00:19:36.152831 1183642 addons.go:69] Setting storage-provisioner=true in profile "old-k8s-version-571339"
I0312 00:19:36.152875 1183642 addons.go:234] Setting addon storage-provisioner=true in "old-k8s-version-571339"
W0312 00:19:36.152887 1183642 addons.go:243] addon storage-provisioner should already be in state true
I0312 00:19:36.152910 1183642 host.go:66] Checking if "old-k8s-version-571339" exists ...
I0312 00:19:36.153349 1183642 cli_runner.go:164] Run: docker container inspect old-k8s-version-571339 --format={{.State.Status}}
I0312 00:19:36.163590 1183642 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0312 00:19:36.156588 1183642 addons.go:69] Setting default-storageclass=true in profile "old-k8s-version-571339"
I0312 00:19:36.163817 1183642 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "old-k8s-version-571339"
I0312 00:19:36.164135 1183642 cli_runner.go:164] Run: docker container inspect old-k8s-version-571339 --format={{.State.Status}}
I0312 00:19:36.156612 1183642 addons.go:69] Setting metrics-server=true in profile "old-k8s-version-571339"
I0312 00:19:36.171741 1183642 addons.go:234] Setting addon metrics-server=true in "old-k8s-version-571339"
W0312 00:19:36.171762 1183642 addons.go:243] addon metrics-server should already be in state true
I0312 00:19:36.171806 1183642 host.go:66] Checking if "old-k8s-version-571339" exists ...
I0312 00:19:36.172476 1183642 cli_runner.go:164] Run: docker container inspect old-k8s-version-571339 --format={{.State.Status}}
I0312 00:19:36.197296 1183642 out.go:177] - Using image registry.k8s.io/echoserver:1.4
I0312 00:19:36.199642 1183642 out.go:177] - Using image docker.io/kubernetesui/dashboard:v2.7.0
I0312 00:19:36.201906 1183642 addons.go:426] installing /etc/kubernetes/addons/dashboard-ns.yaml
I0312 00:19:36.201938 1183642 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-ns.yaml (759 bytes)
I0312 00:19:36.202041 1183642 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-571339
I0312 00:19:36.234063 1183642 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0312 00:19:36.239981 1183642 addons.go:426] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0312 00:19:36.240004 1183642 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0312 00:19:36.240071 1183642 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-571339
I0312 00:19:36.248415 1183642 out.go:177] - Using image fake.domain/registry.k8s.io/echoserver:1.4
I0312 00:19:36.250300 1183642 addons.go:426] installing /etc/kubernetes/addons/metrics-apiservice.yaml
I0312 00:19:36.250324 1183642 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
I0312 00:19:36.250393 1183642 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-571339
I0312 00:19:36.287089 1183642 addons.go:234] Setting addon default-storageclass=true in "old-k8s-version-571339"
W0312 00:19:36.287120 1183642 addons.go:243] addon default-storageclass should already be in state true
I0312 00:19:36.287152 1183642 host.go:66] Checking if "old-k8s-version-571339" exists ...
I0312 00:19:36.287414 1183642 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34197 SSHKeyPath:/home/jenkins/minikube-integration/18358-982285/.minikube/machines/old-k8s-version-571339/id_rsa Username:docker}
I0312 00:19:36.288385 1183642 cli_runner.go:164] Run: docker container inspect old-k8s-version-571339 --format={{.State.Status}}
I0312 00:19:36.333745 1183642 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34197 SSHKeyPath:/home/jenkins/minikube-integration/18358-982285/.minikube/machines/old-k8s-version-571339/id_rsa Username:docker}
I0312 00:19:36.343002 1183642 addons.go:426] installing /etc/kubernetes/addons/storageclass.yaml
I0312 00:19:36.343030 1183642 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0312 00:19:36.343100 1183642 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-571339
I0312 00:19:36.344780 1183642 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34197 SSHKeyPath:/home/jenkins/minikube-integration/18358-982285/.minikube/machines/old-k8s-version-571339/id_rsa Username:docker}
I0312 00:19:36.375420 1183642 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34197 SSHKeyPath:/home/jenkins/minikube-integration/18358-982285/.minikube/machines/old-k8s-version-571339/id_rsa Username:docker}
I0312 00:19:36.420313 1183642 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0312 00:19:36.474219 1183642 node_ready.go:35] waiting up to 6m0s for node "old-k8s-version-571339" to be "Ready" ...
I0312 00:19:36.520332 1183642 addons.go:426] installing /etc/kubernetes/addons/dashboard-clusterrole.yaml
I0312 00:19:36.520359 1183642 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-clusterrole.yaml (1001 bytes)
I0312 00:19:36.563236 1183642 addons.go:426] installing /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml
I0312 00:19:36.563263 1183642 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml (1018 bytes)
I0312 00:19:36.584863 1183642 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0312 00:19:36.614870 1183642 addons.go:426] installing /etc/kubernetes/addons/dashboard-configmap.yaml
I0312 00:19:36.614944 1183642 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-configmap.yaml (837 bytes)
I0312 00:19:36.629502 1183642 addons.go:426] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
I0312 00:19:36.629574 1183642 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1825 bytes)
I0312 00:19:36.654139 1183642 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0312 00:19:36.712198 1183642 addons.go:426] installing /etc/kubernetes/addons/dashboard-dp.yaml
I0312 00:19:36.712274 1183642 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-dp.yaml (4201 bytes)
I0312 00:19:36.764027 1183642 addons.go:426] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
I0312 00:19:36.764101 1183642 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
I0312 00:19:36.797773 1183642 addons.go:426] installing /etc/kubernetes/addons/dashboard-role.yaml
I0312 00:19:36.797847 1183642 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-role.yaml (1724 bytes)
W0312 00:19:36.848350 1183642 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0312 00:19:36.848448 1183642 retry.go:31] will retry after 198.882566ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0312 00:19:36.866505 1183642 addons.go:426] installing /etc/kubernetes/addons/metrics-server-service.yaml
I0312 00:19:36.866584 1183642 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
I0312 00:19:36.891353 1183642 addons.go:426] installing /etc/kubernetes/addons/dashboard-rolebinding.yaml
I0312 00:19:36.891425 1183642 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-rolebinding.yaml (1046 bytes)
I0312 00:19:36.924977 1183642 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0312 00:19:36.926395 1183642 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0312 00:19:36.926506 1183642 retry.go:31] will retry after 284.598578ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0312 00:19:36.965267 1183642 addons.go:426] installing /etc/kubernetes/addons/dashboard-sa.yaml
I0312 00:19:36.965344 1183642 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-sa.yaml (837 bytes)
W0312 00:19:37.047660 1183642 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0312 00:19:37.047743 1183642 retry.go:31] will retry after 279.598784ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0312 00:19:37.047883 1183642 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I0312 00:19:37.080665 1183642 addons.go:426] installing /etc/kubernetes/addons/dashboard-secret.yaml
I0312 00:19:37.080741 1183642 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-secret.yaml (1389 bytes)
I0312 00:19:37.156913 1183642 addons.go:426] installing /etc/kubernetes/addons/dashboard-svc.yaml
I0312 00:19:37.156977 1183642 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-svc.yaml (1294 bytes)
W0312 00:19:37.178706 1183642 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0312 00:19:37.178794 1183642 retry.go:31] will retry after 224.522162ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0312 00:19:37.193433 1183642 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0312 00:19:37.211694 1183642 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0312 00:19:37.327233 1183642 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0312 00:19:37.327331 1183642 retry.go:31] will retry after 237.821499ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0312 00:19:37.328276 1183642 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0312 00:19:37.403626 1183642 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0312 00:19:37.458822 1183642 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0312 00:19:37.458903 1183642 retry.go:31] will retry after 189.923605ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0312 00:19:37.565087 1183642 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0312 00:19:37.565170 1183642 retry.go:31] will retry after 362.412934ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0312 00:19:37.565318 1183642 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0312 00:19:37.573897 1183642 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0312 00:19:37.573999 1183642 retry.go:31] will retry after 481.80373ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0312 00:19:37.649857 1183642 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0312 00:19:37.685564 1183642 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0312 00:19:37.685643 1183642 retry.go:31] will retry after 239.083993ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0312 00:19:37.760513 1183642 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0312 00:19:37.760602 1183642 retry.go:31] will retry after 736.185082ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0312 00:19:37.925163 1183642 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0312 00:19:37.927878 1183642 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0312 00:19:38.056778 1183642 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0312 00:19:38.116957 1183642 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0312 00:19:38.117002 1183642 retry.go:31] will retry after 826.110547ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0312 00:19:38.153910 1183642 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0312 00:19:38.153958 1183642 retry.go:31] will retry after 425.811006ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0312 00:19:38.234309 1183642 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0312 00:19:38.234343 1183642 retry.go:31] will retry after 642.858099ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0312 00:19:38.475169 1183642 node_ready.go:53] error getting node "old-k8s-version-571339": Get "https://192.168.76.2:8443/api/v1/nodes/old-k8s-version-571339": dial tcp 192.168.76.2:8443: connect: connection refused
I0312 00:19:38.497398 1183642 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I0312 00:19:38.580831 1183642 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0312 00:19:38.590106 1183642 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0312 00:19:38.590152 1183642 retry.go:31] will retry after 620.915493ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0312 00:19:38.688659 1183642 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0312 00:19:38.688693 1183642 retry.go:31] will retry after 537.815514ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0312 00:19:38.878094 1183642 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I0312 00:19:38.943421 1183642 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0312 00:19:38.979888 1183642 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0312 00:19:38.979922 1183642 retry.go:31] will retry after 1.462265632s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0312 00:19:39.074285 1183642 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0312 00:19:39.074320 1183642 retry.go:31] will retry after 966.348537ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0312 00:19:39.211629 1183642 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I0312 00:19:39.227128 1183642 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0312 00:19:39.382054 1183642 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0312 00:19:39.382100 1183642 retry.go:31] will retry after 1.390812722s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0312 00:19:39.416043 1183642 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0312 00:19:39.416077 1183642 retry.go:31] will retry after 1.193780421s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0312 00:19:40.041051 1183642 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0312 00:19:40.145032 1183642 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0312 00:19:40.145098 1183642 retry.go:31] will retry after 1.627252687s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0312 00:19:40.442468 1183642 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I0312 00:19:40.475403 1183642 node_ready.go:53] error getting node "old-k8s-version-571339": Get "https://192.168.76.2:8443/api/v1/nodes/old-k8s-version-571339": dial tcp 192.168.76.2:8443: connect: connection refused
W0312 00:19:40.543695 1183642 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0312 00:19:40.543778 1183642 retry.go:31] will retry after 2.278359957s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0312 00:19:40.610071 1183642 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0312 00:19:40.714211 1183642 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0312 00:19:40.714245 1183642 retry.go:31] will retry after 1.31764435s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0312 00:19:40.773599 1183642 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0312 00:19:40.868635 1183642 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0312 00:19:40.868664 1183642 retry.go:31] will retry after 1.095904929s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0312 00:19:41.773092 1183642 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0312 00:19:41.870567 1183642 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0312 00:19:41.870603 1183642 retry.go:31] will retry after 1.765202948s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0312 00:19:41.964930 1183642 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I0312 00:19:42.032705 1183642 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0312 00:19:42.086008 1183642 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0312 00:19:42.086049 1183642 retry.go:31] will retry after 2.445331579s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0312 00:19:42.198776 1183642 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0312 00:19:42.198816 1183642 retry.go:31] will retry after 3.514217165s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0312 00:19:42.475572 1183642 node_ready.go:53] error getting node "old-k8s-version-571339": Get "https://192.168.76.2:8443/api/v1/nodes/old-k8s-version-571339": dial tcp 192.168.76.2:8443: connect: connection refused
I0312 00:19:42.823169 1183642 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0312 00:19:42.922240 1183642 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0312 00:19:42.922272 1183642 retry.go:31] will retry after 4.024510858s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0312 00:19:43.636025 1183642 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0312 00:19:43.734056 1183642 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0312 00:19:43.734094 1183642 retry.go:31] will retry after 2.622307387s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0312 00:19:44.532005 1183642 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0312 00:19:44.774635 1183642 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0312 00:19:44.774666 1183642 retry.go:31] will retry after 4.26181263s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0312 00:19:44.975360 1183642 node_ready.go:53] error getting node "old-k8s-version-571339": Get "https://192.168.76.2:8443/api/v1/nodes/old-k8s-version-571339": dial tcp 192.168.76.2:8443: connect: connection refused
I0312 00:19:45.713798 1183642 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0312 00:19:46.357041 1183642 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0312 00:19:46.946937 1183642 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I0312 00:19:49.037650 1183642 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I0312 00:19:56.630305 1183642 node_ready.go:49] node "old-k8s-version-571339" has status "Ready":"True"
I0312 00:19:56.630331 1183642 node_ready.go:38] duration metric: took 20.156023974s for node "old-k8s-version-571339" to be "Ready" ...
I0312 00:19:56.630341 1183642 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0312 00:19:56.992516 1183642 pod_ready.go:78] waiting up to 6m0s for pod "coredns-74ff55c5b-pd7cs" in "kube-system" namespace to be "Ready" ...
I0312 00:19:57.122827 1183642 pod_ready.go:92] pod "coredns-74ff55c5b-pd7cs" in "kube-system" namespace has status "Ready":"True"
I0312 00:19:57.122904 1183642 pod_ready.go:81] duration metric: took 130.298802ms for pod "coredns-74ff55c5b-pd7cs" in "kube-system" namespace to be "Ready" ...
I0312 00:19:57.122930 1183642 pod_ready.go:78] waiting up to 6m0s for pod "etcd-old-k8s-version-571339" in "kube-system" namespace to be "Ready" ...
I0312 00:19:57.203973 1183642 pod_ready.go:92] pod "etcd-old-k8s-version-571339" in "kube-system" namespace has status "Ready":"True"
I0312 00:19:57.204049 1183642 pod_ready.go:81] duration metric: took 81.098773ms for pod "etcd-old-k8s-version-571339" in "kube-system" namespace to be "Ready" ...
I0312 00:19:57.204077 1183642 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-old-k8s-version-571339" in "kube-system" namespace to be "Ready" ...
I0312 00:19:58.890393 1183642 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (13.176549984s)
I0312 00:19:58.890460 1183642 addons.go:470] Verifying addon metrics-server=true in "old-k8s-version-571339"
I0312 00:19:59.038960 1183642 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: (12.681872642s)
I0312 00:19:59.040915 1183642 out.go:177] * Some dashboard features require the metrics-server addon. To enable all features please run:
minikube -p old-k8s-version-571339 addons enable metrics-server
I0312 00:19:59.039114 1183642 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: (12.092144s)
I0312 00:19:59.039180 1183642 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: (10.001506048s)
I0312 00:19:59.056365 1183642 out.go:177] * Enabled addons: metrics-server, dashboard, storage-provisioner, default-storageclass
I0312 00:19:59.058375 1183642 addons.go:505] duration metric: took 22.9122948s for enable addons: enabled=[metrics-server dashboard storage-provisioner default-storageclass]
I0312 00:19:59.214769 1183642 pod_ready.go:102] pod "kube-apiserver-old-k8s-version-571339" in "kube-system" namespace has status "Ready":"False"
I0312 00:20:01.712824 1183642 pod_ready.go:102] pod "kube-apiserver-old-k8s-version-571339" in "kube-system" namespace has status "Ready":"False"
I0312 00:20:04.210681 1183642 pod_ready.go:102] pod "kube-apiserver-old-k8s-version-571339" in "kube-system" namespace has status "Ready":"False"
I0312 00:20:06.210987 1183642 pod_ready.go:92] pod "kube-apiserver-old-k8s-version-571339" in "kube-system" namespace has status "Ready":"True"
I0312 00:20:06.211014 1183642 pod_ready.go:81] duration metric: took 9.006916676s for pod "kube-apiserver-old-k8s-version-571339" in "kube-system" namespace to be "Ready" ...
I0312 00:20:06.211026 1183642 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-old-k8s-version-571339" in "kube-system" namespace to be "Ready" ...
I0312 00:20:08.217646 1183642 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-571339" in "kube-system" namespace has status "Ready":"False"
I0312 00:20:10.718546 1183642 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-571339" in "kube-system" namespace has status "Ready":"False"
I0312 00:20:12.725138 1183642 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-571339" in "kube-system" namespace has status "Ready":"False"
I0312 00:20:15.220888 1183642 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-571339" in "kube-system" namespace has status "Ready":"False"
I0312 00:20:17.719016 1183642 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-571339" in "kube-system" namespace has status "Ready":"False"
I0312 00:20:19.719148 1183642 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-571339" in "kube-system" namespace has status "Ready":"False"
I0312 00:20:21.770787 1183642 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-571339" in "kube-system" namespace has status "Ready":"False"
I0312 00:20:24.218434 1183642 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-571339" in "kube-system" namespace has status "Ready":"False"
I0312 00:20:26.724512 1183642 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-571339" in "kube-system" namespace has status "Ready":"False"
I0312 00:20:29.218890 1183642 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-571339" in "kube-system" namespace has status "Ready":"False"
I0312 00:20:31.227402 1183642 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-571339" in "kube-system" namespace has status "Ready":"False"
I0312 00:20:33.718093 1183642 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-571339" in "kube-system" namespace has status "Ready":"False"
I0312 00:20:36.218085 1183642 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-571339" in "kube-system" namespace has status "Ready":"False"
I0312 00:20:38.219444 1183642 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-571339" in "kube-system" namespace has status "Ready":"False"
I0312 00:20:40.718284 1183642 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-571339" in "kube-system" namespace has status "Ready":"False"
I0312 00:20:42.718531 1183642 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-571339" in "kube-system" namespace has status "Ready":"False"
I0312 00:20:45.217852 1183642 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-571339" in "kube-system" namespace has status "Ready":"False"
I0312 00:20:47.220802 1183642 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-571339" in "kube-system" namespace has status "Ready":"False"
I0312 00:20:49.718150 1183642 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-571339" in "kube-system" namespace has status "Ready":"False"
I0312 00:20:52.223566 1183642 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-571339" in "kube-system" namespace has status "Ready":"False"
I0312 00:20:54.718119 1183642 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-571339" in "kube-system" namespace has status "Ready":"False"
I0312 00:20:56.719178 1183642 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-571339" in "kube-system" namespace has status "Ready":"False"
I0312 00:20:59.220911 1183642 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-571339" in "kube-system" namespace has status "Ready":"False"
I0312 00:21:01.719534 1183642 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-571339" in "kube-system" namespace has status "Ready":"False"
I0312 00:21:03.227170 1183642 pod_ready.go:92] pod "kube-controller-manager-old-k8s-version-571339" in "kube-system" namespace has status "Ready":"True"
I0312 00:21:03.227190 1183642 pod_ready.go:81] duration metric: took 57.016156506s for pod "kube-controller-manager-old-k8s-version-571339" in "kube-system" namespace to be "Ready" ...
I0312 00:21:03.227202 1183642 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-tvrz6" in "kube-system" namespace to be "Ready" ...
I0312 00:21:03.233214 1183642 pod_ready.go:92] pod "kube-proxy-tvrz6" in "kube-system" namespace has status "Ready":"True"
I0312 00:21:03.233236 1183642 pod_ready.go:81] duration metric: took 6.026509ms for pod "kube-proxy-tvrz6" in "kube-system" namespace to be "Ready" ...
I0312 00:21:03.233252 1183642 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-old-k8s-version-571339" in "kube-system" namespace to be "Ready" ...
I0312 00:21:05.239789 1183642 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-571339" in "kube-system" namespace has status "Ready":"False"
I0312 00:21:07.740120 1183642 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-571339" in "kube-system" namespace has status "Ready":"False"
I0312 00:21:10.240027 1183642 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-571339" in "kube-system" namespace has status "Ready":"False"
I0312 00:21:12.739407 1183642 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-571339" in "kube-system" namespace has status "Ready":"False"
I0312 00:21:14.739905 1183642 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-571339" in "kube-system" namespace has status "Ready":"False"
I0312 00:21:17.239412 1183642 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-571339" in "kube-system" namespace has status "Ready":"False"
I0312 00:21:19.240306 1183642 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-571339" in "kube-system" namespace has status "Ready":"False"
I0312 00:21:21.741209 1183642 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-571339" in "kube-system" namespace has status "Ready":"False"
I0312 00:21:23.741756 1183642 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-571339" in "kube-system" namespace has status "Ready":"False"
I0312 00:21:25.243129 1183642 pod_ready.go:92] pod "kube-scheduler-old-k8s-version-571339" in "kube-system" namespace has status "Ready":"True"
I0312 00:21:25.243227 1183642 pod_ready.go:81] duration metric: took 22.009965136s for pod "kube-scheduler-old-k8s-version-571339" in "kube-system" namespace to be "Ready" ...
I0312 00:21:25.243292 1183642 pod_ready.go:78] waiting up to 6m0s for pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace to be "Ready" ...
I0312 00:21:27.249922 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:21:29.253629 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:21:31.750359 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:21:34.249496 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:21:36.250802 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:21:38.250948 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:21:40.754158 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:21:43.249095 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:21:45.250392 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:21:47.749722 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:21:49.749754 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:21:51.750403 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:21:54.250385 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:21:56.770534 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:21:59.249206 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:22:01.258864 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:22:03.749523 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:22:05.750110 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:22:08.250519 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:22:10.750288 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:22:13.250136 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:22:15.256797 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:22:17.749938 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:22:20.249074 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:22:22.249939 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:22:24.748800 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:22:26.749624 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:22:29.253144 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:22:31.749968 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:22:34.250397 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:22:36.749482 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:22:39.249893 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:22:41.749896 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:22:44.249675 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:22:46.749855 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:22:49.249664 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:22:51.249976 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:22:53.250606 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:22:55.750464 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:22:58.249257 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:23:00.267356 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:23:02.750532 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:23:05.250606 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:23:07.750716 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:23:10.251242 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:23:12.749463 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:23:15.252504 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:23:17.749439 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:23:19.750446 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:23:22.249233 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:23:24.750135 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:23:27.249368 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:23:29.751700 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:23:32.252338 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:23:34.749267 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:23:36.750479 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:23:39.250553 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:23:41.750376 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:23:43.750574 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:23:46.249404 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:23:48.250459 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:23:50.259454 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:23:52.750308 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:23:55.250042 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:23:57.750235 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:24:00.267118 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:24:02.748886 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:24:04.749475 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:24:07.250678 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:24:09.749225 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:24:11.750512 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:24:14.250329 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:24:16.749575 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:24:19.250281 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:24:21.749352 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:24:23.749394 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:24:25.749579 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:24:27.750348 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:24:30.249873 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:24:32.249981 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:24:34.749339 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:24:37.249723 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:24:39.249953 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:24:41.749722 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:24:43.750163 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:24:46.249711 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:24:48.249848 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:24:50.250297 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:24:52.753532 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:24:55.251518 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:24:57.749656 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:24:59.749784 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:25:01.750995 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:25:04.251144 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:25:06.749259 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:25:08.749400 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:25:10.750185 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:25:13.249560 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:25:15.249809 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:25:17.250310 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:25:19.749835 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:25:21.749927 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:25:23.750869 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:25:25.249870 1183642 pod_ready.go:81] duration metric: took 4m0.006519105s for pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace to be "Ready" ...
E0312 00:25:25.249898 1183642 pod_ready.go:66] WaitExtra: waitPodCondition: context deadline exceeded
I0312 00:25:25.249907 1183642 pod_ready.go:38] duration metric: took 5m28.619543264s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0312 00:25:25.256852 1183642 api_server.go:52] waiting for apiserver process to appear ...
I0312 00:25:25.256936 1183642 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
I0312 00:25:25.257019 1183642 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0312 00:25:25.300453 1183642 cri.go:89] found id: "e90658574cccc9b56ea1fd38865b78eb14b34d54f7b6d6f655f8b82d026ee372"
I0312 00:25:25.300515 1183642 cri.go:89] found id: "022154a50546e744b25648ac078a4535c3a97e91f97547e8008e89235fd126f5"
I0312 00:25:25.300533 1183642 cri.go:89] found id: ""
I0312 00:25:25.300551 1183642 logs.go:276] 2 containers: [e90658574cccc9b56ea1fd38865b78eb14b34d54f7b6d6f655f8b82d026ee372 022154a50546e744b25648ac078a4535c3a97e91f97547e8008e89235fd126f5]
I0312 00:25:25.300638 1183642 ssh_runner.go:195] Run: which crictl
I0312 00:25:25.304205 1183642 ssh_runner.go:195] Run: which crictl
I0312 00:25:25.307725 1183642 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
I0312 00:25:25.307813 1183642 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0312 00:25:25.344547 1183642 cri.go:89] found id: "227b5f4c3ec0b541f1e734b3a9400260044363214781e1a18f0928e954c98086"
I0312 00:25:25.344570 1183642 cri.go:89] found id: "00fea42a626bc543839c933d2b36dd4155e2329531f2c8a74fa65079753377a9"
I0312 00:25:25.344576 1183642 cri.go:89] found id: ""
I0312 00:25:25.344583 1183642 logs.go:276] 2 containers: [227b5f4c3ec0b541f1e734b3a9400260044363214781e1a18f0928e954c98086 00fea42a626bc543839c933d2b36dd4155e2329531f2c8a74fa65079753377a9]
I0312 00:25:25.344658 1183642 ssh_runner.go:195] Run: which crictl
I0312 00:25:25.348234 1183642 ssh_runner.go:195] Run: which crictl
I0312 00:25:25.351686 1183642 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
I0312 00:25:25.351805 1183642 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0312 00:25:25.393110 1183642 cri.go:89] found id: "0d3039260ff7a1d3154eac6a37f5460535e860a77d3473b023822022e245e097"
I0312 00:25:25.393134 1183642 cri.go:89] found id: "91ba0f1087505b74193c749143407b360ca52adeb6c8e6fed4c64111ff7ac963"
I0312 00:25:25.393139 1183642 cri.go:89] found id: ""
I0312 00:25:25.393146 1183642 logs.go:276] 2 containers: [0d3039260ff7a1d3154eac6a37f5460535e860a77d3473b023822022e245e097 91ba0f1087505b74193c749143407b360ca52adeb6c8e6fed4c64111ff7ac963]
I0312 00:25:25.393203 1183642 ssh_runner.go:195] Run: which crictl
I0312 00:25:25.396999 1183642 ssh_runner.go:195] Run: which crictl
I0312 00:25:25.400568 1183642 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
I0312 00:25:25.400686 1183642 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0312 00:25:25.439058 1183642 cri.go:89] found id: "cda4f1be508f3de4744e406ac4acfcb87143068155c189f0e7506f78db3a42c9"
I0312 00:25:25.439084 1183642 cri.go:89] found id: "c3f64500c09efd7fdf78260f3bef5ed1adaefa3e3a847a7540726cbee6bd042f"
I0312 00:25:25.439089 1183642 cri.go:89] found id: ""
I0312 00:25:25.439096 1183642 logs.go:276] 2 containers: [cda4f1be508f3de4744e406ac4acfcb87143068155c189f0e7506f78db3a42c9 c3f64500c09efd7fdf78260f3bef5ed1adaefa3e3a847a7540726cbee6bd042f]
I0312 00:25:25.439197 1183642 ssh_runner.go:195] Run: which crictl
I0312 00:25:25.443086 1183642 ssh_runner.go:195] Run: which crictl
I0312 00:25:25.446900 1183642 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
I0312 00:25:25.446974 1183642 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0312 00:25:25.488093 1183642 cri.go:89] found id: "46d69c632200b08b2b8f94cd051969df887d9d074acace5d606fef37cc84295e"
I0312 00:25:25.488164 1183642 cri.go:89] found id: "8abc9a2fec8f5340e92089f46c5ff2bf798571fbcb6c7ce9545d0e353715bed4"
I0312 00:25:25.488181 1183642 cri.go:89] found id: ""
I0312 00:25:25.488196 1183642 logs.go:276] 2 containers: [46d69c632200b08b2b8f94cd051969df887d9d074acace5d606fef37cc84295e 8abc9a2fec8f5340e92089f46c5ff2bf798571fbcb6c7ce9545d0e353715bed4]
I0312 00:25:25.488286 1183642 ssh_runner.go:195] Run: which crictl
I0312 00:25:25.492007 1183642 ssh_runner.go:195] Run: which crictl
I0312 00:25:25.495477 1183642 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
I0312 00:25:25.495557 1183642 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0312 00:25:25.536694 1183642 cri.go:89] found id: "ea472223f1505d76ec6e5c18af4f3ab7760ebdefed097a213c78a396e15d7ba7"
I0312 00:25:25.536759 1183642 cri.go:89] found id: "ac83611721f7a3d26415ed5ae3625edece62f8bd00bc9a63ce61ffa2ad2c9fbc"
I0312 00:25:25.536771 1183642 cri.go:89] found id: ""
I0312 00:25:25.536779 1183642 logs.go:276] 2 containers: [ea472223f1505d76ec6e5c18af4f3ab7760ebdefed097a213c78a396e15d7ba7 ac83611721f7a3d26415ed5ae3625edece62f8bd00bc9a63ce61ffa2ad2c9fbc]
I0312 00:25:25.536850 1183642 ssh_runner.go:195] Run: which crictl
I0312 00:25:25.540733 1183642 ssh_runner.go:195] Run: which crictl
I0312 00:25:25.544497 1183642 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
I0312 00:25:25.544627 1183642 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0312 00:25:25.581655 1183642 cri.go:89] found id: "ae84159c4657eff5eabe4d3d9526af6b40457144653c8a1c7e1b3bc077bdcad0"
I0312 00:25:25.581679 1183642 cri.go:89] found id: "1a5414516a6e0b5fd6faf9a04f4428d130258262f60692b0dffc8b7ffc8541a6"
I0312 00:25:25.581684 1183642 cri.go:89] found id: ""
I0312 00:25:25.581705 1183642 logs.go:276] 2 containers: [ae84159c4657eff5eabe4d3d9526af6b40457144653c8a1c7e1b3bc077bdcad0 1a5414516a6e0b5fd6faf9a04f4428d130258262f60692b0dffc8b7ffc8541a6]
I0312 00:25:25.581770 1183642 ssh_runner.go:195] Run: which crictl
I0312 00:25:25.585569 1183642 ssh_runner.go:195] Run: which crictl
I0312 00:25:25.589471 1183642 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
I0312 00:25:25.589550 1183642 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0312 00:25:25.630552 1183642 cri.go:89] found id: "98a1386a1a083a30c283c882c4ad3a528364088aba6315aa3bd42ba324436879"
I0312 00:25:25.630576 1183642 cri.go:89] found id: "0c3514f843ab806b20582bed37c5a7606b322a3eae956ca0d2a4c8b59c7beb86"
I0312 00:25:25.630581 1183642 cri.go:89] found id: ""
I0312 00:25:25.630589 1183642 logs.go:276] 2 containers: [98a1386a1a083a30c283c882c4ad3a528364088aba6315aa3bd42ba324436879 0c3514f843ab806b20582bed37c5a7606b322a3eae956ca0d2a4c8b59c7beb86]
I0312 00:25:25.630648 1183642 ssh_runner.go:195] Run: which crictl
I0312 00:25:25.634419 1183642 ssh_runner.go:195] Run: which crictl
I0312 00:25:25.637992 1183642 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
I0312 00:25:25.638081 1183642 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I0312 00:25:25.684057 1183642 cri.go:89] found id: "cb775d92b00e5c14170849b1b42ccfd48f3c9d18c9b5da2f8234588eaf4aa2ec"
I0312 00:25:25.684120 1183642 cri.go:89] found id: ""
I0312 00:25:25.684132 1183642 logs.go:276] 1 containers: [cb775d92b00e5c14170849b1b42ccfd48f3c9d18c9b5da2f8234588eaf4aa2ec]
I0312 00:25:25.684207 1183642 ssh_runner.go:195] Run: which crictl
I0312 00:25:25.688044 1183642 logs.go:123] Gathering logs for kube-apiserver [e90658574cccc9b56ea1fd38865b78eb14b34d54f7b6d6f655f8b82d026ee372] ...
I0312 00:25:25.688071 1183642 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e90658574cccc9b56ea1fd38865b78eb14b34d54f7b6d6f655f8b82d026ee372"
I0312 00:25:25.746459 1183642 logs.go:123] Gathering logs for kube-apiserver [022154a50546e744b25648ac078a4535c3a97e91f97547e8008e89235fd126f5] ...
I0312 00:25:25.746492 1183642 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 022154a50546e744b25648ac078a4535c3a97e91f97547e8008e89235fd126f5"
I0312 00:25:25.807669 1183642 logs.go:123] Gathering logs for coredns [0d3039260ff7a1d3154eac6a37f5460535e860a77d3473b023822022e245e097] ...
I0312 00:25:25.807705 1183642 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 0d3039260ff7a1d3154eac6a37f5460535e860a77d3473b023822022e245e097"
I0312 00:25:25.858063 1183642 logs.go:123] Gathering logs for kube-scheduler [cda4f1be508f3de4744e406ac4acfcb87143068155c189f0e7506f78db3a42c9] ...
I0312 00:25:25.858091 1183642 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 cda4f1be508f3de4744e406ac4acfcb87143068155c189f0e7506f78db3a42c9"
I0312 00:25:25.900479 1183642 logs.go:123] Gathering logs for kube-proxy [8abc9a2fec8f5340e92089f46c5ff2bf798571fbcb6c7ce9545d0e353715bed4] ...
I0312 00:25:25.900511 1183642 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 8abc9a2fec8f5340e92089f46c5ff2bf798571fbcb6c7ce9545d0e353715bed4"
I0312 00:25:25.946460 1183642 logs.go:123] Gathering logs for kindnet [1a5414516a6e0b5fd6faf9a04f4428d130258262f60692b0dffc8b7ffc8541a6] ...
I0312 00:25:25.946491 1183642 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 1a5414516a6e0b5fd6faf9a04f4428d130258262f60692b0dffc8b7ffc8541a6"
I0312 00:25:25.992941 1183642 logs.go:123] Gathering logs for kubernetes-dashboard [cb775d92b00e5c14170849b1b42ccfd48f3c9d18c9b5da2f8234588eaf4aa2ec] ...
I0312 00:25:25.992975 1183642 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 cb775d92b00e5c14170849b1b42ccfd48f3c9d18c9b5da2f8234588eaf4aa2ec"
I0312 00:25:26.047245 1183642 logs.go:123] Gathering logs for describe nodes ...
I0312 00:25:26.047275 1183642 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0312 00:25:26.245179 1183642 logs.go:123] Gathering logs for coredns [91ba0f1087505b74193c749143407b360ca52adeb6c8e6fed4c64111ff7ac963] ...
I0312 00:25:26.245208 1183642 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 91ba0f1087505b74193c749143407b360ca52adeb6c8e6fed4c64111ff7ac963"
I0312 00:25:26.286685 1183642 logs.go:123] Gathering logs for kube-proxy [46d69c632200b08b2b8f94cd051969df887d9d074acace5d606fef37cc84295e] ...
I0312 00:25:26.286717 1183642 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 46d69c632200b08b2b8f94cd051969df887d9d074acace5d606fef37cc84295e"
I0312 00:25:26.326586 1183642 logs.go:123] Gathering logs for kindnet [ae84159c4657eff5eabe4d3d9526af6b40457144653c8a1c7e1b3bc077bdcad0] ...
I0312 00:25:26.326619 1183642 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 ae84159c4657eff5eabe4d3d9526af6b40457144653c8a1c7e1b3bc077bdcad0"
I0312 00:25:26.371019 1183642 logs.go:123] Gathering logs for storage-provisioner [0c3514f843ab806b20582bed37c5a7606b322a3eae956ca0d2a4c8b59c7beb86] ...
I0312 00:25:26.371048 1183642 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 0c3514f843ab806b20582bed37c5a7606b322a3eae956ca0d2a4c8b59c7beb86"
I0312 00:25:26.437329 1183642 logs.go:123] Gathering logs for etcd [227b5f4c3ec0b541f1e734b3a9400260044363214781e1a18f0928e954c98086] ...
I0312 00:25:26.437363 1183642 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 227b5f4c3ec0b541f1e734b3a9400260044363214781e1a18f0928e954c98086"
I0312 00:25:26.491828 1183642 logs.go:123] Gathering logs for kube-scheduler [c3f64500c09efd7fdf78260f3bef5ed1adaefa3e3a847a7540726cbee6bd042f] ...
I0312 00:25:26.491858 1183642 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 c3f64500c09efd7fdf78260f3bef5ed1adaefa3e3a847a7540726cbee6bd042f"
I0312 00:25:26.534467 1183642 logs.go:123] Gathering logs for storage-provisioner [98a1386a1a083a30c283c882c4ad3a528364088aba6315aa3bd42ba324436879] ...
I0312 00:25:26.534502 1183642 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 98a1386a1a083a30c283c882c4ad3a528364088aba6315aa3bd42ba324436879"
I0312 00:25:26.573116 1183642 logs.go:123] Gathering logs for containerd ...
I0312 00:25:26.573190 1183642 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
I0312 00:25:26.637555 1183642 logs.go:123] Gathering logs for container status ...
I0312 00:25:26.637593 1183642 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0312 00:25:26.690245 1183642 logs.go:123] Gathering logs for kubelet ...
I0312 00:25:26.690283 1183642 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0312 00:25:26.757014 1183642 logs.go:138] Found kubelet problem: Mar 12 00:19:58 old-k8s-version-571339 kubelet[663]: E0312 00:19:58.352250 663 pod_workers.go:191] Error syncing pod f8f3ac0e-3c2e-451d-8e5a-d3937eab4142 ("metrics-server-9975d5f86-c87xf_kube-system(f8f3ac0e-3c2e-451d-8e5a-d3937eab4142)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0312 00:25:26.757217 1183642 logs.go:138] Found kubelet problem: Mar 12 00:19:58 old-k8s-version-571339 kubelet[663]: E0312 00:19:58.560744 663 pod_workers.go:191] Error syncing pod f8f3ac0e-3c2e-451d-8e5a-d3937eab4142 ("metrics-server-9975d5f86-c87xf_kube-system(f8f3ac0e-3c2e-451d-8e5a-d3937eab4142)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0312 00:25:26.760035 1183642 logs.go:138] Found kubelet problem: Mar 12 00:20:13 old-k8s-version-571339 kubelet[663]: E0312 00:20:13.145527 663 pod_workers.go:191] Error syncing pod f8f3ac0e-3c2e-451d-8e5a-d3937eab4142 ("metrics-server-9975d5f86-c87xf_kube-system(f8f3ac0e-3c2e-451d-8e5a-d3937eab4142)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0312 00:25:26.760786 1183642 logs.go:138] Found kubelet problem: Mar 12 00:20:15 old-k8s-version-571339 kubelet[663]: E0312 00:20:15.137936 663 reflector.go:138] object-"kubernetes-dashboard"/"kubernetes-dashboard-token-5nnmb": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kubernetes-dashboard-token-5nnmb" is forbidden: User "system:node:old-k8s-version-571339" cannot list resource "secrets" in API group "" in the namespace "kubernetes-dashboard": no relationship found between node 'old-k8s-version-571339' and this object
W0312 00:25:26.764232 1183642 logs.go:138] Found kubelet problem: Mar 12 00:20:27 old-k8s-version-571339 kubelet[663]: E0312 00:20:27.691697 663 pod_workers.go:191] Error syncing pod 917984d8-3e49-416e-bb76-594879112f42 ("dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"
W0312 00:25:26.764435 1183642 logs.go:138] Found kubelet problem: Mar 12 00:20:28 old-k8s-version-571339 kubelet[663]: E0312 00:20:28.142650 663 pod_workers.go:191] Error syncing pod f8f3ac0e-3c2e-451d-8e5a-d3937eab4142 ("metrics-server-9975d5f86-c87xf_kube-system(f8f3ac0e-3c2e-451d-8e5a-d3937eab4142)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0312 00:25:26.764781 1183642 logs.go:138] Found kubelet problem: Mar 12 00:20:28 old-k8s-version-571339 kubelet[663]: E0312 00:20:28.687196 663 pod_workers.go:191] Error syncing pod 917984d8-3e49-416e-bb76-594879112f42 ("dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"
W0312 00:25:26.765236 1183642 logs.go:138] Found kubelet problem: Mar 12 00:20:29 old-k8s-version-571339 kubelet[663]: E0312 00:20:29.694628 663 pod_workers.go:191] Error syncing pod c73ffc75-b4a0-4184-80c3-a73e21cc954e ("storage-provisioner_kube-system(c73ffc75-b4a0-4184-80c3-a73e21cc954e)"), skipping: failed to "StartContainer" for "storage-provisioner" with CrashLoopBackOff: "back-off 10s restarting failed container=storage-provisioner pod=storage-provisioner_kube-system(c73ffc75-b4a0-4184-80c3-a73e21cc954e)"
W0312 00:25:26.765570 1183642 logs.go:138] Found kubelet problem: Mar 12 00:20:30 old-k8s-version-571339 kubelet[663]: E0312 00:20:30.101093 663 pod_workers.go:191] Error syncing pod 917984d8-3e49-416e-bb76-594879112f42 ("dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"
W0312 00:25:26.766572 1183642 logs.go:138] Found kubelet problem: Mar 12 00:20:42 old-k8s-version-571339 kubelet[663]: E0312 00:20:42.735991 663 pod_workers.go:191] Error syncing pod 917984d8-3e49-416e-bb76-594879112f42 ("dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"
W0312 00:25:26.769242 1183642 logs.go:138] Found kubelet problem: Mar 12 00:20:43 old-k8s-version-571339 kubelet[663]: E0312 00:20:43.152194 663 pod_workers.go:191] Error syncing pod f8f3ac0e-3c2e-451d-8e5a-d3937eab4142 ("metrics-server-9975d5f86-c87xf_kube-system(f8f3ac0e-3c2e-451d-8e5a-d3937eab4142)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0312 00:25:26.769586 1183642 logs.go:138] Found kubelet problem: Mar 12 00:20:50 old-k8s-version-571339 kubelet[663]: E0312 00:20:50.100788 663 pod_workers.go:191] Error syncing pod 917984d8-3e49-416e-bb76-594879112f42 ("dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"
W0312 00:25:26.769781 1183642 logs.go:138] Found kubelet problem: Mar 12 00:20:54 old-k8s-version-571339 kubelet[663]: E0312 00:20:54.136340 663 pod_workers.go:191] Error syncing pod f8f3ac0e-3c2e-451d-8e5a-d3937eab4142 ("metrics-server-9975d5f86-c87xf_kube-system(f8f3ac0e-3c2e-451d-8e5a-d3937eab4142)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0312 00:25:26.770396 1183642 logs.go:138] Found kubelet problem: Mar 12 00:21:03 old-k8s-version-571339 kubelet[663]: E0312 00:21:03.794154 663 pod_workers.go:191] Error syncing pod 917984d8-3e49-416e-bb76-594879112f42 ("dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"
W0312 00:25:26.770580 1183642 logs.go:138] Found kubelet problem: Mar 12 00:21:07 old-k8s-version-571339 kubelet[663]: E0312 00:21:07.135168 663 pod_workers.go:191] Error syncing pod f8f3ac0e-3c2e-451d-8e5a-d3937eab4142 ("metrics-server-9975d5f86-c87xf_kube-system(f8f3ac0e-3c2e-451d-8e5a-d3937eab4142)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0312 00:25:26.770905 1183642 logs.go:138] Found kubelet problem: Mar 12 00:21:10 old-k8s-version-571339 kubelet[663]: E0312 00:21:10.101222 663 pod_workers.go:191] Error syncing pod 917984d8-3e49-416e-bb76-594879112f42 ("dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"
W0312 00:25:26.771102 1183642 logs.go:138] Found kubelet problem: Mar 12 00:21:22 old-k8s-version-571339 kubelet[663]: E0312 00:21:22.136421 663 pod_workers.go:191] Error syncing pod f8f3ac0e-3c2e-451d-8e5a-d3937eab4142 ("metrics-server-9975d5f86-c87xf_kube-system(f8f3ac0e-3c2e-451d-8e5a-d3937eab4142)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0312 00:25:26.771444 1183642 logs.go:138] Found kubelet problem: Mar 12 00:21:25 old-k8s-version-571339 kubelet[663]: E0312 00:21:25.135960 663 pod_workers.go:191] Error syncing pod 917984d8-3e49-416e-bb76-594879112f42 ("dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"
W0312 00:25:26.773913 1183642 logs.go:138] Found kubelet problem: Mar 12 00:21:33 old-k8s-version-571339 kubelet[663]: E0312 00:21:33.143768 663 pod_workers.go:191] Error syncing pod f8f3ac0e-3c2e-451d-8e5a-d3937eab4142 ("metrics-server-9975d5f86-c87xf_kube-system(f8f3ac0e-3c2e-451d-8e5a-d3937eab4142)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0312 00:25:26.774266 1183642 logs.go:138] Found kubelet problem: Mar 12 00:21:40 old-k8s-version-571339 kubelet[663]: E0312 00:21:40.134926 663 pod_workers.go:191] Error syncing pod 917984d8-3e49-416e-bb76-594879112f42 ("dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"
W0312 00:25:26.774456 1183642 logs.go:138] Found kubelet problem: Mar 12 00:21:45 old-k8s-version-571339 kubelet[663]: E0312 00:21:45.143152 663 pod_workers.go:191] Error syncing pod f8f3ac0e-3c2e-451d-8e5a-d3937eab4142 ("metrics-server-9975d5f86-c87xf_kube-system(f8f3ac0e-3c2e-451d-8e5a-d3937eab4142)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0312 00:25:26.775048 1183642 logs.go:138] Found kubelet problem: Mar 12 00:21:51 old-k8s-version-571339 kubelet[663]: E0312 00:21:51.956550 663 pod_workers.go:191] Error syncing pod 917984d8-3e49-416e-bb76-594879112f42 ("dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"
W0312 00:25:26.775388 1183642 logs.go:138] Found kubelet problem: Mar 12 00:22:00 old-k8s-version-571339 kubelet[663]: E0312 00:22:00.104419 663 pod_workers.go:191] Error syncing pod 917984d8-3e49-416e-bb76-594879112f42 ("dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"
W0312 00:25:26.775575 1183642 logs.go:138] Found kubelet problem: Mar 12 00:22:00 old-k8s-version-571339 kubelet[663]: E0312 00:22:00.145154 663 pod_workers.go:191] Error syncing pod f8f3ac0e-3c2e-451d-8e5a-d3937eab4142 ("metrics-server-9975d5f86-c87xf_kube-system(f8f3ac0e-3c2e-451d-8e5a-d3937eab4142)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0312 00:25:26.775901 1183642 logs.go:138] Found kubelet problem: Mar 12 00:22:15 old-k8s-version-571339 kubelet[663]: E0312 00:22:15.136079 663 pod_workers.go:191] Error syncing pod 917984d8-3e49-416e-bb76-594879112f42 ("dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"
W0312 00:25:26.776087 1183642 logs.go:138] Found kubelet problem: Mar 12 00:22:15 old-k8s-version-571339 kubelet[663]: E0312 00:22:15.136820 663 pod_workers.go:191] Error syncing pod f8f3ac0e-3c2e-451d-8e5a-d3937eab4142 ("metrics-server-9975d5f86-c87xf_kube-system(f8f3ac0e-3c2e-451d-8e5a-d3937eab4142)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0312 00:25:26.776271 1183642 logs.go:138] Found kubelet problem: Mar 12 00:22:28 old-k8s-version-571339 kubelet[663]: E0312 00:22:28.135086 663 pod_workers.go:191] Error syncing pod f8f3ac0e-3c2e-451d-8e5a-d3937eab4142 ("metrics-server-9975d5f86-c87xf_kube-system(f8f3ac0e-3c2e-451d-8e5a-d3937eab4142)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0312 00:25:26.776603 1183642 logs.go:138] Found kubelet problem: Mar 12 00:22:30 old-k8s-version-571339 kubelet[663]: E0312 00:22:30.140098 663 pod_workers.go:191] Error syncing pod 917984d8-3e49-416e-bb76-594879112f42 ("dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"
W0312 00:25:26.776928 1183642 logs.go:138] Found kubelet problem: Mar 12 00:22:42 old-k8s-version-571339 kubelet[663]: E0312 00:22:42.135063 663 pod_workers.go:191] Error syncing pod 917984d8-3e49-416e-bb76-594879112f42 ("dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"
W0312 00:25:26.777116 1183642 logs.go:138] Found kubelet problem: Mar 12 00:22:43 old-k8s-version-571339 kubelet[663]: E0312 00:22:43.135158 663 pod_workers.go:191] Error syncing pod f8f3ac0e-3c2e-451d-8e5a-d3937eab4142 ("metrics-server-9975d5f86-c87xf_kube-system(f8f3ac0e-3c2e-451d-8e5a-d3937eab4142)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0312 00:25:26.779571 1183642 logs.go:138] Found kubelet problem: Mar 12 00:22:54 old-k8s-version-571339 kubelet[663]: E0312 00:22:54.143460 663 pod_workers.go:191] Error syncing pod f8f3ac0e-3c2e-451d-8e5a-d3937eab4142 ("metrics-server-9975d5f86-c87xf_kube-system(f8f3ac0e-3c2e-451d-8e5a-d3937eab4142)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0312 00:25:26.779896 1183642 logs.go:138] Found kubelet problem: Mar 12 00:22:56 old-k8s-version-571339 kubelet[663]: E0312 00:22:56.134757 663 pod_workers.go:191] Error syncing pod 917984d8-3e49-416e-bb76-594879112f42 ("dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"
W0312 00:25:26.780081 1183642 logs.go:138] Found kubelet problem: Mar 12 00:23:06 old-k8s-version-571339 kubelet[663]: E0312 00:23:06.135565 663 pod_workers.go:191] Error syncing pod f8f3ac0e-3c2e-451d-8e5a-d3937eab4142 ("metrics-server-9975d5f86-c87xf_kube-system(f8f3ac0e-3c2e-451d-8e5a-d3937eab4142)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0312 00:25:26.780408 1183642 logs.go:138] Found kubelet problem: Mar 12 00:23:07 old-k8s-version-571339 kubelet[663]: E0312 00:23:07.134751 663 pod_workers.go:191] Error syncing pod 917984d8-3e49-416e-bb76-594879112f42 ("dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"
W0312 00:25:26.780994 1183642 logs.go:138] Found kubelet problem: Mar 12 00:23:19 old-k8s-version-571339 kubelet[663]: E0312 00:23:19.156710 663 pod_workers.go:191] Error syncing pod 917984d8-3e49-416e-bb76-594879112f42 ("dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"
W0312 00:25:26.781319 1183642 logs.go:138] Found kubelet problem: Mar 12 00:23:20 old-k8s-version-571339 kubelet[663]: E0312 00:23:20.160925 663 pod_workers.go:191] Error syncing pod 917984d8-3e49-416e-bb76-594879112f42 ("dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"
W0312 00:25:26.781505 1183642 logs.go:138] Found kubelet problem: Mar 12 00:23:21 old-k8s-version-571339 kubelet[663]: E0312 00:23:21.135408 663 pod_workers.go:191] Error syncing pod f8f3ac0e-3c2e-451d-8e5a-d3937eab4142 ("metrics-server-9975d5f86-c87xf_kube-system(f8f3ac0e-3c2e-451d-8e5a-d3937eab4142)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0312 00:25:26.781832 1183642 logs.go:138] Found kubelet problem: Mar 12 00:23:32 old-k8s-version-571339 kubelet[663]: E0312 00:23:32.135536 663 pod_workers.go:191] Error syncing pod 917984d8-3e49-416e-bb76-594879112f42 ("dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"
W0312 00:25:26.782019 1183642 logs.go:138] Found kubelet problem: Mar 12 00:23:35 old-k8s-version-571339 kubelet[663]: E0312 00:23:35.135123 663 pod_workers.go:191] Error syncing pod f8f3ac0e-3c2e-451d-8e5a-d3937eab4142 ("metrics-server-9975d5f86-c87xf_kube-system(f8f3ac0e-3c2e-451d-8e5a-d3937eab4142)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0312 00:25:26.782353 1183642 logs.go:138] Found kubelet problem: Mar 12 00:23:45 old-k8s-version-571339 kubelet[663]: E0312 00:23:45.134915 663 pod_workers.go:191] Error syncing pod 917984d8-3e49-416e-bb76-594879112f42 ("dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"
W0312 00:25:26.782536 1183642 logs.go:138] Found kubelet problem: Mar 12 00:23:47 old-k8s-version-571339 kubelet[663]: E0312 00:23:47.135061 663 pod_workers.go:191] Error syncing pod f8f3ac0e-3c2e-451d-8e5a-d3937eab4142 ("metrics-server-9975d5f86-c87xf_kube-system(f8f3ac0e-3c2e-451d-8e5a-d3937eab4142)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0312 00:25:26.782860 1183642 logs.go:138] Found kubelet problem: Mar 12 00:23:59 old-k8s-version-571339 kubelet[663]: E0312 00:23:59.134729 663 pod_workers.go:191] Error syncing pod 917984d8-3e49-416e-bb76-594879112f42 ("dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"
W0312 00:25:26.783047 1183642 logs.go:138] Found kubelet problem: Mar 12 00:24:02 old-k8s-version-571339 kubelet[663]: E0312 00:24:02.135523 663 pod_workers.go:191] Error syncing pod f8f3ac0e-3c2e-451d-8e5a-d3937eab4142 ("metrics-server-9975d5f86-c87xf_kube-system(f8f3ac0e-3c2e-451d-8e5a-d3937eab4142)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0312 00:25:26.783378 1183642 logs.go:138] Found kubelet problem: Mar 12 00:24:11 old-k8s-version-571339 kubelet[663]: E0312 00:24:11.134786 663 pod_workers.go:191] Error syncing pod 917984d8-3e49-416e-bb76-594879112f42 ("dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"
W0312 00:25:26.783568 1183642 logs.go:138] Found kubelet problem: Mar 12 00:24:16 old-k8s-version-571339 kubelet[663]: E0312 00:24:16.135140 663 pod_workers.go:191] Error syncing pod f8f3ac0e-3c2e-451d-8e5a-d3937eab4142 ("metrics-server-9975d5f86-c87xf_kube-system(f8f3ac0e-3c2e-451d-8e5a-d3937eab4142)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0312 00:25:26.783898 1183642 logs.go:138] Found kubelet problem: Mar 12 00:24:22 old-k8s-version-571339 kubelet[663]: E0312 00:24:22.135430 663 pod_workers.go:191] Error syncing pod 917984d8-3e49-416e-bb76-594879112f42 ("dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"
W0312 00:25:26.784081 1183642 logs.go:138] Found kubelet problem: Mar 12 00:24:31 old-k8s-version-571339 kubelet[663]: E0312 00:24:31.135197 663 pod_workers.go:191] Error syncing pod f8f3ac0e-3c2e-451d-8e5a-d3937eab4142 ("metrics-server-9975d5f86-c87xf_kube-system(f8f3ac0e-3c2e-451d-8e5a-d3937eab4142)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0312 00:25:26.784405 1183642 logs.go:138] Found kubelet problem: Mar 12 00:24:35 old-k8s-version-571339 kubelet[663]: E0312 00:24:35.134852 663 pod_workers.go:191] Error syncing pod 917984d8-3e49-416e-bb76-594879112f42 ("dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"
W0312 00:25:26.784588 1183642 logs.go:138] Found kubelet problem: Mar 12 00:24:43 old-k8s-version-571339 kubelet[663]: E0312 00:24:43.135594 663 pod_workers.go:191] Error syncing pod f8f3ac0e-3c2e-451d-8e5a-d3937eab4142 ("metrics-server-9975d5f86-c87xf_kube-system(f8f3ac0e-3c2e-451d-8e5a-d3937eab4142)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0312 00:25:26.784918 1183642 logs.go:138] Found kubelet problem: Mar 12 00:24:47 old-k8s-version-571339 kubelet[663]: E0312 00:24:47.134779 663 pod_workers.go:191] Error syncing pod 917984d8-3e49-416e-bb76-594879112f42 ("dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"
W0312 00:25:26.785104 1183642 logs.go:138] Found kubelet problem: Mar 12 00:24:56 old-k8s-version-571339 kubelet[663]: E0312 00:24:56.137730 663 pod_workers.go:191] Error syncing pod f8f3ac0e-3c2e-451d-8e5a-d3937eab4142 ("metrics-server-9975d5f86-c87xf_kube-system(f8f3ac0e-3c2e-451d-8e5a-d3937eab4142)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0312 00:25:26.785429 1183642 logs.go:138] Found kubelet problem: Mar 12 00:24:59 old-k8s-version-571339 kubelet[663]: E0312 00:24:59.134749 663 pod_workers.go:191] Error syncing pod 917984d8-3e49-416e-bb76-594879112f42 ("dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"
W0312 00:25:26.785615 1183642 logs.go:138] Found kubelet problem: Mar 12 00:25:07 old-k8s-version-571339 kubelet[663]: E0312 00:25:07.135133 663 pod_workers.go:191] Error syncing pod f8f3ac0e-3c2e-451d-8e5a-d3937eab4142 ("metrics-server-9975d5f86-c87xf_kube-system(f8f3ac0e-3c2e-451d-8e5a-d3937eab4142)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0312 00:25:26.785969 1183642 logs.go:138] Found kubelet problem: Mar 12 00:25:10 old-k8s-version-571339 kubelet[663]: E0312 00:25:10.134865 663 pod_workers.go:191] Error syncing pod 917984d8-3e49-416e-bb76-594879112f42 ("dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"
W0312 00:25:26.786154 1183642 logs.go:138] Found kubelet problem: Mar 12 00:25:19 old-k8s-version-571339 kubelet[663]: E0312 00:25:19.135515 663 pod_workers.go:191] Error syncing pod f8f3ac0e-3c2e-451d-8e5a-d3937eab4142 ("metrics-server-9975d5f86-c87xf_kube-system(f8f3ac0e-3c2e-451d-8e5a-d3937eab4142)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0312 00:25:26.786482 1183642 logs.go:138] Found kubelet problem: Mar 12 00:25:22 old-k8s-version-571339 kubelet[663]: E0312 00:25:22.136716 663 pod_workers.go:191] Error syncing pod 917984d8-3e49-416e-bb76-594879112f42 ("dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"
I0312 00:25:26.786493 1183642 logs.go:123] Gathering logs for dmesg ...
I0312 00:25:26.786508 1183642 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0312 00:25:26.806149 1183642 logs.go:123] Gathering logs for etcd [00fea42a626bc543839c933d2b36dd4155e2329531f2c8a74fa65079753377a9] ...
I0312 00:25:26.806190 1183642 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 00fea42a626bc543839c933d2b36dd4155e2329531f2c8a74fa65079753377a9"
I0312 00:25:26.874399 1183642 logs.go:123] Gathering logs for kube-controller-manager [ea472223f1505d76ec6e5c18af4f3ab7760ebdefed097a213c78a396e15d7ba7] ...
I0312 00:25:26.874432 1183642 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 ea472223f1505d76ec6e5c18af4f3ab7760ebdefed097a213c78a396e15d7ba7"
I0312 00:25:26.948646 1183642 logs.go:123] Gathering logs for kube-controller-manager [ac83611721f7a3d26415ed5ae3625edece62f8bd00bc9a63ce61ffa2ad2c9fbc] ...
I0312 00:25:26.948680 1183642 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 ac83611721f7a3d26415ed5ae3625edece62f8bd00bc9a63ce61ffa2ad2c9fbc"
I0312 00:25:27.046898 1183642 out.go:304] Setting ErrFile to fd 2...
I0312 00:25:27.046932 1183642 out.go:338] TERM=,COLORTERM=, which probably does not support color
W0312 00:25:27.047003 1183642 out.go:239] X Problems detected in kubelet:
X Problems detected in kubelet:
W0312 00:25:27.047015 1183642 out.go:239] Mar 12 00:24:59 old-k8s-version-571339 kubelet[663]: E0312 00:24:59.134749 663 pod_workers.go:191] Error syncing pod 917984d8-3e49-416e-bb76-594879112f42 ("dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"
Mar 12 00:24:59 old-k8s-version-571339 kubelet[663]: E0312 00:24:59.134749 663 pod_workers.go:191] Error syncing pod 917984d8-3e49-416e-bb76-594879112f42 ("dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"
W0312 00:25:27.047022 1183642 out.go:239] Mar 12 00:25:07 old-k8s-version-571339 kubelet[663]: E0312 00:25:07.135133 663 pod_workers.go:191] Error syncing pod f8f3ac0e-3c2e-451d-8e5a-d3937eab4142 ("metrics-server-9975d5f86-c87xf_kube-system(f8f3ac0e-3c2e-451d-8e5a-d3937eab4142)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Mar 12 00:25:07 old-k8s-version-571339 kubelet[663]: E0312 00:25:07.135133 663 pod_workers.go:191] Error syncing pod f8f3ac0e-3c2e-451d-8e5a-d3937eab4142 ("metrics-server-9975d5f86-c87xf_kube-system(f8f3ac0e-3c2e-451d-8e5a-d3937eab4142)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0312 00:25:27.047037 1183642 out.go:239] Mar 12 00:25:10 old-k8s-version-571339 kubelet[663]: E0312 00:25:10.134865 663 pod_workers.go:191] Error syncing pod 917984d8-3e49-416e-bb76-594879112f42 ("dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"
Mar 12 00:25:10 old-k8s-version-571339 kubelet[663]: E0312 00:25:10.134865 663 pod_workers.go:191] Error syncing pod 917984d8-3e49-416e-bb76-594879112f42 ("dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"
W0312 00:25:27.047048 1183642 out.go:239] Mar 12 00:25:19 old-k8s-version-571339 kubelet[663]: E0312 00:25:19.135515 663 pod_workers.go:191] Error syncing pod f8f3ac0e-3c2e-451d-8e5a-d3937eab4142 ("metrics-server-9975d5f86-c87xf_kube-system(f8f3ac0e-3c2e-451d-8e5a-d3937eab4142)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Mar 12 00:25:19 old-k8s-version-571339 kubelet[663]: E0312 00:25:19.135515 663 pod_workers.go:191] Error syncing pod f8f3ac0e-3c2e-451d-8e5a-d3937eab4142 ("metrics-server-9975d5f86-c87xf_kube-system(f8f3ac0e-3c2e-451d-8e5a-d3937eab4142)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0312 00:25:27.047056 1183642 out.go:239] Mar 12 00:25:22 old-k8s-version-571339 kubelet[663]: E0312 00:25:22.136716 663 pod_workers.go:191] Error syncing pod 917984d8-3e49-416e-bb76-594879112f42 ("dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"
Mar 12 00:25:22 old-k8s-version-571339 kubelet[663]: E0312 00:25:22.136716 663 pod_workers.go:191] Error syncing pod 917984d8-3e49-416e-bb76-594879112f42 ("dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"
I0312 00:25:27.047062 1183642 out.go:304] Setting ErrFile to fd 2...
I0312 00:25:27.047068 1183642 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0312 00:25:37.048428 1183642 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0312 00:25:37.061991 1183642 api_server.go:72] duration metric: took 6m0.915958249s to wait for apiserver process to appear ...
I0312 00:25:37.062023 1183642 api_server.go:88] waiting for apiserver healthz status ...
I0312 00:25:37.064575 1183642 out.go:177]
W0312 00:25:37.066356 1183642 out.go:239] X Exiting due to GUEST_START: failed to start node: wait 6m0s for node: wait for healthy API server: apiserver healthz never reported healthy: cluster wait timed out during healthz check
X Exiting due to GUEST_START: failed to start node: wait 6m0s for node: wait for healthy API server: apiserver healthz never reported healthy: cluster wait timed out during healthz check
W0312 00:25:37.066381 1183642 out.go:239] *
*
W0312 00:25:37.067988 1183642 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0312 00:25:37.069878 1183642 out.go:177]
** /stderr **
start_stop_delete_test.go:259: failed to start minikube post-stop. args "out/minikube-linux-arm64 start -p old-k8s-version-571339 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=containerd --kubernetes-version=v1.20.0": exit status 80
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: docker inspect <======
helpers_test.go:231: (dbg) Run: docker inspect old-k8s-version-571339
helpers_test.go:235: (dbg) docker inspect old-k8s-version-571339:
-- stdout --
[
{
"Id": "d0ed924bcf70c0c265e040ae66ad87355f5e6410c4af11b74451f1ecd317edad",
"Created": "2024-03-12T00:16:37.69329513Z",
"Path": "/usr/local/bin/entrypoint",
"Args": [
"/sbin/init"
],
"State": {
"Status": "running",
"Running": true,
"Paused": false,
"Restarting": false,
"OOMKilled": false,
"Dead": false,
"Pid": 1183859,
"ExitCode": 0,
"Error": "",
"StartedAt": "2024-03-12T00:19:28.61880223Z",
"FinishedAt": "2024-03-12T00:19:27.247079461Z"
},
"Image": "sha256:4a9b65157dd7fb2ddb7cb7afe975b3dc288e9877c60d13613a69dd41a70e2e4e",
"ResolvConfPath": "/var/lib/docker/containers/d0ed924bcf70c0c265e040ae66ad87355f5e6410c4af11b74451f1ecd317edad/resolv.conf",
"HostnamePath": "/var/lib/docker/containers/d0ed924bcf70c0c265e040ae66ad87355f5e6410c4af11b74451f1ecd317edad/hostname",
"HostsPath": "/var/lib/docker/containers/d0ed924bcf70c0c265e040ae66ad87355f5e6410c4af11b74451f1ecd317edad/hosts",
"LogPath": "/var/lib/docker/containers/d0ed924bcf70c0c265e040ae66ad87355f5e6410c4af11b74451f1ecd317edad/d0ed924bcf70c0c265e040ae66ad87355f5e6410c4af11b74451f1ecd317edad-json.log",
"Name": "/old-k8s-version-571339",
"RestartCount": 0,
"Driver": "overlay2",
"Platform": "linux",
"MountLabel": "",
"ProcessLabel": "",
"AppArmorProfile": "unconfined",
"ExecIDs": null,
"HostConfig": {
"Binds": [
"old-k8s-version-571339:/var",
"/lib/modules:/lib/modules:ro"
],
"ContainerIDFile": "",
"LogConfig": {
"Type": "json-file",
"Config": {}
},
"NetworkMode": "old-k8s-version-571339",
"PortBindings": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
]
},
"RestartPolicy": {
"Name": "no",
"MaximumRetryCount": 0
},
"AutoRemove": false,
"VolumeDriver": "",
"VolumesFrom": null,
"ConsoleSize": [
0,
0
],
"CapAdd": null,
"CapDrop": null,
"CgroupnsMode": "host",
"Dns": [],
"DnsOptions": [],
"DnsSearch": [],
"ExtraHosts": null,
"GroupAdd": null,
"IpcMode": "private",
"Cgroup": "",
"Links": null,
"OomScoreAdj": 0,
"PidMode": "",
"Privileged": true,
"PublishAllPorts": false,
"ReadonlyRootfs": false,
"SecurityOpt": [
"seccomp=unconfined",
"apparmor=unconfined",
"label=disable"
],
"Tmpfs": {
"/run": "",
"/tmp": ""
},
"UTSMode": "",
"UsernsMode": "",
"ShmSize": 67108864,
"Runtime": "runc",
"Isolation": "",
"CpuShares": 0,
"Memory": 2306867200,
"NanoCpus": 2000000000,
"CgroupParent": "",
"BlkioWeight": 0,
"BlkioWeightDevice": [],
"BlkioDeviceReadBps": [],
"BlkioDeviceWriteBps": [],
"BlkioDeviceReadIOps": [],
"BlkioDeviceWriteIOps": [],
"CpuPeriod": 0,
"CpuQuota": 0,
"CpuRealtimePeriod": 0,
"CpuRealtimeRuntime": 0,
"CpusetCpus": "",
"CpusetMems": "",
"Devices": [],
"DeviceCgroupRules": null,
"DeviceRequests": null,
"MemoryReservation": 0,
"MemorySwap": 4613734400,
"MemorySwappiness": null,
"OomKillDisable": false,
"PidsLimit": null,
"Ulimits": [],
"CpuCount": 0,
"CpuPercent": 0,
"IOMaximumIOps": 0,
"IOMaximumBandwidth": 0,
"MaskedPaths": null,
"ReadonlyPaths": null
},
"GraphDriver": {
"Data": {
"LowerDir": "/var/lib/docker/overlay2/799efc588e8bca8b36d282e78e117c4163fcff8287fd5d3f16770fdde78849b3-init/diff:/var/lib/docker/overlay2/af090fb944a3b68787e040c2e3137e8bdfd21b050bcd01e191acaa1449d77a1d/diff",
"MergedDir": "/var/lib/docker/overlay2/799efc588e8bca8b36d282e78e117c4163fcff8287fd5d3f16770fdde78849b3/merged",
"UpperDir": "/var/lib/docker/overlay2/799efc588e8bca8b36d282e78e117c4163fcff8287fd5d3f16770fdde78849b3/diff",
"WorkDir": "/var/lib/docker/overlay2/799efc588e8bca8b36d282e78e117c4163fcff8287fd5d3f16770fdde78849b3/work"
},
"Name": "overlay2"
},
"Mounts": [
{
"Type": "volume",
"Name": "old-k8s-version-571339",
"Source": "/var/lib/docker/volumes/old-k8s-version-571339/_data",
"Destination": "/var",
"Driver": "local",
"Mode": "z",
"RW": true,
"Propagation": ""
},
{
"Type": "bind",
"Source": "/lib/modules",
"Destination": "/lib/modules",
"Mode": "ro",
"RW": false,
"Propagation": "rprivate"
}
],
"Config": {
"Hostname": "old-k8s-version-571339",
"Domainname": "",
"User": "",
"AttachStdin": false,
"AttachStdout": false,
"AttachStderr": false,
"ExposedPorts": {
"22/tcp": {},
"2376/tcp": {},
"32443/tcp": {},
"5000/tcp": {},
"8443/tcp": {}
},
"Tty": true,
"OpenStdin": false,
"StdinOnce": false,
"Env": [
"container=docker",
"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
],
"Cmd": null,
"Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08",
"Volumes": null,
"WorkingDir": "/",
"Entrypoint": [
"/usr/local/bin/entrypoint",
"/sbin/init"
],
"OnBuild": null,
"Labels": {
"created_by.minikube.sigs.k8s.io": "true",
"mode.minikube.sigs.k8s.io": "old-k8s-version-571339",
"name.minikube.sigs.k8s.io": "old-k8s-version-571339",
"role.minikube.sigs.k8s.io": ""
},
"StopSignal": "SIGRTMIN+3"
},
"NetworkSettings": {
"Bridge": "",
"SandboxID": "2efb7bf6160d6e6bd33829a98d866eb4709fb58faffbc748362ac583077de47c",
"SandboxKey": "/var/run/docker/netns/2efb7bf6160d",
"Ports": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "34197"
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "34196"
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "34193"
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "34195"
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "34194"
}
]
},
"HairpinMode": false,
"LinkLocalIPv6Address": "",
"LinkLocalIPv6PrefixLen": 0,
"SecondaryIPAddresses": null,
"SecondaryIPv6Addresses": null,
"EndpointID": "",
"Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"IPAddress": "",
"IPPrefixLen": 0,
"IPv6Gateway": "",
"MacAddress": "",
"Networks": {
"old-k8s-version-571339": {
"IPAMConfig": {
"IPv4Address": "192.168.76.2"
},
"Links": null,
"Aliases": [
"d0ed924bcf70",
"old-k8s-version-571339"
],
"MacAddress": "02:42:c0:a8:4c:02",
"NetworkID": "7dab5417b71482a2fa0e3f51504a41f5c656a79e603a13811e111600dad1650c",
"EndpointID": "6672f67923e99fa5d955745822f6951448e20a20383c19c0dc97f889ec0f59cb",
"Gateway": "192.168.76.1",
"IPAddress": "192.168.76.2",
"IPPrefixLen": 24,
"IPv6Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"DriverOpts": null,
"DNSNames": [
"old-k8s-version-571339",
"d0ed924bcf70"
]
}
}
}
}
]
-- /stdout --
helpers_test.go:239: (dbg) Run: out/minikube-linux-arm64 status --format={{.Host}} -p old-k8s-version-571339 -n old-k8s-version-571339
helpers_test.go:244: <<< TestStartStop/group/old-k8s-version/serial/SecondStart FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: minikube logs <======
helpers_test.go:247: (dbg) Run: out/minikube-linux-arm64 -p old-k8s-version-571339 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-arm64 -p old-k8s-version-571339 logs -n 25: (2.28202625s)
helpers_test.go:252: TestStartStop/group/old-k8s-version/serial/SecondStart logs:
-- stdout --
==> Audit <==
|---------|--------------------------------------------------------|--------------------------|---------|---------|---------------------|---------------------|
| Command | Args | Profile | User | Version | Start Time | End Time |
|---------|--------------------------------------------------------|--------------------------|---------|---------|---------------------|---------------------|
| ssh | -p cilium-399839 sudo | cilium-399839 | jenkins | v1.32.0 | 12 Mar 24 00:15 UTC | |
| | containerd config dump | | | | | |
| ssh | -p cilium-399839 sudo | cilium-399839 | jenkins | v1.32.0 | 12 Mar 24 00:15 UTC | |
| | systemctl status crio --all | | | | | |
| | --full --no-pager | | | | | |
| ssh | -p cilium-399839 sudo | cilium-399839 | jenkins | v1.32.0 | 12 Mar 24 00:15 UTC | |
| | systemctl cat crio --no-pager | | | | | |
| ssh | -p cilium-399839 sudo find | cilium-399839 | jenkins | v1.32.0 | 12 Mar 24 00:15 UTC | |
| | /etc/crio -type f -exec sh -c | | | | | |
| | 'echo {}; cat {}' \; | | | | | |
| ssh | -p cilium-399839 sudo crio | cilium-399839 | jenkins | v1.32.0 | 12 Mar 24 00:15 UTC | |
| | config | | | | | |
| delete | -p cilium-399839 | cilium-399839 | jenkins | v1.32.0 | 12 Mar 24 00:15 UTC | 12 Mar 24 00:15 UTC |
| start | -p cert-expiration-627308 | cert-expiration-627308 | jenkins | v1.32.0 | 12 Mar 24 00:15 UTC | 12 Mar 24 00:16 UTC |
| | --memory=2048 | | | | | |
| | --cert-expiration=3m | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| ssh | force-systemd-env-074205 | force-systemd-env-074205 | jenkins | v1.32.0 | 12 Mar 24 00:15 UTC | 12 Mar 24 00:15 UTC |
| | ssh cat | | | | | |
| | /etc/containerd/config.toml | | | | | |
| delete | -p force-systemd-env-074205 | force-systemd-env-074205 | jenkins | v1.32.0 | 12 Mar 24 00:15 UTC | 12 Mar 24 00:15 UTC |
| start | -p cert-options-844120 | cert-options-844120 | jenkins | v1.32.0 | 12 Mar 24 00:15 UTC | 12 Mar 24 00:16 UTC |
| | --memory=2048 | | | | | |
| | --apiserver-ips=127.0.0.1 | | | | | |
| | --apiserver-ips=192.168.15.15 | | | | | |
| | --apiserver-names=localhost | | | | | |
| | --apiserver-names=www.google.com | | | | | |
| | --apiserver-port=8555 | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| ssh | cert-options-844120 ssh | cert-options-844120 | jenkins | v1.32.0 | 12 Mar 24 00:16 UTC | 12 Mar 24 00:16 UTC |
| | openssl x509 -text -noout -in | | | | | |
| | /var/lib/minikube/certs/apiserver.crt | | | | | |
| ssh | -p cert-options-844120 -- sudo | cert-options-844120 | jenkins | v1.32.0 | 12 Mar 24 00:16 UTC | 12 Mar 24 00:16 UTC |
| | cat /etc/kubernetes/admin.conf | | | | | |
| delete | -p cert-options-844120 | cert-options-844120 | jenkins | v1.32.0 | 12 Mar 24 00:16 UTC | 12 Mar 24 00:16 UTC |
| start | -p old-k8s-version-571339 | old-k8s-version-571339 | jenkins | v1.32.0 | 12 Mar 24 00:16 UTC | 12 Mar 24 00:19 UTC |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --kvm-network=default | | | | | |
| | --kvm-qemu-uri=qemu:///system | | | | | |
| | --disable-driver-mounts | | | | | |
| | --keep-context=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --kubernetes-version=v1.20.0 | | | | | |
| start | -p cert-expiration-627308 | cert-expiration-627308 | jenkins | v1.32.0 | 12 Mar 24 00:19 UTC | 12 Mar 24 00:19 UTC |
| | --memory=2048 | | | | | |
| | --cert-expiration=8760h | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| delete | -p cert-expiration-627308 | cert-expiration-627308 | jenkins | v1.32.0 | 12 Mar 24 00:19 UTC | 12 Mar 24 00:19 UTC |
| start | -p no-preload-820117 | no-preload-820117 | jenkins | v1.32.0 | 12 Mar 24 00:19 UTC | 12 Mar 24 00:20 UTC |
| | --memory=2200 --alsologtostderr | | | | | |
| | --wait=true --preload=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --kubernetes-version=v1.29.0-rc.2 | | | | | |
| addons | enable metrics-server -p old-k8s-version-571339 | old-k8s-version-571339 | jenkins | v1.32.0 | 12 Mar 24 00:19 UTC | 12 Mar 24 00:19 UTC |
| | --images=MetricsServer=registry.k8s.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| stop | -p old-k8s-version-571339 | old-k8s-version-571339 | jenkins | v1.32.0 | 12 Mar 24 00:19 UTC | 12 Mar 24 00:19 UTC |
| | --alsologtostderr -v=3 | | | | | |
| addons | enable dashboard -p old-k8s-version-571339 | old-k8s-version-571339 | jenkins | v1.32.0 | 12 Mar 24 00:19 UTC | 12 Mar 24 00:19 UTC |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| start | -p old-k8s-version-571339 | old-k8s-version-571339 | jenkins | v1.32.0 | 12 Mar 24 00:19 UTC | |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --kvm-network=default | | | | | |
| | --kvm-qemu-uri=qemu:///system | | | | | |
| | --disable-driver-mounts | | | | | |
| | --keep-context=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --kubernetes-version=v1.20.0 | | | | | |
| addons | enable metrics-server -p no-preload-820117 | no-preload-820117 | jenkins | v1.32.0 | 12 Mar 24 00:20 UTC | 12 Mar 24 00:20 UTC |
| | --images=MetricsServer=registry.k8s.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| stop | -p no-preload-820117 | no-preload-820117 | jenkins | v1.32.0 | 12 Mar 24 00:20 UTC | 12 Mar 24 00:20 UTC |
| | --alsologtostderr -v=3 | | | | | |
| addons | enable dashboard -p no-preload-820117 | no-preload-820117 | jenkins | v1.32.0 | 12 Mar 24 00:20 UTC | 12 Mar 24 00:20 UTC |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| start | -p no-preload-820117 | no-preload-820117 | jenkins | v1.32.0 | 12 Mar 24 00:20 UTC | |
| | --memory=2200 --alsologtostderr | | | | | |
| | --wait=true --preload=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --kubernetes-version=v1.29.0-rc.2 | | | | | |
|---------|--------------------------------------------------------|--------------------------|---------|---------|---------------------|---------------------|
==> Last Start <==
Log file created at: 2024/03/12 00:20:50
Running on machine: ip-172-31-29-130
Binary: Built with gc go1.22.0 for linux/arm64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I0312 00:20:50.541954 1188932 out.go:291] Setting OutFile to fd 1 ...
I0312 00:20:50.542135 1188932 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0312 00:20:50.542219 1188932 out.go:304] Setting ErrFile to fd 2...
I0312 00:20:50.542235 1188932 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0312 00:20:50.542599 1188932 root.go:338] Updating PATH: /home/jenkins/minikube-integration/18358-982285/.minikube/bin
I0312 00:20:50.543046 1188932 out.go:298] Setting JSON to false
I0312 00:20:50.544420 1188932 start.go:129] hostinfo: {"hostname":"ip-172-31-29-130","uptime":18199,"bootTime":1710184652,"procs":224,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1055-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"36adf542-ef4f-4e2d-a0c8-6868d1383ff9"}
I0312 00:20:50.544504 1188932 start.go:139] virtualization:
I0312 00:20:50.547384 1188932 out.go:177] * [no-preload-820117] minikube v1.32.0 on Ubuntu 20.04 (arm64)
I0312 00:20:50.549904 1188932 out.go:177] - MINIKUBE_LOCATION=18358
I0312 00:20:50.552171 1188932 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0312 00:20:50.550060 1188932 notify.go:220] Checking for updates...
I0312 00:20:50.555668 1188932 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/18358-982285/kubeconfig
I0312 00:20:50.557452 1188932 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/18358-982285/.minikube
I0312 00:20:50.559152 1188932 out.go:177] - MINIKUBE_BIN=out/minikube-linux-arm64
I0312 00:20:50.560775 1188932 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0312 00:20:50.562988 1188932 config.go:182] Loaded profile config "no-preload-820117": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.29.0-rc.2
I0312 00:20:50.563569 1188932 driver.go:392] Setting default libvirt URI to qemu:///system
I0312 00:20:50.586673 1188932 docker.go:122] docker version: linux-25.0.4:Docker Engine - Community
I0312 00:20:50.586789 1188932 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0312 00:20:50.658543 1188932 info.go:266] docker info: {ID:U5VK:ZNT5:35M3:FHLW:Q7TL:ELFX:BNAG:AV4T:UD2H:SK5L:SEJV:SJJL Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:38 OomKillDisable:true NGoroutines:56 SystemTime:2024-03-12 00:20:50.64889652 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1055-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aarc
h64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215040000 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-29-130 Labels:[] ExperimentalBuild:false ServerVersion:25.0.4 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:ae07eda36dd25f8a1b98dfbf587313b99c0190bb Expected:ae07eda36dd25f8a1b98dfbf587313b99c0190bb} RuncCommit:{ID:v1.1.12-0-g51d5e94 Expected:v1.1.12-0-g51d5e94} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerError
s:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.13.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.24.7]] Warnings:<nil>}}
I0312 00:20:50.658663 1188932 docker.go:295] overlay module found
I0312 00:20:50.660696 1188932 out.go:177] * Using the docker driver based on existing profile
I0312 00:20:50.662660 1188932 start.go:297] selected driver: docker
I0312 00:20:50.662678 1188932 start.go:901] validating driver "docker" against &{Name:no-preload-820117 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.29.0-rc.2 ClusterName:no-preload-820117 Namespace:default APIServerHAVIP: APISer
verName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.29.0-rc.2 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:f
alse MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0312 00:20:50.662790 1188932 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0312 00:20:50.663699 1188932 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0312 00:20:50.721141 1188932 info.go:266] docker info: {ID:U5VK:ZNT5:35M3:FHLW:Q7TL:ELFX:BNAG:AV4T:UD2H:SK5L:SEJV:SJJL Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:38 OomKillDisable:true NGoroutines:56 SystemTime:2024-03-12 00:20:50.710655071 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1055-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215040000 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-29-130 Labels:[] ExperimentalBuild:false ServerVersion:25.0.4 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:ae07eda36dd25f8a1b98dfbf587313b99c0190bb Expected:ae07eda36dd25f8a1b98dfbf587313b99c0190bb} RuncCommit:{ID:v1.1.12-0-g51d5e94 Expected:v1.1.12-0-g51d5e94} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.13.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.24.7]] Warnings:<nil>}}
I0312 00:20:50.721491 1188932 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0312 00:20:50.721553 1188932 cni.go:84] Creating CNI manager for ""
I0312 00:20:50.721568 1188932 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0312 00:20:50.721613 1188932 start.go:340] cluster config:
{Name:no-preload-820117 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.29.0-rc.2 ClusterName:no-preload-820117 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Con
tainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.29.0-rc.2 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:d
ocker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0312 00:20:50.724785 1188932 out.go:177] * Starting "no-preload-820117" primary control-plane node in "no-preload-820117" cluster
I0312 00:20:50.726676 1188932 cache.go:121] Beginning downloading kic base image for docker with containerd
I0312 00:20:50.728514 1188932 out.go:177] * Pulling base image v0.0.42-1708944392-18244 ...
I0312 00:20:50.730603 1188932 preload.go:132] Checking if preload exists for k8s version v1.29.0-rc.2 and runtime containerd
I0312 00:20:50.730690 1188932 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 in local docker daemon
I0312 00:20:50.730803 1188932 profile.go:142] Saving config to /home/jenkins/minikube-integration/18358-982285/.minikube/profiles/no-preload-820117/config.json ...
I0312 00:20:50.731196 1188932 cache.go:107] acquiring lock: {Name:mkf92ea0c89d4c9524d1be4c946c4329ff83f832 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0312 00:20:50.731302 1188932 cache.go:115] /home/jenkins/minikube-integration/18358-982285/.minikube/cache/images/arm64/gcr.io/k8s-minikube/storage-provisioner_v5 exists
I0312 00:20:50.731418 1188932 cache.go:96] cache image "gcr.io/k8s-minikube/storage-provisioner:v5" -> "/home/jenkins/minikube-integration/18358-982285/.minikube/cache/images/arm64/gcr.io/k8s-minikube/storage-provisioner_v5" took 226.899µs
I0312 00:20:50.731431 1188932 cache.go:80] save to tar file gcr.io/k8s-minikube/storage-provisioner:v5 -> /home/jenkins/minikube-integration/18358-982285/.minikube/cache/images/arm64/gcr.io/k8s-minikube/storage-provisioner_v5 succeeded
I0312 00:20:50.731446 1188932 cache.go:107] acquiring lock: {Name:mk4f885f5af3bd070a6064f366370a31e2783607 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0312 00:20:50.731496 1188932 cache.go:115] /home/jenkins/minikube-integration/18358-982285/.minikube/cache/images/arm64/registry.k8s.io/kube-apiserver_v1.29.0-rc.2 exists
I0312 00:20:50.731506 1188932 cache.go:96] cache image "registry.k8s.io/kube-apiserver:v1.29.0-rc.2" -> "/home/jenkins/minikube-integration/18358-982285/.minikube/cache/images/arm64/registry.k8s.io/kube-apiserver_v1.29.0-rc.2" took 63.137µs
I0312 00:20:50.731513 1188932 cache.go:80] save to tar file registry.k8s.io/kube-apiserver:v1.29.0-rc.2 -> /home/jenkins/minikube-integration/18358-982285/.minikube/cache/images/arm64/registry.k8s.io/kube-apiserver_v1.29.0-rc.2 succeeded
I0312 00:20:50.731528 1188932 cache.go:107] acquiring lock: {Name:mk605a8ec10e82852869543fe9055ed85de43697 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0312 00:20:50.731668 1188932 cache.go:115] /home/jenkins/minikube-integration/18358-982285/.minikube/cache/images/arm64/registry.k8s.io/kube-controller-manager_v1.29.0-rc.2 exists
I0312 00:20:50.731684 1188932 cache.go:96] cache image "registry.k8s.io/kube-controller-manager:v1.29.0-rc.2" -> "/home/jenkins/minikube-integration/18358-982285/.minikube/cache/images/arm64/registry.k8s.io/kube-controller-manager_v1.29.0-rc.2" took 156.698µs
I0312 00:20:50.731744 1188932 cache.go:80] save to tar file registry.k8s.io/kube-controller-manager:v1.29.0-rc.2 -> /home/jenkins/minikube-integration/18358-982285/.minikube/cache/images/arm64/registry.k8s.io/kube-controller-manager_v1.29.0-rc.2 succeeded
I0312 00:20:50.731768 1188932 cache.go:107] acquiring lock: {Name:mk04bd77379cac93c500d24284ab41dbdff0ba22 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0312 00:20:50.731821 1188932 cache.go:115] /home/jenkins/minikube-integration/18358-982285/.minikube/cache/images/arm64/registry.k8s.io/kube-scheduler_v1.29.0-rc.2 exists
I0312 00:20:50.731816 1188932 cache.go:107] acquiring lock: {Name:mk1efd3e8a093653b7f7789b238a2bb8793c57c9 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0312 00:20:50.731828 1188932 cache.go:96] cache image "registry.k8s.io/kube-scheduler:v1.29.0-rc.2" -> "/home/jenkins/minikube-integration/18358-982285/.minikube/cache/images/arm64/registry.k8s.io/kube-scheduler_v1.29.0-rc.2" took 63.285µs
I0312 00:20:50.731849 1188932 cache.go:80] save to tar file registry.k8s.io/kube-scheduler:v1.29.0-rc.2 -> /home/jenkins/minikube-integration/18358-982285/.minikube/cache/images/arm64/registry.k8s.io/kube-scheduler_v1.29.0-rc.2 succeeded
I0312 00:20:50.731860 1188932 cache.go:107] acquiring lock: {Name:mk6161219273dc520579db8d426cf678fbbc9882 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0312 00:20:50.731885 1188932 cache.go:115] /home/jenkins/minikube-integration/18358-982285/.minikube/cache/images/arm64/registry.k8s.io/pause_3.9 exists
I0312 00:20:50.731895 1188932 cache.go:115] /home/jenkins/minikube-integration/18358-982285/.minikube/cache/images/arm64/registry.k8s.io/etcd_3.5.10-0 exists
I0312 00:20:50.731907 1188932 cache.go:96] cache image "registry.k8s.io/etcd:3.5.10-0" -> "/home/jenkins/minikube-integration/18358-982285/.minikube/cache/images/arm64/registry.k8s.io/etcd_3.5.10-0" took 48.606µs
I0312 00:20:50.731915 1188932 cache.go:80] save to tar file registry.k8s.io/etcd:3.5.10-0 -> /home/jenkins/minikube-integration/18358-982285/.minikube/cache/images/arm64/registry.k8s.io/etcd_3.5.10-0 succeeded
I0312 00:20:50.731908 1188932 cache.go:107] acquiring lock: {Name:mk0f67a5c72f21c67d3c044b68201bb27f19ccd0 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0312 00:20:50.731894 1188932 cache.go:96] cache image "registry.k8s.io/pause:3.9" -> "/home/jenkins/minikube-integration/18358-982285/.minikube/cache/images/arm64/registry.k8s.io/pause_3.9" took 87.333µs
I0312 00:20:50.731932 1188932 cache.go:80] save to tar file registry.k8s.io/pause:3.9 -> /home/jenkins/minikube-integration/18358-982285/.minikube/cache/images/arm64/registry.k8s.io/pause_3.9 succeeded
I0312 00:20:50.731943 1188932 cache.go:115] /home/jenkins/minikube-integration/18358-982285/.minikube/cache/images/arm64/registry.k8s.io/kube-proxy_v1.29.0-rc.2 exists
I0312 00:20:50.731949 1188932 cache.go:96] cache image "registry.k8s.io/kube-proxy:v1.29.0-rc.2" -> "/home/jenkins/minikube-integration/18358-982285/.minikube/cache/images/arm64/registry.k8s.io/kube-proxy_v1.29.0-rc.2" took 42.805µs
I0312 00:20:50.731947 1188932 cache.go:107] acquiring lock: {Name:mk93316922e2d696693cfb2ed02a67004963bb8a Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0312 00:20:50.731956 1188932 cache.go:80] save to tar file registry.k8s.io/kube-proxy:v1.29.0-rc.2 -> /home/jenkins/minikube-integration/18358-982285/.minikube/cache/images/arm64/registry.k8s.io/kube-proxy_v1.29.0-rc.2 succeeded
I0312 00:20:50.732104 1188932 cache.go:115] /home/jenkins/minikube-integration/18358-982285/.minikube/cache/images/arm64/registry.k8s.io/coredns/coredns_v1.11.1 exists
I0312 00:20:50.732120 1188932 cache.go:96] cache image "registry.k8s.io/coredns/coredns:v1.11.1" -> "/home/jenkins/minikube-integration/18358-982285/.minikube/cache/images/arm64/registry.k8s.io/coredns/coredns_v1.11.1" took 174.436µs
I0312 00:20:50.732127 1188932 cache.go:80] save to tar file registry.k8s.io/coredns/coredns:v1.11.1 -> /home/jenkins/minikube-integration/18358-982285/.minikube/cache/images/arm64/registry.k8s.io/coredns/coredns_v1.11.1 succeeded
I0312 00:20:50.732155 1188932 cache.go:87] Successfully saved all images to host disk.
I0312 00:20:50.747997 1188932 image.go:83] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 in local docker daemon, skipping pull
I0312 00:20:50.748025 1188932 cache.go:144] gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 exists in daemon, skipping load
I0312 00:20:50.748047 1188932 cache.go:194] Successfully downloaded all kic artifacts
I0312 00:20:50.748075 1188932 start.go:360] acquireMachinesLock for no-preload-820117: {Name:mkf37752eca2fd3272417c72bab17c9ea390482e Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0312 00:20:50.748139 1188932 start.go:364] duration metric: took 41.722µs to acquireMachinesLock for "no-preload-820117"
I0312 00:20:50.748164 1188932 start.go:96] Skipping create...Using existing machine configuration
I0312 00:20:50.748170 1188932 fix.go:54] fixHost starting:
I0312 00:20:50.748474 1188932 cli_runner.go:164] Run: docker container inspect no-preload-820117 --format={{.State.Status}}
I0312 00:20:50.765598 1188932 fix.go:112] recreateIfNeeded on no-preload-820117: state=Stopped err=<nil>
W0312 00:20:50.765630 1188932 fix.go:138] unexpected machine state, will restart: <nil>
I0312 00:20:50.769145 1188932 out.go:177] * Restarting existing docker container for "no-preload-820117" ...
I0312 00:20:49.718150 1183642 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-571339" in "kube-system" namespace has status "Ready":"False"
I0312 00:20:52.223566 1183642 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-571339" in "kube-system" namespace has status "Ready":"False"
I0312 00:20:50.771173 1188932 cli_runner.go:164] Run: docker start no-preload-820117
I0312 00:20:51.156543 1188932 cli_runner.go:164] Run: docker container inspect no-preload-820117 --format={{.State.Status}}
I0312 00:20:51.180309 1188932 kic.go:430] container "no-preload-820117" state is running.
I0312 00:20:51.180709 1188932 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" no-preload-820117
I0312 00:20:51.202838 1188932 profile.go:142] Saving config to /home/jenkins/minikube-integration/18358-982285/.minikube/profiles/no-preload-820117/config.json ...
I0312 00:20:51.203062 1188932 machine.go:94] provisionDockerMachine start ...
I0312 00:20:51.203118 1188932 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-820117
I0312 00:20:51.232865 1188932 main.go:141] libmachine: Using SSH client type: native
I0312 00:20:51.233141 1188932 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e1ca0] 0x3e4500 <nil> [] 0s} 127.0.0.1 34202 <nil> <nil>}
I0312 00:20:51.233151 1188932 main.go:141] libmachine: About to run SSH command:
hostname
I0312 00:20:51.233908 1188932 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: EOF
I0312 00:20:54.367519 1188932 main.go:141] libmachine: SSH cmd err, output: <nil>: no-preload-820117
I0312 00:20:54.367541 1188932 ubuntu.go:169] provisioning hostname "no-preload-820117"
I0312 00:20:54.367608 1188932 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-820117
I0312 00:20:54.383745 1188932 main.go:141] libmachine: Using SSH client type: native
I0312 00:20:54.384002 1188932 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e1ca0] 0x3e4500 <nil> [] 0s} 127.0.0.1 34202 <nil> <nil>}
I0312 00:20:54.384020 1188932 main.go:141] libmachine: About to run SSH command:
sudo hostname no-preload-820117 && echo "no-preload-820117" | sudo tee /etc/hostname
I0312 00:20:54.527831 1188932 main.go:141] libmachine: SSH cmd err, output: <nil>: no-preload-820117
I0312 00:20:54.527945 1188932 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-820117
I0312 00:20:54.545529 1188932 main.go:141] libmachine: Using SSH client type: native
I0312 00:20:54.545788 1188932 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e1ca0] 0x3e4500 <nil> [] 0s} 127.0.0.1 34202 <nil> <nil>}
I0312 00:20:54.545810 1188932 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sno-preload-820117' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 no-preload-820117/g' /etc/hosts;
else
echo '127.0.1.1 no-preload-820117' | sudo tee -a /etc/hosts;
fi
fi
I0312 00:20:54.675514 1188932 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0312 00:20:54.675540 1188932 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/18358-982285/.minikube CaCertPath:/home/jenkins/minikube-integration/18358-982285/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/18358-982285/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/18358-982285/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/18358-982285/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/18358-982285/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/18358-982285/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/18358-982285/.minikube}
I0312 00:20:54.675561 1188932 ubuntu.go:177] setting up certificates
I0312 00:20:54.675572 1188932 provision.go:84] configureAuth start
I0312 00:20:54.675652 1188932 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" no-preload-820117
I0312 00:20:54.694260 1188932 provision.go:143] copyHostCerts
I0312 00:20:54.694339 1188932 exec_runner.go:144] found /home/jenkins/minikube-integration/18358-982285/.minikube/key.pem, removing ...
I0312 00:20:54.694356 1188932 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18358-982285/.minikube/key.pem
I0312 00:20:54.694434 1188932 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18358-982285/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/18358-982285/.minikube/key.pem (1679 bytes)
I0312 00:20:54.694562 1188932 exec_runner.go:144] found /home/jenkins/minikube-integration/18358-982285/.minikube/ca.pem, removing ...
I0312 00:20:54.694574 1188932 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18358-982285/.minikube/ca.pem
I0312 00:20:54.694601 1188932 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18358-982285/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/18358-982285/.minikube/ca.pem (1082 bytes)
I0312 00:20:54.694671 1188932 exec_runner.go:144] found /home/jenkins/minikube-integration/18358-982285/.minikube/cert.pem, removing ...
I0312 00:20:54.694688 1188932 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18358-982285/.minikube/cert.pem
I0312 00:20:54.694715 1188932 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18358-982285/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/18358-982285/.minikube/cert.pem (1123 bytes)
I0312 00:20:54.694781 1188932 provision.go:117] generating server cert: /home/jenkins/minikube-integration/18358-982285/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/18358-982285/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/18358-982285/.minikube/certs/ca-key.pem org=jenkins.no-preload-820117 san=[127.0.0.1 192.168.85.2 localhost minikube no-preload-820117]
I0312 00:20:55.033567 1188932 provision.go:177] copyRemoteCerts
I0312 00:20:55.033679 1188932 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0312 00:20:55.033743 1188932 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-820117
I0312 00:20:55.054507 1188932 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34202 SSHKeyPath:/home/jenkins/minikube-integration/18358-982285/.minikube/machines/no-preload-820117/id_rsa Username:docker}
I0312 00:20:55.153333 1188932 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18358-982285/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0312 00:20:55.180376 1188932 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18358-982285/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
I0312 00:20:55.208912 1188932 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18358-982285/.minikube/machines/server.pem --> /etc/docker/server.pem (1220 bytes)
I0312 00:20:55.235445 1188932 provision.go:87] duration metric: took 559.859948ms to configureAuth
I0312 00:20:55.235471 1188932 ubuntu.go:193] setting minikube options for container-runtime
I0312 00:20:55.235703 1188932 config.go:182] Loaded profile config "no-preload-820117": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.29.0-rc.2
I0312 00:20:55.235718 1188932 machine.go:97] duration metric: took 4.032647509s to provisionDockerMachine
I0312 00:20:55.235726 1188932 start.go:293] postStartSetup for "no-preload-820117" (driver="docker")
I0312 00:20:55.235739 1188932 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0312 00:20:55.235795 1188932 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0312 00:20:55.235849 1188932 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-820117
I0312 00:20:55.252078 1188932 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34202 SSHKeyPath:/home/jenkins/minikube-integration/18358-982285/.minikube/machines/no-preload-820117/id_rsa Username:docker}
I0312 00:20:55.344473 1188932 ssh_runner.go:195] Run: cat /etc/os-release
I0312 00:20:55.347582 1188932 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0312 00:20:55.347658 1188932 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0312 00:20:55.347684 1188932 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0312 00:20:55.347706 1188932 info.go:137] Remote host: Ubuntu 22.04.3 LTS
I0312 00:20:55.347729 1188932 filesync.go:126] Scanning /home/jenkins/minikube-integration/18358-982285/.minikube/addons for local assets ...
I0312 00:20:55.347801 1188932 filesync.go:126] Scanning /home/jenkins/minikube-integration/18358-982285/.minikube/files for local assets ...
I0312 00:20:55.347935 1188932 filesync.go:149] local asset: /home/jenkins/minikube-integration/18358-982285/.minikube/files/etc/ssl/certs/9876862.pem -> 9876862.pem in /etc/ssl/certs
I0312 00:20:55.348062 1188932 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0312 00:20:55.356594 1188932 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18358-982285/.minikube/files/etc/ssl/certs/9876862.pem --> /etc/ssl/certs/9876862.pem (1708 bytes)
I0312 00:20:55.381509 1188932 start.go:296] duration metric: took 145.766296ms for postStartSetup
I0312 00:20:55.381633 1188932 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0312 00:20:55.381679 1188932 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-820117
I0312 00:20:55.400821 1188932 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34202 SSHKeyPath:/home/jenkins/minikube-integration/18358-982285/.minikube/machines/no-preload-820117/id_rsa Username:docker}
I0312 00:20:55.492164 1188932 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I0312 00:20:55.496564 1188932 fix.go:56] duration metric: took 4.74838679s for fixHost
I0312 00:20:55.496588 1188932 start.go:83] releasing machines lock for "no-preload-820117", held for 4.7484367s
I0312 00:20:55.496657 1188932 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" no-preload-820117
I0312 00:20:55.512626 1188932 ssh_runner.go:195] Run: cat /version.json
I0312 00:20:55.512679 1188932 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-820117
I0312 00:20:55.512913 1188932 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0312 00:20:55.512957 1188932 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-820117
I0312 00:20:55.532428 1188932 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34202 SSHKeyPath:/home/jenkins/minikube-integration/18358-982285/.minikube/machines/no-preload-820117/id_rsa Username:docker}
I0312 00:20:55.543131 1188932 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34202 SSHKeyPath:/home/jenkins/minikube-integration/18358-982285/.minikube/machines/no-preload-820117/id_rsa Username:docker}
I0312 00:20:55.626680 1188932 ssh_runner.go:195] Run: systemctl --version
I0312 00:20:55.759795 1188932 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I0312 00:20:55.764145 1188932 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
I0312 00:20:55.782847 1188932 cni.go:230] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
I0312 00:20:55.782921 1188932 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0312 00:20:55.791772 1188932 cni.go:259] no active bridge cni configs found in "/etc/cni/net.d" - nothing to disable
I0312 00:20:55.791796 1188932 start.go:494] detecting cgroup driver to use...
I0312 00:20:55.791830 1188932 detect.go:196] detected "cgroupfs" cgroup driver on host os
I0312 00:20:55.791880 1188932 ssh_runner.go:195] Run: sudo systemctl stop -f crio
I0312 00:20:55.805586 1188932 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I0312 00:20:55.817874 1188932 docker.go:217] disabling cri-docker service (if available) ...
I0312 00:20:55.817946 1188932 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0312 00:20:55.834402 1188932 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0312 00:20:55.846680 1188932 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0312 00:20:55.934928 1188932 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0312 00:20:56.026248 1188932 docker.go:233] disabling docker service ...
I0312 00:20:56.026376 1188932 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0312 00:20:56.044738 1188932 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0312 00:20:56.057287 1188932 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0312 00:20:56.150693 1188932 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0312 00:20:56.266398 1188932 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0312 00:20:56.281870 1188932 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///run/containerd/containerd.sock
" | sudo tee /etc/crictl.yaml"
I0312 00:20:56.299043 1188932 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.9"|' /etc/containerd/config.toml"
I0312 00:20:56.310000 1188932 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
I0312 00:20:56.320172 1188932 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...
I0312 00:20:56.320298 1188932 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
I0312 00:20:56.330897 1188932 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0312 00:20:56.341273 1188932 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
I0312 00:20:56.352132 1188932 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0312 00:20:56.362649 1188932 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0312 00:20:56.372445 1188932 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
I0312 00:20:56.384235 1188932 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0312 00:20:56.394172 1188932 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0312 00:20:56.403535 1188932 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0312 00:20:56.509745 1188932 ssh_runner.go:195] Run: sudo systemctl restart containerd
I0312 00:20:56.710905 1188932 start.go:541] Will wait 60s for socket path /run/containerd/containerd.sock
I0312 00:20:56.710977 1188932 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
I0312 00:20:56.716899 1188932 start.go:562] Will wait 60s for crictl version
I0312 00:20:56.716962 1188932 ssh_runner.go:195] Run: which crictl
I0312 00:20:56.721946 1188932 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0312 00:20:56.761680 1188932 start.go:578] Version: 0.1.0
RuntimeName: containerd
RuntimeVersion: 1.6.28
RuntimeApiVersion: v1
I0312 00:20:56.761754 1188932 ssh_runner.go:195] Run: containerd --version
I0312 00:20:56.787297 1188932 ssh_runner.go:195] Run: containerd --version
I0312 00:20:56.811807 1188932 out.go:177] * Preparing Kubernetes v1.29.0-rc.2 on containerd 1.6.28 ...
I0312 00:20:56.814611 1188932 cli_runner.go:164] Run: docker network inspect no-preload-820117 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0312 00:20:56.832211 1188932 ssh_runner.go:195] Run: grep 192.168.85.1 host.minikube.internal$ /etc/hosts
I0312 00:20:56.836483 1188932 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.85.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0312 00:20:56.847610 1188932 kubeadm.go:877] updating cluster {Name:no-preload-820117 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.29.0-rc.2 ClusterName:no-preload-820117 Namespace:default APIServerHAVIP: APIServerName:minikubeC
A APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.29.0-rc.2 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:
/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0312 00:20:56.847735 1188932 preload.go:132] Checking if preload exists for k8s version v1.29.0-rc.2 and runtime containerd
I0312 00:20:56.847788 1188932 ssh_runner.go:195] Run: sudo crictl images --output json
I0312 00:20:56.885727 1188932 containerd.go:612] all images are preloaded for containerd runtime.
I0312 00:20:56.885749 1188932 cache_images.go:84] Images are preloaded, skipping loading
I0312 00:20:56.885757 1188932 kubeadm.go:928] updating node { 192.168.85.2 8443 v1.29.0-rc.2 containerd true true} ...
I0312 00:20:56.885861 1188932 kubeadm.go:940] kubelet [Unit]
Wants=containerd.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.29.0-rc.2/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=no-preload-820117 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.85.2
[Install]
config:
{KubernetesVersion:v1.29.0-rc.2 ClusterName:no-preload-820117 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0312 00:20:56.885930 1188932 ssh_runner.go:195] Run: sudo crictl info
I0312 00:20:56.922106 1188932 cni.go:84] Creating CNI manager for ""
I0312 00:20:56.922134 1188932 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0312 00:20:56.922145 1188932 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0312 00:20:56.922167 1188932 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.85.2 APIServerPort:8443 KubernetesVersion:v1.29.0-rc.2 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:no-preload-820117 NodeName:no-preload-820117 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.85.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.85.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt Stati
cPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///run/containerd/containerd.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I0312 00:20:56.922298 1188932 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta3
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.85.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///run/containerd/containerd.sock
name: "no-preload-820117"
kubeletExtraArgs:
node-ip: 192.168.85.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta3
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.85.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.29.0-rc.2
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
containerRuntimeEndpoint: unix:///run/containerd/containerd.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%!"(MISSING)
nodefs.inodesFree: "0%!"(MISSING)
imagefs.available: "0%!"(MISSING)
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0312 00:20:56.922368 1188932 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.29.0-rc.2
I0312 00:20:56.932378 1188932 binaries.go:44] Found k8s binaries, skipping transfer
I0312 00:20:56.932452 1188932 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0312 00:20:56.941363 1188932 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (326 bytes)
I0312 00:20:56.960725 1188932 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (357 bytes)
I0312 00:20:56.980006 1188932 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2176 bytes)
I0312 00:20:56.999645 1188932 ssh_runner.go:195] Run: grep 192.168.85.2 control-plane.minikube.internal$ /etc/hosts
I0312 00:20:57.005884 1188932 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.85.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0312 00:20:57.017793 1188932 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0312 00:20:57.106623 1188932 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0312 00:20:57.123629 1188932 certs.go:68] Setting up /home/jenkins/minikube-integration/18358-982285/.minikube/profiles/no-preload-820117 for IP: 192.168.85.2
I0312 00:20:57.123655 1188932 certs.go:194] generating shared ca certs ...
I0312 00:20:57.123671 1188932 certs.go:226] acquiring lock for ca certs: {Name:mk0a8924146da92e76e9ff4162540f84539e9725 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0312 00:20:57.123895 1188932 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/18358-982285/.minikube/ca.key
I0312 00:20:57.123968 1188932 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/18358-982285/.minikube/proxy-client-ca.key
I0312 00:20:57.123984 1188932 certs.go:256] generating profile certs ...
I0312 00:20:57.124104 1188932 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/18358-982285/.minikube/profiles/no-preload-820117/client.key
I0312 00:20:57.124254 1188932 certs.go:359] skipping valid signed profile cert regeneration for "minikube": /home/jenkins/minikube-integration/18358-982285/.minikube/profiles/no-preload-820117/apiserver.key.268b8182
I0312 00:20:57.124330 1188932 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/18358-982285/.minikube/profiles/no-preload-820117/proxy-client.key
I0312 00:20:57.124488 1188932 certs.go:484] found cert: /home/jenkins/minikube-integration/18358-982285/.minikube/certs/987686.pem (1338 bytes)
W0312 00:20:57.124544 1188932 certs.go:480] ignoring /home/jenkins/minikube-integration/18358-982285/.minikube/certs/987686_empty.pem, impossibly tiny 0 bytes
I0312 00:20:57.124558 1188932 certs.go:484] found cert: /home/jenkins/minikube-integration/18358-982285/.minikube/certs/ca-key.pem (1675 bytes)
I0312 00:20:57.124588 1188932 certs.go:484] found cert: /home/jenkins/minikube-integration/18358-982285/.minikube/certs/ca.pem (1082 bytes)
I0312 00:20:57.124648 1188932 certs.go:484] found cert: /home/jenkins/minikube-integration/18358-982285/.minikube/certs/cert.pem (1123 bytes)
I0312 00:20:57.124692 1188932 certs.go:484] found cert: /home/jenkins/minikube-integration/18358-982285/.minikube/certs/key.pem (1679 bytes)
I0312 00:20:57.124771 1188932 certs.go:484] found cert: /home/jenkins/minikube-integration/18358-982285/.minikube/files/etc/ssl/certs/9876862.pem (1708 bytes)
I0312 00:20:57.125559 1188932 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18358-982285/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0312 00:20:57.156483 1188932 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18358-982285/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I0312 00:20:57.184039 1188932 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18358-982285/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0312 00:20:57.211140 1188932 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18358-982285/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0312 00:20:57.238842 1188932 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18358-982285/.minikube/profiles/no-preload-820117/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1424 bytes)
I0312 00:20:57.273175 1188932 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18358-982285/.minikube/profiles/no-preload-820117/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0312 00:20:57.314602 1188932 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18358-982285/.minikube/profiles/no-preload-820117/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0312 00:20:57.349458 1188932 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18358-982285/.minikube/profiles/no-preload-820117/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0312 00:20:57.379205 1188932 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18358-982285/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0312 00:20:57.414532 1188932 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18358-982285/.minikube/certs/987686.pem --> /usr/share/ca-certificates/987686.pem (1338 bytes)
I0312 00:20:57.442947 1188932 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18358-982285/.minikube/files/etc/ssl/certs/9876862.pem --> /usr/share/ca-certificates/9876862.pem (1708 bytes)
I0312 00:20:57.472613 1188932 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0312 00:20:57.494421 1188932 ssh_runner.go:195] Run: openssl version
I0312 00:20:57.503121 1188932 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/9876862.pem && ln -fs /usr/share/ca-certificates/9876862.pem /etc/ssl/certs/9876862.pem"
I0312 00:20:57.513927 1188932 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/9876862.pem
I0312 00:20:57.518112 1188932 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Mar 11 23:40 /usr/share/ca-certificates/9876862.pem
I0312 00:20:57.518204 1188932 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/9876862.pem
I0312 00:20:57.525289 1188932 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/9876862.pem /etc/ssl/certs/3ec20f2e.0"
I0312 00:20:57.535124 1188932 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0312 00:20:57.545222 1188932 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0312 00:20:57.549439 1188932 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Mar 11 23:34 /usr/share/ca-certificates/minikubeCA.pem
I0312 00:20:57.549510 1188932 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0312 00:20:57.556906 1188932 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0312 00:20:57.566292 1188932 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/987686.pem && ln -fs /usr/share/ca-certificates/987686.pem /etc/ssl/certs/987686.pem"
I0312 00:20:57.576440 1188932 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/987686.pem
I0312 00:20:57.580172 1188932 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Mar 11 23:40 /usr/share/ca-certificates/987686.pem
I0312 00:20:57.580268 1188932 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/987686.pem
I0312 00:20:57.587370 1188932 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/987686.pem /etc/ssl/certs/51391683.0"
I0312 00:20:57.596971 1188932 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0312 00:20:57.600754 1188932 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
I0312 00:20:57.607803 1188932 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
I0312 00:20:57.614831 1188932 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
I0312 00:20:57.621850 1188932 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
I0312 00:20:57.629155 1188932 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
I0312 00:20:57.636263 1188932 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
I0312 00:20:57.643278 1188932 kubeadm.go:391] StartCluster: {Name:no-preload-820117 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.29.0-rc.2 ClusterName:no-preload-820117 Namespace:default APIServerHAVIP: APIServerName:minikubeCA A
PIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.29.0-rc.2 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/ho
me/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0312 00:20:57.643425 1188932 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}
I0312 00:20:57.643511 1188932 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0312 00:20:57.686858 1188932 cri.go:89] found id: "84b4bce6633a2747538b2b0094a5cdbd7dbdcc49272243631213feef4909f91d"
I0312 00:20:57.686882 1188932 cri.go:89] found id: "9d99f44eeab838fb07f421ae4950e661e5f56229d69d698d8f9d2033522367ec"
I0312 00:20:57.686887 1188932 cri.go:89] found id: "dcde5d00729bb4753633d3244c211c58c0f9f4746661a0859e35488e957c7617"
I0312 00:20:57.686899 1188932 cri.go:89] found id: "98ff369cade299c3b79c03bdcf3fa19fb46b634e98833fe1a4dacb2e30baa2c8"
I0312 00:20:57.686903 1188932 cri.go:89] found id: "c8529a2810c2bb6eb70f0f41e1933487322a4e0712a39e177213f3244173c3df"
I0312 00:20:57.686907 1188932 cri.go:89] found id: "e37d0739e1cf5a034f8279d0f1c5a380bdf13f8df12805914af49b8d09457cc3"
I0312 00:20:57.686910 1188932 cri.go:89] found id: "4e2109d4bafae2dd679c7ef05f522399401b1a72fb57a580332be0348557938e"
I0312 00:20:57.686913 1188932 cri.go:89] found id: "1433ae512c5cae729926e9a205666b562fb23efcf8bdc4b06b97fb200275abad"
I0312 00:20:57.686916 1188932 cri.go:89] found id: ""
I0312 00:20:57.686969 1188932 ssh_runner.go:195] Run: sudo runc --root /run/containerd/runc/k8s.io list -f json
I0312 00:20:57.699859 1188932 cri.go:116] JSON = null
W0312 00:20:57.699907 1188932 kubeadm.go:398] unpause failed: list paused: list returned 0 containers, but ps returned 8
I0312 00:20:57.699969 1188932 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
W0312 00:20:57.709442 1188932 kubeadm.go:404] apiserver tunnel failed: apiserver port not set
I0312 00:20:57.709463 1188932 kubeadm.go:407] found existing configuration files, will attempt cluster restart
I0312 00:20:57.709471 1188932 kubeadm.go:587] restartPrimaryControlPlane start ...
I0312 00:20:57.709532 1188932 ssh_runner.go:195] Run: sudo test -d /data/minikube
I0312 00:20:57.721537 1188932 kubeadm.go:129] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
stdout:
stderr:
I0312 00:20:57.722163 1188932 kubeconfig.go:47] verify endpoint returned: get endpoint: "no-preload-820117" does not appear in /home/jenkins/minikube-integration/18358-982285/kubeconfig
I0312 00:20:57.722438 1188932 kubeconfig.go:62] /home/jenkins/minikube-integration/18358-982285/kubeconfig needs updating (will repair): [kubeconfig missing "no-preload-820117" cluster setting kubeconfig missing "no-preload-820117" context setting]
I0312 00:20:57.722929 1188932 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18358-982285/kubeconfig: {Name:mk502765d2bd81c45b0b0cd22382df706d40c442 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0312 00:20:57.724384 1188932 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
I0312 00:20:57.735340 1188932 kubeadm.go:624] The running cluster does not require reconfiguration: 192.168.85.2
I0312 00:20:57.735374 1188932 kubeadm.go:591] duration metric: took 25.897381ms to restartPrimaryControlPlane
I0312 00:20:57.735384 1188932 kubeadm.go:393] duration metric: took 92.124741ms to StartCluster
I0312 00:20:57.735401 1188932 settings.go:142] acquiring lock: {Name:mk66549f73c966ba6f23af9cfb4fef2b1aaf9da2 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0312 00:20:57.735463 1188932 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/18358-982285/kubeconfig
I0312 00:20:57.736483 1188932 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18358-982285/kubeconfig: {Name:mk502765d2bd81c45b0b0cd22382df706d40c442 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0312 00:20:57.736708 1188932 start.go:234] Will wait 6m0s for node &{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.29.0-rc.2 ContainerRuntime:containerd ControlPlane:true Worker:true}
I0312 00:20:57.740656 1188932 out.go:177] * Verifying Kubernetes components...
I0312 00:20:57.737002 1188932 config.go:182] Loaded profile config "no-preload-820117": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.29.0-rc.2
I0312 00:20:57.737013 1188932 addons.go:502] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:true default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volumesnapshots:false yakd:false]
I0312 00:20:57.740702 1188932 addons.go:69] Setting storage-provisioner=true in profile "no-preload-820117"
I0312 00:20:57.740719 1188932 addons.go:69] Setting dashboard=true in profile "no-preload-820117"
I0312 00:20:57.740742 1188932 addons.go:234] Setting addon storage-provisioner=true in "no-preload-820117"
W0312 00:20:57.740750 1188932 addons.go:243] addon storage-provisioner should already be in state true
I0312 00:20:57.740756 1188932 addons.go:234] Setting addon dashboard=true in "no-preload-820117"
W0312 00:20:57.740764 1188932 addons.go:243] addon dashboard should already be in state true
I0312 00:20:57.740781 1188932 host.go:66] Checking if "no-preload-820117" exists ...
I0312 00:20:57.740791 1188932 host.go:66] Checking if "no-preload-820117" exists ...
I0312 00:20:57.741249 1188932 cli_runner.go:164] Run: docker container inspect no-preload-820117 --format={{.State.Status}}
I0312 00:20:57.741254 1188932 addons.go:69] Setting default-storageclass=true in profile "no-preload-820117"
I0312 00:20:57.741275 1188932 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "no-preload-820117"
I0312 00:20:57.741480 1188932 cli_runner.go:164] Run: docker container inspect no-preload-820117 --format={{.State.Status}}
I0312 00:20:57.741868 1188932 addons.go:69] Setting metrics-server=true in profile "no-preload-820117"
I0312 00:20:57.744299 1188932 addons.go:234] Setting addon metrics-server=true in "no-preload-820117"
W0312 00:20:57.744329 1188932 addons.go:243] addon metrics-server should already be in state true
I0312 00:20:57.741249 1188932 cli_runner.go:164] Run: docker container inspect no-preload-820117 --format={{.State.Status}}
I0312 00:20:57.744211 1188932 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0312 00:20:57.744412 1188932 host.go:66] Checking if "no-preload-820117" exists ...
I0312 00:20:57.745126 1188932 cli_runner.go:164] Run: docker container inspect no-preload-820117 --format={{.State.Status}}
I0312 00:20:57.800871 1188932 addons.go:234] Setting addon default-storageclass=true in "no-preload-820117"
W0312 00:20:57.800894 1188932 addons.go:243] addon default-storageclass should already be in state true
I0312 00:20:57.800920 1188932 host.go:66] Checking if "no-preload-820117" exists ...
I0312 00:20:57.801368 1188932 cli_runner.go:164] Run: docker container inspect no-preload-820117 --format={{.State.Status}}
I0312 00:20:57.806980 1188932 out.go:177] - Using image fake.domain/registry.k8s.io/echoserver:1.4
I0312 00:20:57.811268 1188932 addons.go:426] installing /etc/kubernetes/addons/metrics-apiservice.yaml
I0312 00:20:57.811296 1188932 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
I0312 00:20:57.811449 1188932 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-820117
I0312 00:20:57.827361 1188932 out.go:177] - Using image docker.io/kubernetesui/dashboard:v2.7.0
I0312 00:20:57.833312 1188932 out.go:177] - Using image registry.k8s.io/echoserver:1.4
I0312 00:20:57.837008 1188932 addons.go:426] installing /etc/kubernetes/addons/dashboard-ns.yaml
I0312 00:20:57.837085 1188932 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-ns.yaml (759 bytes)
I0312 00:20:57.837186 1188932 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-820117
I0312 00:20:57.840420 1188932 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0312 00:20:54.718119 1183642 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-571339" in "kube-system" namespace has status "Ready":"False"
I0312 00:20:56.719178 1183642 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-571339" in "kube-system" namespace has status "Ready":"False"
I0312 00:20:57.843116 1188932 addons.go:426] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0312 00:20:57.843138 1188932 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0312 00:20:57.843213 1188932 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-820117
I0312 00:20:57.865763 1188932 addons.go:426] installing /etc/kubernetes/addons/storageclass.yaml
I0312 00:20:57.865787 1188932 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0312 00:20:57.865879 1188932 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-820117
I0312 00:20:57.887088 1188932 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34202 SSHKeyPath:/home/jenkins/minikube-integration/18358-982285/.minikube/machines/no-preload-820117/id_rsa Username:docker}
I0312 00:20:57.889268 1188932 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34202 SSHKeyPath:/home/jenkins/minikube-integration/18358-982285/.minikube/machines/no-preload-820117/id_rsa Username:docker}
I0312 00:20:57.925474 1188932 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34202 SSHKeyPath:/home/jenkins/minikube-integration/18358-982285/.minikube/machines/no-preload-820117/id_rsa Username:docker}
I0312 00:20:57.933711 1188932 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34202 SSHKeyPath:/home/jenkins/minikube-integration/18358-982285/.minikube/machines/no-preload-820117/id_rsa Username:docker}
I0312 00:20:57.964991 1188932 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0312 00:20:58.087728 1188932 node_ready.go:35] waiting up to 6m0s for node "no-preload-820117" to be "Ready" ...
I0312 00:20:58.156702 1188932 addons.go:426] installing /etc/kubernetes/addons/dashboard-clusterrole.yaml
I0312 00:20:58.156779 1188932 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-clusterrole.yaml (1001 bytes)
I0312 00:20:58.208389 1188932 addons.go:426] installing /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml
I0312 00:20:58.208429 1188932 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml (1018 bytes)
I0312 00:20:58.230802 1188932 addons.go:426] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
I0312 00:20:58.230826 1188932 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1825 bytes)
I0312 00:20:58.272847 1188932 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0312 00:20:58.281485 1188932 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0312 00:20:58.336996 1188932 addons.go:426] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
I0312 00:20:58.337070 1188932 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
I0312 00:20:58.338654 1188932 addons.go:426] installing /etc/kubernetes/addons/dashboard-configmap.yaml
I0312 00:20:58.338709 1188932 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-configmap.yaml (837 bytes)
I0312 00:20:58.373149 1188932 addons.go:426] installing /etc/kubernetes/addons/dashboard-dp.yaml
I0312 00:20:58.373177 1188932 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-dp.yaml (4201 bytes)
I0312 00:20:58.505474 1188932 addons.go:426] installing /etc/kubernetes/addons/metrics-server-service.yaml
I0312 00:20:58.505503 1188932 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
I0312 00:20:58.694506 1188932 addons.go:426] installing /etc/kubernetes/addons/dashboard-role.yaml
I0312 00:20:58.694534 1188932 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-role.yaml (1724 bytes)
I0312 00:20:58.773111 1188932 addons.go:426] installing /etc/kubernetes/addons/dashboard-rolebinding.yaml
I0312 00:20:58.773142 1188932 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-rolebinding.yaml (1046 bytes)
I0312 00:20:58.864635 1188932 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0312 00:20:58.964010 1188932 addons.go:426] installing /etc/kubernetes/addons/dashboard-sa.yaml
I0312 00:20:58.964043 1188932 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-sa.yaml (837 bytes)
I0312 00:20:59.059937 1188932 addons.go:426] installing /etc/kubernetes/addons/dashboard-secret.yaml
I0312 00:20:59.059971 1188932 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-secret.yaml (1389 bytes)
I0312 00:20:59.193041 1188932 addons.go:426] installing /etc/kubernetes/addons/dashboard-svc.yaml
I0312 00:20:59.193067 1188932 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-svc.yaml (1294 bytes)
I0312 00:20:59.251256 1188932 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0312 00:20:59.220911 1183642 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-571339" in "kube-system" namespace has status "Ready":"False"
I0312 00:21:01.719534 1183642 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-571339" in "kube-system" namespace has status "Ready":"False"
I0312 00:21:03.113667 1188932 node_ready.go:49] node "no-preload-820117" has status "Ready":"True"
I0312 00:21:03.113691 1188932 node_ready.go:38] duration metric: took 5.025918521s for node "no-preload-820117" to be "Ready" ...
I0312 00:21:03.113708 1188932 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0312 00:21:03.248632 1188932 pod_ready.go:78] waiting up to 6m0s for pod "coredns-76f75df574-bd88h" in "kube-system" namespace to be "Ready" ...
I0312 00:21:03.263866 1188932 pod_ready.go:92] pod "coredns-76f75df574-bd88h" in "kube-system" namespace has status "Ready":"True"
I0312 00:21:03.263937 1188932 pod_ready.go:81] duration metric: took 15.217798ms for pod "coredns-76f75df574-bd88h" in "kube-system" namespace to be "Ready" ...
I0312 00:21:03.263963 1188932 pod_ready.go:78] waiting up to 6m0s for pod "etcd-no-preload-820117" in "kube-system" namespace to be "Ready" ...
I0312 00:21:03.295559 1188932 pod_ready.go:92] pod "etcd-no-preload-820117" in "kube-system" namespace has status "Ready":"True"
I0312 00:21:03.295580 1188932 pod_ready.go:81] duration metric: took 31.596646ms for pod "etcd-no-preload-820117" in "kube-system" namespace to be "Ready" ...
I0312 00:21:03.295599 1188932 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-no-preload-820117" in "kube-system" namespace to be "Ready" ...
I0312 00:21:03.333460 1188932 pod_ready.go:92] pod "kube-apiserver-no-preload-820117" in "kube-system" namespace has status "Ready":"True"
I0312 00:21:03.333494 1188932 pod_ready.go:81] duration metric: took 37.886377ms for pod "kube-apiserver-no-preload-820117" in "kube-system" namespace to be "Ready" ...
I0312 00:21:03.333506 1188932 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-no-preload-820117" in "kube-system" namespace to be "Ready" ...
I0312 00:21:03.341468 1188932 pod_ready.go:92] pod "kube-controller-manager-no-preload-820117" in "kube-system" namespace has status "Ready":"True"
I0312 00:21:03.341501 1188932 pod_ready.go:81] duration metric: took 7.987145ms for pod "kube-controller-manager-no-preload-820117" in "kube-system" namespace to be "Ready" ...
I0312 00:21:03.341529 1188932 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-p9vcv" in "kube-system" namespace to be "Ready" ...
I0312 00:21:03.372669 1188932 pod_ready.go:92] pod "kube-proxy-p9vcv" in "kube-system" namespace has status "Ready":"True"
I0312 00:21:03.372703 1188932 pod_ready.go:81] duration metric: took 31.159957ms for pod "kube-proxy-p9vcv" in "kube-system" namespace to be "Ready" ...
I0312 00:21:03.372731 1188932 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-no-preload-820117" in "kube-system" namespace to be "Ready" ...
I0312 00:21:03.806738 1188932 pod_ready.go:92] pod "kube-scheduler-no-preload-820117" in "kube-system" namespace has status "Ready":"True"
I0312 00:21:03.806775 1188932 pod_ready.go:81] duration metric: took 434.030637ms for pod "kube-scheduler-no-preload-820117" in "kube-system" namespace to be "Ready" ...
I0312 00:21:03.806787 1188932 pod_ready.go:78] waiting up to 6m0s for pod "metrics-server-57f55c9bc5-h8x5t" in "kube-system" namespace to be "Ready" ...
I0312 00:21:03.844472 1188932 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (5.571568585s)
I0312 00:21:05.814150 1188932 pod_ready.go:102] pod "metrics-server-57f55c9bc5-h8x5t" in "kube-system" namespace has status "Ready":"False"
I0312 00:21:06.167343 1188932 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (7.885820804s)
I0312 00:21:06.257173 1188932 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (7.392495941s)
I0312 00:21:06.257377 1188932 addons.go:470] Verifying addon metrics-server=true in "no-preload-820117"
I0312 00:21:06.257352 1188932 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: (7.006055397s)
I0312 00:21:06.259702 1188932 out.go:177] * Some dashboard features require the metrics-server addon. To enable all features please run:
minikube -p no-preload-820117 addons enable metrics-server
I0312 00:21:06.261821 1188932 out.go:177] * Enabled addons: default-storageclass, storage-provisioner, metrics-server, dashboard
I0312 00:21:03.227170 1183642 pod_ready.go:92] pod "kube-controller-manager-old-k8s-version-571339" in "kube-system" namespace has status "Ready":"True"
I0312 00:21:03.227190 1183642 pod_ready.go:81] duration metric: took 57.016156506s for pod "kube-controller-manager-old-k8s-version-571339" in "kube-system" namespace to be "Ready" ...
I0312 00:21:03.227202 1183642 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-tvrz6" in "kube-system" namespace to be "Ready" ...
I0312 00:21:03.233214 1183642 pod_ready.go:92] pod "kube-proxy-tvrz6" in "kube-system" namespace has status "Ready":"True"
I0312 00:21:03.233236 1183642 pod_ready.go:81] duration metric: took 6.026509ms for pod "kube-proxy-tvrz6" in "kube-system" namespace to be "Ready" ...
I0312 00:21:03.233252 1183642 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-old-k8s-version-571339" in "kube-system" namespace to be "Ready" ...
I0312 00:21:05.239789 1183642 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-571339" in "kube-system" namespace has status "Ready":"False"
I0312 00:21:07.740120 1183642 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-571339" in "kube-system" namespace has status "Ready":"False"
I0312 00:21:06.263876 1188932 addons.go:505] duration metric: took 8.526856984s for enable addons: enabled=[default-storageclass storage-provisioner metrics-server dashboard]
I0312 00:21:08.313184 1188932 pod_ready.go:102] pod "metrics-server-57f55c9bc5-h8x5t" in "kube-system" namespace has status "Ready":"False"
I0312 00:21:10.316553 1188932 pod_ready.go:102] pod "metrics-server-57f55c9bc5-h8x5t" in "kube-system" namespace has status "Ready":"False"
I0312 00:21:10.240027 1183642 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-571339" in "kube-system" namespace has status "Ready":"False"
I0312 00:21:12.739407 1183642 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-571339" in "kube-system" namespace has status "Ready":"False"
I0312 00:21:12.814806 1188932 pod_ready.go:102] pod "metrics-server-57f55c9bc5-h8x5t" in "kube-system" namespace has status "Ready":"False"
I0312 00:21:15.313639 1188932 pod_ready.go:102] pod "metrics-server-57f55c9bc5-h8x5t" in "kube-system" namespace has status "Ready":"False"
I0312 00:21:14.739905 1183642 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-571339" in "kube-system" namespace has status "Ready":"False"
I0312 00:21:17.239412 1183642 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-571339" in "kube-system" namespace has status "Ready":"False"
I0312 00:21:17.814088 1188932 pod_ready.go:102] pod "metrics-server-57f55c9bc5-h8x5t" in "kube-system" namespace has status "Ready":"False"
I0312 00:21:19.814247 1188932 pod_ready.go:102] pod "metrics-server-57f55c9bc5-h8x5t" in "kube-system" namespace has status "Ready":"False"
I0312 00:21:19.240306 1183642 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-571339" in "kube-system" namespace has status "Ready":"False"
I0312 00:21:21.741209 1183642 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-571339" in "kube-system" namespace has status "Ready":"False"
I0312 00:21:21.832031 1188932 pod_ready.go:102] pod "metrics-server-57f55c9bc5-h8x5t" in "kube-system" namespace has status "Ready":"False"
I0312 00:21:24.312961 1188932 pod_ready.go:102] pod "metrics-server-57f55c9bc5-h8x5t" in "kube-system" namespace has status "Ready":"False"
I0312 00:21:23.741756 1183642 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-571339" in "kube-system" namespace has status "Ready":"False"
I0312 00:21:25.243129 1183642 pod_ready.go:92] pod "kube-scheduler-old-k8s-version-571339" in "kube-system" namespace has status "Ready":"True"
I0312 00:21:25.243227 1183642 pod_ready.go:81] duration metric: took 22.009965136s for pod "kube-scheduler-old-k8s-version-571339" in "kube-system" namespace to be "Ready" ...
I0312 00:21:25.243292 1183642 pod_ready.go:78] waiting up to 6m0s for pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace to be "Ready" ...
I0312 00:21:27.249922 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:21:26.313558 1188932 pod_ready.go:102] pod "metrics-server-57f55c9bc5-h8x5t" in "kube-system" namespace has status "Ready":"False"
I0312 00:21:28.313787 1188932 pod_ready.go:102] pod "metrics-server-57f55c9bc5-h8x5t" in "kube-system" namespace has status "Ready":"False"
I0312 00:21:29.253629 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:21:31.750359 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:21:30.813610 1188932 pod_ready.go:102] pod "metrics-server-57f55c9bc5-h8x5t" in "kube-system" namespace has status "Ready":"False"
I0312 00:21:32.813843 1188932 pod_ready.go:102] pod "metrics-server-57f55c9bc5-h8x5t" in "kube-system" namespace has status "Ready":"False"
I0312 00:21:35.313045 1188932 pod_ready.go:102] pod "metrics-server-57f55c9bc5-h8x5t" in "kube-system" namespace has status "Ready":"False"
I0312 00:21:34.249496 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:21:36.250802 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:21:37.313937 1188932 pod_ready.go:102] pod "metrics-server-57f55c9bc5-h8x5t" in "kube-system" namespace has status "Ready":"False"
I0312 00:21:39.813372 1188932 pod_ready.go:102] pod "metrics-server-57f55c9bc5-h8x5t" in "kube-system" namespace has status "Ready":"False"
I0312 00:21:38.250948 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:21:40.754158 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:21:41.813995 1188932 pod_ready.go:102] pod "metrics-server-57f55c9bc5-h8x5t" in "kube-system" namespace has status "Ready":"False"
I0312 00:21:44.313530 1188932 pod_ready.go:102] pod "metrics-server-57f55c9bc5-h8x5t" in "kube-system" namespace has status "Ready":"False"
I0312 00:21:43.249095 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:21:45.250392 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:21:47.749722 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:21:46.313653 1188932 pod_ready.go:102] pod "metrics-server-57f55c9bc5-h8x5t" in "kube-system" namespace has status "Ready":"False"
I0312 00:21:48.813597 1188932 pod_ready.go:102] pod "metrics-server-57f55c9bc5-h8x5t" in "kube-system" namespace has status "Ready":"False"
I0312 00:21:49.749754 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:21:51.750403 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:21:50.814351 1188932 pod_ready.go:102] pod "metrics-server-57f55c9bc5-h8x5t" in "kube-system" namespace has status "Ready":"False"
I0312 00:21:53.313263 1188932 pod_ready.go:102] pod "metrics-server-57f55c9bc5-h8x5t" in "kube-system" namespace has status "Ready":"False"
I0312 00:21:55.313689 1188932 pod_ready.go:102] pod "metrics-server-57f55c9bc5-h8x5t" in "kube-system" namespace has status "Ready":"False"
I0312 00:21:54.250385 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:21:56.770534 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:21:57.316917 1188932 pod_ready.go:102] pod "metrics-server-57f55c9bc5-h8x5t" in "kube-system" namespace has status "Ready":"False"
I0312 00:21:59.813635 1188932 pod_ready.go:102] pod "metrics-server-57f55c9bc5-h8x5t" in "kube-system" namespace has status "Ready":"False"
I0312 00:21:59.249206 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:22:01.258864 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:22:01.815257 1188932 pod_ready.go:102] pod "metrics-server-57f55c9bc5-h8x5t" in "kube-system" namespace has status "Ready":"False"
I0312 00:22:04.316221 1188932 pod_ready.go:102] pod "metrics-server-57f55c9bc5-h8x5t" in "kube-system" namespace has status "Ready":"False"
I0312 00:22:03.749523 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:22:05.750110 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:22:06.814865 1188932 pod_ready.go:102] pod "metrics-server-57f55c9bc5-h8x5t" in "kube-system" namespace has status "Ready":"False"
I0312 00:22:09.313710 1188932 pod_ready.go:102] pod "metrics-server-57f55c9bc5-h8x5t" in "kube-system" namespace has status "Ready":"False"
I0312 00:22:08.250519 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:22:10.750288 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:22:11.813589 1188932 pod_ready.go:102] pod "metrics-server-57f55c9bc5-h8x5t" in "kube-system" namespace has status "Ready":"False"
I0312 00:22:14.312931 1188932 pod_ready.go:102] pod "metrics-server-57f55c9bc5-h8x5t" in "kube-system" namespace has status "Ready":"False"
I0312 00:22:13.250136 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:22:15.256797 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:22:17.749938 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:22:16.315604 1188932 pod_ready.go:102] pod "metrics-server-57f55c9bc5-h8x5t" in "kube-system" namespace has status "Ready":"False"
I0312 00:22:18.813703 1188932 pod_ready.go:102] pod "metrics-server-57f55c9bc5-h8x5t" in "kube-system" namespace has status "Ready":"False"
I0312 00:22:20.249074 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:22:22.249939 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:22:21.313512 1188932 pod_ready.go:102] pod "metrics-server-57f55c9bc5-h8x5t" in "kube-system" namespace has status "Ready":"False"
I0312 00:22:23.813611 1188932 pod_ready.go:102] pod "metrics-server-57f55c9bc5-h8x5t" in "kube-system" namespace has status "Ready":"False"
I0312 00:22:24.748800 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:22:26.749624 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:22:26.314585 1188932 pod_ready.go:102] pod "metrics-server-57f55c9bc5-h8x5t" in "kube-system" namespace has status "Ready":"False"
I0312 00:22:28.814287 1188932 pod_ready.go:102] pod "metrics-server-57f55c9bc5-h8x5t" in "kube-system" namespace has status "Ready":"False"
I0312 00:22:29.253144 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:22:31.749968 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:22:31.313261 1188932 pod_ready.go:102] pod "metrics-server-57f55c9bc5-h8x5t" in "kube-system" namespace has status "Ready":"False"
I0312 00:22:33.812805 1188932 pod_ready.go:102] pod "metrics-server-57f55c9bc5-h8x5t" in "kube-system" namespace has status "Ready":"False"
I0312 00:22:34.250397 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:22:36.749482 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:22:35.813112 1188932 pod_ready.go:102] pod "metrics-server-57f55c9bc5-h8x5t" in "kube-system" namespace has status "Ready":"False"
I0312 00:22:37.813503 1188932 pod_ready.go:102] pod "metrics-server-57f55c9bc5-h8x5t" in "kube-system" namespace has status "Ready":"False"
I0312 00:22:40.313595 1188932 pod_ready.go:102] pod "metrics-server-57f55c9bc5-h8x5t" in "kube-system" namespace has status "Ready":"False"
I0312 00:22:39.249893 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:22:41.749896 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:22:42.314090 1188932 pod_ready.go:102] pod "metrics-server-57f55c9bc5-h8x5t" in "kube-system" namespace has status "Ready":"False"
I0312 00:22:44.813268 1188932 pod_ready.go:102] pod "metrics-server-57f55c9bc5-h8x5t" in "kube-system" namespace has status "Ready":"False"
I0312 00:22:44.249675 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:22:46.749855 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:22:46.814183 1188932 pod_ready.go:102] pod "metrics-server-57f55c9bc5-h8x5t" in "kube-system" namespace has status "Ready":"False"
I0312 00:22:49.312904 1188932 pod_ready.go:102] pod "metrics-server-57f55c9bc5-h8x5t" in "kube-system" namespace has status "Ready":"False"
I0312 00:22:49.249664 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:22:51.249976 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:22:51.812954 1188932 pod_ready.go:102] pod "metrics-server-57f55c9bc5-h8x5t" in "kube-system" namespace has status "Ready":"False"
I0312 00:22:53.813494 1188932 pod_ready.go:102] pod "metrics-server-57f55c9bc5-h8x5t" in "kube-system" namespace has status "Ready":"False"
I0312 00:22:53.250606 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:22:55.750464 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:22:55.813824 1188932 pod_ready.go:102] pod "metrics-server-57f55c9bc5-h8x5t" in "kube-system" namespace has status "Ready":"False"
I0312 00:22:57.815080 1188932 pod_ready.go:102] pod "metrics-server-57f55c9bc5-h8x5t" in "kube-system" namespace has status "Ready":"False"
I0312 00:23:00.314547 1188932 pod_ready.go:102] pod "metrics-server-57f55c9bc5-h8x5t" in "kube-system" namespace has status "Ready":"False"
I0312 00:22:58.249257 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:23:00.267356 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:23:02.750532 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:23:02.813543 1188932 pod_ready.go:102] pod "metrics-server-57f55c9bc5-h8x5t" in "kube-system" namespace has status "Ready":"False"
I0312 00:23:05.313532 1188932 pod_ready.go:102] pod "metrics-server-57f55c9bc5-h8x5t" in "kube-system" namespace has status "Ready":"False"
I0312 00:23:05.250606 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:23:07.750716 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:23:07.314229 1188932 pod_ready.go:102] pod "metrics-server-57f55c9bc5-h8x5t" in "kube-system" namespace has status "Ready":"False"
I0312 00:23:09.813749 1188932 pod_ready.go:102] pod "metrics-server-57f55c9bc5-h8x5t" in "kube-system" namespace has status "Ready":"False"
I0312 00:23:10.251242 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:23:12.749463 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:23:11.813841 1188932 pod_ready.go:102] pod "metrics-server-57f55c9bc5-h8x5t" in "kube-system" namespace has status "Ready":"False"
I0312 00:23:13.820653 1188932 pod_ready.go:102] pod "metrics-server-57f55c9bc5-h8x5t" in "kube-system" namespace has status "Ready":"False"
I0312 00:23:15.252504 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:23:17.749439 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:23:16.313277 1188932 pod_ready.go:102] pod "metrics-server-57f55c9bc5-h8x5t" in "kube-system" namespace has status "Ready":"False"
I0312 00:23:18.313547 1188932 pod_ready.go:102] pod "metrics-server-57f55c9bc5-h8x5t" in "kube-system" namespace has status "Ready":"False"
I0312 00:23:20.313817 1188932 pod_ready.go:102] pod "metrics-server-57f55c9bc5-h8x5t" in "kube-system" namespace has status "Ready":"False"
I0312 00:23:19.750446 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:23:22.249233 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:23:22.813713 1188932 pod_ready.go:102] pod "metrics-server-57f55c9bc5-h8x5t" in "kube-system" namespace has status "Ready":"False"
I0312 00:23:25.313209 1188932 pod_ready.go:102] pod "metrics-server-57f55c9bc5-h8x5t" in "kube-system" namespace has status "Ready":"False"
I0312 00:23:24.750135 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:23:27.249368 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:23:27.816745 1188932 pod_ready.go:102] pod "metrics-server-57f55c9bc5-h8x5t" in "kube-system" namespace has status "Ready":"False"
I0312 00:23:30.314045 1188932 pod_ready.go:102] pod "metrics-server-57f55c9bc5-h8x5t" in "kube-system" namespace has status "Ready":"False"
I0312 00:23:29.751700 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:23:32.252338 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:23:32.812864 1188932 pod_ready.go:102] pod "metrics-server-57f55c9bc5-h8x5t" in "kube-system" namespace has status "Ready":"False"
I0312 00:23:34.813470 1188932 pod_ready.go:102] pod "metrics-server-57f55c9bc5-h8x5t" in "kube-system" namespace has status "Ready":"False"
I0312 00:23:34.749267 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:23:36.750479 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:23:36.813525 1188932 pod_ready.go:102] pod "metrics-server-57f55c9bc5-h8x5t" in "kube-system" namespace has status "Ready":"False"
I0312 00:23:38.813621 1188932 pod_ready.go:102] pod "metrics-server-57f55c9bc5-h8x5t" in "kube-system" namespace has status "Ready":"False"
I0312 00:23:39.250553 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:23:41.750376 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:23:41.313580 1188932 pod_ready.go:102] pod "metrics-server-57f55c9bc5-h8x5t" in "kube-system" namespace has status "Ready":"False"
I0312 00:23:43.314016 1188932 pod_ready.go:102] pod "metrics-server-57f55c9bc5-h8x5t" in "kube-system" namespace has status "Ready":"False"
I0312 00:23:43.750574 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:23:46.249404 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:23:45.813789 1188932 pod_ready.go:102] pod "metrics-server-57f55c9bc5-h8x5t" in "kube-system" namespace has status "Ready":"False"
I0312 00:23:47.813925 1188932 pod_ready.go:102] pod "metrics-server-57f55c9bc5-h8x5t" in "kube-system" namespace has status "Ready":"False"
I0312 00:23:49.814192 1188932 pod_ready.go:102] pod "metrics-server-57f55c9bc5-h8x5t" in "kube-system" namespace has status "Ready":"False"
I0312 00:23:48.250459 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:23:50.259454 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:23:52.750308 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:23:52.313527 1188932 pod_ready.go:102] pod "metrics-server-57f55c9bc5-h8x5t" in "kube-system" namespace has status "Ready":"False"
I0312 00:23:54.314535 1188932 pod_ready.go:102] pod "metrics-server-57f55c9bc5-h8x5t" in "kube-system" namespace has status "Ready":"False"
I0312 00:23:55.250042 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:23:57.750235 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:23:56.813942 1188932 pod_ready.go:102] pod "metrics-server-57f55c9bc5-h8x5t" in "kube-system" namespace has status "Ready":"False"
I0312 00:23:59.313409 1188932 pod_ready.go:102] pod "metrics-server-57f55c9bc5-h8x5t" in "kube-system" namespace has status "Ready":"False"
I0312 00:24:00.267118 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:24:02.748886 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:24:01.313867 1188932 pod_ready.go:102] pod "metrics-server-57f55c9bc5-h8x5t" in "kube-system" namespace has status "Ready":"False"
I0312 00:24:03.813736 1188932 pod_ready.go:102] pod "metrics-server-57f55c9bc5-h8x5t" in "kube-system" namespace has status "Ready":"False"
I0312 00:24:04.749475 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:24:07.250678 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:24:05.814473 1188932 pod_ready.go:102] pod "metrics-server-57f55c9bc5-h8x5t" in "kube-system" namespace has status "Ready":"False"
I0312 00:24:08.313478 1188932 pod_ready.go:102] pod "metrics-server-57f55c9bc5-h8x5t" in "kube-system" namespace has status "Ready":"False"
I0312 00:24:10.313750 1188932 pod_ready.go:102] pod "metrics-server-57f55c9bc5-h8x5t" in "kube-system" namespace has status "Ready":"False"
I0312 00:24:09.749225 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:24:11.750512 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:24:12.313795 1188932 pod_ready.go:102] pod "metrics-server-57f55c9bc5-h8x5t" in "kube-system" namespace has status "Ready":"False"
I0312 00:24:14.813978 1188932 pod_ready.go:102] pod "metrics-server-57f55c9bc5-h8x5t" in "kube-system" namespace has status "Ready":"False"
I0312 00:24:14.250329 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:24:16.749575 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:24:16.814143 1188932 pod_ready.go:102] pod "metrics-server-57f55c9bc5-h8x5t" in "kube-system" namespace has status "Ready":"False"
I0312 00:24:19.318164 1188932 pod_ready.go:102] pod "metrics-server-57f55c9bc5-h8x5t" in "kube-system" namespace has status "Ready":"False"
I0312 00:24:19.250281 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:24:21.749352 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:24:21.813539 1188932 pod_ready.go:102] pod "metrics-server-57f55c9bc5-h8x5t" in "kube-system" namespace has status "Ready":"False"
I0312 00:24:23.813877 1188932 pod_ready.go:102] pod "metrics-server-57f55c9bc5-h8x5t" in "kube-system" namespace has status "Ready":"False"
I0312 00:24:23.749394 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:24:25.749579 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:24:27.750348 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:24:26.313792 1188932 pod_ready.go:102] pod "metrics-server-57f55c9bc5-h8x5t" in "kube-system" namespace has status "Ready":"False"
I0312 00:24:28.813350 1188932 pod_ready.go:102] pod "metrics-server-57f55c9bc5-h8x5t" in "kube-system" namespace has status "Ready":"False"
I0312 00:24:30.249873 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:24:32.249981 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:24:30.813918 1188932 pod_ready.go:102] pod "metrics-server-57f55c9bc5-h8x5t" in "kube-system" namespace has status "Ready":"False"
I0312 00:24:33.314028 1188932 pod_ready.go:102] pod "metrics-server-57f55c9bc5-h8x5t" in "kube-system" namespace has status "Ready":"False"
I0312 00:24:35.314496 1188932 pod_ready.go:102] pod "metrics-server-57f55c9bc5-h8x5t" in "kube-system" namespace has status "Ready":"False"
I0312 00:24:34.749339 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:24:37.249723 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:24:37.817186 1188932 pod_ready.go:102] pod "metrics-server-57f55c9bc5-h8x5t" in "kube-system" namespace has status "Ready":"False"
I0312 00:24:40.313608 1188932 pod_ready.go:102] pod "metrics-server-57f55c9bc5-h8x5t" in "kube-system" namespace has status "Ready":"False"
I0312 00:24:39.249953 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:24:41.749722 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:24:42.314608 1188932 pod_ready.go:102] pod "metrics-server-57f55c9bc5-h8x5t" in "kube-system" namespace has status "Ready":"False"
I0312 00:24:44.314832 1188932 pod_ready.go:102] pod "metrics-server-57f55c9bc5-h8x5t" in "kube-system" namespace has status "Ready":"False"
I0312 00:24:43.750163 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:24:46.249711 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:24:46.813345 1188932 pod_ready.go:102] pod "metrics-server-57f55c9bc5-h8x5t" in "kube-system" namespace has status "Ready":"False"
I0312 00:24:48.814051 1188932 pod_ready.go:102] pod "metrics-server-57f55c9bc5-h8x5t" in "kube-system" namespace has status "Ready":"False"
I0312 00:24:48.249848 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:24:50.250297 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:24:52.753532 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:24:51.313790 1188932 pod_ready.go:102] pod "metrics-server-57f55c9bc5-h8x5t" in "kube-system" namespace has status "Ready":"False"
I0312 00:24:53.814548 1188932 pod_ready.go:102] pod "metrics-server-57f55c9bc5-h8x5t" in "kube-system" namespace has status "Ready":"False"
I0312 00:24:55.251518 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:24:57.749656 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:24:56.313176 1188932 pod_ready.go:102] pod "metrics-server-57f55c9bc5-h8x5t" in "kube-system" namespace has status "Ready":"False"
I0312 00:24:58.813951 1188932 pod_ready.go:102] pod "metrics-server-57f55c9bc5-h8x5t" in "kube-system" namespace has status "Ready":"False"
I0312 00:24:59.749784 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:25:01.750995 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:25:01.314048 1188932 pod_ready.go:102] pod "metrics-server-57f55c9bc5-h8x5t" in "kube-system" namespace has status "Ready":"False"
I0312 00:25:03.813782 1188932 pod_ready.go:102] pod "metrics-server-57f55c9bc5-h8x5t" in "kube-system" namespace has status "Ready":"False"
I0312 00:25:03.813813 1188932 pod_ready.go:81] duration metric: took 4m0.007017303s for pod "metrics-server-57f55c9bc5-h8x5t" in "kube-system" namespace to be "Ready" ...
E0312 00:25:03.813824 1188932 pod_ready.go:66] WaitExtra: waitPodCondition: context deadline exceeded
I0312 00:25:03.813832 1188932 pod_ready.go:38] duration metric: took 4m0.700114288s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0312 00:25:03.813846 1188932 api_server.go:52] waiting for apiserver process to appear ...
I0312 00:25:03.813878 1188932 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
I0312 00:25:03.813955 1188932 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0312 00:25:03.877358 1188932 cri.go:89] found id: "5bba79d28e804260c46d7e8af4c7322a6e22b8739a7b65e4f7be5d64306a2ec8"
I0312 00:25:03.877377 1188932 cri.go:89] found id: "4e2109d4bafae2dd679c7ef05f522399401b1a72fb57a580332be0348557938e"
I0312 00:25:03.877382 1188932 cri.go:89] found id: ""
I0312 00:25:03.877389 1188932 logs.go:276] 2 containers: [5bba79d28e804260c46d7e8af4c7322a6e22b8739a7b65e4f7be5d64306a2ec8 4e2109d4bafae2dd679c7ef05f522399401b1a72fb57a580332be0348557938e]
I0312 00:25:03.877445 1188932 ssh_runner.go:195] Run: which crictl
I0312 00:25:03.881097 1188932 ssh_runner.go:195] Run: which crictl
I0312 00:25:03.884555 1188932 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
I0312 00:25:03.884629 1188932 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0312 00:25:03.927396 1188932 cri.go:89] found id: "4c03779c654a410263bf652c7f2d430f984d91760e30f9510e4952a4de615984"
I0312 00:25:03.927417 1188932 cri.go:89] found id: "1433ae512c5cae729926e9a205666b562fb23efcf8bdc4b06b97fb200275abad"
I0312 00:25:03.927421 1188932 cri.go:89] found id: ""
I0312 00:25:03.927429 1188932 logs.go:276] 2 containers: [4c03779c654a410263bf652c7f2d430f984d91760e30f9510e4952a4de615984 1433ae512c5cae729926e9a205666b562fb23efcf8bdc4b06b97fb200275abad]
I0312 00:25:03.927515 1188932 ssh_runner.go:195] Run: which crictl
I0312 00:25:03.931339 1188932 ssh_runner.go:195] Run: which crictl
I0312 00:25:03.934844 1188932 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
I0312 00:25:03.934921 1188932 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0312 00:25:03.981316 1188932 cri.go:89] found id: "c2acdec1d054a8ac4872c3f65232c70b6c961ec0aba27f0912710c095efd38b6"
I0312 00:25:03.981339 1188932 cri.go:89] found id: "84b4bce6633a2747538b2b0094a5cdbd7dbdcc49272243631213feef4909f91d"
I0312 00:25:03.981348 1188932 cri.go:89] found id: ""
I0312 00:25:03.981355 1188932 logs.go:276] 2 containers: [c2acdec1d054a8ac4872c3f65232c70b6c961ec0aba27f0912710c095efd38b6 84b4bce6633a2747538b2b0094a5cdbd7dbdcc49272243631213feef4909f91d]
I0312 00:25:03.981435 1188932 ssh_runner.go:195] Run: which crictl
I0312 00:25:03.984979 1188932 ssh_runner.go:195] Run: which crictl
I0312 00:25:03.988598 1188932 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
I0312 00:25:03.988671 1188932 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0312 00:25:04.033496 1188932 cri.go:89] found id: "88c55a6c60bb439bcdf99b25641fcd058c1a45d0e83950575189d082ee25643b"
I0312 00:25:04.033518 1188932 cri.go:89] found id: "c8529a2810c2bb6eb70f0f41e1933487322a4e0712a39e177213f3244173c3df"
I0312 00:25:04.033523 1188932 cri.go:89] found id: ""
I0312 00:25:04.033530 1188932 logs.go:276] 2 containers: [88c55a6c60bb439bcdf99b25641fcd058c1a45d0e83950575189d082ee25643b c8529a2810c2bb6eb70f0f41e1933487322a4e0712a39e177213f3244173c3df]
I0312 00:25:04.033591 1188932 ssh_runner.go:195] Run: which crictl
I0312 00:25:04.037404 1188932 ssh_runner.go:195] Run: which crictl
I0312 00:25:04.040992 1188932 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
I0312 00:25:04.041082 1188932 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0312 00:25:04.081262 1188932 cri.go:89] found id: "696c39e44fc846bdc283e21d2e90ef3b55024f28122476a01c185722052ac947"
I0312 00:25:04.081323 1188932 cri.go:89] found id: "98ff369cade299c3b79c03bdcf3fa19fb46b634e98833fe1a4dacb2e30baa2c8"
I0312 00:25:04.081341 1188932 cri.go:89] found id: ""
I0312 00:25:04.081362 1188932 logs.go:276] 2 containers: [696c39e44fc846bdc283e21d2e90ef3b55024f28122476a01c185722052ac947 98ff369cade299c3b79c03bdcf3fa19fb46b634e98833fe1a4dacb2e30baa2c8]
I0312 00:25:04.081448 1188932 ssh_runner.go:195] Run: which crictl
I0312 00:25:04.085159 1188932 ssh_runner.go:195] Run: which crictl
I0312 00:25:04.089384 1188932 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
I0312 00:25:04.089505 1188932 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0312 00:25:04.132607 1188932 cri.go:89] found id: "819dcb8ce3bf495d395f8bfd175489a574b14f4d7ec3abfc8d1da331f9f75175"
I0312 00:25:04.132628 1188932 cri.go:89] found id: "e37d0739e1cf5a034f8279d0f1c5a380bdf13f8df12805914af49b8d09457cc3"
I0312 00:25:04.132633 1188932 cri.go:89] found id: ""
I0312 00:25:04.132640 1188932 logs.go:276] 2 containers: [819dcb8ce3bf495d395f8bfd175489a574b14f4d7ec3abfc8d1da331f9f75175 e37d0739e1cf5a034f8279d0f1c5a380bdf13f8df12805914af49b8d09457cc3]
I0312 00:25:04.132721 1188932 ssh_runner.go:195] Run: which crictl
I0312 00:25:04.141275 1188932 ssh_runner.go:195] Run: which crictl
I0312 00:25:04.144869 1188932 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
I0312 00:25:04.144998 1188932 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0312 00:25:04.184133 1188932 cri.go:89] found id: "323bfd261df2aa6bdcaadc95d9b56bc2270a431303c0f1b4ecf16c54f87d6c7b"
I0312 00:25:04.184159 1188932 cri.go:89] found id: "9d99f44eeab838fb07f421ae4950e661e5f56229d69d698d8f9d2033522367ec"
I0312 00:25:04.184164 1188932 cri.go:89] found id: ""
I0312 00:25:04.184171 1188932 logs.go:276] 2 containers: [323bfd261df2aa6bdcaadc95d9b56bc2270a431303c0f1b4ecf16c54f87d6c7b 9d99f44eeab838fb07f421ae4950e661e5f56229d69d698d8f9d2033522367ec]
I0312 00:25:04.184279 1188932 ssh_runner.go:195] Run: which crictl
I0312 00:25:04.187966 1188932 ssh_runner.go:195] Run: which crictl
I0312 00:25:04.191734 1188932 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
I0312 00:25:04.191848 1188932 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I0312 00:25:04.237275 1188932 cri.go:89] found id: "37d755023a893e06a00cdc14d2dc52b4f5c42a585c7ee881d7d3e29d292b126d"
I0312 00:25:04.237305 1188932 cri.go:89] found id: ""
I0312 00:25:04.237313 1188932 logs.go:276] 1 containers: [37d755023a893e06a00cdc14d2dc52b4f5c42a585c7ee881d7d3e29d292b126d]
I0312 00:25:04.237388 1188932 ssh_runner.go:195] Run: which crictl
I0312 00:25:04.240976 1188932 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
I0312 00:25:04.241058 1188932 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0312 00:25:04.288105 1188932 cri.go:89] found id: "9368f694d66d01b464cc56ea1fd680f25acfb86767c32c49af31dc0da67bacb2"
I0312 00:25:04.288179 1188932 cri.go:89] found id: "dec1c27378bb4ef4460888bcfb40ca5dfccc459968492dd3e38b75ac421b0e8e"
I0312 00:25:04.288190 1188932 cri.go:89] found id: ""
I0312 00:25:04.288199 1188932 logs.go:276] 2 containers: [9368f694d66d01b464cc56ea1fd680f25acfb86767c32c49af31dc0da67bacb2 dec1c27378bb4ef4460888bcfb40ca5dfccc459968492dd3e38b75ac421b0e8e]
I0312 00:25:04.288261 1188932 ssh_runner.go:195] Run: which crictl
I0312 00:25:04.292487 1188932 ssh_runner.go:195] Run: which crictl
I0312 00:25:04.299588 1188932 logs.go:123] Gathering logs for kube-apiserver [4e2109d4bafae2dd679c7ef05f522399401b1a72fb57a580332be0348557938e] ...
I0312 00:25:04.299625 1188932 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 4e2109d4bafae2dd679c7ef05f522399401b1a72fb57a580332be0348557938e"
I0312 00:25:04.369166 1188932 logs.go:123] Gathering logs for etcd [4c03779c654a410263bf652c7f2d430f984d91760e30f9510e4952a4de615984] ...
I0312 00:25:04.369201 1188932 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 4c03779c654a410263bf652c7f2d430f984d91760e30f9510e4952a4de615984"
I0312 00:25:04.421140 1188932 logs.go:123] Gathering logs for coredns [84b4bce6633a2747538b2b0094a5cdbd7dbdcc49272243631213feef4909f91d] ...
I0312 00:25:04.421176 1188932 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 84b4bce6633a2747538b2b0094a5cdbd7dbdcc49272243631213feef4909f91d"
I0312 00:25:04.461413 1188932 logs.go:123] Gathering logs for kube-scheduler [88c55a6c60bb439bcdf99b25641fcd058c1a45d0e83950575189d082ee25643b] ...
I0312 00:25:04.461449 1188932 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 88c55a6c60bb439bcdf99b25641fcd058c1a45d0e83950575189d082ee25643b"
I0312 00:25:04.505307 1188932 logs.go:123] Gathering logs for kube-scheduler [c8529a2810c2bb6eb70f0f41e1933487322a4e0712a39e177213f3244173c3df] ...
I0312 00:25:04.505339 1188932 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 c8529a2810c2bb6eb70f0f41e1933487322a4e0712a39e177213f3244173c3df"
I0312 00:25:04.556019 1188932 logs.go:123] Gathering logs for kube-proxy [696c39e44fc846bdc283e21d2e90ef3b55024f28122476a01c185722052ac947] ...
I0312 00:25:04.556054 1188932 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 696c39e44fc846bdc283e21d2e90ef3b55024f28122476a01c185722052ac947"
I0312 00:25:04.600108 1188932 logs.go:123] Gathering logs for describe nodes ...
I0312 00:25:04.600139 1188932 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0312 00:25:04.742641 1188932 logs.go:123] Gathering logs for kube-apiserver [5bba79d28e804260c46d7e8af4c7322a6e22b8739a7b65e4f7be5d64306a2ec8] ...
I0312 00:25:04.742679 1188932 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 5bba79d28e804260c46d7e8af4c7322a6e22b8739a7b65e4f7be5d64306a2ec8"
I0312 00:25:04.798684 1188932 logs.go:123] Gathering logs for storage-provisioner [9368f694d66d01b464cc56ea1fd680f25acfb86767c32c49af31dc0da67bacb2] ...
I0312 00:25:04.798717 1188932 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 9368f694d66d01b464cc56ea1fd680f25acfb86767c32c49af31dc0da67bacb2"
I0312 00:25:04.847779 1188932 logs.go:123] Gathering logs for container status ...
I0312 00:25:04.847810 1188932 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0312 00:25:04.931917 1188932 logs.go:123] Gathering logs for kube-proxy [98ff369cade299c3b79c03bdcf3fa19fb46b634e98833fe1a4dacb2e30baa2c8] ...
I0312 00:25:04.931949 1188932 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 98ff369cade299c3b79c03bdcf3fa19fb46b634e98833fe1a4dacb2e30baa2c8"
I0312 00:25:04.977858 1188932 logs.go:123] Gathering logs for kindnet [323bfd261df2aa6bdcaadc95d9b56bc2270a431303c0f1b4ecf16c54f87d6c7b] ...
I0312 00:25:04.977887 1188932 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 323bfd261df2aa6bdcaadc95d9b56bc2270a431303c0f1b4ecf16c54f87d6c7b"
I0312 00:25:05.027625 1188932 logs.go:123] Gathering logs for etcd [1433ae512c5cae729926e9a205666b562fb23efcf8bdc4b06b97fb200275abad] ...
I0312 00:25:05.027658 1188932 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 1433ae512c5cae729926e9a205666b562fb23efcf8bdc4b06b97fb200275abad"
I0312 00:25:05.088263 1188932 logs.go:123] Gathering logs for kube-controller-manager [819dcb8ce3bf495d395f8bfd175489a574b14f4d7ec3abfc8d1da331f9f75175] ...
I0312 00:25:05.088303 1188932 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 819dcb8ce3bf495d395f8bfd175489a574b14f4d7ec3abfc8d1da331f9f75175"
I0312 00:25:05.160391 1188932 logs.go:123] Gathering logs for storage-provisioner [dec1c27378bb4ef4460888bcfb40ca5dfccc459968492dd3e38b75ac421b0e8e] ...
I0312 00:25:05.160427 1188932 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 dec1c27378bb4ef4460888bcfb40ca5dfccc459968492dd3e38b75ac421b0e8e"
I0312 00:25:05.218952 1188932 logs.go:123] Gathering logs for kubelet ...
I0312 00:25:05.218983 1188932 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0312 00:25:05.274186 1188932 logs.go:138] Found kubelet problem: Mar 12 00:21:16 no-preload-820117 kubelet[656]: W0312 00:21:16.198194 656 reflector.go:539] object-"kubernetes-dashboard"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:no-preload-820117" cannot list resource "configmaps" in API group "" in the namespace "kubernetes-dashboard": no relationship found between node 'no-preload-820117' and this object
W0312 00:25:05.274423 1188932 logs.go:138] Found kubelet problem: Mar 12 00:21:16 no-preload-820117 kubelet[656]: E0312 00:21:16.198236 656 reflector.go:147] object-"kubernetes-dashboard"/"kube-root-ca.crt": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:no-preload-820117" cannot list resource "configmaps" in API group "" in the namespace "kubernetes-dashboard": no relationship found between node 'no-preload-820117' and this object
I0312 00:25:05.301923 1188932 logs.go:123] Gathering logs for kubernetes-dashboard [37d755023a893e06a00cdc14d2dc52b4f5c42a585c7ee881d7d3e29d292b126d] ...
I0312 00:25:05.301954 1188932 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 37d755023a893e06a00cdc14d2dc52b4f5c42a585c7ee881d7d3e29d292b126d"
I0312 00:25:05.342290 1188932 logs.go:123] Gathering logs for kube-controller-manager [e37d0739e1cf5a034f8279d0f1c5a380bdf13f8df12805914af49b8d09457cc3] ...
I0312 00:25:05.342318 1188932 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e37d0739e1cf5a034f8279d0f1c5a380bdf13f8df12805914af49b8d09457cc3"
I0312 00:25:05.432926 1188932 logs.go:123] Gathering logs for kindnet [9d99f44eeab838fb07f421ae4950e661e5f56229d69d698d8f9d2033522367ec] ...
I0312 00:25:05.432961 1188932 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 9d99f44eeab838fb07f421ae4950e661e5f56229d69d698d8f9d2033522367ec"
I0312 00:25:05.472908 1188932 logs.go:123] Gathering logs for containerd ...
I0312 00:25:05.472935 1188932 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
I0312 00:25:05.535001 1188932 logs.go:123] Gathering logs for dmesg ...
I0312 00:25:05.535041 1188932 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0312 00:25:04.251144 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:25:06.749259 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:25:05.556359 1188932 logs.go:123] Gathering logs for coredns [c2acdec1d054a8ac4872c3f65232c70b6c961ec0aba27f0912710c095efd38b6] ...
I0312 00:25:05.556399 1188932 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 c2acdec1d054a8ac4872c3f65232c70b6c961ec0aba27f0912710c095efd38b6"
I0312 00:25:05.601787 1188932 out.go:304] Setting ErrFile to fd 2...
I0312 00:25:05.601814 1188932 out.go:338] TERM=,COLORTERM=, which probably does not support color
W0312 00:25:05.601865 1188932 out.go:239] X Problems detected in kubelet:
W0312 00:25:05.601879 1188932 out.go:239] Mar 12 00:21:16 no-preload-820117 kubelet[656]: W0312 00:21:16.198194 656 reflector.go:539] object-"kubernetes-dashboard"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:no-preload-820117" cannot list resource "configmaps" in API group "" in the namespace "kubernetes-dashboard": no relationship found between node 'no-preload-820117' and this object
W0312 00:25:05.601887 1188932 out.go:239] Mar 12 00:21:16 no-preload-820117 kubelet[656]: E0312 00:21:16.198236 656 reflector.go:147] object-"kubernetes-dashboard"/"kube-root-ca.crt": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:no-preload-820117" cannot list resource "configmaps" in API group "" in the namespace "kubernetes-dashboard": no relationship found between node 'no-preload-820117' and this object
I0312 00:25:05.601901 1188932 out.go:304] Setting ErrFile to fd 2...
I0312 00:25:05.601907 1188932 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0312 00:25:08.749400 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:25:10.750185 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:25:13.249560 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:25:15.249809 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:25:17.250310 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:25:15.603197 1188932 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0312 00:25:15.616802 1188932 api_server.go:72] duration metric: took 4m17.8800599s to wait for apiserver process to appear ...
I0312 00:25:15.616828 1188932 api_server.go:88] waiting for apiserver healthz status ...
I0312 00:25:15.616863 1188932 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
I0312 00:25:15.616940 1188932 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0312 00:25:15.656555 1188932 cri.go:89] found id: "5bba79d28e804260c46d7e8af4c7322a6e22b8739a7b65e4f7be5d64306a2ec8"
I0312 00:25:15.656580 1188932 cri.go:89] found id: "4e2109d4bafae2dd679c7ef05f522399401b1a72fb57a580332be0348557938e"
I0312 00:25:15.656585 1188932 cri.go:89] found id: ""
I0312 00:25:15.656592 1188932 logs.go:276] 2 containers: [5bba79d28e804260c46d7e8af4c7322a6e22b8739a7b65e4f7be5d64306a2ec8 4e2109d4bafae2dd679c7ef05f522399401b1a72fb57a580332be0348557938e]
I0312 00:25:15.656656 1188932 ssh_runner.go:195] Run: which crictl
I0312 00:25:15.660631 1188932 ssh_runner.go:195] Run: which crictl
I0312 00:25:15.664102 1188932 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
I0312 00:25:15.664173 1188932 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0312 00:25:15.706381 1188932 cri.go:89] found id: "4c03779c654a410263bf652c7f2d430f984d91760e30f9510e4952a4de615984"
I0312 00:25:15.706404 1188932 cri.go:89] found id: "1433ae512c5cae729926e9a205666b562fb23efcf8bdc4b06b97fb200275abad"
I0312 00:25:15.706409 1188932 cri.go:89] found id: ""
I0312 00:25:15.706417 1188932 logs.go:276] 2 containers: [4c03779c654a410263bf652c7f2d430f984d91760e30f9510e4952a4de615984 1433ae512c5cae729926e9a205666b562fb23efcf8bdc4b06b97fb200275abad]
I0312 00:25:15.706473 1188932 ssh_runner.go:195] Run: which crictl
I0312 00:25:15.710574 1188932 ssh_runner.go:195] Run: which crictl
I0312 00:25:15.714335 1188932 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
I0312 00:25:15.714407 1188932 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0312 00:25:15.760796 1188932 cri.go:89] found id: "c2acdec1d054a8ac4872c3f65232c70b6c961ec0aba27f0912710c095efd38b6"
I0312 00:25:15.760821 1188932 cri.go:89] found id: "84b4bce6633a2747538b2b0094a5cdbd7dbdcc49272243631213feef4909f91d"
I0312 00:25:15.760833 1188932 cri.go:89] found id: ""
I0312 00:25:15.760842 1188932 logs.go:276] 2 containers: [c2acdec1d054a8ac4872c3f65232c70b6c961ec0aba27f0912710c095efd38b6 84b4bce6633a2747538b2b0094a5cdbd7dbdcc49272243631213feef4909f91d]
I0312 00:25:15.760900 1188932 ssh_runner.go:195] Run: which crictl
I0312 00:25:15.764634 1188932 ssh_runner.go:195] Run: which crictl
I0312 00:25:15.768257 1188932 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
I0312 00:25:15.768338 1188932 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0312 00:25:15.815803 1188932 cri.go:89] found id: "88c55a6c60bb439bcdf99b25641fcd058c1a45d0e83950575189d082ee25643b"
I0312 00:25:15.815826 1188932 cri.go:89] found id: "c8529a2810c2bb6eb70f0f41e1933487322a4e0712a39e177213f3244173c3df"
I0312 00:25:15.815832 1188932 cri.go:89] found id: ""
I0312 00:25:15.815839 1188932 logs.go:276] 2 containers: [88c55a6c60bb439bcdf99b25641fcd058c1a45d0e83950575189d082ee25643b c8529a2810c2bb6eb70f0f41e1933487322a4e0712a39e177213f3244173c3df]
I0312 00:25:15.815896 1188932 ssh_runner.go:195] Run: which crictl
I0312 00:25:15.821347 1188932 ssh_runner.go:195] Run: which crictl
I0312 00:25:15.825458 1188932 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
I0312 00:25:15.825538 1188932 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0312 00:25:15.874737 1188932 cri.go:89] found id: "696c39e44fc846bdc283e21d2e90ef3b55024f28122476a01c185722052ac947"
I0312 00:25:15.874761 1188932 cri.go:89] found id: "98ff369cade299c3b79c03bdcf3fa19fb46b634e98833fe1a4dacb2e30baa2c8"
I0312 00:25:15.874765 1188932 cri.go:89] found id: ""
I0312 00:25:15.874773 1188932 logs.go:276] 2 containers: [696c39e44fc846bdc283e21d2e90ef3b55024f28122476a01c185722052ac947 98ff369cade299c3b79c03bdcf3fa19fb46b634e98833fe1a4dacb2e30baa2c8]
I0312 00:25:15.874828 1188932 ssh_runner.go:195] Run: which crictl
I0312 00:25:15.878670 1188932 ssh_runner.go:195] Run: which crictl
I0312 00:25:15.882276 1188932 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
I0312 00:25:15.882355 1188932 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0312 00:25:15.926561 1188932 cri.go:89] found id: "819dcb8ce3bf495d395f8bfd175489a574b14f4d7ec3abfc8d1da331f9f75175"
I0312 00:25:15.926581 1188932 cri.go:89] found id: "e37d0739e1cf5a034f8279d0f1c5a380bdf13f8df12805914af49b8d09457cc3"
I0312 00:25:15.926585 1188932 cri.go:89] found id: ""
I0312 00:25:15.926592 1188932 logs.go:276] 2 containers: [819dcb8ce3bf495d395f8bfd175489a574b14f4d7ec3abfc8d1da331f9f75175 e37d0739e1cf5a034f8279d0f1c5a380bdf13f8df12805914af49b8d09457cc3]
I0312 00:25:15.926649 1188932 ssh_runner.go:195] Run: which crictl
I0312 00:25:15.930718 1188932 ssh_runner.go:195] Run: which crictl
I0312 00:25:15.934373 1188932 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
I0312 00:25:15.934484 1188932 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0312 00:25:15.979063 1188932 cri.go:89] found id: "323bfd261df2aa6bdcaadc95d9b56bc2270a431303c0f1b4ecf16c54f87d6c7b"
I0312 00:25:15.979086 1188932 cri.go:89] found id: "9d99f44eeab838fb07f421ae4950e661e5f56229d69d698d8f9d2033522367ec"
I0312 00:25:15.979091 1188932 cri.go:89] found id: ""
I0312 00:25:15.979098 1188932 logs.go:276] 2 containers: [323bfd261df2aa6bdcaadc95d9b56bc2270a431303c0f1b4ecf16c54f87d6c7b 9d99f44eeab838fb07f421ae4950e661e5f56229d69d698d8f9d2033522367ec]
I0312 00:25:15.979156 1188932 ssh_runner.go:195] Run: which crictl
I0312 00:25:15.982802 1188932 ssh_runner.go:195] Run: which crictl
I0312 00:25:15.986260 1188932 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
I0312 00:25:15.986344 1188932 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I0312 00:25:16.034671 1188932 cri.go:89] found id: "37d755023a893e06a00cdc14d2dc52b4f5c42a585c7ee881d7d3e29d292b126d"
I0312 00:25:16.034695 1188932 cri.go:89] found id: ""
I0312 00:25:16.034704 1188932 logs.go:276] 1 containers: [37d755023a893e06a00cdc14d2dc52b4f5c42a585c7ee881d7d3e29d292b126d]
I0312 00:25:16.034765 1188932 ssh_runner.go:195] Run: which crictl
I0312 00:25:16.040676 1188932 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
I0312 00:25:16.040776 1188932 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0312 00:25:16.089561 1188932 cri.go:89] found id: "9368f694d66d01b464cc56ea1fd680f25acfb86767c32c49af31dc0da67bacb2"
I0312 00:25:16.089583 1188932 cri.go:89] found id: "dec1c27378bb4ef4460888bcfb40ca5dfccc459968492dd3e38b75ac421b0e8e"
I0312 00:25:16.089587 1188932 cri.go:89] found id: ""
I0312 00:25:16.089595 1188932 logs.go:276] 2 containers: [9368f694d66d01b464cc56ea1fd680f25acfb86767c32c49af31dc0da67bacb2 dec1c27378bb4ef4460888bcfb40ca5dfccc459968492dd3e38b75ac421b0e8e]
I0312 00:25:16.089660 1188932 ssh_runner.go:195] Run: which crictl
I0312 00:25:16.093570 1188932 ssh_runner.go:195] Run: which crictl
I0312 00:25:16.097242 1188932 logs.go:123] Gathering logs for kube-proxy [696c39e44fc846bdc283e21d2e90ef3b55024f28122476a01c185722052ac947] ...
I0312 00:25:16.097269 1188932 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 696c39e44fc846bdc283e21d2e90ef3b55024f28122476a01c185722052ac947"
I0312 00:25:16.137056 1188932 logs.go:123] Gathering logs for kube-controller-manager [819dcb8ce3bf495d395f8bfd175489a574b14f4d7ec3abfc8d1da331f9f75175] ...
I0312 00:25:16.137135 1188932 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 819dcb8ce3bf495d395f8bfd175489a574b14f4d7ec3abfc8d1da331f9f75175"
I0312 00:25:16.213494 1188932 logs.go:123] Gathering logs for container status ...
I0312 00:25:16.213574 1188932 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0312 00:25:16.292189 1188932 logs.go:123] Gathering logs for kube-apiserver [5bba79d28e804260c46d7e8af4c7322a6e22b8739a7b65e4f7be5d64306a2ec8] ...
I0312 00:25:16.292373 1188932 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 5bba79d28e804260c46d7e8af4c7322a6e22b8739a7b65e4f7be5d64306a2ec8"
I0312 00:25:16.366443 1188932 logs.go:123] Gathering logs for etcd [1433ae512c5cae729926e9a205666b562fb23efcf8bdc4b06b97fb200275abad] ...
I0312 00:25:16.366523 1188932 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 1433ae512c5cae729926e9a205666b562fb23efcf8bdc4b06b97fb200275abad"
I0312 00:25:16.424676 1188932 logs.go:123] Gathering logs for kube-scheduler [88c55a6c60bb439bcdf99b25641fcd058c1a45d0e83950575189d082ee25643b] ...
I0312 00:25:16.424709 1188932 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 88c55a6c60bb439bcdf99b25641fcd058c1a45d0e83950575189d082ee25643b"
I0312 00:25:16.471886 1188932 logs.go:123] Gathering logs for coredns [c2acdec1d054a8ac4872c3f65232c70b6c961ec0aba27f0912710c095efd38b6] ...
I0312 00:25:16.471918 1188932 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 c2acdec1d054a8ac4872c3f65232c70b6c961ec0aba27f0912710c095efd38b6"
I0312 00:25:16.516126 1188932 logs.go:123] Gathering logs for kube-scheduler [c8529a2810c2bb6eb70f0f41e1933487322a4e0712a39e177213f3244173c3df] ...
I0312 00:25:16.516159 1188932 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 c8529a2810c2bb6eb70f0f41e1933487322a4e0712a39e177213f3244173c3df"
I0312 00:25:16.565627 1188932 logs.go:123] Gathering logs for kube-controller-manager [e37d0739e1cf5a034f8279d0f1c5a380bdf13f8df12805914af49b8d09457cc3] ...
I0312 00:25:16.565660 1188932 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e37d0739e1cf5a034f8279d0f1c5a380bdf13f8df12805914af49b8d09457cc3"
I0312 00:25:16.642532 1188932 logs.go:123] Gathering logs for storage-provisioner [9368f694d66d01b464cc56ea1fd680f25acfb86767c32c49af31dc0da67bacb2] ...
I0312 00:25:16.642566 1188932 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 9368f694d66d01b464cc56ea1fd680f25acfb86767c32c49af31dc0da67bacb2"
I0312 00:25:16.690549 1188932 logs.go:123] Gathering logs for dmesg ...
I0312 00:25:16.690582 1188932 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0312 00:25:16.719869 1188932 logs.go:123] Gathering logs for describe nodes ...
I0312 00:25:16.719903 1188932 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0312 00:25:16.883756 1188932 logs.go:123] Gathering logs for etcd [4c03779c654a410263bf652c7f2d430f984d91760e30f9510e4952a4de615984] ...
I0312 00:25:16.883795 1188932 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 4c03779c654a410263bf652c7f2d430f984d91760e30f9510e4952a4de615984"
I0312 00:25:16.940774 1188932 logs.go:123] Gathering logs for storage-provisioner [dec1c27378bb4ef4460888bcfb40ca5dfccc459968492dd3e38b75ac421b0e8e] ...
I0312 00:25:16.940806 1188932 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 dec1c27378bb4ef4460888bcfb40ca5dfccc459968492dd3e38b75ac421b0e8e"
I0312 00:25:16.982622 1188932 logs.go:123] Gathering logs for kube-apiserver [4e2109d4bafae2dd679c7ef05f522399401b1a72fb57a580332be0348557938e] ...
I0312 00:25:16.982652 1188932 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 4e2109d4bafae2dd679c7ef05f522399401b1a72fb57a580332be0348557938e"
I0312 00:25:17.065545 1188932 logs.go:123] Gathering logs for kube-proxy [98ff369cade299c3b79c03bdcf3fa19fb46b634e98833fe1a4dacb2e30baa2c8] ...
I0312 00:25:17.065578 1188932 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 98ff369cade299c3b79c03bdcf3fa19fb46b634e98833fe1a4dacb2e30baa2c8"
I0312 00:25:17.115498 1188932 logs.go:123] Gathering logs for kindnet [323bfd261df2aa6bdcaadc95d9b56bc2270a431303c0f1b4ecf16c54f87d6c7b] ...
I0312 00:25:17.115530 1188932 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 323bfd261df2aa6bdcaadc95d9b56bc2270a431303c0f1b4ecf16c54f87d6c7b"
I0312 00:25:17.157056 1188932 logs.go:123] Gathering logs for kubernetes-dashboard [37d755023a893e06a00cdc14d2dc52b4f5c42a585c7ee881d7d3e29d292b126d] ...
I0312 00:25:17.157094 1188932 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 37d755023a893e06a00cdc14d2dc52b4f5c42a585c7ee881d7d3e29d292b126d"
I0312 00:25:17.201427 1188932 logs.go:123] Gathering logs for containerd ...
I0312 00:25:17.201455 1188932 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
I0312 00:25:17.262909 1188932 logs.go:123] Gathering logs for kubelet ...
I0312 00:25:17.262944 1188932 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0312 00:25:17.310234 1188932 logs.go:138] Found kubelet problem: Mar 12 00:21:16 no-preload-820117 kubelet[656]: W0312 00:21:16.198194 656 reflector.go:539] object-"kubernetes-dashboard"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:no-preload-820117" cannot list resource "configmaps" in API group "" in the namespace "kubernetes-dashboard": no relationship found between node 'no-preload-820117' and this object
W0312 00:25:17.310492 1188932 logs.go:138] Found kubelet problem: Mar 12 00:21:16 no-preload-820117 kubelet[656]: E0312 00:21:16.198236 656 reflector.go:147] object-"kubernetes-dashboard"/"kube-root-ca.crt": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:no-preload-820117" cannot list resource "configmaps" in API group "" in the namespace "kubernetes-dashboard": no relationship found between node 'no-preload-820117' and this object
I0312 00:25:17.338504 1188932 logs.go:123] Gathering logs for coredns [84b4bce6633a2747538b2b0094a5cdbd7dbdcc49272243631213feef4909f91d] ...
I0312 00:25:17.338537 1188932 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 84b4bce6633a2747538b2b0094a5cdbd7dbdcc49272243631213feef4909f91d"
I0312 00:25:17.381814 1188932 logs.go:123] Gathering logs for kindnet [9d99f44eeab838fb07f421ae4950e661e5f56229d69d698d8f9d2033522367ec] ...
I0312 00:25:17.381895 1188932 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 9d99f44eeab838fb07f421ae4950e661e5f56229d69d698d8f9d2033522367ec"
I0312 00:25:17.422599 1188932 out.go:304] Setting ErrFile to fd 2...
I0312 00:25:17.422628 1188932 out.go:338] TERM=,COLORTERM=, which probably does not support color
W0312 00:25:17.422702 1188932 out.go:239] X Problems detected in kubelet:
W0312 00:25:17.422718 1188932 out.go:239] Mar 12 00:21:16 no-preload-820117 kubelet[656]: W0312 00:21:16.198194 656 reflector.go:539] object-"kubernetes-dashboard"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:no-preload-820117" cannot list resource "configmaps" in API group "" in the namespace "kubernetes-dashboard": no relationship found between node 'no-preload-820117' and this object
W0312 00:25:17.422728 1188932 out.go:239] Mar 12 00:21:16 no-preload-820117 kubelet[656]: E0312 00:21:16.198236 656 reflector.go:147] object-"kubernetes-dashboard"/"kube-root-ca.crt": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:no-preload-820117" cannot list resource "configmaps" in API group "" in the namespace "kubernetes-dashboard": no relationship found between node 'no-preload-820117' and this object
I0312 00:25:17.422919 1188932 out.go:304] Setting ErrFile to fd 2...
I0312 00:25:17.422927 1188932 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0312 00:25:19.749835 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:25:21.749927 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:25:23.750869 1183642 pod_ready.go:102] pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace has status "Ready":"False"
I0312 00:25:25.249870 1183642 pod_ready.go:81] duration metric: took 4m0.006519105s for pod "metrics-server-9975d5f86-c87xf" in "kube-system" namespace to be "Ready" ...
E0312 00:25:25.249898 1183642 pod_ready.go:66] WaitExtra: waitPodCondition: context deadline exceeded
I0312 00:25:25.249907 1183642 pod_ready.go:38] duration metric: took 5m28.619543264s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0312 00:25:25.256852 1183642 api_server.go:52] waiting for apiserver process to appear ...
I0312 00:25:25.256936 1183642 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
I0312 00:25:25.257019 1183642 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0312 00:25:25.300453 1183642 cri.go:89] found id: "e90658574cccc9b56ea1fd38865b78eb14b34d54f7b6d6f655f8b82d026ee372"
I0312 00:25:25.300515 1183642 cri.go:89] found id: "022154a50546e744b25648ac078a4535c3a97e91f97547e8008e89235fd126f5"
I0312 00:25:25.300533 1183642 cri.go:89] found id: ""
I0312 00:25:25.300551 1183642 logs.go:276] 2 containers: [e90658574cccc9b56ea1fd38865b78eb14b34d54f7b6d6f655f8b82d026ee372 022154a50546e744b25648ac078a4535c3a97e91f97547e8008e89235fd126f5]
I0312 00:25:25.300638 1183642 ssh_runner.go:195] Run: which crictl
I0312 00:25:25.304205 1183642 ssh_runner.go:195] Run: which crictl
I0312 00:25:25.307725 1183642 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
I0312 00:25:25.307813 1183642 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0312 00:25:25.344547 1183642 cri.go:89] found id: "227b5f4c3ec0b541f1e734b3a9400260044363214781e1a18f0928e954c98086"
I0312 00:25:25.344570 1183642 cri.go:89] found id: "00fea42a626bc543839c933d2b36dd4155e2329531f2c8a74fa65079753377a9"
I0312 00:25:25.344576 1183642 cri.go:89] found id: ""
I0312 00:25:25.344583 1183642 logs.go:276] 2 containers: [227b5f4c3ec0b541f1e734b3a9400260044363214781e1a18f0928e954c98086 00fea42a626bc543839c933d2b36dd4155e2329531f2c8a74fa65079753377a9]
I0312 00:25:25.344658 1183642 ssh_runner.go:195] Run: which crictl
I0312 00:25:25.348234 1183642 ssh_runner.go:195] Run: which crictl
I0312 00:25:25.351686 1183642 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
I0312 00:25:25.351805 1183642 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0312 00:25:25.393110 1183642 cri.go:89] found id: "0d3039260ff7a1d3154eac6a37f5460535e860a77d3473b023822022e245e097"
I0312 00:25:25.393134 1183642 cri.go:89] found id: "91ba0f1087505b74193c749143407b360ca52adeb6c8e6fed4c64111ff7ac963"
I0312 00:25:25.393139 1183642 cri.go:89] found id: ""
I0312 00:25:25.393146 1183642 logs.go:276] 2 containers: [0d3039260ff7a1d3154eac6a37f5460535e860a77d3473b023822022e245e097 91ba0f1087505b74193c749143407b360ca52adeb6c8e6fed4c64111ff7ac963]
I0312 00:25:25.393203 1183642 ssh_runner.go:195] Run: which crictl
I0312 00:25:25.396999 1183642 ssh_runner.go:195] Run: which crictl
I0312 00:25:25.400568 1183642 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
I0312 00:25:25.400686 1183642 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0312 00:25:25.439058 1183642 cri.go:89] found id: "cda4f1be508f3de4744e406ac4acfcb87143068155c189f0e7506f78db3a42c9"
I0312 00:25:25.439084 1183642 cri.go:89] found id: "c3f64500c09efd7fdf78260f3bef5ed1adaefa3e3a847a7540726cbee6bd042f"
I0312 00:25:25.439089 1183642 cri.go:89] found id: ""
I0312 00:25:25.439096 1183642 logs.go:276] 2 containers: [cda4f1be508f3de4744e406ac4acfcb87143068155c189f0e7506f78db3a42c9 c3f64500c09efd7fdf78260f3bef5ed1adaefa3e3a847a7540726cbee6bd042f]
I0312 00:25:25.439197 1183642 ssh_runner.go:195] Run: which crictl
I0312 00:25:25.443086 1183642 ssh_runner.go:195] Run: which crictl
I0312 00:25:25.446900 1183642 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
I0312 00:25:25.446974 1183642 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0312 00:25:25.488093 1183642 cri.go:89] found id: "46d69c632200b08b2b8f94cd051969df887d9d074acace5d606fef37cc84295e"
I0312 00:25:25.488164 1183642 cri.go:89] found id: "8abc9a2fec8f5340e92089f46c5ff2bf798571fbcb6c7ce9545d0e353715bed4"
I0312 00:25:25.488181 1183642 cri.go:89] found id: ""
I0312 00:25:25.488196 1183642 logs.go:276] 2 containers: [46d69c632200b08b2b8f94cd051969df887d9d074acace5d606fef37cc84295e 8abc9a2fec8f5340e92089f46c5ff2bf798571fbcb6c7ce9545d0e353715bed4]
I0312 00:25:25.488286 1183642 ssh_runner.go:195] Run: which crictl
I0312 00:25:25.492007 1183642 ssh_runner.go:195] Run: which crictl
I0312 00:25:25.495477 1183642 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
I0312 00:25:25.495557 1183642 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0312 00:25:25.536694 1183642 cri.go:89] found id: "ea472223f1505d76ec6e5c18af4f3ab7760ebdefed097a213c78a396e15d7ba7"
I0312 00:25:25.536759 1183642 cri.go:89] found id: "ac83611721f7a3d26415ed5ae3625edece62f8bd00bc9a63ce61ffa2ad2c9fbc"
I0312 00:25:25.536771 1183642 cri.go:89] found id: ""
I0312 00:25:25.536779 1183642 logs.go:276] 2 containers: [ea472223f1505d76ec6e5c18af4f3ab7760ebdefed097a213c78a396e15d7ba7 ac83611721f7a3d26415ed5ae3625edece62f8bd00bc9a63ce61ffa2ad2c9fbc]
I0312 00:25:25.536850 1183642 ssh_runner.go:195] Run: which crictl
I0312 00:25:25.540733 1183642 ssh_runner.go:195] Run: which crictl
I0312 00:25:25.544497 1183642 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
I0312 00:25:25.544627 1183642 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0312 00:25:25.581655 1183642 cri.go:89] found id: "ae84159c4657eff5eabe4d3d9526af6b40457144653c8a1c7e1b3bc077bdcad0"
I0312 00:25:25.581679 1183642 cri.go:89] found id: "1a5414516a6e0b5fd6faf9a04f4428d130258262f60692b0dffc8b7ffc8541a6"
I0312 00:25:25.581684 1183642 cri.go:89] found id: ""
I0312 00:25:25.581705 1183642 logs.go:276] 2 containers: [ae84159c4657eff5eabe4d3d9526af6b40457144653c8a1c7e1b3bc077bdcad0 1a5414516a6e0b5fd6faf9a04f4428d130258262f60692b0dffc8b7ffc8541a6]
I0312 00:25:25.581770 1183642 ssh_runner.go:195] Run: which crictl
I0312 00:25:25.585569 1183642 ssh_runner.go:195] Run: which crictl
I0312 00:25:25.589471 1183642 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
I0312 00:25:25.589550 1183642 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0312 00:25:25.630552 1183642 cri.go:89] found id: "98a1386a1a083a30c283c882c4ad3a528364088aba6315aa3bd42ba324436879"
I0312 00:25:25.630576 1183642 cri.go:89] found id: "0c3514f843ab806b20582bed37c5a7606b322a3eae956ca0d2a4c8b59c7beb86"
I0312 00:25:25.630581 1183642 cri.go:89] found id: ""
I0312 00:25:25.630589 1183642 logs.go:276] 2 containers: [98a1386a1a083a30c283c882c4ad3a528364088aba6315aa3bd42ba324436879 0c3514f843ab806b20582bed37c5a7606b322a3eae956ca0d2a4c8b59c7beb86]
I0312 00:25:25.630648 1183642 ssh_runner.go:195] Run: which crictl
I0312 00:25:25.634419 1183642 ssh_runner.go:195] Run: which crictl
I0312 00:25:25.637992 1183642 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
I0312 00:25:25.638081 1183642 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I0312 00:25:25.684057 1183642 cri.go:89] found id: "cb775d92b00e5c14170849b1b42ccfd48f3c9d18c9b5da2f8234588eaf4aa2ec"
I0312 00:25:25.684120 1183642 cri.go:89] found id: ""
I0312 00:25:25.684132 1183642 logs.go:276] 1 containers: [cb775d92b00e5c14170849b1b42ccfd48f3c9d18c9b5da2f8234588eaf4aa2ec]
I0312 00:25:25.684207 1183642 ssh_runner.go:195] Run: which crictl
I0312 00:25:25.688044 1183642 logs.go:123] Gathering logs for kube-apiserver [e90658574cccc9b56ea1fd38865b78eb14b34d54f7b6d6f655f8b82d026ee372] ...
I0312 00:25:25.688071 1183642 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e90658574cccc9b56ea1fd38865b78eb14b34d54f7b6d6f655f8b82d026ee372"
I0312 00:25:25.746459 1183642 logs.go:123] Gathering logs for kube-apiserver [022154a50546e744b25648ac078a4535c3a97e91f97547e8008e89235fd126f5] ...
I0312 00:25:25.746492 1183642 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 022154a50546e744b25648ac078a4535c3a97e91f97547e8008e89235fd126f5"
I0312 00:25:25.807669 1183642 logs.go:123] Gathering logs for coredns [0d3039260ff7a1d3154eac6a37f5460535e860a77d3473b023822022e245e097] ...
I0312 00:25:25.807705 1183642 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 0d3039260ff7a1d3154eac6a37f5460535e860a77d3473b023822022e245e097"
I0312 00:25:25.858063 1183642 logs.go:123] Gathering logs for kube-scheduler [cda4f1be508f3de4744e406ac4acfcb87143068155c189f0e7506f78db3a42c9] ...
I0312 00:25:25.858091 1183642 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 cda4f1be508f3de4744e406ac4acfcb87143068155c189f0e7506f78db3a42c9"
I0312 00:25:25.900479 1183642 logs.go:123] Gathering logs for kube-proxy [8abc9a2fec8f5340e92089f46c5ff2bf798571fbcb6c7ce9545d0e353715bed4] ...
I0312 00:25:25.900511 1183642 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 8abc9a2fec8f5340e92089f46c5ff2bf798571fbcb6c7ce9545d0e353715bed4"
I0312 00:25:25.946460 1183642 logs.go:123] Gathering logs for kindnet [1a5414516a6e0b5fd6faf9a04f4428d130258262f60692b0dffc8b7ffc8541a6] ...
I0312 00:25:25.946491 1183642 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 1a5414516a6e0b5fd6faf9a04f4428d130258262f60692b0dffc8b7ffc8541a6"
I0312 00:25:25.992941 1183642 logs.go:123] Gathering logs for kubernetes-dashboard [cb775d92b00e5c14170849b1b42ccfd48f3c9d18c9b5da2f8234588eaf4aa2ec] ...
I0312 00:25:25.992975 1183642 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 cb775d92b00e5c14170849b1b42ccfd48f3c9d18c9b5da2f8234588eaf4aa2ec"
I0312 00:25:26.047245 1183642 logs.go:123] Gathering logs for describe nodes ...
I0312 00:25:26.047275 1183642 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0312 00:25:26.245179 1183642 logs.go:123] Gathering logs for coredns [91ba0f1087505b74193c749143407b360ca52adeb6c8e6fed4c64111ff7ac963] ...
I0312 00:25:26.245208 1183642 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 91ba0f1087505b74193c749143407b360ca52adeb6c8e6fed4c64111ff7ac963"
I0312 00:25:26.286685 1183642 logs.go:123] Gathering logs for kube-proxy [46d69c632200b08b2b8f94cd051969df887d9d074acace5d606fef37cc84295e] ...
I0312 00:25:26.286717 1183642 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 46d69c632200b08b2b8f94cd051969df887d9d074acace5d606fef37cc84295e"
I0312 00:25:26.326586 1183642 logs.go:123] Gathering logs for kindnet [ae84159c4657eff5eabe4d3d9526af6b40457144653c8a1c7e1b3bc077bdcad0] ...
I0312 00:25:26.326619 1183642 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 ae84159c4657eff5eabe4d3d9526af6b40457144653c8a1c7e1b3bc077bdcad0"
I0312 00:25:26.371019 1183642 logs.go:123] Gathering logs for storage-provisioner [0c3514f843ab806b20582bed37c5a7606b322a3eae956ca0d2a4c8b59c7beb86] ...
I0312 00:25:26.371048 1183642 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 0c3514f843ab806b20582bed37c5a7606b322a3eae956ca0d2a4c8b59c7beb86"
I0312 00:25:26.437329 1183642 logs.go:123] Gathering logs for etcd [227b5f4c3ec0b541f1e734b3a9400260044363214781e1a18f0928e954c98086] ...
I0312 00:25:26.437363 1183642 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 227b5f4c3ec0b541f1e734b3a9400260044363214781e1a18f0928e954c98086"
I0312 00:25:26.491828 1183642 logs.go:123] Gathering logs for kube-scheduler [c3f64500c09efd7fdf78260f3bef5ed1adaefa3e3a847a7540726cbee6bd042f] ...
I0312 00:25:26.491858 1183642 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 c3f64500c09efd7fdf78260f3bef5ed1adaefa3e3a847a7540726cbee6bd042f"
I0312 00:25:26.534467 1183642 logs.go:123] Gathering logs for storage-provisioner [98a1386a1a083a30c283c882c4ad3a528364088aba6315aa3bd42ba324436879] ...
I0312 00:25:26.534502 1183642 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 98a1386a1a083a30c283c882c4ad3a528364088aba6315aa3bd42ba324436879"
I0312 00:25:26.573116 1183642 logs.go:123] Gathering logs for containerd ...
I0312 00:25:26.573190 1183642 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
I0312 00:25:26.637555 1183642 logs.go:123] Gathering logs for container status ...
I0312 00:25:26.637593 1183642 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0312 00:25:26.690245 1183642 logs.go:123] Gathering logs for kubelet ...
I0312 00:25:26.690283 1183642 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0312 00:25:26.757014 1183642 logs.go:138] Found kubelet problem: Mar 12 00:19:58 old-k8s-version-571339 kubelet[663]: E0312 00:19:58.352250 663 pod_workers.go:191] Error syncing pod f8f3ac0e-3c2e-451d-8e5a-d3937eab4142 ("metrics-server-9975d5f86-c87xf_kube-system(f8f3ac0e-3c2e-451d-8e5a-d3937eab4142)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0312 00:25:26.757217 1183642 logs.go:138] Found kubelet problem: Mar 12 00:19:58 old-k8s-version-571339 kubelet[663]: E0312 00:19:58.560744 663 pod_workers.go:191] Error syncing pod f8f3ac0e-3c2e-451d-8e5a-d3937eab4142 ("metrics-server-9975d5f86-c87xf_kube-system(f8f3ac0e-3c2e-451d-8e5a-d3937eab4142)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0312 00:25:26.760035 1183642 logs.go:138] Found kubelet problem: Mar 12 00:20:13 old-k8s-version-571339 kubelet[663]: E0312 00:20:13.145527 663 pod_workers.go:191] Error syncing pod f8f3ac0e-3c2e-451d-8e5a-d3937eab4142 ("metrics-server-9975d5f86-c87xf_kube-system(f8f3ac0e-3c2e-451d-8e5a-d3937eab4142)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0312 00:25:26.760786 1183642 logs.go:138] Found kubelet problem: Mar 12 00:20:15 old-k8s-version-571339 kubelet[663]: E0312 00:20:15.137936 663 reflector.go:138] object-"kubernetes-dashboard"/"kubernetes-dashboard-token-5nnmb": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kubernetes-dashboard-token-5nnmb" is forbidden: User "system:node:old-k8s-version-571339" cannot list resource "secrets" in API group "" in the namespace "kubernetes-dashboard": no relationship found between node 'old-k8s-version-571339' and this object
W0312 00:25:26.764232 1183642 logs.go:138] Found kubelet problem: Mar 12 00:20:27 old-k8s-version-571339 kubelet[663]: E0312 00:20:27.691697 663 pod_workers.go:191] Error syncing pod 917984d8-3e49-416e-bb76-594879112f42 ("dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"
W0312 00:25:26.764435 1183642 logs.go:138] Found kubelet problem: Mar 12 00:20:28 old-k8s-version-571339 kubelet[663]: E0312 00:20:28.142650 663 pod_workers.go:191] Error syncing pod f8f3ac0e-3c2e-451d-8e5a-d3937eab4142 ("metrics-server-9975d5f86-c87xf_kube-system(f8f3ac0e-3c2e-451d-8e5a-d3937eab4142)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0312 00:25:26.764781 1183642 logs.go:138] Found kubelet problem: Mar 12 00:20:28 old-k8s-version-571339 kubelet[663]: E0312 00:20:28.687196 663 pod_workers.go:191] Error syncing pod 917984d8-3e49-416e-bb76-594879112f42 ("dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"
W0312 00:25:26.765236 1183642 logs.go:138] Found kubelet problem: Mar 12 00:20:29 old-k8s-version-571339 kubelet[663]: E0312 00:20:29.694628 663 pod_workers.go:191] Error syncing pod c73ffc75-b4a0-4184-80c3-a73e21cc954e ("storage-provisioner_kube-system(c73ffc75-b4a0-4184-80c3-a73e21cc954e)"), skipping: failed to "StartContainer" for "storage-provisioner" with CrashLoopBackOff: "back-off 10s restarting failed container=storage-provisioner pod=storage-provisioner_kube-system(c73ffc75-b4a0-4184-80c3-a73e21cc954e)"
W0312 00:25:26.765570 1183642 logs.go:138] Found kubelet problem: Mar 12 00:20:30 old-k8s-version-571339 kubelet[663]: E0312 00:20:30.101093 663 pod_workers.go:191] Error syncing pod 917984d8-3e49-416e-bb76-594879112f42 ("dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"
W0312 00:25:26.766572 1183642 logs.go:138] Found kubelet problem: Mar 12 00:20:42 old-k8s-version-571339 kubelet[663]: E0312 00:20:42.735991 663 pod_workers.go:191] Error syncing pod 917984d8-3e49-416e-bb76-594879112f42 ("dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"
W0312 00:25:26.769242 1183642 logs.go:138] Found kubelet problem: Mar 12 00:20:43 old-k8s-version-571339 kubelet[663]: E0312 00:20:43.152194 663 pod_workers.go:191] Error syncing pod f8f3ac0e-3c2e-451d-8e5a-d3937eab4142 ("metrics-server-9975d5f86-c87xf_kube-system(f8f3ac0e-3c2e-451d-8e5a-d3937eab4142)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0312 00:25:26.769586 1183642 logs.go:138] Found kubelet problem: Mar 12 00:20:50 old-k8s-version-571339 kubelet[663]: E0312 00:20:50.100788 663 pod_workers.go:191] Error syncing pod 917984d8-3e49-416e-bb76-594879112f42 ("dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"
W0312 00:25:26.769781 1183642 logs.go:138] Found kubelet problem: Mar 12 00:20:54 old-k8s-version-571339 kubelet[663]: E0312 00:20:54.136340 663 pod_workers.go:191] Error syncing pod f8f3ac0e-3c2e-451d-8e5a-d3937eab4142 ("metrics-server-9975d5f86-c87xf_kube-system(f8f3ac0e-3c2e-451d-8e5a-d3937eab4142)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0312 00:25:26.770396 1183642 logs.go:138] Found kubelet problem: Mar 12 00:21:03 old-k8s-version-571339 kubelet[663]: E0312 00:21:03.794154 663 pod_workers.go:191] Error syncing pod 917984d8-3e49-416e-bb76-594879112f42 ("dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"
W0312 00:25:26.770580 1183642 logs.go:138] Found kubelet problem: Mar 12 00:21:07 old-k8s-version-571339 kubelet[663]: E0312 00:21:07.135168 663 pod_workers.go:191] Error syncing pod f8f3ac0e-3c2e-451d-8e5a-d3937eab4142 ("metrics-server-9975d5f86-c87xf_kube-system(f8f3ac0e-3c2e-451d-8e5a-d3937eab4142)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0312 00:25:26.770905 1183642 logs.go:138] Found kubelet problem: Mar 12 00:21:10 old-k8s-version-571339 kubelet[663]: E0312 00:21:10.101222 663 pod_workers.go:191] Error syncing pod 917984d8-3e49-416e-bb76-594879112f42 ("dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"
W0312 00:25:26.771102 1183642 logs.go:138] Found kubelet problem: Mar 12 00:21:22 old-k8s-version-571339 kubelet[663]: E0312 00:21:22.136421 663 pod_workers.go:191] Error syncing pod f8f3ac0e-3c2e-451d-8e5a-d3937eab4142 ("metrics-server-9975d5f86-c87xf_kube-system(f8f3ac0e-3c2e-451d-8e5a-d3937eab4142)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0312 00:25:26.771444 1183642 logs.go:138] Found kubelet problem: Mar 12 00:21:25 old-k8s-version-571339 kubelet[663]: E0312 00:21:25.135960 663 pod_workers.go:191] Error syncing pod 917984d8-3e49-416e-bb76-594879112f42 ("dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"
W0312 00:25:26.773913 1183642 logs.go:138] Found kubelet problem: Mar 12 00:21:33 old-k8s-version-571339 kubelet[663]: E0312 00:21:33.143768 663 pod_workers.go:191] Error syncing pod f8f3ac0e-3c2e-451d-8e5a-d3937eab4142 ("metrics-server-9975d5f86-c87xf_kube-system(f8f3ac0e-3c2e-451d-8e5a-d3937eab4142)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0312 00:25:26.774266 1183642 logs.go:138] Found kubelet problem: Mar 12 00:21:40 old-k8s-version-571339 kubelet[663]: E0312 00:21:40.134926 663 pod_workers.go:191] Error syncing pod 917984d8-3e49-416e-bb76-594879112f42 ("dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"
W0312 00:25:26.774456 1183642 logs.go:138] Found kubelet problem: Mar 12 00:21:45 old-k8s-version-571339 kubelet[663]: E0312 00:21:45.143152 663 pod_workers.go:191] Error syncing pod f8f3ac0e-3c2e-451d-8e5a-d3937eab4142 ("metrics-server-9975d5f86-c87xf_kube-system(f8f3ac0e-3c2e-451d-8e5a-d3937eab4142)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0312 00:25:26.775048 1183642 logs.go:138] Found kubelet problem: Mar 12 00:21:51 old-k8s-version-571339 kubelet[663]: E0312 00:21:51.956550 663 pod_workers.go:191] Error syncing pod 917984d8-3e49-416e-bb76-594879112f42 ("dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"
W0312 00:25:26.775388 1183642 logs.go:138] Found kubelet problem: Mar 12 00:22:00 old-k8s-version-571339 kubelet[663]: E0312 00:22:00.104419 663 pod_workers.go:191] Error syncing pod 917984d8-3e49-416e-bb76-594879112f42 ("dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"
W0312 00:25:26.775575 1183642 logs.go:138] Found kubelet problem: Mar 12 00:22:00 old-k8s-version-571339 kubelet[663]: E0312 00:22:00.145154 663 pod_workers.go:191] Error syncing pod f8f3ac0e-3c2e-451d-8e5a-d3937eab4142 ("metrics-server-9975d5f86-c87xf_kube-system(f8f3ac0e-3c2e-451d-8e5a-d3937eab4142)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0312 00:25:26.775901 1183642 logs.go:138] Found kubelet problem: Mar 12 00:22:15 old-k8s-version-571339 kubelet[663]: E0312 00:22:15.136079 663 pod_workers.go:191] Error syncing pod 917984d8-3e49-416e-bb76-594879112f42 ("dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"
W0312 00:25:26.776087 1183642 logs.go:138] Found kubelet problem: Mar 12 00:22:15 old-k8s-version-571339 kubelet[663]: E0312 00:22:15.136820 663 pod_workers.go:191] Error syncing pod f8f3ac0e-3c2e-451d-8e5a-d3937eab4142 ("metrics-server-9975d5f86-c87xf_kube-system(f8f3ac0e-3c2e-451d-8e5a-d3937eab4142)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0312 00:25:26.776271 1183642 logs.go:138] Found kubelet problem: Mar 12 00:22:28 old-k8s-version-571339 kubelet[663]: E0312 00:22:28.135086 663 pod_workers.go:191] Error syncing pod f8f3ac0e-3c2e-451d-8e5a-d3937eab4142 ("metrics-server-9975d5f86-c87xf_kube-system(f8f3ac0e-3c2e-451d-8e5a-d3937eab4142)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0312 00:25:26.776603 1183642 logs.go:138] Found kubelet problem: Mar 12 00:22:30 old-k8s-version-571339 kubelet[663]: E0312 00:22:30.140098 663 pod_workers.go:191] Error syncing pod 917984d8-3e49-416e-bb76-594879112f42 ("dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"
W0312 00:25:26.776928 1183642 logs.go:138] Found kubelet problem: Mar 12 00:22:42 old-k8s-version-571339 kubelet[663]: E0312 00:22:42.135063 663 pod_workers.go:191] Error syncing pod 917984d8-3e49-416e-bb76-594879112f42 ("dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"
W0312 00:25:26.777116 1183642 logs.go:138] Found kubelet problem: Mar 12 00:22:43 old-k8s-version-571339 kubelet[663]: E0312 00:22:43.135158 663 pod_workers.go:191] Error syncing pod f8f3ac0e-3c2e-451d-8e5a-d3937eab4142 ("metrics-server-9975d5f86-c87xf_kube-system(f8f3ac0e-3c2e-451d-8e5a-d3937eab4142)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0312 00:25:26.779571 1183642 logs.go:138] Found kubelet problem: Mar 12 00:22:54 old-k8s-version-571339 kubelet[663]: E0312 00:22:54.143460 663 pod_workers.go:191] Error syncing pod f8f3ac0e-3c2e-451d-8e5a-d3937eab4142 ("metrics-server-9975d5f86-c87xf_kube-system(f8f3ac0e-3c2e-451d-8e5a-d3937eab4142)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0312 00:25:26.779896 1183642 logs.go:138] Found kubelet problem: Mar 12 00:22:56 old-k8s-version-571339 kubelet[663]: E0312 00:22:56.134757 663 pod_workers.go:191] Error syncing pod 917984d8-3e49-416e-bb76-594879112f42 ("dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"
W0312 00:25:26.780081 1183642 logs.go:138] Found kubelet problem: Mar 12 00:23:06 old-k8s-version-571339 kubelet[663]: E0312 00:23:06.135565 663 pod_workers.go:191] Error syncing pod f8f3ac0e-3c2e-451d-8e5a-d3937eab4142 ("metrics-server-9975d5f86-c87xf_kube-system(f8f3ac0e-3c2e-451d-8e5a-d3937eab4142)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0312 00:25:26.780408 1183642 logs.go:138] Found kubelet problem: Mar 12 00:23:07 old-k8s-version-571339 kubelet[663]: E0312 00:23:07.134751 663 pod_workers.go:191] Error syncing pod 917984d8-3e49-416e-bb76-594879112f42 ("dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"
W0312 00:25:26.780994 1183642 logs.go:138] Found kubelet problem: Mar 12 00:23:19 old-k8s-version-571339 kubelet[663]: E0312 00:23:19.156710 663 pod_workers.go:191] Error syncing pod 917984d8-3e49-416e-bb76-594879112f42 ("dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"
W0312 00:25:26.781319 1183642 logs.go:138] Found kubelet problem: Mar 12 00:23:20 old-k8s-version-571339 kubelet[663]: E0312 00:23:20.160925 663 pod_workers.go:191] Error syncing pod 917984d8-3e49-416e-bb76-594879112f42 ("dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"
W0312 00:25:26.781505 1183642 logs.go:138] Found kubelet problem: Mar 12 00:23:21 old-k8s-version-571339 kubelet[663]: E0312 00:23:21.135408 663 pod_workers.go:191] Error syncing pod f8f3ac0e-3c2e-451d-8e5a-d3937eab4142 ("metrics-server-9975d5f86-c87xf_kube-system(f8f3ac0e-3c2e-451d-8e5a-d3937eab4142)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0312 00:25:26.781832 1183642 logs.go:138] Found kubelet problem: Mar 12 00:23:32 old-k8s-version-571339 kubelet[663]: E0312 00:23:32.135536 663 pod_workers.go:191] Error syncing pod 917984d8-3e49-416e-bb76-594879112f42 ("dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"
W0312 00:25:26.782019 1183642 logs.go:138] Found kubelet problem: Mar 12 00:23:35 old-k8s-version-571339 kubelet[663]: E0312 00:23:35.135123 663 pod_workers.go:191] Error syncing pod f8f3ac0e-3c2e-451d-8e5a-d3937eab4142 ("metrics-server-9975d5f86-c87xf_kube-system(f8f3ac0e-3c2e-451d-8e5a-d3937eab4142)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0312 00:25:26.782353 1183642 logs.go:138] Found kubelet problem: Mar 12 00:23:45 old-k8s-version-571339 kubelet[663]: E0312 00:23:45.134915 663 pod_workers.go:191] Error syncing pod 917984d8-3e49-416e-bb76-594879112f42 ("dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"
W0312 00:25:26.782536 1183642 logs.go:138] Found kubelet problem: Mar 12 00:23:47 old-k8s-version-571339 kubelet[663]: E0312 00:23:47.135061 663 pod_workers.go:191] Error syncing pod f8f3ac0e-3c2e-451d-8e5a-d3937eab4142 ("metrics-server-9975d5f86-c87xf_kube-system(f8f3ac0e-3c2e-451d-8e5a-d3937eab4142)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0312 00:25:26.782860 1183642 logs.go:138] Found kubelet problem: Mar 12 00:23:59 old-k8s-version-571339 kubelet[663]: E0312 00:23:59.134729 663 pod_workers.go:191] Error syncing pod 917984d8-3e49-416e-bb76-594879112f42 ("dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"
W0312 00:25:26.783047 1183642 logs.go:138] Found kubelet problem: Mar 12 00:24:02 old-k8s-version-571339 kubelet[663]: E0312 00:24:02.135523 663 pod_workers.go:191] Error syncing pod f8f3ac0e-3c2e-451d-8e5a-d3937eab4142 ("metrics-server-9975d5f86-c87xf_kube-system(f8f3ac0e-3c2e-451d-8e5a-d3937eab4142)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0312 00:25:26.783378 1183642 logs.go:138] Found kubelet problem: Mar 12 00:24:11 old-k8s-version-571339 kubelet[663]: E0312 00:24:11.134786 663 pod_workers.go:191] Error syncing pod 917984d8-3e49-416e-bb76-594879112f42 ("dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"
W0312 00:25:26.783568 1183642 logs.go:138] Found kubelet problem: Mar 12 00:24:16 old-k8s-version-571339 kubelet[663]: E0312 00:24:16.135140 663 pod_workers.go:191] Error syncing pod f8f3ac0e-3c2e-451d-8e5a-d3937eab4142 ("metrics-server-9975d5f86-c87xf_kube-system(f8f3ac0e-3c2e-451d-8e5a-d3937eab4142)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0312 00:25:26.783898 1183642 logs.go:138] Found kubelet problem: Mar 12 00:24:22 old-k8s-version-571339 kubelet[663]: E0312 00:24:22.135430 663 pod_workers.go:191] Error syncing pod 917984d8-3e49-416e-bb76-594879112f42 ("dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"
W0312 00:25:26.784081 1183642 logs.go:138] Found kubelet problem: Mar 12 00:24:31 old-k8s-version-571339 kubelet[663]: E0312 00:24:31.135197 663 pod_workers.go:191] Error syncing pod f8f3ac0e-3c2e-451d-8e5a-d3937eab4142 ("metrics-server-9975d5f86-c87xf_kube-system(f8f3ac0e-3c2e-451d-8e5a-d3937eab4142)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0312 00:25:26.784405 1183642 logs.go:138] Found kubelet problem: Mar 12 00:24:35 old-k8s-version-571339 kubelet[663]: E0312 00:24:35.134852 663 pod_workers.go:191] Error syncing pod 917984d8-3e49-416e-bb76-594879112f42 ("dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"
W0312 00:25:26.784588 1183642 logs.go:138] Found kubelet problem: Mar 12 00:24:43 old-k8s-version-571339 kubelet[663]: E0312 00:24:43.135594 663 pod_workers.go:191] Error syncing pod f8f3ac0e-3c2e-451d-8e5a-d3937eab4142 ("metrics-server-9975d5f86-c87xf_kube-system(f8f3ac0e-3c2e-451d-8e5a-d3937eab4142)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0312 00:25:26.784918 1183642 logs.go:138] Found kubelet problem: Mar 12 00:24:47 old-k8s-version-571339 kubelet[663]: E0312 00:24:47.134779 663 pod_workers.go:191] Error syncing pod 917984d8-3e49-416e-bb76-594879112f42 ("dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"
W0312 00:25:26.785104 1183642 logs.go:138] Found kubelet problem: Mar 12 00:24:56 old-k8s-version-571339 kubelet[663]: E0312 00:24:56.137730 663 pod_workers.go:191] Error syncing pod f8f3ac0e-3c2e-451d-8e5a-d3937eab4142 ("metrics-server-9975d5f86-c87xf_kube-system(f8f3ac0e-3c2e-451d-8e5a-d3937eab4142)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0312 00:25:26.785429 1183642 logs.go:138] Found kubelet problem: Mar 12 00:24:59 old-k8s-version-571339 kubelet[663]: E0312 00:24:59.134749 663 pod_workers.go:191] Error syncing pod 917984d8-3e49-416e-bb76-594879112f42 ("dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"
W0312 00:25:26.785615 1183642 logs.go:138] Found kubelet problem: Mar 12 00:25:07 old-k8s-version-571339 kubelet[663]: E0312 00:25:07.135133 663 pod_workers.go:191] Error syncing pod f8f3ac0e-3c2e-451d-8e5a-d3937eab4142 ("metrics-server-9975d5f86-c87xf_kube-system(f8f3ac0e-3c2e-451d-8e5a-d3937eab4142)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0312 00:25:26.785969 1183642 logs.go:138] Found kubelet problem: Mar 12 00:25:10 old-k8s-version-571339 kubelet[663]: E0312 00:25:10.134865 663 pod_workers.go:191] Error syncing pod 917984d8-3e49-416e-bb76-594879112f42 ("dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"
W0312 00:25:26.786154 1183642 logs.go:138] Found kubelet problem: Mar 12 00:25:19 old-k8s-version-571339 kubelet[663]: E0312 00:25:19.135515 663 pod_workers.go:191] Error syncing pod f8f3ac0e-3c2e-451d-8e5a-d3937eab4142 ("metrics-server-9975d5f86-c87xf_kube-system(f8f3ac0e-3c2e-451d-8e5a-d3937eab4142)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0312 00:25:26.786482 1183642 logs.go:138] Found kubelet problem: Mar 12 00:25:22 old-k8s-version-571339 kubelet[663]: E0312 00:25:22.136716 663 pod_workers.go:191] Error syncing pod 917984d8-3e49-416e-bb76-594879112f42 ("dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"
I0312 00:25:26.786493 1183642 logs.go:123] Gathering logs for dmesg ...
I0312 00:25:26.786508 1183642 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0312 00:25:26.806149 1183642 logs.go:123] Gathering logs for etcd [00fea42a626bc543839c933d2b36dd4155e2329531f2c8a74fa65079753377a9] ...
I0312 00:25:26.806190 1183642 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 00fea42a626bc543839c933d2b36dd4155e2329531f2c8a74fa65079753377a9"
I0312 00:25:26.874399 1183642 logs.go:123] Gathering logs for kube-controller-manager [ea472223f1505d76ec6e5c18af4f3ab7760ebdefed097a213c78a396e15d7ba7] ...
I0312 00:25:26.874432 1183642 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 ea472223f1505d76ec6e5c18af4f3ab7760ebdefed097a213c78a396e15d7ba7"
I0312 00:25:26.948646 1183642 logs.go:123] Gathering logs for kube-controller-manager [ac83611721f7a3d26415ed5ae3625edece62f8bd00bc9a63ce61ffa2ad2c9fbc] ...
I0312 00:25:26.948680 1183642 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 ac83611721f7a3d26415ed5ae3625edece62f8bd00bc9a63ce61ffa2ad2c9fbc"
I0312 00:25:27.046898 1183642 out.go:304] Setting ErrFile to fd 2...
I0312 00:25:27.046932 1183642 out.go:338] TERM=,COLORTERM=, which probably does not support color
W0312 00:25:27.047003 1183642 out.go:239] X Problems detected in kubelet:
W0312 00:25:27.047015 1183642 out.go:239] Mar 12 00:24:59 old-k8s-version-571339 kubelet[663]: E0312 00:24:59.134749 663 pod_workers.go:191] Error syncing pod 917984d8-3e49-416e-bb76-594879112f42 ("dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"
W0312 00:25:27.047022 1183642 out.go:239] Mar 12 00:25:07 old-k8s-version-571339 kubelet[663]: E0312 00:25:07.135133 663 pod_workers.go:191] Error syncing pod f8f3ac0e-3c2e-451d-8e5a-d3937eab4142 ("metrics-server-9975d5f86-c87xf_kube-system(f8f3ac0e-3c2e-451d-8e5a-d3937eab4142)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0312 00:25:27.047037 1183642 out.go:239] Mar 12 00:25:10 old-k8s-version-571339 kubelet[663]: E0312 00:25:10.134865 663 pod_workers.go:191] Error syncing pod 917984d8-3e49-416e-bb76-594879112f42 ("dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"
W0312 00:25:27.047048 1183642 out.go:239] Mar 12 00:25:19 old-k8s-version-571339 kubelet[663]: E0312 00:25:19.135515 663 pod_workers.go:191] Error syncing pod f8f3ac0e-3c2e-451d-8e5a-d3937eab4142 ("metrics-server-9975d5f86-c87xf_kube-system(f8f3ac0e-3c2e-451d-8e5a-d3937eab4142)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0312 00:25:27.047056 1183642 out.go:239] Mar 12 00:25:22 old-k8s-version-571339 kubelet[663]: E0312 00:25:22.136716 663 pod_workers.go:191] Error syncing pod 917984d8-3e49-416e-bb76-594879112f42 ("dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"
I0312 00:25:27.047062 1183642 out.go:304] Setting ErrFile to fd 2...
I0312 00:25:27.047068 1183642 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0312 00:25:27.424002 1188932 api_server.go:253] Checking apiserver healthz at https://192.168.85.2:8443/healthz ...
I0312 00:25:27.431924 1188932 api_server.go:279] https://192.168.85.2:8443/healthz returned 200:
ok
I0312 00:25:27.433124 1188932 api_server.go:141] control plane version: v1.29.0-rc.2
I0312 00:25:27.433160 1188932 api_server.go:131] duration metric: took 11.816324942s to wait for apiserver health ...
I0312 00:25:27.433168 1188932 system_pods.go:43] waiting for kube-system pods to appear ...
I0312 00:25:27.433189 1188932 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
I0312 00:25:27.433252 1188932 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0312 00:25:27.483202 1188932 cri.go:89] found id: "5bba79d28e804260c46d7e8af4c7322a6e22b8739a7b65e4f7be5d64306a2ec8"
I0312 00:25:27.483222 1188932 cri.go:89] found id: "4e2109d4bafae2dd679c7ef05f522399401b1a72fb57a580332be0348557938e"
I0312 00:25:27.483227 1188932 cri.go:89] found id: ""
I0312 00:25:27.483234 1188932 logs.go:276] 2 containers: [5bba79d28e804260c46d7e8af4c7322a6e22b8739a7b65e4f7be5d64306a2ec8 4e2109d4bafae2dd679c7ef05f522399401b1a72fb57a580332be0348557938e]
I0312 00:25:27.483294 1188932 ssh_runner.go:195] Run: which crictl
I0312 00:25:27.487015 1188932 ssh_runner.go:195] Run: which crictl
I0312 00:25:27.490679 1188932 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
I0312 00:25:27.490761 1188932 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0312 00:25:27.531815 1188932 cri.go:89] found id: "4c03779c654a410263bf652c7f2d430f984d91760e30f9510e4952a4de615984"
I0312 00:25:27.531838 1188932 cri.go:89] found id: "1433ae512c5cae729926e9a205666b562fb23efcf8bdc4b06b97fb200275abad"
I0312 00:25:27.531843 1188932 cri.go:89] found id: ""
I0312 00:25:27.531867 1188932 logs.go:276] 2 containers: [4c03779c654a410263bf652c7f2d430f984d91760e30f9510e4952a4de615984 1433ae512c5cae729926e9a205666b562fb23efcf8bdc4b06b97fb200275abad]
I0312 00:25:27.531937 1188932 ssh_runner.go:195] Run: which crictl
I0312 00:25:27.535875 1188932 ssh_runner.go:195] Run: which crictl
I0312 00:25:27.539681 1188932 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
I0312 00:25:27.539762 1188932 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0312 00:25:27.590701 1188932 cri.go:89] found id: "c2acdec1d054a8ac4872c3f65232c70b6c961ec0aba27f0912710c095efd38b6"
I0312 00:25:27.590724 1188932 cri.go:89] found id: "84b4bce6633a2747538b2b0094a5cdbd7dbdcc49272243631213feef4909f91d"
I0312 00:25:27.590729 1188932 cri.go:89] found id: ""
I0312 00:25:27.590736 1188932 logs.go:276] 2 containers: [c2acdec1d054a8ac4872c3f65232c70b6c961ec0aba27f0912710c095efd38b6 84b4bce6633a2747538b2b0094a5cdbd7dbdcc49272243631213feef4909f91d]
I0312 00:25:27.590821 1188932 ssh_runner.go:195] Run: which crictl
I0312 00:25:27.594960 1188932 ssh_runner.go:195] Run: which crictl
I0312 00:25:27.598873 1188932 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
I0312 00:25:27.598981 1188932 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0312 00:25:27.639416 1188932 cri.go:89] found id: "88c55a6c60bb439bcdf99b25641fcd058c1a45d0e83950575189d082ee25643b"
I0312 00:25:27.639441 1188932 cri.go:89] found id: "c8529a2810c2bb6eb70f0f41e1933487322a4e0712a39e177213f3244173c3df"
I0312 00:25:27.639445 1188932 cri.go:89] found id: ""
I0312 00:25:27.639452 1188932 logs.go:276] 2 containers: [88c55a6c60bb439bcdf99b25641fcd058c1a45d0e83950575189d082ee25643b c8529a2810c2bb6eb70f0f41e1933487322a4e0712a39e177213f3244173c3df]
I0312 00:25:27.639524 1188932 ssh_runner.go:195] Run: which crictl
I0312 00:25:27.643051 1188932 ssh_runner.go:195] Run: which crictl
I0312 00:25:27.646656 1188932 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
I0312 00:25:27.646730 1188932 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0312 00:25:27.685204 1188932 cri.go:89] found id: "696c39e44fc846bdc283e21d2e90ef3b55024f28122476a01c185722052ac947"
I0312 00:25:27.685226 1188932 cri.go:89] found id: "98ff369cade299c3b79c03bdcf3fa19fb46b634e98833fe1a4dacb2e30baa2c8"
I0312 00:25:27.685231 1188932 cri.go:89] found id: ""
I0312 00:25:27.685238 1188932 logs.go:276] 2 containers: [696c39e44fc846bdc283e21d2e90ef3b55024f28122476a01c185722052ac947 98ff369cade299c3b79c03bdcf3fa19fb46b634e98833fe1a4dacb2e30baa2c8]
I0312 00:25:27.685296 1188932 ssh_runner.go:195] Run: which crictl
I0312 00:25:27.688926 1188932 ssh_runner.go:195] Run: which crictl
I0312 00:25:27.692613 1188932 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
I0312 00:25:27.692685 1188932 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0312 00:25:27.732789 1188932 cri.go:89] found id: "819dcb8ce3bf495d395f8bfd175489a574b14f4d7ec3abfc8d1da331f9f75175"
I0312 00:25:27.732822 1188932 cri.go:89] found id: "e37d0739e1cf5a034f8279d0f1c5a380bdf13f8df12805914af49b8d09457cc3"
I0312 00:25:27.732828 1188932 cri.go:89] found id: ""
I0312 00:25:27.732837 1188932 logs.go:276] 2 containers: [819dcb8ce3bf495d395f8bfd175489a574b14f4d7ec3abfc8d1da331f9f75175 e37d0739e1cf5a034f8279d0f1c5a380bdf13f8df12805914af49b8d09457cc3]
I0312 00:25:27.732936 1188932 ssh_runner.go:195] Run: which crictl
I0312 00:25:27.736608 1188932 ssh_runner.go:195] Run: which crictl
I0312 00:25:27.740158 1188932 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
I0312 00:25:27.740238 1188932 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0312 00:25:27.779515 1188932 cri.go:89] found id: "323bfd261df2aa6bdcaadc95d9b56bc2270a431303c0f1b4ecf16c54f87d6c7b"
I0312 00:25:27.779536 1188932 cri.go:89] found id: "9d99f44eeab838fb07f421ae4950e661e5f56229d69d698d8f9d2033522367ec"
I0312 00:25:27.779541 1188932 cri.go:89] found id: ""
I0312 00:25:27.779549 1188932 logs.go:276] 2 containers: [323bfd261df2aa6bdcaadc95d9b56bc2270a431303c0f1b4ecf16c54f87d6c7b 9d99f44eeab838fb07f421ae4950e661e5f56229d69d698d8f9d2033522367ec]
I0312 00:25:27.779605 1188932 ssh_runner.go:195] Run: which crictl
I0312 00:25:27.783235 1188932 ssh_runner.go:195] Run: which crictl
I0312 00:25:27.786785 1188932 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
I0312 00:25:27.786892 1188932 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0312 00:25:27.829835 1188932 cri.go:89] found id: "9368f694d66d01b464cc56ea1fd680f25acfb86767c32c49af31dc0da67bacb2"
I0312 00:25:27.829947 1188932 cri.go:89] found id: "dec1c27378bb4ef4460888bcfb40ca5dfccc459968492dd3e38b75ac421b0e8e"
I0312 00:25:27.829958 1188932 cri.go:89] found id: ""
I0312 00:25:27.829970 1188932 logs.go:276] 2 containers: [9368f694d66d01b464cc56ea1fd680f25acfb86767c32c49af31dc0da67bacb2 dec1c27378bb4ef4460888bcfb40ca5dfccc459968492dd3e38b75ac421b0e8e]
I0312 00:25:27.830064 1188932 ssh_runner.go:195] Run: which crictl
I0312 00:25:27.835410 1188932 ssh_runner.go:195] Run: which crictl
I0312 00:25:27.840308 1188932 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
I0312 00:25:27.840406 1188932 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I0312 00:25:27.884411 1188932 cri.go:89] found id: "37d755023a893e06a00cdc14d2dc52b4f5c42a585c7ee881d7d3e29d292b126d"
I0312 00:25:27.884447 1188932 cri.go:89] found id: ""
I0312 00:25:27.884455 1188932 logs.go:276] 1 containers: [37d755023a893e06a00cdc14d2dc52b4f5c42a585c7ee881d7d3e29d292b126d]
I0312 00:25:27.884515 1188932 ssh_runner.go:195] Run: which crictl
I0312 00:25:27.888405 1188932 logs.go:123] Gathering logs for storage-provisioner [dec1c27378bb4ef4460888bcfb40ca5dfccc459968492dd3e38b75ac421b0e8e] ...
I0312 00:25:27.888474 1188932 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 dec1c27378bb4ef4460888bcfb40ca5dfccc459968492dd3e38b75ac421b0e8e"
I0312 00:25:27.930569 1188932 logs.go:123] Gathering logs for kubernetes-dashboard [37d755023a893e06a00cdc14d2dc52b4f5c42a585c7ee881d7d3e29d292b126d] ...
I0312 00:25:27.930601 1188932 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 37d755023a893e06a00cdc14d2dc52b4f5c42a585c7ee881d7d3e29d292b126d"
I0312 00:25:27.975720 1188932 logs.go:123] Gathering logs for kube-apiserver [5bba79d28e804260c46d7e8af4c7322a6e22b8739a7b65e4f7be5d64306a2ec8] ...
I0312 00:25:27.975752 1188932 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 5bba79d28e804260c46d7e8af4c7322a6e22b8739a7b65e4f7be5d64306a2ec8"
I0312 00:25:28.055686 1188932 logs.go:123] Gathering logs for kube-proxy [696c39e44fc846bdc283e21d2e90ef3b55024f28122476a01c185722052ac947] ...
I0312 00:25:28.055726 1188932 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 696c39e44fc846bdc283e21d2e90ef3b55024f28122476a01c185722052ac947"
I0312 00:25:28.105164 1188932 logs.go:123] Gathering logs for kube-proxy [98ff369cade299c3b79c03bdcf3fa19fb46b634e98833fe1a4dacb2e30baa2c8] ...
I0312 00:25:28.105194 1188932 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 98ff369cade299c3b79c03bdcf3fa19fb46b634e98833fe1a4dacb2e30baa2c8"
I0312 00:25:28.157314 1188932 logs.go:123] Gathering logs for kindnet [323bfd261df2aa6bdcaadc95d9b56bc2270a431303c0f1b4ecf16c54f87d6c7b] ...
I0312 00:25:28.157343 1188932 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 323bfd261df2aa6bdcaadc95d9b56bc2270a431303c0f1b4ecf16c54f87d6c7b"
I0312 00:25:28.209856 1188932 logs.go:123] Gathering logs for kindnet [9d99f44eeab838fb07f421ae4950e661e5f56229d69d698d8f9d2033522367ec] ...
I0312 00:25:28.209886 1188932 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 9d99f44eeab838fb07f421ae4950e661e5f56229d69d698d8f9d2033522367ec"
I0312 00:25:28.280971 1188932 logs.go:123] Gathering logs for storage-provisioner [9368f694d66d01b464cc56ea1fd680f25acfb86767c32c49af31dc0da67bacb2] ...
I0312 00:25:28.281000 1188932 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 9368f694d66d01b464cc56ea1fd680f25acfb86767c32c49af31dc0da67bacb2"
I0312 00:25:28.326384 1188932 logs.go:123] Gathering logs for describe nodes ...
I0312 00:25:28.326415 1188932 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0312 00:25:28.470175 1188932 logs.go:123] Gathering logs for kube-scheduler [88c55a6c60bb439bcdf99b25641fcd058c1a45d0e83950575189d082ee25643b] ...
I0312 00:25:28.470210 1188932 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 88c55a6c60bb439bcdf99b25641fcd058c1a45d0e83950575189d082ee25643b"
I0312 00:25:28.530734 1188932 logs.go:123] Gathering logs for kube-controller-manager [819dcb8ce3bf495d395f8bfd175489a574b14f4d7ec3abfc8d1da331f9f75175] ...
I0312 00:25:28.530768 1188932 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 819dcb8ce3bf495d395f8bfd175489a574b14f4d7ec3abfc8d1da331f9f75175"
I0312 00:25:28.612208 1188932 logs.go:123] Gathering logs for kube-controller-manager [e37d0739e1cf5a034f8279d0f1c5a380bdf13f8df12805914af49b8d09457cc3] ...
I0312 00:25:28.612240 1188932 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e37d0739e1cf5a034f8279d0f1c5a380bdf13f8df12805914af49b8d09457cc3"
I0312 00:25:28.685567 1188932 logs.go:123] Gathering logs for container status ...
I0312 00:25:28.685602 1188932 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0312 00:25:28.762445 1188932 logs.go:123] Gathering logs for etcd [1433ae512c5cae729926e9a205666b562fb23efcf8bdc4b06b97fb200275abad] ...
I0312 00:25:28.762475 1188932 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 1433ae512c5cae729926e9a205666b562fb23efcf8bdc4b06b97fb200275abad"
I0312 00:25:28.828318 1188932 logs.go:123] Gathering logs for kube-scheduler [c8529a2810c2bb6eb70f0f41e1933487322a4e0712a39e177213f3244173c3df] ...
I0312 00:25:28.828349 1188932 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 c8529a2810c2bb6eb70f0f41e1933487322a4e0712a39e177213f3244173c3df"
I0312 00:25:28.889240 1188932 logs.go:123] Gathering logs for kube-apiserver [4e2109d4bafae2dd679c7ef05f522399401b1a72fb57a580332be0348557938e] ...
I0312 00:25:28.889274 1188932 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 4e2109d4bafae2dd679c7ef05f522399401b1a72fb57a580332be0348557938e"
I0312 00:25:28.954312 1188932 logs.go:123] Gathering logs for etcd [4c03779c654a410263bf652c7f2d430f984d91760e30f9510e4952a4de615984] ...
I0312 00:25:28.954346 1188932 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 4c03779c654a410263bf652c7f2d430f984d91760e30f9510e4952a4de615984"
I0312 00:25:29.021788 1188932 logs.go:123] Gathering logs for coredns [c2acdec1d054a8ac4872c3f65232c70b6c961ec0aba27f0912710c095efd38b6] ...
I0312 00:25:29.021819 1188932 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 c2acdec1d054a8ac4872c3f65232c70b6c961ec0aba27f0912710c095efd38b6"
I0312 00:25:29.069054 1188932 logs.go:123] Gathering logs for coredns [84b4bce6633a2747538b2b0094a5cdbd7dbdcc49272243631213feef4909f91d] ...
I0312 00:25:29.069083 1188932 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 84b4bce6633a2747538b2b0094a5cdbd7dbdcc49272243631213feef4909f91d"
I0312 00:25:29.116014 1188932 logs.go:123] Gathering logs for containerd ...
I0312 00:25:29.116044 1188932 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
I0312 00:25:29.188012 1188932 logs.go:123] Gathering logs for kubelet ...
I0312 00:25:29.188051 1188932 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0312 00:25:29.238053 1188932 logs.go:138] Found kubelet problem: Mar 12 00:21:16 no-preload-820117 kubelet[656]: W0312 00:21:16.198194 656 reflector.go:539] object-"kubernetes-dashboard"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:no-preload-820117" cannot list resource "configmaps" in API group "" in the namespace "kubernetes-dashboard": no relationship found between node 'no-preload-820117' and this object
W0312 00:25:29.238324 1188932 logs.go:138] Found kubelet problem: Mar 12 00:21:16 no-preload-820117 kubelet[656]: E0312 00:21:16.198236 656 reflector.go:147] object-"kubernetes-dashboard"/"kube-root-ca.crt": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:no-preload-820117" cannot list resource "configmaps" in API group "" in the namespace "kubernetes-dashboard": no relationship found between node 'no-preload-820117' and this object
I0312 00:25:29.267755 1188932 logs.go:123] Gathering logs for dmesg ...
I0312 00:25:29.267800 1188932 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0312 00:25:29.287297 1188932 out.go:304] Setting ErrFile to fd 2...
I0312 00:25:29.287426 1188932 out.go:338] TERM=,COLORTERM=, which probably does not support color
W0312 00:25:29.287505 1188932 out.go:239] X Problems detected in kubelet:
W0312 00:25:29.287517 1188932 out.go:239] Mar 12 00:21:16 no-preload-820117 kubelet[656]: W0312 00:21:16.198194 656 reflector.go:539] object-"kubernetes-dashboard"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:no-preload-820117" cannot list resource "configmaps" in API group "" in the namespace "kubernetes-dashboard": no relationship found between node 'no-preload-820117' and this object
W0312 00:25:29.287539 1188932 out.go:239] Mar 12 00:21:16 no-preload-820117 kubelet[656]: E0312 00:21:16.198236 656 reflector.go:147] object-"kubernetes-dashboard"/"kube-root-ca.crt": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:no-preload-820117" cannot list resource "configmaps" in API group "" in the namespace "kubernetes-dashboard": no relationship found between node 'no-preload-820117' and this object
I0312 00:25:29.287554 1188932 out.go:304] Setting ErrFile to fd 2...
I0312 00:25:29.287570 1188932 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0312 00:25:37.048428 1183642 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0312 00:25:37.061991 1183642 api_server.go:72] duration metric: took 6m0.915958249s to wait for apiserver process to appear ...
I0312 00:25:37.062023 1183642 api_server.go:88] waiting for apiserver healthz status ...
I0312 00:25:37.064575 1183642 out.go:177]
W0312 00:25:37.066356 1183642 out.go:239] X Exiting due to GUEST_START: failed to start node: wait 6m0s for node: wait for healthy API server: apiserver healthz never reported healthy: cluster wait timed out during healthz check
W0312 00:25:37.066381 1183642 out.go:239] *
W0312 00:25:37.067988 1183642 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0312 00:25:37.069878 1183642 out.go:177]
==> container status <==
CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID POD
d96f9b6b28f75 523cad1a4df73 2 minutes ago Exited dashboard-metrics-scraper 5 4c072bfdf413c dashboard-metrics-scraper-8d5bb5db8-5w7h2
98a1386a1a083 ba04bb24b9575 4 minutes ago Running storage-provisioner 2 edb00b61a3759 storage-provisioner
cb775d92b00e5 20b332c9a70d8 5 minutes ago Running kubernetes-dashboard 0 8cab24836afeb kubernetes-dashboard-cd95d586-7dtbw
de7fe1bbfd940 1611cd07b61d5 5 minutes ago Running busybox 1 2f92a28ed6f88 busybox
46d69c632200b 25a5233254979 5 minutes ago Running kube-proxy 1 3d1afaa7fdbea kube-proxy-tvrz6
0c3514f843ab8 ba04bb24b9575 5 minutes ago Exited storage-provisioner 1 edb00b61a3759 storage-provisioner
0d3039260ff7a db91994f4ee8f 5 minutes ago Running coredns 1 c0d5814aae44a coredns-74ff55c5b-pd7cs
ae84159c4657e 4740c1948d3fc 5 minutes ago Running kindnet-cni 1 41f7a3d542fb0 kindnet-rjqrt
cda4f1be508f3 e7605f88f17d6 5 minutes ago Running kube-scheduler 1 cc1db8d1f9f60 kube-scheduler-old-k8s-version-571339
e90658574cccc 2c08bbbc02d3a 5 minutes ago Running kube-apiserver 1 5bd08f59387bf kube-apiserver-old-k8s-version-571339
ea472223f1505 1df8a2b116bd1 5 minutes ago Running kube-controller-manager 1 a88a84a19ae84 kube-controller-manager-old-k8s-version-571339
227b5f4c3ec0b 05b738aa1bc63 5 minutes ago Running etcd 1 b3a3020aa402e etcd-old-k8s-version-571339
7bb137f0f54c1 1611cd07b61d5 6 minutes ago Exited busybox 0 3878b8d8c4e8f busybox
91ba0f1087505 db91994f4ee8f 7 minutes ago Exited coredns 0 d94680007b27a coredns-74ff55c5b-pd7cs
1a5414516a6e0 4740c1948d3fc 8 minutes ago Exited kindnet-cni 0 3398bdba178bc kindnet-rjqrt
8abc9a2fec8f5 25a5233254979 8 minutes ago Exited kube-proxy 0 a42a1e56024d9 kube-proxy-tvrz6
00fea42a626bc 05b738aa1bc63 8 minutes ago Exited etcd 0 0b7b672a1a34d etcd-old-k8s-version-571339
c3f64500c09ef e7605f88f17d6 8 minutes ago Exited kube-scheduler 0 3558549ec2755 kube-scheduler-old-k8s-version-571339
ac83611721f7a 1df8a2b116bd1 8 minutes ago Exited kube-controller-manager 0 98b40a199c49e kube-controller-manager-old-k8s-version-571339
022154a50546e 2c08bbbc02d3a 8 minutes ago Exited kube-apiserver 0 a81f0f0ec4767 kube-apiserver-old-k8s-version-571339
==> containerd <==
Mar 12 00:21:33 old-k8s-version-571339 containerd[567]: time="2024-03-12T00:21:33.141243057Z" level=info msg="trying next host" error="failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host" host=fake.domain
Mar 12 00:21:33 old-k8s-version-571339 containerd[567]: time="2024-03-12T00:21:33.143100368Z" level=error msg="PullImage \"fake.domain/registry.k8s.io/echoserver:1.4\" failed" error="failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
Mar 12 00:21:51 old-k8s-version-571339 containerd[567]: time="2024-03-12T00:21:51.136588303Z" level=info msg="CreateContainer within sandbox \"4c072bfdf413cc4e7943a809c1a7f5a31a9cf7e9c35adc7348fcaac6419ca06a\" for container &ContainerMetadata{Name:dashboard-metrics-scraper,Attempt:4,}"
Mar 12 00:21:51 old-k8s-version-571339 containerd[567]: time="2024-03-12T00:21:51.156308787Z" level=info msg="CreateContainer within sandbox \"4c072bfdf413cc4e7943a809c1a7f5a31a9cf7e9c35adc7348fcaac6419ca06a\" for &ContainerMetadata{Name:dashboard-metrics-scraper,Attempt:4,} returns container id \"6c6a6c77b06d378178da0ea3b51f9fd2adc77daafe8f04ab0c47fc47771dcd09\""
Mar 12 00:21:51 old-k8s-version-571339 containerd[567]: time="2024-03-12T00:21:51.158796587Z" level=info msg="StartContainer for \"6c6a6c77b06d378178da0ea3b51f9fd2adc77daafe8f04ab0c47fc47771dcd09\""
Mar 12 00:21:51 old-k8s-version-571339 containerd[567]: time="2024-03-12T00:21:51.239130258Z" level=info msg="StartContainer for \"6c6a6c77b06d378178da0ea3b51f9fd2adc77daafe8f04ab0c47fc47771dcd09\" returns successfully"
Mar 12 00:21:51 old-k8s-version-571339 containerd[567]: time="2024-03-12T00:21:51.268108785Z" level=info msg="shim disconnected" id=6c6a6c77b06d378178da0ea3b51f9fd2adc77daafe8f04ab0c47fc47771dcd09
Mar 12 00:21:51 old-k8s-version-571339 containerd[567]: time="2024-03-12T00:21:51.268174572Z" level=warning msg="cleaning up after shim disconnected" id=6c6a6c77b06d378178da0ea3b51f9fd2adc77daafe8f04ab0c47fc47771dcd09 namespace=k8s.io
Mar 12 00:21:51 old-k8s-version-571339 containerd[567]: time="2024-03-12T00:21:51.268187142Z" level=info msg="cleaning up dead shim"
Mar 12 00:21:51 old-k8s-version-571339 containerd[567]: time="2024-03-12T00:21:51.277349712Z" level=warning msg="cleanup warnings time=\"2024-03-12T00:21:51Z\" level=info msg=\"starting signal loop\" namespace=k8s.io pid=2937 runtime=io.containerd.runc.v2\n"
Mar 12 00:21:51 old-k8s-version-571339 containerd[567]: time="2024-03-12T00:21:51.961980310Z" level=info msg="RemoveContainer for \"349a0a6fa1ecc529c3bf38cbf5f38050c10fd75de25e559a5ac6f114e43cfe53\""
Mar 12 00:21:51 old-k8s-version-571339 containerd[567]: time="2024-03-12T00:21:51.967205651Z" level=info msg="RemoveContainer for \"349a0a6fa1ecc529c3bf38cbf5f38050c10fd75de25e559a5ac6f114e43cfe53\" returns successfully"
Mar 12 00:22:54 old-k8s-version-571339 containerd[567]: time="2024-03-12T00:22:54.136434236Z" level=info msg="PullImage \"fake.domain/registry.k8s.io/echoserver:1.4\""
Mar 12 00:22:54 old-k8s-version-571339 containerd[567]: time="2024-03-12T00:22:54.141105016Z" level=info msg="trying next host" error="failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host" host=fake.domain
Mar 12 00:22:54 old-k8s-version-571339 containerd[567]: time="2024-03-12T00:22:54.142890387Z" level=error msg="PullImage \"fake.domain/registry.k8s.io/echoserver:1.4\" failed" error="failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
Mar 12 00:23:18 old-k8s-version-571339 containerd[567]: time="2024-03-12T00:23:18.138235110Z" level=info msg="CreateContainer within sandbox \"4c072bfdf413cc4e7943a809c1a7f5a31a9cf7e9c35adc7348fcaac6419ca06a\" for container &ContainerMetadata{Name:dashboard-metrics-scraper,Attempt:5,}"
Mar 12 00:23:18 old-k8s-version-571339 containerd[567]: time="2024-03-12T00:23:18.153904020Z" level=info msg="CreateContainer within sandbox \"4c072bfdf413cc4e7943a809c1a7f5a31a9cf7e9c35adc7348fcaac6419ca06a\" for &ContainerMetadata{Name:dashboard-metrics-scraper,Attempt:5,} returns container id \"d96f9b6b28f75a14646275fa9003956dbbbade5886c46b60dd834a36084849f7\""
Mar 12 00:23:18 old-k8s-version-571339 containerd[567]: time="2024-03-12T00:23:18.154755098Z" level=info msg="StartContainer for \"d96f9b6b28f75a14646275fa9003956dbbbade5886c46b60dd834a36084849f7\""
Mar 12 00:23:18 old-k8s-version-571339 containerd[567]: time="2024-03-12T00:23:18.215771808Z" level=info msg="StartContainer for \"d96f9b6b28f75a14646275fa9003956dbbbade5886c46b60dd834a36084849f7\" returns successfully"
Mar 12 00:23:18 old-k8s-version-571339 containerd[567]: time="2024-03-12T00:23:18.241899984Z" level=info msg="shim disconnected" id=d96f9b6b28f75a14646275fa9003956dbbbade5886c46b60dd834a36084849f7
Mar 12 00:23:18 old-k8s-version-571339 containerd[567]: time="2024-03-12T00:23:18.241971728Z" level=warning msg="cleaning up after shim disconnected" id=d96f9b6b28f75a14646275fa9003956dbbbade5886c46b60dd834a36084849f7 namespace=k8s.io
Mar 12 00:23:18 old-k8s-version-571339 containerd[567]: time="2024-03-12T00:23:18.241984232Z" level=info msg="cleaning up dead shim"
Mar 12 00:23:18 old-k8s-version-571339 containerd[567]: time="2024-03-12T00:23:18.255813095Z" level=warning msg="cleanup warnings time=\"2024-03-12T00:23:18Z\" level=info msg=\"starting signal loop\" namespace=k8s.io pid=3193 runtime=io.containerd.runc.v2\n"
Mar 12 00:23:19 old-k8s-version-571339 containerd[567]: time="2024-03-12T00:23:19.162394641Z" level=info msg="RemoveContainer for \"6c6a6c77b06d378178da0ea3b51f9fd2adc77daafe8f04ab0c47fc47771dcd09\""
Mar 12 00:23:19 old-k8s-version-571339 containerd[567]: time="2024-03-12T00:23:19.167991910Z" level=info msg="RemoveContainer for \"6c6a6c77b06d378178da0ea3b51f9fd2adc77daafe8f04ab0c47fc47771dcd09\" returns successfully"
==> coredns [0d3039260ff7a1d3154eac6a37f5460535e860a77d3473b023822022e245e097] <==
.:53
[INFO] plugin/reload: Running configuration MD5 = b494d968e357ba1b925cee838fbd78ed
CoreDNS-1.7.0
linux/arm64, go1.14.4, f59c03d
[INFO] 127.0.0.1:58748 - 36917 "HINFO IN 4395544677134104827.6798169659976917837. udp 57 false 512" NXDOMAIN qr,rd,ra 57 0.051213619s
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/ready: Still waiting on: "kubernetes"
I0312 00:20:28.835220 1 trace.go:116] Trace[2019727887]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125 (started: 2024-03-12 00:19:58.834469372 +0000 UTC m=+0.115253210) (total time: 30.000594188s):
Trace[2019727887]: [30.000594188s] [30.000594188s] END
E0312 00:20:28.835294 1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to list *v1.Service: Get "https://10.96.0.1:443/api/v1/services?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
I0312 00:20:28.837562 1 trace.go:116] Trace[939984059]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125 (started: 2024-03-12 00:19:58.835971764 +0000 UTC m=+0.116755610) (total time: 30.001536438s):
Trace[939984059]: [30.001536438s] [30.001536438s] END
E0312 00:20:28.837582 1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to list *v1.Endpoints: Get "https://10.96.0.1:443/api/v1/endpoints?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
I0312 00:20:28.842345 1 trace.go:116] Trace[1474941318]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125 (started: 2024-03-12 00:19:58.829244014 +0000 UTC m=+0.110027860) (total time: 30.013077505s):
Trace[1474941318]: [30.013077505s] [30.013077505s] END
E0312 00:20:28.842365 1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to list *v1.Namespace: Get "https://10.96.0.1:443/api/v1/namespaces?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
==> coredns [91ba0f1087505b74193c749143407b360ca52adeb6c8e6fed4c64111ff7ac963] <==
.:53
[INFO] plugin/reload: Running configuration MD5 = b494d968e357ba1b925cee838fbd78ed
CoreDNS-1.7.0
linux/arm64, go1.14.4, f59c03d
[INFO] 127.0.0.1:46841 - 10479 "HINFO IN 3423868519258051186.756692252847698553. udp 56 false 512" NXDOMAIN qr,rd,ra 56 0.036606604s
==> describe nodes <==
Name: old-k8s-version-571339
Roles: control-plane,master
Labels: beta.kubernetes.io/arch=arm64
beta.kubernetes.io/os=linux
kubernetes.io/arch=arm64
kubernetes.io/hostname=old-k8s-version-571339
kubernetes.io/os=linux
minikube.k8s.io/commit=e0a9a803bb8418ee87aee3b4880090eb65379520
minikube.k8s.io/name=old-k8s-version-571339
minikube.k8s.io/primary=true
minikube.k8s.io/updated_at=2024_03_12T00_17_14_0700
minikube.k8s.io/version=v1.32.0
node-role.kubernetes.io/control-plane=
node-role.kubernetes.io/master=
Annotations: kubeadm.alpha.kubernetes.io/cri-socket: /run/containerd/containerd.sock
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Tue, 12 Mar 2024 00:17:10 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: old-k8s-version-571339
AcquireTime: <unset>
RenewTime: Tue, 12 Mar 2024 00:25:28 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Tue, 12 Mar 2024 00:20:47 +0000 Tue, 12 Mar 2024 00:17:03 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Tue, 12 Mar 2024 00:20:47 +0000 Tue, 12 Mar 2024 00:17:03 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Tue, 12 Mar 2024 00:20:47 +0000 Tue, 12 Mar 2024 00:17:03 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Tue, 12 Mar 2024 00:20:47 +0000 Tue, 12 Mar 2024 00:17:30 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.76.2
Hostname: old-k8s-version-571339
Capacity:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022500Ki
pods: 110
Allocatable:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022500Ki
pods: 110
System Info:
Machine ID: db945c8abecb4b39a647c266f9524661
System UUID: b4f4bdad-4162-4003-b09b-7ab7462500c7
Boot ID: 8c314cab-fe64-4f72-b005-d9231ff3e4e9
Kernel Version: 5.15.0-1055-aws
OS Image: Ubuntu 22.04.3 LTS
Operating System: linux
Architecture: arm64
Container Runtime Version: containerd://1.6.28
Kubelet Version: v1.20.0
Kube-Proxy Version: v1.20.0
PodCIDR: 10.244.0.0/24
PodCIDRs: 10.244.0.0/24
Non-terminated Pods: (12 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits AGE
--------- ---- ------------ ---------- --------------- ------------- ---
default busybox 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 6m36s
kube-system coredns-74ff55c5b-pd7cs 100m (5%!)(MISSING) 0 (0%!)(MISSING) 70Mi (0%!)(MISSING) 170Mi (2%!)(MISSING) 8m8s
kube-system etcd-old-k8s-version-571339 100m (5%!)(MISSING) 0 (0%!)(MISSING) 100Mi (1%!)(MISSING) 0 (0%!)(MISSING) 8m16s
kube-system kindnet-rjqrt 100m (5%!)(MISSING) 100m (5%!)(MISSING) 50Mi (0%!)(MISSING) 50Mi (0%!)(MISSING) 8m8s
kube-system kube-apiserver-old-k8s-version-571339 250m (12%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 8m16s
kube-system kube-controller-manager-old-k8s-version-571339 200m (10%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 8m16s
kube-system kube-proxy-tvrz6 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 8m8s
kube-system kube-scheduler-old-k8s-version-571339 100m (5%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 8m16s
kube-system metrics-server-9975d5f86-c87xf 100m (5%!)(MISSING) 0 (0%!)(MISSING) 200Mi (2%!)(MISSING) 0 (0%!)(MISSING) 6m24s
kube-system storage-provisioner 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 8m7s
kubernetes-dashboard dashboard-metrics-scraper-8d5bb5db8-5w7h2 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 5m23s
kubernetes-dashboard kubernetes-dashboard-cd95d586-7dtbw 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 5m23s
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 950m (47%!)(MISSING) 100m (5%!)(MISSING)
memory 420Mi (5%!)(MISSING) 220Mi (2%!)(MISSING)
ephemeral-storage 100Mi (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-1Gi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-2Mi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-32Mi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-64Ki 0 (0%!)(MISSING) 0 (0%!)(MISSING)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal NodeHasSufficientMemory 8m36s (x5 over 8m36s) kubelet Node old-k8s-version-571339 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 8m36s (x5 over 8m36s) kubelet Node old-k8s-version-571339 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 8m36s (x5 over 8m36s) kubelet Node old-k8s-version-571339 status is now: NodeHasSufficientPID
Normal Starting 8m16s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 8m16s kubelet Node old-k8s-version-571339 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 8m16s kubelet Node old-k8s-version-571339 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 8m16s kubelet Node old-k8s-version-571339 status is now: NodeHasSufficientPID
Normal NodeAllocatableEnforced 8m16s kubelet Updated Node Allocatable limit across pods
Normal NodeReady 8m8s kubelet Node old-k8s-version-571339 status is now: NodeReady
Normal Starting 8m7s kube-proxy Starting kube-proxy.
Normal Starting 5m54s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 5m54s (x8 over 5m54s) kubelet Node old-k8s-version-571339 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 5m54s (x8 over 5m54s) kubelet Node old-k8s-version-571339 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 5m54s (x7 over 5m54s) kubelet Node old-k8s-version-571339 status is now: NodeHasSufficientPID
Normal NodeAllocatableEnforced 5m54s kubelet Updated Node Allocatable limit across pods
Normal Starting 5m39s kube-proxy Starting kube-proxy.
==> dmesg <==
[ +0.001026] FS-Cache: O-key=[8] 'fbd5c90000000000'
[ +0.000688] FS-Cache: N-cookie c=00000042 [p=00000039 fl=2 nc=0 na=1]
[ +0.000944] FS-Cache: N-cookie d=000000002b48fe46{9p.inode} n=0000000019a34a10
[ +0.001112] FS-Cache: N-key=[8] 'fbd5c90000000000'
[ +0.003583] FS-Cache: Duplicate cookie detected
[ +0.000712] FS-Cache: O-cookie c=0000003c [p=00000039 fl=226 nc=0 na=1]
[ +0.000955] FS-Cache: O-cookie d=000000002b48fe46{9p.inode} n=0000000082ac578f
[ +0.001051] FS-Cache: O-key=[8] 'fbd5c90000000000'
[ +0.000746] FS-Cache: N-cookie c=00000043 [p=00000039 fl=2 nc=0 na=1]
[ +0.001053] FS-Cache: N-cookie d=000000002b48fe46{9p.inode} n=00000000c300ad87
[ +0.001076] FS-Cache: N-key=[8] 'fbd5c90000000000'
[ +2.667407] FS-Cache: Duplicate cookie detected
[ +0.000857] FS-Cache: O-cookie c=0000003a [p=00000039 fl=226 nc=0 na=1]
[ +0.001131] FS-Cache: O-cookie d=000000002b48fe46{9p.inode} n=0000000050caa49d
[ +0.001172] FS-Cache: O-key=[8] 'fad5c90000000000'
[ +0.000698] FS-Cache: N-cookie c=00000045 [p=00000039 fl=2 nc=0 na=1]
[ +0.000911] FS-Cache: N-cookie d=000000002b48fe46{9p.inode} n=0000000019a34a10
[ +0.001045] FS-Cache: N-key=[8] 'fad5c90000000000'
[ +0.373823] FS-Cache: Duplicate cookie detected
[ +0.000883] FS-Cache: O-cookie c=0000003f [p=00000039 fl=226 nc=0 na=1]
[ +0.000950] FS-Cache: O-cookie d=000000002b48fe46{9p.inode} n=00000000896a7b32
[ +0.001046] FS-Cache: O-key=[8] '00d6c90000000000'
[ +0.000794] FS-Cache: N-cookie c=00000046 [p=00000039 fl=2 nc=0 na=1]
[ +0.000954] FS-Cache: N-cookie d=000000002b48fe46{9p.inode} n=00000000a0cc2f4a
[ +0.001057] FS-Cache: N-key=[8] '00d6c90000000000'
==> etcd [00fea42a626bc543839c933d2b36dd4155e2329531f2c8a74fa65079753377a9] <==
raft2024/03/12 00:17:03 INFO: ea7e25599daad906 is starting a new election at term 1
raft2024/03/12 00:17:03 INFO: ea7e25599daad906 became candidate at term 2
raft2024/03/12 00:17:03 INFO: ea7e25599daad906 received MsgVoteResp from ea7e25599daad906 at term 2
raft2024/03/12 00:17:03 INFO: ea7e25599daad906 became leader at term 2
raft2024/03/12 00:17:03 INFO: raft.node: ea7e25599daad906 elected leader ea7e25599daad906 at term 2
2024-03-12 00:17:03.264126 I | embed: ready to serve client requests
2024-03-12 00:17:03.265898 I | embed: serving client requests on 192.168.76.2:2379
2024-03-12 00:17:03.266234 I | etcdserver: setting up the initial cluster version to 3.4
2024-03-12 00:17:03.267019 N | etcdserver/membership: set the initial cluster version to 3.4
2024-03-12 00:17:03.267274 I | etcdserver/api: enabled capabilities for version 3.4
2024-03-12 00:17:03.268342 I | embed: ready to serve client requests
2024-03-12 00:17:03.273905 I | embed: serving client requests on 127.0.0.1:2379
2024-03-12 00:17:03.288452 I | etcdserver: published {Name:old-k8s-version-571339 ClientURLs:[https://192.168.76.2:2379]} to cluster 6f20f2c4b2fb5f8a
2024-03-12 00:17:26.958744 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-12 00:17:33.221760 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-12 00:17:43.221760 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-12 00:17:53.221923 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-12 00:18:03.221860 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-12 00:18:13.221887 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-12 00:18:23.221942 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-12 00:18:33.222989 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-12 00:18:43.221793 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-12 00:18:53.222060 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-12 00:19:03.221826 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-12 00:19:13.222439 I | etcdserver/api/etcdhttp: /health OK (status code 200)
==> etcd [227b5f4c3ec0b541f1e734b3a9400260044363214781e1a18f0928e954c98086] <==
2024-03-12 00:21:38.264632 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-12 00:21:48.264533 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-12 00:21:58.264572 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-12 00:22:08.264514 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-12 00:22:18.264590 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-12 00:22:28.264534 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-12 00:22:38.264631 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-12 00:22:48.264568 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-12 00:22:58.264646 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-12 00:23:08.264600 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-12 00:23:18.264710 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-12 00:23:28.264981 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-12 00:23:38.272706 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-12 00:23:48.264510 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-12 00:23:58.264638 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-12 00:24:08.264763 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-12 00:24:18.264551 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-12 00:24:28.264503 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-12 00:24:38.267755 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-12 00:24:48.264541 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-12 00:24:58.264649 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-12 00:25:08.264631 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-12 00:25:18.264493 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-12 00:25:28.264606 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-12 00:25:38.264563 I | etcdserver/api/etcdhttp: /health OK (status code 200)
==> kernel <==
00:25:38 up 5:08, 0 users, load average: 0.39, 1.82, 2.49
Linux old-k8s-version-571339 5.15.0-1055-aws #60~20.04.1-Ubuntu SMP Thu Feb 22 15:54:21 UTC 2024 aarch64 aarch64 aarch64 GNU/Linux
PRETTY_NAME="Ubuntu 22.04.3 LTS"
==> kindnet [1a5414516a6e0b5fd6faf9a04f4428d130258262f60692b0dffc8b7ffc8541a6] <==
I0312 00:17:31.538796 1 main.go:102] connected to apiserver: https://10.96.0.1:443
I0312 00:17:31.538870 1 main.go:107] hostIP = 192.168.76.2
podIP = 192.168.76.2
I0312 00:17:31.539030 1 main.go:116] setting mtu 1500 for CNI
I0312 00:17:31.539041 1 main.go:146] kindnetd IP family: "ipv4"
I0312 00:17:31.539052 1 main.go:150] noMask IPv4 subnets: [10.244.0.0/16]
I0312 00:18:01.763035 1 main.go:191] Failed to get nodes, retrying after error: Get "https://10.96.0.1:443/api/v1/nodes": dial tcp 10.96.0.1:443: i/o timeout
I0312 00:18:01.780369 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0312 00:18:01.780403 1 main.go:227] handling current node
I0312 00:18:11.839109 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0312 00:18:11.839137 1 main.go:227] handling current node
I0312 00:18:21.854115 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0312 00:18:21.854148 1 main.go:227] handling current node
I0312 00:18:31.860517 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0312 00:18:31.860972 1 main.go:227] handling current node
I0312 00:18:41.871857 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0312 00:18:41.871888 1 main.go:227] handling current node
I0312 00:18:51.884995 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0312 00:18:51.885025 1 main.go:227] handling current node
I0312 00:19:01.889659 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0312 00:19:01.889696 1 main.go:227] handling current node
I0312 00:19:11.939839 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0312 00:19:11.939867 1 main.go:227] handling current node
==> kindnet [ae84159c4657eff5eabe4d3d9526af6b40457144653c8a1c7e1b3bc077bdcad0] <==
I0312 00:23:29.334974 1 main.go:227] handling current node
I0312 00:23:39.346212 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0312 00:23:39.346244 1 main.go:227] handling current node
I0312 00:23:49.358740 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0312 00:23:49.358768 1 main.go:227] handling current node
I0312 00:23:59.367557 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0312 00:23:59.367586 1 main.go:227] handling current node
I0312 00:24:09.387180 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0312 00:24:09.387229 1 main.go:227] handling current node
I0312 00:24:19.392637 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0312 00:24:19.392668 1 main.go:227] handling current node
I0312 00:24:29.402303 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0312 00:24:29.402335 1 main.go:227] handling current node
I0312 00:24:39.412349 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0312 00:24:39.412577 1 main.go:227] handling current node
I0312 00:24:49.422974 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0312 00:24:49.423005 1 main.go:227] handling current node
I0312 00:24:59.430126 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0312 00:24:59.430152 1 main.go:227] handling current node
I0312 00:25:09.446156 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0312 00:25:09.446189 1 main.go:227] handling current node
I0312 00:25:19.458013 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0312 00:25:19.458044 1 main.go:227] handling current node
I0312 00:25:29.465499 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0312 00:25:29.465543 1 main.go:227] handling current node
==> kube-apiserver [022154a50546e744b25648ac078a4535c3a97e91f97547e8008e89235fd126f5] <==
I0312 00:17:11.466290 1 controller.go:132] OpenAPI AggregationController: action for item : Nothing (removed from the queue).
I0312 00:17:11.466325 1 controller.go:132] OpenAPI AggregationController: action for item k8s_internal_local_delegation_chain_0000000000: Nothing (removed from the queue).
I0312 00:17:11.474572 1 storage_scheduling.go:132] created PriorityClass system-node-critical with value 2000001000
I0312 00:17:11.480758 1 storage_scheduling.go:132] created PriorityClass system-cluster-critical with value 2000000000
I0312 00:17:11.481718 1 storage_scheduling.go:148] all system priority classes are created successfully or already exist.
I0312 00:17:11.996122 1 controller.go:606] quota admission added evaluator for: roles.rbac.authorization.k8s.io
I0312 00:17:12.059392 1 controller.go:606] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io
W0312 00:17:12.173874 1 lease.go:233] Resetting endpoints for master service "kubernetes" to [192.168.76.2]
I0312 00:17:12.175259 1 controller.go:606] quota admission added evaluator for: endpoints
I0312 00:17:12.182037 1 controller.go:606] quota admission added evaluator for: endpointslices.discovery.k8s.io
I0312 00:17:13.197577 1 controller.go:606] quota admission added evaluator for: serviceaccounts
I0312 00:17:13.932657 1 controller.go:606] quota admission added evaluator for: deployments.apps
I0312 00:17:13.986416 1 controller.go:606] quota admission added evaluator for: daemonsets.apps
I0312 00:17:22.454095 1 controller.go:606] quota admission added evaluator for: leases.coordination.k8s.io
I0312 00:17:30.153157 1 controller.go:606] quota admission added evaluator for: replicasets.apps
I0312 00:17:30.332538 1 controller.go:606] quota admission added evaluator for: controllerrevisions.apps
I0312 00:17:45.643854 1 client.go:360] parsed scheme: "passthrough"
I0312 00:17:45.643899 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0312 00:17:45.643935 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0312 00:18:20.227620 1 client.go:360] parsed scheme: "passthrough"
I0312 00:18:20.227856 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0312 00:18:20.227955 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0312 00:18:57.603267 1 client.go:360] parsed scheme: "passthrough"
I0312 00:18:57.603338 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0312 00:18:57.603347 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
==> kube-apiserver [e90658574cccc9b56ea1fd38865b78eb14b34d54f7b6d6f655f8b82d026ee372] <==
I0312 00:21:49.616082 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0312 00:21:49.616091 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0312 00:22:27.392570 1 client.go:360] parsed scheme: "passthrough"
I0312 00:22:27.392613 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0312 00:22:27.392622 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
W0312 00:22:59.945345 1 handler_proxy.go:102] no RequestInfo found in the context
E0312 00:22:59.945453 1 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I0312 00:22:59.945470 1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
I0312 00:23:07.476140 1 client.go:360] parsed scheme: "passthrough"
I0312 00:23:07.476181 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0312 00:23:07.476191 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0312 00:23:46.534666 1 client.go:360] parsed scheme: "passthrough"
I0312 00:23:46.534712 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0312 00:23:46.534723 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0312 00:24:21.305367 1 client.go:360] parsed scheme: "passthrough"
I0312 00:24:21.305410 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0312 00:24:21.305420 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
W0312 00:24:57.400277 1 handler_proxy.go:102] no RequestInfo found in the context
E0312 00:24:57.400355 1 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I0312 00:24:57.400368 1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
I0312 00:25:02.133077 1 client.go:360] parsed scheme: "passthrough"
I0312 00:25:02.133125 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0312 00:25:02.133135 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
==> kube-controller-manager [ac83611721f7a3d26415ed5ae3625edece62f8bd00bc9a63ce61ffa2ad2c9fbc] <==
I0312 00:17:30.259600 1 event.go:291] "Event occurred" object="kube-system/coredns-74ff55c5b" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-74ff55c5b-pd7cs"
I0312 00:17:30.288792 1 shared_informer.go:247] Caches are synced for resource quota
I0312 00:17:30.293761 1 shared_informer.go:247] Caches are synced for HPA
I0312 00:17:30.293789 1 shared_informer.go:247] Caches are synced for ClusterRoleAggregator
I0312 00:17:30.294857 1 shared_informer.go:247] Caches are synced for daemon sets
I0312 00:17:30.368611 1 event.go:291] "Event occurred" object="kube-system/coredns-74ff55c5b" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-74ff55c5b-6ptvm"
I0312 00:17:30.456660 1 shared_informer.go:240] Waiting for caches to sync for garbage collector
I0312 00:17:30.575836 1 event.go:291] "Event occurred" object="kube-system/kube-proxy" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kube-proxy-tvrz6"
I0312 00:17:30.669979 1 event.go:291] "Event occurred" object="kube-system/kindnet" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kindnet-rjqrt"
E0312 00:17:30.742350 1 daemon_controller.go:320] kube-system/kube-proxy failed with : error storing status for daemon set &v1.DaemonSet{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"kube-proxy", GenerateName:"", Namespace:"kube-system", SelfLink:"", UID:"4dbbd939-c3b2-48ec-904d-f7cb7443f93e", ResourceVersion:"270", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63845799433, loc:(*time.Location)(0x632eb80)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"k8s-app":"kube-proxy"}, Annotations:map[string]string{"deprecated.daemonset.template.generation":"1"}, OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry{v1.ManagedFieldsEntry{Manager:"kubeadm", Operation:"Update", APIVersion:"apps/v1", Time:(*v1.Time)(0x4001376cc0), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0x4001376ce0)}}}, Spec:v1.DaemonSetSpec{Selector:(*v1.
LabelSelector)(0x4001376d00), Template:v1.PodTemplateSpec{ObjectMeta:v1.ObjectMeta{Name:"", GenerateName:"", Namespace:"", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"k8s-app":"kube-proxy"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v1.PodSpec{Volumes:[]v1.Volume{v1.Volume{Name:"kube-proxy", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(nil), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.Gl
usterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(0x400128de40), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}, v1.Volume{Name:"xtables-lock", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0x4001376
d20), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeS
ource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}, v1.Volume{Name:"lib-modules", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0x4001376d40), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil),
AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}}, InitContainers:[]v1.Container(nil), Containers:[]v1.Container{v1.Container{Name:"kube-proxy", Image:"k8s.gcr.io/kube-proxy:v1.20.0", Command:[]string{"/usr/local/bin/kube-proxy", "--config=/var/lib/kube-proxy/config.conf", "--hostname-override=$(NODE_NAME)"}, Args:[]string(nil), WorkingDir:"", Ports:[]v1.ContainerPort(nil), EnvFrom:[]v1.EnvFromSource(nil), Env:[]v1.EnvVar{v1.EnvVar{Name:"NODE_NAME", Value:"", ValueFrom:(*v1.EnvVarSource)(0x4001376d80)}}, Resources:v1.R
esourceRequirements{Limits:v1.ResourceList(nil), Requests:v1.ResourceList(nil)}, VolumeMounts:[]v1.VolumeMount{v1.VolumeMount{Name:"kube-proxy", ReadOnly:false, MountPath:"/var/lib/kube-proxy", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"xtables-lock", ReadOnly:false, MountPath:"/run/xtables.lock", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"lib-modules", ReadOnly:true, MountPath:"/lib/modules", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}}, VolumeDevices:[]v1.VolumeDevice(nil), LivenessProbe:(*v1.Probe)(nil), ReadinessProbe:(*v1.Probe)(nil), StartupProbe:(*v1.Probe)(nil), Lifecycle:(*v1.Lifecycle)(nil), TerminationMessagePath:"/dev/termination-log", TerminationMessagePolicy:"File", ImagePullPolicy:"IfNotPresent", SecurityContext:(*v1.SecurityContext)(0x400152e540), Stdin:false, StdinOnce:false, TTY:false}}, EphemeralContainers:[]v1.EphemeralContainer(nil), RestartPo
licy:"Always", TerminationGracePeriodSeconds:(*int64)(0x4000fc1ce8), ActiveDeadlineSeconds:(*int64)(nil), DNSPolicy:"ClusterFirst", NodeSelector:map[string]string{"kubernetes.io/os":"linux"}, ServiceAccountName:"kube-proxy", DeprecatedServiceAccount:"kube-proxy", AutomountServiceAccountToken:(*bool)(nil), NodeName:"", HostNetwork:true, HostPID:false, HostIPC:false, ShareProcessNamespace:(*bool)(nil), SecurityContext:(*v1.PodSecurityContext)(0x4000b35b90), ImagePullSecrets:[]v1.LocalObjectReference(nil), Hostname:"", Subdomain:"", Affinity:(*v1.Affinity)(nil), SchedulerName:"default-scheduler", Tolerations:[]v1.Toleration{v1.Toleration{Key:"CriticalAddonsOnly", Operator:"Exists", Value:"", Effect:"", TolerationSeconds:(*int64)(nil)}, v1.Toleration{Key:"", Operator:"Exists", Value:"", Effect:"", TolerationSeconds:(*int64)(nil)}}, HostAliases:[]v1.HostAlias(nil), PriorityClassName:"system-node-critical", Priority:(*int32)(nil), DNSConfig:(*v1.PodDNSConfig)(nil), ReadinessGates:[]v1.PodReadinessGate(nil), Runtime
ClassName:(*string)(nil), EnableServiceLinks:(*bool)(nil), PreemptionPolicy:(*v1.PreemptionPolicy)(nil), Overhead:v1.ResourceList(nil), TopologySpreadConstraints:[]v1.TopologySpreadConstraint(nil), SetHostnameAsFQDN:(*bool)(nil)}}, UpdateStrategy:v1.DaemonSetUpdateStrategy{Type:"RollingUpdate", RollingUpdate:(*v1.RollingUpdateDaemonSet)(0x4000116220)}, MinReadySeconds:0, RevisionHistoryLimit:(*int32)(0x4000fc1d68)}, Status:v1.DaemonSetStatus{CurrentNumberScheduled:0, NumberMisscheduled:0, DesiredNumberScheduled:0, NumberReady:0, ObservedGeneration:0, UpdatedNumberScheduled:0, NumberAvailable:0, NumberUnavailable:0, CollisionCount:(*int32)(nil), Conditions:[]v1.DaemonSetCondition(nil)}}: Operation cannot be fulfilled on daemonsets.apps "kube-proxy": the object has been modified; please apply your changes to the latest version and try again
I0312 00:17:30.743598 1 shared_informer.go:247] Caches are synced for garbage collector
I0312 00:17:30.743618 1 garbagecollector.go:151] Garbage collector: all resource monitors have synced. Proceeding to collect garbage
E0312 00:17:30.747141 1 daemon_controller.go:320] kube-system/kindnet failed with : error storing status for daemon set &v1.DaemonSet{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"kindnet", GenerateName:"", Namespace:"kube-system", SelfLink:"", UID:"b550cbbf-2525-4689-b8bf-859affd27c33", ResourceVersion:"288", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63845799434, loc:(*time.Location)(0x632eb80)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"app":"kindnet", "k8s-app":"kindnet", "tier":"node"}, Annotations:map[string]string{"deprecated.daemonset.template.generation":"1", "kubectl.kubernetes.io/last-applied-configuration":"{\"apiVersion\":\"apps/v1\",\"kind\":\"DaemonSet\",\"metadata\":{\"annotations\":{},\"labels\":{\"app\":\"kindnet\",\"k8s-app\":\"kindnet\",\"tier\":\"node\"},\"name\":\"kindnet\",\"namespace\":\"kube-system\"},\"spec\":{\"selector\":{\"matchLabels\":{\"app\":\"k
indnet\"}},\"template\":{\"metadata\":{\"labels\":{\"app\":\"kindnet\",\"k8s-app\":\"kindnet\",\"tier\":\"node\"}},\"spec\":{\"containers\":[{\"env\":[{\"name\":\"HOST_IP\",\"valueFrom\":{\"fieldRef\":{\"fieldPath\":\"status.hostIP\"}}},{\"name\":\"POD_IP\",\"valueFrom\":{\"fieldRef\":{\"fieldPath\":\"status.podIP\"}}},{\"name\":\"POD_SUBNET\",\"value\":\"10.244.0.0/16\"}],\"image\":\"docker.io/kindest/kindnetd:v20240202-8f1494ea\",\"name\":\"kindnet-cni\",\"resources\":{\"limits\":{\"cpu\":\"100m\",\"memory\":\"50Mi\"},\"requests\":{\"cpu\":\"100m\",\"memory\":\"50Mi\"}},\"securityContext\":{\"capabilities\":{\"add\":[\"NET_RAW\",\"NET_ADMIN\"]},\"privileged\":false},\"volumeMounts\":[{\"mountPath\":\"/etc/cni/net.d\",\"name\":\"cni-cfg\"},{\"mountPath\":\"/run/xtables.lock\",\"name\":\"xtables-lock\",\"readOnly\":false},{\"mountPath\":\"/lib/modules\",\"name\":\"lib-modules\",\"readOnly\":true}]}],\"hostNetwork\":true,\"serviceAccountName\":\"kindnet\",\"tolerations\":[{\"effect\":\"NoSchedule\",\"operator\
":\"Exists\"}],\"volumes\":[{\"hostPath\":{\"path\":\"/etc/cni/net.d\",\"type\":\"DirectoryOrCreate\"},\"name\":\"cni-cfg\"},{\"hostPath\":{\"path\":\"/run/xtables.lock\",\"type\":\"FileOrCreate\"},\"name\":\"xtables-lock\"},{\"hostPath\":{\"path\":\"/lib/modules\"},\"name\":\"lib-modules\"}]}}}}\n"}, OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry{v1.ManagedFieldsEntry{Manager:"kubectl-client-side-apply", Operation:"Update", APIVersion:"apps/v1", Time:(*v1.Time)(0x4001376de0), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0x4001376e00)}}}, Spec:v1.DaemonSetSpec{Selector:(*v1.LabelSelector)(0x4001376e20), Template:v1.PodTemplateSpec{ObjectMeta:v1.ObjectMeta{Name:"", GenerateName:"", Namespace:"", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string
{"app":"kindnet", "k8s-app":"kindnet", "tier":"node"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v1.PodSpec{Volumes:[]v1.Volume{v1.Volume{Name:"cni-cfg", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0x4001376e40), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil),
FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}, v1.Volume{Name:"xtables-lock", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0x4001376e60), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.Glust
erfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}, v1.Volume{Name:"lib-modules", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0x4001376e80), EmptyDi
r:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil),
PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}}, InitContainers:[]v1.Container(nil), Containers:[]v1.Container{v1.Container{Name:"kindnet-cni", Image:"docker.io/kindest/kindnetd:v20240202-8f1494ea", Command:[]string(nil), Args:[]string(nil), WorkingDir:"", Ports:[]v1.ContainerPort(nil), EnvFrom:[]v1.EnvFromSource(nil), Env:[]v1.EnvVar{v1.EnvVar{Name:"HOST_IP", Value:"", ValueFrom:(*v1.EnvVarSource)(0x4001376ea0)}, v1.EnvVar{Name:"POD_IP", Value:"", ValueFrom:(*v1.EnvVarSource)(0x4001376ee0)}, v1.EnvVar{Name:"POD_SUBNET", Value:"10.244.0.0/16", ValueFrom:(*v1.EnvVarSource)(nil)}}, Resources:v1.ResourceRequirements{Limits:v1.ResourceList{"cpu":resource.Quantity{i:resource.int64Amount{value:100, scale:-3}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"100m", Format:"DecimalSI"}, "memory":resource.Quantity{i:resource.int64Amount{value:52428800, scale:
0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"50Mi", Format:"BinarySI"}}, Requests:v1.ResourceList{"cpu":resource.Quantity{i:resource.int64Amount{value:100, scale:-3}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"100m", Format:"DecimalSI"}, "memory":resource.Quantity{i:resource.int64Amount{value:52428800, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"50Mi", Format:"BinarySI"}}}, VolumeMounts:[]v1.VolumeMount{v1.VolumeMount{Name:"cni-cfg", ReadOnly:false, MountPath:"/etc/cni/net.d", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"xtables-lock", ReadOnly:false, MountPath:"/run/xtables.lock", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"lib-modules", ReadOnly:true, MountPath:"/lib/modules", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}}, VolumeDevices:[]v1.VolumeDevice(nil), LivenessProbe:(*v1.Probe)(nil), ReadinessProbe:(*v1.Probe)(nil), StartupProbe:
(*v1.Probe)(nil), Lifecycle:(*v1.Lifecycle)(nil), TerminationMessagePath:"/dev/termination-log", TerminationMessagePolicy:"File", ImagePullPolicy:"IfNotPresent", SecurityContext:(*v1.SecurityContext)(0x400152e5a0), Stdin:false, StdinOnce:false, TTY:false}}, EphemeralContainers:[]v1.EphemeralContainer(nil), RestartPolicy:"Always", TerminationGracePeriodSeconds:(*int64)(0x4000fc1f68), ActiveDeadlineSeconds:(*int64)(nil), DNSPolicy:"ClusterFirst", NodeSelector:map[string]string(nil), ServiceAccountName:"kindnet", DeprecatedServiceAccount:"kindnet", AutomountServiceAccountToken:(*bool)(nil), NodeName:"", HostNetwork:true, HostPID:false, HostIPC:false, ShareProcessNamespace:(*bool)(nil), SecurityContext:(*v1.PodSecurityContext)(0x4000b35c00), ImagePullSecrets:[]v1.LocalObjectReference(nil), Hostname:"", Subdomain:"", Affinity:(*v1.Affinity)(nil), SchedulerName:"default-scheduler", Tolerations:[]v1.Toleration{v1.Toleration{Key:"", Operator:"Exists", Value:"", Effect:"NoSchedule", TolerationSeconds:(*int64)(nil)}},
HostAliases:[]v1.HostAlias(nil), PriorityClassName:"", Priority:(*int32)(nil), DNSConfig:(*v1.PodDNSConfig)(nil), ReadinessGates:[]v1.PodReadinessGate(nil), RuntimeClassName:(*string)(nil), EnableServiceLinks:(*bool)(nil), PreemptionPolicy:(*v1.PreemptionPolicy)(nil), Overhead:v1.ResourceList(nil), TopologySpreadConstraints:[]v1.TopologySpreadConstraint(nil), SetHostnameAsFQDN:(*bool)(nil)}}, UpdateStrategy:v1.DaemonSetUpdateStrategy{Type:"RollingUpdate", RollingUpdate:(*v1.RollingUpdateDaemonSet)(0x4000116248)}, MinReadySeconds:0, RevisionHistoryLimit:(*int32)(0x4000fc1fb0)}, Status:v1.DaemonSetStatus{CurrentNumberScheduled:0, NumberMisscheduled:0, DesiredNumberScheduled:0, NumberReady:0, ObservedGeneration:0, UpdatedNumberScheduled:0, NumberAvailable:0, NumberUnavailable:0, CollisionCount:(*int32)(nil), Conditions:[]v1.DaemonSetCondition(nil)}}: Operation cannot be fulfilled on daemonsets.apps "kindnet": the object has been modified; please apply your changes to the latest version and try again
I0312 00:17:30.758024 1 shared_informer.go:247] Caches are synced for garbage collector
E0312 00:17:30.914175 1 daemon_controller.go:320] kube-system/kube-proxy failed with : error storing status for daemon set &v1.DaemonSet{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"kube-proxy", GenerateName:"", Namespace:"kube-system", SelfLink:"", UID:"4dbbd939-c3b2-48ec-904d-f7cb7443f93e", ResourceVersion:"404", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63845799433, loc:(*time.Location)(0x632eb80)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"k8s-app":"kube-proxy"}, Annotations:map[string]string{"deprecated.daemonset.template.generation":"1"}, OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry{v1.ManagedFieldsEntry{Manager:"kubeadm", Operation:"Update", APIVersion:"apps/v1", Time:(*v1.Time)(0x40019bcc80), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0x40019bcca0)}, v1.ManagedFieldsEntry{Manager:"kube-co
ntroller-manager", Operation:"Update", APIVersion:"apps/v1", Time:(*v1.Time)(0x40019bccc0), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0x40019bcce0)}}}, Spec:v1.DaemonSetSpec{Selector:(*v1.LabelSelector)(0x40019bcd00), Template:v1.PodTemplateSpec{ObjectMeta:v1.ObjectMeta{Name:"", GenerateName:"", Namespace:"", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"k8s-app":"kube-proxy"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v1.PodSpec{Volumes:[]v1.Volume{v1.Volume{Name:"kube-proxy", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(nil), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElastic
BlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(0x4001951540), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSour
ce)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}, v1.Volume{Name:"xtables-lock", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0x40019bcd20), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSo
urce)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}, v1.Volume{Name:"lib-modules", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0x40019bcd40), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil),
Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}}, InitContainers:[]v1.Container(nil), Containers:[]v1.Container{v1.Container{Name:"kube-proxy", Image:"k8s.gcr.io/kube-proxy:v1.20.0", Command:[]string{"/usr/local/bin/kube-proxy", "--config=/var/lib/kube-proxy/config.conf", "--hostname-override=$(NODE_NAME)"}, Args:[]string(nil),
WorkingDir:"", Ports:[]v1.ContainerPort(nil), EnvFrom:[]v1.EnvFromSource(nil), Env:[]v1.EnvVar{v1.EnvVar{Name:"NODE_NAME", Value:"", ValueFrom:(*v1.EnvVarSource)(0x40019bcd80)}}, Resources:v1.ResourceRequirements{Limits:v1.ResourceList(nil), Requests:v1.ResourceList(nil)}, VolumeMounts:[]v1.VolumeMount{v1.VolumeMount{Name:"kube-proxy", ReadOnly:false, MountPath:"/var/lib/kube-proxy", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"xtables-lock", ReadOnly:false, MountPath:"/run/xtables.lock", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"lib-modules", ReadOnly:true, MountPath:"/lib/modules", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}}, VolumeDevices:[]v1.VolumeDevice(nil), LivenessProbe:(*v1.Probe)(nil), ReadinessProbe:(*v1.Probe)(nil), StartupProbe:(*v1.Probe)(nil), Lifecycle:(*v1.Lifecycle)(nil), TerminationMessagePath:"/dev/termination-log", TerminationMessagePolicy:"F
ile", ImagePullPolicy:"IfNotPresent", SecurityContext:(*v1.SecurityContext)(0x4001954d20), Stdin:false, StdinOnce:false, TTY:false}}, EphemeralContainers:[]v1.EphemeralContainer(nil), RestartPolicy:"Always", TerminationGracePeriodSeconds:(*int64)(0x400194b5c8), ActiveDeadlineSeconds:(*int64)(nil), DNSPolicy:"ClusterFirst", NodeSelector:map[string]string{"kubernetes.io/os":"linux"}, ServiceAccountName:"kube-proxy", DeprecatedServiceAccount:"kube-proxy", AutomountServiceAccountToken:(*bool)(nil), NodeName:"", HostNetwork:true, HostPID:false, HostIPC:false, ShareProcessNamespace:(*bool)(nil), SecurityContext:(*v1.PodSecurityContext)(0x40004219d0), ImagePullSecrets:[]v1.LocalObjectReference(nil), Hostname:"", Subdomain:"", Affinity:(*v1.Affinity)(nil), SchedulerName:"default-scheduler", Tolerations:[]v1.Toleration{v1.Toleration{Key:"CriticalAddonsOnly", Operator:"Exists", Value:"", Effect:"", TolerationSeconds:(*int64)(nil)}, v1.Toleration{Key:"", Operator:"Exists", Value:"", Effect:"", TolerationSeconds:(*int64)
(nil)}}, HostAliases:[]v1.HostAlias(nil), PriorityClassName:"system-node-critical", Priority:(*int32)(nil), DNSConfig:(*v1.PodDNSConfig)(nil), ReadinessGates:[]v1.PodReadinessGate(nil), RuntimeClassName:(*string)(nil), EnableServiceLinks:(*bool)(nil), PreemptionPolicy:(*v1.PreemptionPolicy)(nil), Overhead:v1.ResourceList(nil), TopologySpreadConstraints:[]v1.TopologySpreadConstraint(nil), SetHostnameAsFQDN:(*bool)(nil)}}, UpdateStrategy:v1.DaemonSetUpdateStrategy{Type:"RollingUpdate", RollingUpdate:(*v1.RollingUpdateDaemonSet)(0x40001177a8)}, MinReadySeconds:0, RevisionHistoryLimit:(*int32)(0x400194b618)}, Status:v1.DaemonSetStatus{CurrentNumberScheduled:0, NumberMisscheduled:0, DesiredNumberScheduled:1, NumberReady:0, ObservedGeneration:1, UpdatedNumberScheduled:0, NumberAvailable:0, NumberUnavailable:1, CollisionCount:(*int32)(nil), Conditions:[]v1.DaemonSetCondition(nil)}}: Operation cannot be fulfilled on daemonsets.apps "kube-proxy": the object has been modified; please apply your changes to the latest ve
rsion and try again
I0312 00:17:31.234380 1 request.go:655] Throttling request took 1.013767022s, request: GET:https://192.168.76.2:8443/apis/rbac.authorization.k8s.io/v1?timeout=32s
I0312 00:17:31.936700 1 shared_informer.go:240] Waiting for caches to sync for resource quota
I0312 00:17:31.936752 1 shared_informer.go:247] Caches are synced for resource quota
I0312 00:17:32.002734 1 event.go:291] "Event occurred" object="kube-system/coredns" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled down replica set coredns-74ff55c5b to 1"
I0312 00:17:32.034474 1 event.go:291] "Event occurred" object="kube-system/coredns-74ff55c5b" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulDelete" message="Deleted pod: coredns-74ff55c5b-6ptvm"
I0312 00:17:35.022157 1 node_lifecycle_controller.go:1222] Controller detected that some Nodes are Ready. Exiting master disruption mode.
I0312 00:19:13.187252 1 event.go:291] "Event occurred" object="kube-system/metrics-server" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set metrics-server-9975d5f86 to 1"
I0312 00:19:13.306136 1 event.go:291] "Event occurred" object="kube-system/metrics-server-9975d5f86" kind="ReplicaSet" apiVersion="apps/v1" type="Warning" reason="FailedCreate" message="Error creating: pods \"metrics-server-9975d5f86-\" is forbidden: error looking up service account kube-system/metrics-server: serviceaccount \"metrics-server\" not found"
E0312 00:19:13.438005 1 replica_set.go:532] sync "kube-system/metrics-server-9975d5f86" failed with pods "metrics-server-9975d5f86-" is forbidden: error looking up service account kube-system/metrics-server: serviceaccount "metrics-server" not found
E0312 00:19:13.702847 1 clusterroleaggregation_controller.go:181] admin failed with : Operation cannot be fulfilled on clusterroles.rbac.authorization.k8s.io "admin": the object has been modified; please apply your changes to the latest version and try again
==> kube-controller-manager [ea472223f1505d76ec6e5c18af4f3ab7760ebdefed097a213c78a396e15d7ba7] <==
E0312 00:21:15.975987 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0312 00:21:19.975257 1 request.go:655] Throttling request took 1.044857219s, request: GET:https://192.168.76.2:8443/apis/extensions/v1beta1?timeout=32s
W0312 00:21:20.828522 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0312 00:21:46.477717 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0312 00:21:52.478990 1 request.go:655] Throttling request took 1.048353316s, request: GET:https://192.168.76.2:8443/apis/extensions/v1beta1?timeout=32s
W0312 00:21:53.331236 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0312 00:22:16.979548 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0312 00:22:24.981811 1 request.go:655] Throttling request took 1.048339413s, request: GET:https://192.168.76.2:8443/apis/extensions/v1beta1?timeout=32s
W0312 00:22:25.833113 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0312 00:22:47.481451 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0312 00:22:57.483568 1 request.go:655] Throttling request took 1.048271219s, request: GET:https://192.168.76.2:8443/apis/extensions/v1beta1?timeout=32s
W0312 00:22:58.335148 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0312 00:23:17.983363 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0312 00:23:29.986059 1 request.go:655] Throttling request took 1.048464229s, request: GET:https://192.168.76.2:8443/apis/apiextensions.k8s.io/v1beta1?timeout=32s
W0312 00:23:30.837394 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0312 00:23:48.485196 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0312 00:24:02.487839 1 request.go:655] Throttling request took 1.048341697s, request: GET:https://192.168.76.2:8443/apis/certificates.k8s.io/v1beta1?timeout=32s
W0312 00:24:03.339388 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0312 00:24:18.987473 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0312 00:24:34.989723 1 request.go:655] Throttling request took 1.048394888s, request: GET:https://192.168.76.2:8443/apis/coordination.k8s.io/v1?timeout=32s
W0312 00:24:35.841125 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0312 00:24:49.489310 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0312 00:25:07.491585 1 request.go:655] Throttling request took 1.048277767s, request: GET:https://192.168.76.2:8443/apis/scheduling.k8s.io/v1beta1?timeout=32s
W0312 00:25:08.343138 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0312 00:25:19.991376 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
==> kube-proxy [46d69c632200b08b2b8f94cd051969df887d9d074acace5d606fef37cc84295e] <==
I0312 00:19:59.631896 1 node.go:172] Successfully retrieved node IP: 192.168.76.2
I0312 00:19:59.632063 1 server_others.go:142] kube-proxy node IP is an IPv4 address (192.168.76.2), assume IPv4 operation
W0312 00:19:59.655911 1 server_others.go:578] Unknown proxy mode "", assuming iptables proxy
I0312 00:19:59.656200 1 server_others.go:185] Using iptables Proxier.
I0312 00:19:59.656568 1 server.go:650] Version: v1.20.0
I0312 00:19:59.657429 1 config.go:315] Starting service config controller
I0312 00:19:59.657588 1 shared_informer.go:240] Waiting for caches to sync for service config
I0312 00:19:59.657686 1 config.go:224] Starting endpoint slice config controller
I0312 00:19:59.657775 1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config
I0312 00:19:59.758829 1 shared_informer.go:247] Caches are synced for endpoint slice config
I0312 00:19:59.766925 1 shared_informer.go:247] Caches are synced for service config
==> kube-proxy [8abc9a2fec8f5340e92089f46c5ff2bf798571fbcb6c7ce9545d0e353715bed4] <==
I0312 00:17:31.669418 1 node.go:172] Successfully retrieved node IP: 192.168.76.2
I0312 00:17:31.669524 1 server_others.go:142] kube-proxy node IP is an IPv4 address (192.168.76.2), assume IPv4 operation
W0312 00:17:31.693844 1 server_others.go:578] Unknown proxy mode "", assuming iptables proxy
I0312 00:17:31.693933 1 server_others.go:185] Using iptables Proxier.
I0312 00:17:31.694132 1 server.go:650] Version: v1.20.0
I0312 00:17:31.694625 1 config.go:315] Starting service config controller
I0312 00:17:31.694633 1 shared_informer.go:240] Waiting for caches to sync for service config
I0312 00:17:31.696431 1 config.go:224] Starting endpoint slice config controller
I0312 00:17:31.696443 1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config
I0312 00:17:31.794750 1 shared_informer.go:247] Caches are synced for service config
I0312 00:17:31.796563 1 shared_informer.go:247] Caches are synced for endpoint slice config
==> kube-scheduler [c3f64500c09efd7fdf78260f3bef5ed1adaefa3e3a847a7540726cbee6bd042f] <==
I0312 00:17:05.858423 1 serving.go:331] Generated self-signed cert in-memory
W0312 00:17:10.679497 1 requestheader_controller.go:193] Unable to get configmap/extension-apiserver-authentication in kube-system. Usually fixed by 'kubectl create rolebinding -n kube-system ROLEBINDING_NAME --role=extension-apiserver-authentication-reader --serviceaccount=YOUR_NS:YOUR_SA'
W0312 00:17:10.683371 1 authentication.go:332] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"
W0312 00:17:10.683580 1 authentication.go:333] Continuing without authentication configuration. This may treat all requests as anonymous.
W0312 00:17:10.683669 1 authentication.go:334] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false
I0312 00:17:10.757445 1 secure_serving.go:197] Serving securely on 127.0.0.1:10259
I0312 00:17:10.757500 1 configmap_cafile_content.go:202] Starting client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0312 00:17:10.770944 1 shared_informer.go:240] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0312 00:17:10.757529 1 tlsconfig.go:240] Starting DynamicServingCertificateController
E0312 00:17:10.779100 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
E0312 00:17:10.779428 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
E0312 00:17:10.779639 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
E0312 00:17:10.779830 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
E0312 00:17:10.780033 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
E0312 00:17:10.780224 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
E0312 00:17:10.780440 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
E0312 00:17:10.785656 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
E0312 00:17:10.787497 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
E0312 00:17:10.787746 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
E0312 00:17:10.788632 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1beta1.PodDisruptionBudget: failed to list *v1beta1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
E0312 00:17:10.795407 1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
E0312 00:17:11.595607 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
I0312 00:17:12.371130 1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
==> kube-scheduler [cda4f1be508f3de4744e406ac4acfcb87143068155c189f0e7506f78db3a42c9] <==
I0312 00:19:49.872110 1 serving.go:331] Generated self-signed cert in-memory
W0312 00:19:56.406843 1 requestheader_controller.go:193] Unable to get configmap/extension-apiserver-authentication in kube-system. Usually fixed by 'kubectl create rolebinding -n kube-system ROLEBINDING_NAME --role=extension-apiserver-authentication-reader --serviceaccount=YOUR_NS:YOUR_SA'
W0312 00:19:56.410203 1 authentication.go:332] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"
W0312 00:19:56.410244 1 authentication.go:333] Continuing without authentication configuration. This may treat all requests as anonymous.
W0312 00:19:56.410250 1 authentication.go:334] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false
I0312 00:19:56.816131 1 configmap_cafile_content.go:202] Starting client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0312 00:19:56.819259 1 shared_informer.go:240] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0312 00:19:56.819474 1 tlsconfig.go:240] Starting DynamicServingCertificateController
I0312 00:19:56.820827 1 secure_serving.go:197] Serving securely on 127.0.0.1:10259
I0312 00:19:57.019599 1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
==> kubelet <==
Mar 12 00:23:59 old-k8s-version-571339 kubelet[663]: E0312 00:23:59.134729 663 pod_workers.go:191] Error syncing pod 917984d8-3e49-416e-bb76-594879112f42 ("dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"
Mar 12 00:24:02 old-k8s-version-571339 kubelet[663]: E0312 00:24:02.135523 663 pod_workers.go:191] Error syncing pod f8f3ac0e-3c2e-451d-8e5a-d3937eab4142 ("metrics-server-9975d5f86-c87xf_kube-system(f8f3ac0e-3c2e-451d-8e5a-d3937eab4142)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Mar 12 00:24:11 old-k8s-version-571339 kubelet[663]: I0312 00:24:11.134423 663 scope.go:95] [topologymanager] RemoveContainer - Container ID: d96f9b6b28f75a14646275fa9003956dbbbade5886c46b60dd834a36084849f7
Mar 12 00:24:11 old-k8s-version-571339 kubelet[663]: E0312 00:24:11.134786 663 pod_workers.go:191] Error syncing pod 917984d8-3e49-416e-bb76-594879112f42 ("dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"
Mar 12 00:24:16 old-k8s-version-571339 kubelet[663]: E0312 00:24:16.135140 663 pod_workers.go:191] Error syncing pod f8f3ac0e-3c2e-451d-8e5a-d3937eab4142 ("metrics-server-9975d5f86-c87xf_kube-system(f8f3ac0e-3c2e-451d-8e5a-d3937eab4142)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Mar 12 00:24:22 old-k8s-version-571339 kubelet[663]: I0312 00:24:22.135005 663 scope.go:95] [topologymanager] RemoveContainer - Container ID: d96f9b6b28f75a14646275fa9003956dbbbade5886c46b60dd834a36084849f7
Mar 12 00:24:22 old-k8s-version-571339 kubelet[663]: E0312 00:24:22.135430 663 pod_workers.go:191] Error syncing pod 917984d8-3e49-416e-bb76-594879112f42 ("dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"
Mar 12 00:24:31 old-k8s-version-571339 kubelet[663]: E0312 00:24:31.135197 663 pod_workers.go:191] Error syncing pod f8f3ac0e-3c2e-451d-8e5a-d3937eab4142 ("metrics-server-9975d5f86-c87xf_kube-system(f8f3ac0e-3c2e-451d-8e5a-d3937eab4142)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Mar 12 00:24:35 old-k8s-version-571339 kubelet[663]: I0312 00:24:35.134419 663 scope.go:95] [topologymanager] RemoveContainer - Container ID: d96f9b6b28f75a14646275fa9003956dbbbade5886c46b60dd834a36084849f7
Mar 12 00:24:35 old-k8s-version-571339 kubelet[663]: E0312 00:24:35.134852 663 pod_workers.go:191] Error syncing pod 917984d8-3e49-416e-bb76-594879112f42 ("dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"
Mar 12 00:24:43 old-k8s-version-571339 kubelet[663]: E0312 00:24:43.135594 663 pod_workers.go:191] Error syncing pod f8f3ac0e-3c2e-451d-8e5a-d3937eab4142 ("metrics-server-9975d5f86-c87xf_kube-system(f8f3ac0e-3c2e-451d-8e5a-d3937eab4142)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Mar 12 00:24:47 old-k8s-version-571339 kubelet[663]: I0312 00:24:47.134423 663 scope.go:95] [topologymanager] RemoveContainer - Container ID: d96f9b6b28f75a14646275fa9003956dbbbade5886c46b60dd834a36084849f7
Mar 12 00:24:47 old-k8s-version-571339 kubelet[663]: E0312 00:24:47.134779 663 pod_workers.go:191] Error syncing pod 917984d8-3e49-416e-bb76-594879112f42 ("dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"
Mar 12 00:24:56 old-k8s-version-571339 kubelet[663]: E0312 00:24:56.137730 663 pod_workers.go:191] Error syncing pod f8f3ac0e-3c2e-451d-8e5a-d3937eab4142 ("metrics-server-9975d5f86-c87xf_kube-system(f8f3ac0e-3c2e-451d-8e5a-d3937eab4142)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Mar 12 00:24:59 old-k8s-version-571339 kubelet[663]: I0312 00:24:59.134388 663 scope.go:95] [topologymanager] RemoveContainer - Container ID: d96f9b6b28f75a14646275fa9003956dbbbade5886c46b60dd834a36084849f7
Mar 12 00:24:59 old-k8s-version-571339 kubelet[663]: E0312 00:24:59.134749 663 pod_workers.go:191] Error syncing pod 917984d8-3e49-416e-bb76-594879112f42 ("dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"
Mar 12 00:25:07 old-k8s-version-571339 kubelet[663]: E0312 00:25:07.135133 663 pod_workers.go:191] Error syncing pod f8f3ac0e-3c2e-451d-8e5a-d3937eab4142 ("metrics-server-9975d5f86-c87xf_kube-system(f8f3ac0e-3c2e-451d-8e5a-d3937eab4142)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Mar 12 00:25:10 old-k8s-version-571339 kubelet[663]: I0312 00:25:10.134529 663 scope.go:95] [topologymanager] RemoveContainer - Container ID: d96f9b6b28f75a14646275fa9003956dbbbade5886c46b60dd834a36084849f7
Mar 12 00:25:10 old-k8s-version-571339 kubelet[663]: E0312 00:25:10.134865 663 pod_workers.go:191] Error syncing pod 917984d8-3e49-416e-bb76-594879112f42 ("dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"
Mar 12 00:25:19 old-k8s-version-571339 kubelet[663]: E0312 00:25:19.135515 663 pod_workers.go:191] Error syncing pod f8f3ac0e-3c2e-451d-8e5a-d3937eab4142 ("metrics-server-9975d5f86-c87xf_kube-system(f8f3ac0e-3c2e-451d-8e5a-d3937eab4142)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Mar 12 00:25:22 old-k8s-version-571339 kubelet[663]: I0312 00:25:22.135847 663 scope.go:95] [topologymanager] RemoveContainer - Container ID: d96f9b6b28f75a14646275fa9003956dbbbade5886c46b60dd834a36084849f7
Mar 12 00:25:22 old-k8s-version-571339 kubelet[663]: E0312 00:25:22.136716 663 pod_workers.go:191] Error syncing pod 917984d8-3e49-416e-bb76-594879112f42 ("dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"
Mar 12 00:25:34 old-k8s-version-571339 kubelet[663]: E0312 00:25:34.135529 663 pod_workers.go:191] Error syncing pod f8f3ac0e-3c2e-451d-8e5a-d3937eab4142 ("metrics-server-9975d5f86-c87xf_kube-system(f8f3ac0e-3c2e-451d-8e5a-d3937eab4142)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Mar 12 00:25:37 old-k8s-version-571339 kubelet[663]: I0312 00:25:37.134503 663 scope.go:95] [topologymanager] RemoveContainer - Container ID: d96f9b6b28f75a14646275fa9003956dbbbade5886c46b60dd834a36084849f7
Mar 12 00:25:37 old-k8s-version-571339 kubelet[663]: E0312 00:25:37.134884 663 pod_workers.go:191] Error syncing pod 917984d8-3e49-416e-bb76-594879112f42 ("dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5w7h2_kubernetes-dashboard(917984d8-3e49-416e-bb76-594879112f42)"
==> kubernetes-dashboard [cb775d92b00e5c14170849b1b42ccfd48f3c9d18c9b5da2f8234588eaf4aa2ec] <==
2024/03/12 00:20:21 Using namespace: kubernetes-dashboard
2024/03/12 00:20:21 Using in-cluster config to connect to apiserver
2024/03/12 00:20:21 Using secret token for csrf signing
2024/03/12 00:20:21 Initializing csrf token from kubernetes-dashboard-csrf secret
2024/03/12 00:20:21 Empty token. Generating and storing in a secret kubernetes-dashboard-csrf
2024/03/12 00:20:21 Successful initial request to the apiserver, version: v1.20.0
2024/03/12 00:20:21 Generating JWE encryption key
2024/03/12 00:20:21 New synchronizer has been registered: kubernetes-dashboard-key-holder-kubernetes-dashboard. Starting
2024/03/12 00:20:21 Starting secret synchronizer for kubernetes-dashboard-key-holder in namespace kubernetes-dashboard
2024/03/12 00:20:23 Initializing JWE encryption key from synchronized object
2024/03/12 00:20:23 Creating in-cluster Sidecar client
2024/03/12 00:20:23 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/03/12 00:20:23 Serving insecurely on HTTP port: 9090
2024/03/12 00:20:53 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/03/12 00:21:23 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/03/12 00:21:53 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/03/12 00:22:23 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/03/12 00:22:53 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/03/12 00:23:23 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/03/12 00:23:53 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/03/12 00:24:23 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/03/12 00:24:53 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/03/12 00:25:23 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/03/12 00:20:21 Starting overwatch
==> storage-provisioner [0c3514f843ab806b20582bed37c5a7606b322a3eae956ca0d2a4c8b59c7beb86] <==
I0312 00:19:59.274477 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
F0312 00:20:29.276251 1 main.go:39] error getting server version: Get "https://10.96.0.1:443/version?timeout=32s": dial tcp 10.96.0.1:443: i/o timeout
==> storage-provisioner [98a1386a1a083a30c283c882c4ad3a528364088aba6315aa3bd42ba324436879] <==
I0312 00:20:43.239813 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
I0312 00:20:43.256311 1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
I0312 00:20:43.256518 1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
I0312 00:21:00.749561 1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
I0312 00:21:00.751690 1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_old-k8s-version-571339_e3d1ccc1-62a9-403f-a28e-d96e346a4c93!
I0312 00:21:00.751945 1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"10706e07-fea2-49a4-8ad4-85b3effe5dc7", APIVersion:"v1", ResourceVersion:"842", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' old-k8s-version-571339_e3d1ccc1-62a9-403f-a28e-d96e346a4c93 became leader
I0312 00:21:00.854802 1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_old-k8s-version-571339_e3d1ccc1-62a9-403f-a28e-d96e346a4c93!
-- /stdout --
helpers_test.go:254: (dbg) Run: out/minikube-linux-arm64 status --format={{.APIServer}} -p old-k8s-version-571339 -n old-k8s-version-571339
helpers_test.go:261: (dbg) Run: kubectl --context old-k8s-version-571339 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:272: non-running pods: metrics-server-9975d5f86-c87xf
helpers_test.go:274: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: describe non-running pods <======
helpers_test.go:277: (dbg) Run: kubectl --context old-k8s-version-571339 describe pod metrics-server-9975d5f86-c87xf
helpers_test.go:277: (dbg) Non-zero exit: kubectl --context old-k8s-version-571339 describe pod metrics-server-9975d5f86-c87xf: exit status 1 (101.009872ms)
** stderr **
Error from server (NotFound): pods "metrics-server-9975d5f86-c87xf" not found
** /stderr **
helpers_test.go:279: kubectl --context old-k8s-version-571339 describe pod metrics-server-9975d5f86-c87xf: exit status 1
--- FAIL: TestStartStop/group/old-k8s-version/serial/SecondStart (372.92s)