=== RUN TestStartStop/group/old-k8s-version/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run: out/minikube-linux-arm64 start -p old-k8s-version-716021 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=containerd --kubernetes-version=v1.20.0
E1007 13:46:52.883116 580163 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/18424-574640/.minikube/profiles/functional-389582/client.crt: no such file or directory" logger="UnhandledError"
start_stop_delete_test.go:256: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p old-k8s-version-716021 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=containerd --kubernetes-version=v1.20.0: exit status 80 (6m10.904493623s)
-- stdout --
* [old-k8s-version-716021] minikube v1.34.0 on Ubuntu 20.04 (arm64)
- MINIKUBE_LOCATION=18424
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/18424-574640/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/18424-574640/.minikube
- MINIKUBE_BIN=out/minikube-linux-arm64
- MINIKUBE_FORCE_SYSTEMD=
* Kubernetes 1.31.1 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.31.1
* Using the docker driver based on existing profile
* Starting "old-k8s-version-716021" primary control-plane node in "old-k8s-version-716021" cluster
* Pulling base image v0.0.45-1727731891-master ...
* Restarting existing docker container for "old-k8s-version-716021" ...
* Preparing Kubernetes v1.20.0 on containerd 1.7.22 ...
* Verifying Kubernetes components...
- Using image gcr.io/k8s-minikube/storage-provisioner:v5
- Using image registry.k8s.io/echoserver:1.4
- Using image docker.io/kubernetesui/dashboard:v2.7.0
- Using image fake.domain/registry.k8s.io/echoserver:1.4
* Some dashboard features require the metrics-server addon. To enable all features please run:
minikube -p old-k8s-version-716021 addons enable metrics-server
* Enabled addons: metrics-server, storage-provisioner, dashboard, default-storageclass
-- /stdout --
** stderr **
I1007 13:45:57.694588 788969 out.go:345] Setting OutFile to fd 1 ...
I1007 13:45:57.695224 788969 out.go:392] TERM=,COLORTERM=, which probably does not support color
I1007 13:45:57.695260 788969 out.go:358] Setting ErrFile to fd 2...
I1007 13:45:57.695283 788969 out.go:392] TERM=,COLORTERM=, which probably does not support color
I1007 13:45:57.695575 788969 root.go:338] Updating PATH: /home/jenkins/minikube-integration/18424-574640/.minikube/bin
I1007 13:45:57.696014 788969 out.go:352] Setting JSON to false
I1007 13:45:57.697026 788969 start.go:129] hostinfo: {"hostname":"ip-172-31-24-2","uptime":12507,"bootTime":1728296251,"procs":196,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1070-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"6d436adf-771e-4269-b9a3-c25fd4fca4f5"}
I1007 13:45:57.697139 788969 start.go:139] virtualization:
I1007 13:45:57.700424 788969 out.go:177] * [old-k8s-version-716021] minikube v1.34.0 on Ubuntu 20.04 (arm64)
I1007 13:45:57.703321 788969 out.go:177] - MINIKUBE_LOCATION=18424
I1007 13:45:57.703407 788969 notify.go:220] Checking for updates...
I1007 13:45:57.707732 788969 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I1007 13:45:57.710980 788969 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/18424-574640/kubeconfig
I1007 13:45:57.712779 788969 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/18424-574640/.minikube
I1007 13:45:57.714617 788969 out.go:177] - MINIKUBE_BIN=out/minikube-linux-arm64
I1007 13:45:57.716406 788969 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I1007 13:45:57.718762 788969 config.go:182] Loaded profile config "old-k8s-version-716021": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0
I1007 13:45:57.721151 788969 out.go:177] * Kubernetes 1.31.1 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.31.1
I1007 13:45:57.722853 788969 driver.go:394] Setting default libvirt URI to qemu:///system
I1007 13:45:57.764777 788969 docker.go:123] docker version: linux-27.3.1:Docker Engine - Community
I1007 13:45:57.764910 788969 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I1007 13:45:57.823310 788969 info.go:266] docker info: {ID:J4M5:W6MX:GOX4:4LAQ:VI7E:VJNF:J3OP:OPBH:GF7G:PPY4:WQWD:7N4L Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:50 OomKillDisable:true NGoroutines:67 SystemTime:2024-10-07 13:45:57.809709072 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1070-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:a
arch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214835200 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-24-2 Labels:[] ExperimentalBuild:false ServerVersion:27.3.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c Expected:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c} RuncCommit:{ID:v1.1.14-0-g2c9f560 Expected:v1.1.14-0-g2c9f560} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:[WARNING: bridge
-nf-call-iptables is disabled WARNING: bridge-nf-call-ip6tables is disabled] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.17.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.7]] Warnings:<nil>}}
I1007 13:45:57.823430 788969 docker.go:318] overlay module found
I1007 13:45:57.825499 788969 out.go:177] * Using the docker driver based on existing profile
I1007 13:45:57.827658 788969 start.go:297] selected driver: docker
I1007 13:45:57.827678 788969 start.go:901] validating driver "docker" against &{Name:old-k8s-version-716021 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727731891-master@sha256:d66dfd4a976cf0b4581cac255174cef4031588c4570fa4a795e0b3d42edc9122 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-716021 Namespace:default APIServerHAVIP: A
PIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:f
alse MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I1007 13:45:57.827791 788969 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I1007 13:45:57.828425 788969 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I1007 13:45:57.906885 788969 info.go:266] docker info: {ID:J4M5:W6MX:GOX4:4LAQ:VI7E:VJNF:J3OP:OPBH:GF7G:PPY4:WQWD:7N4L Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:50 OomKillDisable:true NGoroutines:67 SystemTime:2024-10-07 13:45:57.895919244 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1070-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:a
arch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214835200 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-24-2 Labels:[] ExperimentalBuild:false ServerVersion:27.3.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c Expected:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c} RuncCommit:{ID:v1.1.14-0-g2c9f560 Expected:v1.1.14-0-g2c9f560} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:[WARNING: bridge
-nf-call-iptables is disabled WARNING: bridge-nf-call-ip6tables is disabled] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.17.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.7]] Warnings:<nil>}}
I1007 13:45:57.907292 788969 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I1007 13:45:57.907331 788969 cni.go:84] Creating CNI manager for ""
I1007 13:45:57.907375 788969 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I1007 13:45:57.907426 788969 start.go:340] cluster config:
{Name:old-k8s-version-716021 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727731891-master@sha256:d66dfd4a976cf0b4581cac255174cef4031588c4570fa4a795e0b3d42edc9122 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-716021 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.loca
l ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:d
ocker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I1007 13:45:57.911472 788969 out.go:177] * Starting "old-k8s-version-716021" primary control-plane node in "old-k8s-version-716021" cluster
I1007 13:45:57.913740 788969 cache.go:121] Beginning downloading kic base image for docker with containerd
I1007 13:45:57.916157 788969 out.go:177] * Pulling base image v0.0.45-1727731891-master ...
I1007 13:45:57.918623 788969 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime containerd
I1007 13:45:57.918679 788969 preload.go:146] Found local preload: /home/jenkins/minikube-integration/18424-574640/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-containerd-overlay2-arm64.tar.lz4
I1007 13:45:57.918708 788969 cache.go:56] Caching tarball of preloaded images
I1007 13:45:57.918703 788969 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727731891-master@sha256:d66dfd4a976cf0b4581cac255174cef4031588c4570fa4a795e0b3d42edc9122 in local docker daemon
I1007 13:45:57.918796 788969 preload.go:172] Found /home/jenkins/minikube-integration/18424-574640/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-containerd-overlay2-arm64.tar.lz4 in cache, skipping download
I1007 13:45:57.918815 788969 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on containerd
I1007 13:45:57.918930 788969 profile.go:143] Saving config to /home/jenkins/minikube-integration/18424-574640/.minikube/profiles/old-k8s-version-716021/config.json ...
I1007 13:45:57.949506 788969 image.go:98] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727731891-master@sha256:d66dfd4a976cf0b4581cac255174cef4031588c4570fa4a795e0b3d42edc9122 in local docker daemon, skipping pull
I1007 13:45:57.949527 788969 cache.go:144] gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727731891-master@sha256:d66dfd4a976cf0b4581cac255174cef4031588c4570fa4a795e0b3d42edc9122 exists in daemon, skipping load
I1007 13:45:57.949541 788969 cache.go:194] Successfully downloaded all kic artifacts
I1007 13:45:57.949563 788969 start.go:360] acquireMachinesLock for old-k8s-version-716021: {Name:mk12f5339910ed66eeb98e377e7821a911147d6d Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1007 13:45:57.949616 788969 start.go:364] duration metric: took 36.118µs to acquireMachinesLock for "old-k8s-version-716021"
I1007 13:45:57.949635 788969 start.go:96] Skipping create...Using existing machine configuration
I1007 13:45:57.949648 788969 fix.go:54] fixHost starting:
I1007 13:45:57.949948 788969 cli_runner.go:164] Run: docker container inspect old-k8s-version-716021 --format={{.State.Status}}
I1007 13:45:57.979393 788969 fix.go:112] recreateIfNeeded on old-k8s-version-716021: state=Stopped err=<nil>
W1007 13:45:57.979427 788969 fix.go:138] unexpected machine state, will restart: <nil>
I1007 13:45:57.981762 788969 out.go:177] * Restarting existing docker container for "old-k8s-version-716021" ...
I1007 13:45:57.983921 788969 cli_runner.go:164] Run: docker start old-k8s-version-716021
I1007 13:45:58.374372 788969 cli_runner.go:164] Run: docker container inspect old-k8s-version-716021 --format={{.State.Status}}
I1007 13:45:58.395803 788969 kic.go:430] container "old-k8s-version-716021" state is running.
I1007 13:45:58.396184 788969 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-716021
I1007 13:45:58.429981 788969 profile.go:143] Saving config to /home/jenkins/minikube-integration/18424-574640/.minikube/profiles/old-k8s-version-716021/config.json ...
I1007 13:45:58.430206 788969 machine.go:93] provisionDockerMachine start ...
I1007 13:45:58.430273 788969 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-716021
I1007 13:45:58.459315 788969 main.go:141] libmachine: Using SSH client type: native
I1007 13:45:58.459577 788969 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x413c00] 0x416440 <nil> [] 0s} 127.0.0.1 33799 <nil> <nil>}
I1007 13:45:58.459586 788969 main.go:141] libmachine: About to run SSH command:
hostname
I1007 13:45:58.460372 788969 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:47400->127.0.0.1:33799: read: connection reset by peer
I1007 13:46:01.605211 788969 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-716021
I1007 13:46:01.605260 788969 ubuntu.go:169] provisioning hostname "old-k8s-version-716021"
I1007 13:46:01.605346 788969 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-716021
I1007 13:46:01.627334 788969 main.go:141] libmachine: Using SSH client type: native
I1007 13:46:01.627583 788969 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x413c00] 0x416440 <nil> [] 0s} 127.0.0.1 33799 <nil> <nil>}
I1007 13:46:01.627595 788969 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-716021 && echo "old-k8s-version-716021" | sudo tee /etc/hostname
I1007 13:46:01.787381 788969 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-716021
I1007 13:46:01.787550 788969 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-716021
I1007 13:46:01.809729 788969 main.go:141] libmachine: Using SSH client type: native
I1007 13:46:01.809984 788969 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x413c00] 0x416440 <nil> [] 0s} 127.0.0.1 33799 <nil> <nil>}
I1007 13:46:01.810001 788969 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-716021' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-716021/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-716021' | sudo tee -a /etc/hosts;
fi
fi
I1007 13:46:01.954248 788969 main.go:141] libmachine: SSH cmd err, output: <nil>:
I1007 13:46:01.954279 788969 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/18424-574640/.minikube CaCertPath:/home/jenkins/minikube-integration/18424-574640/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/18424-574640/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/18424-574640/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/18424-574640/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/18424-574640/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/18424-574640/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/18424-574640/.minikube}
I1007 13:46:01.954319 788969 ubuntu.go:177] setting up certificates
I1007 13:46:01.954331 788969 provision.go:84] configureAuth start
I1007 13:46:01.954449 788969 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-716021
I1007 13:46:01.976401 788969 provision.go:143] copyHostCerts
I1007 13:46:01.976488 788969 exec_runner.go:144] found /home/jenkins/minikube-integration/18424-574640/.minikube/ca.pem, removing ...
I1007 13:46:01.976502 788969 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18424-574640/.minikube/ca.pem
I1007 13:46:01.976576 788969 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18424-574640/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/18424-574640/.minikube/ca.pem (1082 bytes)
I1007 13:46:01.976683 788969 exec_runner.go:144] found /home/jenkins/minikube-integration/18424-574640/.minikube/cert.pem, removing ...
I1007 13:46:01.976695 788969 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18424-574640/.minikube/cert.pem
I1007 13:46:01.976725 788969 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18424-574640/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/18424-574640/.minikube/cert.pem (1123 bytes)
I1007 13:46:01.976785 788969 exec_runner.go:144] found /home/jenkins/minikube-integration/18424-574640/.minikube/key.pem, removing ...
I1007 13:46:01.976793 788969 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18424-574640/.minikube/key.pem
I1007 13:46:01.976820 788969 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18424-574640/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/18424-574640/.minikube/key.pem (1679 bytes)
I1007 13:46:01.976872 788969 provision.go:117] generating server cert: /home/jenkins/minikube-integration/18424-574640/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/18424-574640/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/18424-574640/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-716021 san=[127.0.0.1 192.168.76.2 localhost minikube old-k8s-version-716021]
I1007 13:46:02.520737 788969 provision.go:177] copyRemoteCerts
I1007 13:46:02.520817 788969 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I1007 13:46:02.520862 788969 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-716021
I1007 13:46:02.538709 788969 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33799 SSHKeyPath:/home/jenkins/minikube-integration/18424-574640/.minikube/machines/old-k8s-version-716021/id_rsa Username:docker}
I1007 13:46:02.647679 788969 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18424-574640/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
I1007 13:46:02.676915 788969 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18424-574640/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I1007 13:46:02.705404 788969 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18424-574640/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I1007 13:46:02.733161 788969 provision.go:87] duration metric: took 778.810007ms to configureAuth
I1007 13:46:02.733207 788969 ubuntu.go:193] setting minikube options for container-runtime
I1007 13:46:02.733479 788969 config.go:182] Loaded profile config "old-k8s-version-716021": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0
I1007 13:46:02.733494 788969 machine.go:96] duration metric: took 4.30327257s to provisionDockerMachine
I1007 13:46:02.733503 788969 start.go:293] postStartSetup for "old-k8s-version-716021" (driver="docker")
I1007 13:46:02.733520 788969 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I1007 13:46:02.733589 788969 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I1007 13:46:02.733639 788969 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-716021
I1007 13:46:02.755407 788969 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33799 SSHKeyPath:/home/jenkins/minikube-integration/18424-574640/.minikube/machines/old-k8s-version-716021/id_rsa Username:docker}
I1007 13:46:02.856180 788969 ssh_runner.go:195] Run: cat /etc/os-release
I1007 13:46:02.860090 788969 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I1007 13:46:02.860131 788969 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I1007 13:46:02.860145 788969 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I1007 13:46:02.860157 788969 info.go:137] Remote host: Ubuntu 22.04.5 LTS
I1007 13:46:02.860169 788969 filesync.go:126] Scanning /home/jenkins/minikube-integration/18424-574640/.minikube/addons for local assets ...
I1007 13:46:02.860228 788969 filesync.go:126] Scanning /home/jenkins/minikube-integration/18424-574640/.minikube/files for local assets ...
I1007 13:46:02.860307 788969 filesync.go:149] local asset: /home/jenkins/minikube-integration/18424-574640/.minikube/files/etc/ssl/certs/5801632.pem -> 5801632.pem in /etc/ssl/certs
I1007 13:46:02.860413 788969 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I1007 13:46:02.871150 788969 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18424-574640/.minikube/files/etc/ssl/certs/5801632.pem --> /etc/ssl/certs/5801632.pem (1708 bytes)
I1007 13:46:02.900761 788969 start.go:296] duration metric: took 167.235547ms for postStartSetup
I1007 13:46:02.900856 788969 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I1007 13:46:02.900914 788969 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-716021
I1007 13:46:02.921987 788969 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33799 SSHKeyPath:/home/jenkins/minikube-integration/18424-574640/.minikube/machines/old-k8s-version-716021/id_rsa Username:docker}
I1007 13:46:03.025557 788969 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I1007 13:46:03.031549 788969 fix.go:56] duration metric: took 5.081898539s for fixHost
I1007 13:46:03.031574 788969 start.go:83] releasing machines lock for "old-k8s-version-716021", held for 5.081949337s
I1007 13:46:03.031649 788969 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-716021
I1007 13:46:03.082473 788969 ssh_runner.go:195] Run: cat /version.json
I1007 13:46:03.082530 788969 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-716021
I1007 13:46:03.083016 788969 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I1007 13:46:03.083182 788969 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-716021
I1007 13:46:03.108889 788969 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33799 SSHKeyPath:/home/jenkins/minikube-integration/18424-574640/.minikube/machines/old-k8s-version-716021/id_rsa Username:docker}
I1007 13:46:03.147931 788969 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33799 SSHKeyPath:/home/jenkins/minikube-integration/18424-574640/.minikube/machines/old-k8s-version-716021/id_rsa Username:docker}
I1007 13:46:03.217328 788969 ssh_runner.go:195] Run: systemctl --version
I1007 13:46:03.408287 788969 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I1007 13:46:03.419563 788969 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
I1007 13:46:03.455300 788969 cni.go:230] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
I1007 13:46:03.455379 788969 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I1007 13:46:03.483648 788969 cni.go:259] no active bridge cni configs found in "/etc/cni/net.d" - nothing to disable
I1007 13:46:03.483672 788969 start.go:495] detecting cgroup driver to use...
I1007 13:46:03.483706 788969 detect.go:187] detected "cgroupfs" cgroup driver on host os
I1007 13:46:03.483756 788969 ssh_runner.go:195] Run: sudo systemctl stop -f crio
I1007 13:46:03.546760 788969 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I1007 13:46:03.576131 788969 docker.go:217] disabling cri-docker service (if available) ...
I1007 13:46:03.576208 788969 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I1007 13:46:03.599529 788969 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I1007 13:46:03.615209 788969 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I1007 13:46:03.741109 788969 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I1007 13:46:03.887411 788969 docker.go:233] disabling docker service ...
I1007 13:46:03.887488 788969 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I1007 13:46:03.916072 788969 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I1007 13:46:03.942521 788969 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I1007 13:46:04.100234 788969 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I1007 13:46:04.291244 788969 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I1007 13:46:04.316706 788969 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock
" | sudo tee /etc/crictl.yaml"
I1007 13:46:04.346799 788969 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.2"|' /etc/containerd/config.toml"
I1007 13:46:04.368626 788969 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
I1007 13:46:04.386553 788969 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...
I1007 13:46:04.386631 788969 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
I1007 13:46:04.402588 788969 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I1007 13:46:04.418026 788969 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
I1007 13:46:04.433072 788969 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I1007 13:46:04.447040 788969 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I1007 13:46:04.458708 788969 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
I1007 13:46:04.470956 788969 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I1007 13:46:04.482207 788969 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I1007 13:46:04.492928 788969 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1007 13:46:04.722770 788969 ssh_runner.go:195] Run: sudo systemctl restart containerd
I1007 13:46:04.954793 788969 start.go:542] Will wait 60s for socket path /run/containerd/containerd.sock
I1007 13:46:04.954866 788969 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
I1007 13:46:04.962580 788969 start.go:563] Will wait 60s for crictl version
I1007 13:46:04.962644 788969 ssh_runner.go:195] Run: which crictl
I1007 13:46:04.968084 788969 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I1007 13:46:05.071375 788969 start.go:579] Version: 0.1.0
RuntimeName: containerd
RuntimeVersion: 1.7.22
RuntimeApiVersion: v1
I1007 13:46:05.071454 788969 ssh_runner.go:195] Run: containerd --version
I1007 13:46:05.097125 788969 ssh_runner.go:195] Run: containerd --version
I1007 13:46:05.127117 788969 out.go:177] * Preparing Kubernetes v1.20.0 on containerd 1.7.22 ...
I1007 13:46:05.130041 788969 cli_runner.go:164] Run: docker network inspect old-k8s-version-716021 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I1007 13:46:05.158932 788969 ssh_runner.go:195] Run: grep 192.168.76.1 host.minikube.internal$ /etc/hosts
I1007 13:46:05.163339 788969 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.76.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I1007 13:46:05.180459 788969 kubeadm.go:883] updating cluster {Name:old-k8s-version-716021 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727731891-master@sha256:d66dfd4a976cf0b4581cac255174cef4031588c4570fa4a795e0b3d42edc9122 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-716021 Namespace:default APIServerHAVIP: APIServerName:mini
kubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:
/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I1007 13:46:05.180598 788969 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime containerd
I1007 13:46:05.180657 788969 ssh_runner.go:195] Run: sudo crictl images --output json
I1007 13:46:05.227623 788969 containerd.go:627] all images are preloaded for containerd runtime.
I1007 13:46:05.227651 788969 containerd.go:534] Images already preloaded, skipping extraction
I1007 13:46:05.227717 788969 ssh_runner.go:195] Run: sudo crictl images --output json
I1007 13:46:05.280636 788969 containerd.go:627] all images are preloaded for containerd runtime.
I1007 13:46:05.280657 788969 cache_images.go:84] Images are preloaded, skipping loading
I1007 13:46:05.280665 788969 kubeadm.go:934] updating node { 192.168.76.2 8443 v1.20.0 containerd true true} ...
I1007 13:46:05.280774 788969 kubeadm.go:946] kubelet [Unit]
Wants=containerd.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///run/containerd/containerd.sock --hostname-override=old-k8s-version-716021 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.76.2
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-716021 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I1007 13:46:05.280839 788969 ssh_runner.go:195] Run: sudo crictl info
I1007 13:46:05.342407 788969 cni.go:84] Creating CNI manager for ""
I1007 13:46:05.342430 788969 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I1007 13:46:05.342446 788969 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I1007 13:46:05.342467 788969 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.76.2 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-716021 NodeName:old-k8s-version-716021 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.76.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.76.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt
StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I1007 13:46:05.342596 788969 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.76.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /run/containerd/containerd.sock
name: "old-k8s-version-716021"
kubeletExtraArgs:
node-ip: 192.168.76.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.76.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I1007 13:46:05.342660 788969 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I1007 13:46:05.353056 788969 binaries.go:44] Found k8s binaries, skipping transfer
I1007 13:46:05.353129 788969 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I1007 13:46:05.363154 788969 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (442 bytes)
I1007 13:46:05.383665 788969 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I1007 13:46:05.404121 788969 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2125 bytes)
I1007 13:46:05.425829 788969 ssh_runner.go:195] Run: grep 192.168.76.2 control-plane.minikube.internal$ /etc/hosts
I1007 13:46:05.430038 788969 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.76.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I1007 13:46:05.442204 788969 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1007 13:46:05.556549 788969 ssh_runner.go:195] Run: sudo systemctl start kubelet
I1007 13:46:05.573975 788969 certs.go:68] Setting up /home/jenkins/minikube-integration/18424-574640/.minikube/profiles/old-k8s-version-716021 for IP: 192.168.76.2
I1007 13:46:05.574036 788969 certs.go:194] generating shared ca certs ...
I1007 13:46:05.574076 788969 certs.go:226] acquiring lock for ca certs: {Name:mkb94cd23ae3efb673f2949842bd2c98014816e7 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1007 13:46:05.574263 788969 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/18424-574640/.minikube/ca.key
I1007 13:46:05.574345 788969 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/18424-574640/.minikube/proxy-client-ca.key
I1007 13:46:05.574379 788969 certs.go:256] generating profile certs ...
I1007 13:46:05.574510 788969 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/18424-574640/.minikube/profiles/old-k8s-version-716021/client.key
I1007 13:46:05.574629 788969 certs.go:359] skipping valid signed profile cert regeneration for "minikube": /home/jenkins/minikube-integration/18424-574640/.minikube/profiles/old-k8s-version-716021/apiserver.key.6852896d
I1007 13:46:05.574712 788969 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/18424-574640/.minikube/profiles/old-k8s-version-716021/proxy-client.key
I1007 13:46:05.574957 788969 certs.go:484] found cert: /home/jenkins/minikube-integration/18424-574640/.minikube/certs/580163.pem (1338 bytes)
W1007 13:46:05.575035 788969 certs.go:480] ignoring /home/jenkins/minikube-integration/18424-574640/.minikube/certs/580163_empty.pem, impossibly tiny 0 bytes
I1007 13:46:05.575060 788969 certs.go:484] found cert: /home/jenkins/minikube-integration/18424-574640/.minikube/certs/ca-key.pem (1679 bytes)
I1007 13:46:05.575132 788969 certs.go:484] found cert: /home/jenkins/minikube-integration/18424-574640/.minikube/certs/ca.pem (1082 bytes)
I1007 13:46:05.575191 788969 certs.go:484] found cert: /home/jenkins/minikube-integration/18424-574640/.minikube/certs/cert.pem (1123 bytes)
I1007 13:46:05.575255 788969 certs.go:484] found cert: /home/jenkins/minikube-integration/18424-574640/.minikube/certs/key.pem (1679 bytes)
I1007 13:46:05.575339 788969 certs.go:484] found cert: /home/jenkins/minikube-integration/18424-574640/.minikube/files/etc/ssl/certs/5801632.pem (1708 bytes)
I1007 13:46:05.576219 788969 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18424-574640/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I1007 13:46:05.663591 788969 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18424-574640/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I1007 13:46:05.701394 788969 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18424-574640/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I1007 13:46:05.763635 788969 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18424-574640/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I1007 13:46:05.795049 788969 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18424-574640/.minikube/profiles/old-k8s-version-716021/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I1007 13:46:05.824194 788969 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18424-574640/.minikube/profiles/old-k8s-version-716021/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I1007 13:46:05.851887 788969 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18424-574640/.minikube/profiles/old-k8s-version-716021/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I1007 13:46:05.920055 788969 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18424-574640/.minikube/profiles/old-k8s-version-716021/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I1007 13:46:05.944873 788969 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18424-574640/.minikube/files/etc/ssl/certs/5801632.pem --> /usr/share/ca-certificates/5801632.pem (1708 bytes)
I1007 13:46:05.969261 788969 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18424-574640/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I1007 13:46:05.993900 788969 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18424-574640/.minikube/certs/580163.pem --> /usr/share/ca-certificates/580163.pem (1338 bytes)
I1007 13:46:06.022131 788969 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I1007 13:46:06.044232 788969 ssh_runner.go:195] Run: openssl version
I1007 13:46:06.051104 788969 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/5801632.pem && ln -fs /usr/share/ca-certificates/5801632.pem /etc/ssl/certs/5801632.pem"
I1007 13:46:06.061762 788969 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/5801632.pem
I1007 13:46:06.066240 788969 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Oct 7 13:06 /usr/share/ca-certificates/5801632.pem
I1007 13:46:06.066333 788969 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/5801632.pem
I1007 13:46:06.074548 788969 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/5801632.pem /etc/ssl/certs/3ec20f2e.0"
I1007 13:46:06.090960 788969 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I1007 13:46:06.104109 788969 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I1007 13:46:06.108723 788969 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Oct 7 12:56 /usr/share/ca-certificates/minikubeCA.pem
I1007 13:46:06.108826 788969 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I1007 13:46:06.117522 788969 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I1007 13:46:06.128201 788969 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/580163.pem && ln -fs /usr/share/ca-certificates/580163.pem /etc/ssl/certs/580163.pem"
I1007 13:46:06.141805 788969 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/580163.pem
I1007 13:46:06.146629 788969 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Oct 7 13:06 /usr/share/ca-certificates/580163.pem
I1007 13:46:06.146733 788969 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/580163.pem
I1007 13:46:06.154918 788969 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/580163.pem /etc/ssl/certs/51391683.0"
I1007 13:46:06.164445 788969 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I1007 13:46:06.168827 788969 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
I1007 13:46:06.176731 788969 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
I1007 13:46:06.184583 788969 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
I1007 13:46:06.192151 788969 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
I1007 13:46:06.199680 788969 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
I1007 13:46:06.207156 788969 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
I1007 13:46:06.214541 788969 kubeadm.go:392] StartCluster: {Name:old-k8s-version-716021 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727731891-master@sha256:d66dfd4a976cf0b4581cac255174cef4031588c4570fa4a795e0b3d42edc9122 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-716021 Namespace:default APIServerHAVIP: APIServerName:minikub
eCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/ho
me/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I1007 13:46:06.214683 788969 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}
I1007 13:46:06.214771 788969 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I1007 13:46:06.269220 788969 cri.go:89] found id: "fefa6581f4e4cb7fefe7289a78cf684582ea646cd5283484696218c2863765ed"
I1007 13:46:06.269251 788969 cri.go:89] found id: "54c2e6b5d938cc814a93018f032c376c76d65bc1872f0fa55dd63fe950ff317f"
I1007 13:46:06.269256 788969 cri.go:89] found id: "1ee06c3a9952c8c73c2b2a6c861f6a265db79248f4d1cef2824ca7604148d547"
I1007 13:46:06.269260 788969 cri.go:89] found id: "90271f39ba89eca0f9f411179e611fffa8cb7092df3cd7385b2489d67eb7a32d"
I1007 13:46:06.269294 788969 cri.go:89] found id: "3a2ed108143653900fc42a927e9971546f5f58f58c845162e9ad03a74ef4c19f"
I1007 13:46:06.269306 788969 cri.go:89] found id: "6ee84abf1b4464314c9cb9e84d60de9b2b00461bb97fe11808df52c7e0f87771"
I1007 13:46:06.269311 788969 cri.go:89] found id: "dffbe9e7eda4a16ea00f685c861a1d7506d88d6ae76dc1fbd3b528f0186bf960"
I1007 13:46:06.269314 788969 cri.go:89] found id: "3f8d8d7911069dffad8bf7ce9156d34436c105ed532c7439e0b6bda21c43e87c"
I1007 13:46:06.269318 788969 cri.go:89] found id: ""
I1007 13:46:06.269392 788969 ssh_runner.go:195] Run: sudo runc --root /run/containerd/runc/k8s.io list -f json
I1007 13:46:06.283562 788969 cri.go:116] JSON = null
W1007 13:46:06.283645 788969 kubeadm.go:399] unpause failed: list paused: list returned 0 containers, but ps returned 8
I1007 13:46:06.283740 788969 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I1007 13:46:06.293219 788969 kubeadm.go:408] found existing configuration files, will attempt cluster restart
I1007 13:46:06.293237 788969 kubeadm.go:593] restartPrimaryControlPlane start ...
I1007 13:46:06.293288 788969 ssh_runner.go:195] Run: sudo test -d /data/minikube
I1007 13:46:06.301828 788969 kubeadm.go:130] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
stdout:
stderr:
I1007 13:46:06.302315 788969 kubeconfig.go:47] verify endpoint returned: get endpoint: "old-k8s-version-716021" does not appear in /home/jenkins/minikube-integration/18424-574640/kubeconfig
I1007 13:46:06.302490 788969 kubeconfig.go:62] /home/jenkins/minikube-integration/18424-574640/kubeconfig needs updating (will repair): [kubeconfig missing "old-k8s-version-716021" cluster setting kubeconfig missing "old-k8s-version-716021" context setting]
I1007 13:46:06.302958 788969 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18424-574640/kubeconfig: {Name:mk8cb646df388630470eb87db824f7b511497a09 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1007 13:46:06.304288 788969 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
I1007 13:46:06.313992 788969 kubeadm.go:630] The running cluster does not require reconfiguration: 192.168.76.2
I1007 13:46:06.314024 788969 kubeadm.go:597] duration metric: took 20.780537ms to restartPrimaryControlPlane
I1007 13:46:06.314034 788969 kubeadm.go:394] duration metric: took 99.504516ms to StartCluster
I1007 13:46:06.314054 788969 settings.go:142] acquiring lock: {Name:mk8a7c208419d2453ea37ed5e7d0421609f0d046 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1007 13:46:06.314113 788969 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/18424-574640/kubeconfig
I1007 13:46:06.314728 788969 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18424-574640/kubeconfig: {Name:mk8cb646df388630470eb87db824f7b511497a09 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1007 13:46:06.314927 788969 start.go:235] Will wait 6m0s for node &{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}
I1007 13:46:06.315205 788969 config.go:182] Loaded profile config "old-k8s-version-716021": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0
I1007 13:46:06.315254 788969 addons.go:507] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:true default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]
I1007 13:46:06.315318 788969 addons.go:69] Setting storage-provisioner=true in profile "old-k8s-version-716021"
I1007 13:46:06.315333 788969 addons.go:234] Setting addon storage-provisioner=true in "old-k8s-version-716021"
W1007 13:46:06.315340 788969 addons.go:243] addon storage-provisioner should already be in state true
I1007 13:46:06.315361 788969 host.go:66] Checking if "old-k8s-version-716021" exists ...
I1007 13:46:06.315963 788969 cli_runner.go:164] Run: docker container inspect old-k8s-version-716021 --format={{.State.Status}}
I1007 13:46:06.317907 788969 addons.go:69] Setting dashboard=true in profile "old-k8s-version-716021"
I1007 13:46:06.317929 788969 addons.go:234] Setting addon dashboard=true in "old-k8s-version-716021"
W1007 13:46:06.317936 788969 addons.go:243] addon dashboard should already be in state true
I1007 13:46:06.317966 788969 host.go:66] Checking if "old-k8s-version-716021" exists ...
I1007 13:46:06.318434 788969 cli_runner.go:164] Run: docker container inspect old-k8s-version-716021 --format={{.State.Status}}
I1007 13:46:06.318674 788969 addons.go:69] Setting metrics-server=true in profile "old-k8s-version-716021"
I1007 13:46:06.318694 788969 addons.go:234] Setting addon metrics-server=true in "old-k8s-version-716021"
W1007 13:46:06.318701 788969 addons.go:243] addon metrics-server should already be in state true
I1007 13:46:06.318730 788969 host.go:66] Checking if "old-k8s-version-716021" exists ...
I1007 13:46:06.319118 788969 cli_runner.go:164] Run: docker container inspect old-k8s-version-716021 --format={{.State.Status}}
I1007 13:46:06.320627 788969 out.go:177] * Verifying Kubernetes components...
I1007 13:46:06.323240 788969 addons.go:69] Setting default-storageclass=true in profile "old-k8s-version-716021"
I1007 13:46:06.323272 788969 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "old-k8s-version-716021"
I1007 13:46:06.323565 788969 cli_runner.go:164] Run: docker container inspect old-k8s-version-716021 --format={{.State.Status}}
I1007 13:46:06.325012 788969 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1007 13:46:06.361615 788969 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I1007 13:46:06.365645 788969 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner.yaml
I1007 13:46:06.365734 788969 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I1007 13:46:06.365819 788969 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-716021
I1007 13:46:06.376439 788969 out.go:177] - Using image registry.k8s.io/echoserver:1.4
I1007 13:46:06.381815 788969 out.go:177] - Using image docker.io/kubernetesui/dashboard:v2.7.0
I1007 13:46:06.384239 788969 addons.go:431] installing /etc/kubernetes/addons/dashboard-ns.yaml
I1007 13:46:06.384259 788969 ssh_runner.go:362] scp dashboard/dashboard-ns.yaml --> /etc/kubernetes/addons/dashboard-ns.yaml (759 bytes)
I1007 13:46:06.384327 788969 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-716021
I1007 13:46:06.395373 788969 addons.go:234] Setting addon default-storageclass=true in "old-k8s-version-716021"
W1007 13:46:06.395404 788969 addons.go:243] addon default-storageclass should already be in state true
I1007 13:46:06.395429 788969 host.go:66] Checking if "old-k8s-version-716021" exists ...
I1007 13:46:06.395831 788969 cli_runner.go:164] Run: docker container inspect old-k8s-version-716021 --format={{.State.Status}}
I1007 13:46:06.445221 788969 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33799 SSHKeyPath:/home/jenkins/minikube-integration/18424-574640/.minikube/machines/old-k8s-version-716021/id_rsa Username:docker}
I1007 13:46:06.446328 788969 out.go:177] - Using image fake.domain/registry.k8s.io/echoserver:1.4
I1007 13:46:06.448682 788969 addons.go:431] installing /etc/kubernetes/addons/metrics-apiservice.yaml
I1007 13:46:06.448705 788969 ssh_runner.go:362] scp metrics-server/metrics-apiservice.yaml --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
I1007 13:46:06.448787 788969 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-716021
I1007 13:46:06.456194 788969 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33799 SSHKeyPath:/home/jenkins/minikube-integration/18424-574640/.minikube/machines/old-k8s-version-716021/id_rsa Username:docker}
I1007 13:46:06.472945 788969 addons.go:431] installing /etc/kubernetes/addons/storageclass.yaml
I1007 13:46:06.472985 788969 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I1007 13:46:06.473088 788969 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-716021
I1007 13:46:06.473411 788969 ssh_runner.go:195] Run: sudo systemctl start kubelet
I1007 13:46:06.524484 788969 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33799 SSHKeyPath:/home/jenkins/minikube-integration/18424-574640/.minikube/machines/old-k8s-version-716021/id_rsa Username:docker}
I1007 13:46:06.529183 788969 node_ready.go:35] waiting up to 6m0s for node "old-k8s-version-716021" to be "Ready" ...
I1007 13:46:06.552555 788969 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33799 SSHKeyPath:/home/jenkins/minikube-integration/18424-574640/.minikube/machines/old-k8s-version-716021/id_rsa Username:docker}
I1007 13:46:06.600204 788969 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I1007 13:46:06.685585 788969 addons.go:431] installing /etc/kubernetes/addons/dashboard-clusterrole.yaml
I1007 13:46:06.685608 788969 ssh_runner.go:362] scp dashboard/dashboard-clusterrole.yaml --> /etc/kubernetes/addons/dashboard-clusterrole.yaml (1001 bytes)
I1007 13:46:06.728003 788969 addons.go:431] installing /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml
I1007 13:46:06.728078 788969 ssh_runner.go:362] scp dashboard/dashboard-clusterrolebinding.yaml --> /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml (1018 bytes)
I1007 13:46:06.735239 788969 addons.go:431] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
I1007 13:46:06.735315 788969 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1825 bytes)
I1007 13:46:06.798291 788969 addons.go:431] installing /etc/kubernetes/addons/dashboard-configmap.yaml
I1007 13:46:06.798316 788969 ssh_runner.go:362] scp dashboard/dashboard-configmap.yaml --> /etc/kubernetes/addons/dashboard-configmap.yaml (837 bytes)
I1007 13:46:06.798596 788969 addons.go:431] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
I1007 13:46:06.798727 788969 ssh_runner.go:362] scp metrics-server/metrics-server-rbac.yaml --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
I1007 13:46:06.819661 788969 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I1007 13:46:06.891016 788969 addons.go:431] installing /etc/kubernetes/addons/dashboard-dp.yaml
I1007 13:46:06.891036 788969 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-dp.yaml (4201 bytes)
I1007 13:46:06.904443 788969 addons.go:431] installing /etc/kubernetes/addons/metrics-server-service.yaml
I1007 13:46:06.904528 788969 ssh_runner.go:362] scp metrics-server/metrics-server-service.yaml --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
W1007 13:46:06.935870 788969 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1007 13:46:06.935911 788969 retry.go:31] will retry after 261.633317ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1007 13:46:06.959201 788969 addons.go:431] installing /etc/kubernetes/addons/dashboard-role.yaml
I1007 13:46:06.959228 788969 ssh_runner.go:362] scp dashboard/dashboard-role.yaml --> /etc/kubernetes/addons/dashboard-role.yaml (1724 bytes)
I1007 13:46:07.023335 788969 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W1007 13:46:07.037048 788969 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1007 13:46:07.037134 788969 retry.go:31] will retry after 133.972785ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1007 13:46:07.050226 788969 addons.go:431] installing /etc/kubernetes/addons/dashboard-rolebinding.yaml
I1007 13:46:07.050307 788969 ssh_runner.go:362] scp dashboard/dashboard-rolebinding.yaml --> /etc/kubernetes/addons/dashboard-rolebinding.yaml (1046 bytes)
I1007 13:46:07.108363 788969 addons.go:431] installing /etc/kubernetes/addons/dashboard-sa.yaml
I1007 13:46:07.108444 788969 ssh_runner.go:362] scp dashboard/dashboard-sa.yaml --> /etc/kubernetes/addons/dashboard-sa.yaml (837 bytes)
I1007 13:46:07.148807 788969 addons.go:431] installing /etc/kubernetes/addons/dashboard-secret.yaml
I1007 13:46:07.148891 788969 ssh_runner.go:362] scp dashboard/dashboard-secret.yaml --> /etc/kubernetes/addons/dashboard-secret.yaml (1389 bytes)
I1007 13:46:07.171856 788969 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W1007 13:46:07.189820 788969 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1007 13:46:07.189930 788969 retry.go:31] will retry after 354.295601ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1007 13:46:07.198204 788969 addons.go:431] installing /etc/kubernetes/addons/dashboard-svc.yaml
I1007 13:46:07.198286 788969 ssh_runner.go:362] scp dashboard/dashboard-svc.yaml --> /etc/kubernetes/addons/dashboard-svc.yaml (1294 bytes)
I1007 13:46:07.198320 788969 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I1007 13:46:07.294700 788969 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W1007 13:46:07.446215 788969 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1007 13:46:07.446247 788969 retry.go:31] will retry after 551.906217ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W1007 13:46:07.446296 788969 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1007 13:46:07.446302 788969 retry.go:31] will retry after 532.642273ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W1007 13:46:07.504935 788969 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1007 13:46:07.504967 788969 retry.go:31] will retry after 371.680389ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1007 13:46:07.544830 788969 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W1007 13:46:07.650246 788969 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1007 13:46:07.650284 788969 retry.go:31] will retry after 467.621154ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1007 13:46:07.876884 788969 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I1007 13:46:07.979962 788969 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W1007 13:46:07.980957 788969 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1007 13:46:07.980993 788969 retry.go:31] will retry after 257.463197ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1007 13:46:07.998500 788969 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I1007 13:46:08.118493 788969 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W1007 13:46:08.141082 788969 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1007 13:46:08.141118 788969 retry.go:31] will retry after 767.911389ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1007 13:46:08.239279 788969 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W1007 13:46:08.288112 788969 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1007 13:46:08.288154 788969 retry.go:31] will retry after 636.104053ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W1007 13:46:08.438247 788969 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1007 13:46:08.438287 788969 retry.go:31] will retry after 570.751236ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W1007 13:46:08.468973 788969 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1007 13:46:08.469004 788969 retry.go:31] will retry after 353.559317ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1007 13:46:08.530876 788969 node_ready.go:53] error getting node "old-k8s-version-716021": Get "https://192.168.76.2:8443/api/v1/nodes/old-k8s-version-716021": dial tcp 192.168.76.2:8443: connect: connection refused
I1007 13:46:08.823430 788969 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I1007 13:46:08.909786 788969 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W1007 13:46:08.923101 788969 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1007 13:46:08.923133 788969 retry.go:31] will retry after 1.018024514s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1007 13:46:08.925376 788969 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I1007 13:46:09.009669 788969 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W1007 13:46:09.163255 788969 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1007 13:46:09.163286 788969 retry.go:31] will retry after 1.245239285s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W1007 13:46:09.163330 788969 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1007 13:46:09.163338 788969 retry.go:31] will retry after 955.898971ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W1007 13:46:09.233102 788969 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1007 13:46:09.233135 788969 retry.go:31] will retry after 1.263712163s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1007 13:46:09.941433 788969 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W1007 13:46:10.065696 788969 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1007 13:46:10.065731 788969 retry.go:31] will retry after 1.32022848s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1007 13:46:10.120074 788969 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W1007 13:46:10.227377 788969 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1007 13:46:10.227417 788969 retry.go:31] will retry after 731.297685ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1007 13:46:10.409641 788969 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I1007 13:46:10.497166 788969 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W1007 13:46:10.503604 788969 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1007 13:46:10.503642 788969 retry.go:31] will retry after 1.426551085s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W1007 13:46:10.607567 788969 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1007 13:46:10.607605 788969 retry.go:31] will retry after 892.983574ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1007 13:46:10.958912 788969 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I1007 13:46:11.030676 788969 node_ready.go:53] error getting node "old-k8s-version-716021": Get "https://192.168.76.2:8443/api/v1/nodes/old-k8s-version-716021": dial tcp 192.168.76.2:8443: connect: connection refused
W1007 13:46:11.058236 788969 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1007 13:46:11.058266 788969 retry.go:31] will retry after 2.472362831s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1007 13:46:11.386901 788969 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W1007 13:46:11.482369 788969 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1007 13:46:11.482414 788969 retry.go:31] will retry after 2.391254743s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1007 13:46:11.501681 788969 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W1007 13:46:11.610753 788969 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1007 13:46:11.610790 788969 retry.go:31] will retry after 2.662015924s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1007 13:46:11.931359 788969 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W1007 13:46:12.038997 788969 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1007 13:46:12.039046 788969 retry.go:31] will retry after 1.724850441s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1007 13:46:13.529756 788969 node_ready.go:53] error getting node "old-k8s-version-716021": Get "https://192.168.76.2:8443/api/v1/nodes/old-k8s-version-716021": dial tcp 192.168.76.2:8443: connect: connection refused
I1007 13:46:13.530856 788969 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W1007 13:46:13.639787 788969 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1007 13:46:13.639822 788969 retry.go:31] will retry after 3.963151321s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1007 13:46:13.764148 788969 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I1007 13:46:13.874519 788969 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W1007 13:46:13.889095 788969 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1007 13:46:13.889131 788969 retry.go:31] will retry after 1.744963465s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W1007 13:46:13.999476 788969 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1007 13:46:13.999522 788969 retry.go:31] will retry after 2.259482521s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1007 13:46:14.273512 788969 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W1007 13:46:14.385503 788969 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1007 13:46:14.385537 788969 retry.go:31] will retry after 2.257107138s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1007 13:46:15.530151 788969 node_ready.go:53] error getting node "old-k8s-version-716021": Get "https://192.168.76.2:8443/api/v1/nodes/old-k8s-version-716021": dial tcp 192.168.76.2:8443: connect: connection refused
I1007 13:46:15.634256 788969 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W1007 13:46:15.997416 788969 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1007 13:46:15.997446 788969 retry.go:31] will retry after 2.819310108s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I1007 13:46:16.259794 788969 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I1007 13:46:16.642845 788969 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I1007 13:46:17.604138 788969 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I1007 13:46:18.817334 788969 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I1007 13:46:26.030516 788969 node_ready.go:53] error getting node "old-k8s-version-716021": Get "https://192.168.76.2:8443/api/v1/nodes/old-k8s-version-716021": net/http: TLS handshake timeout
I1007 13:46:26.580155 788969 node_ready.go:49] node "old-k8s-version-716021" has status "Ready":"True"
I1007 13:46:26.580227 788969 node_ready.go:38] duration metric: took 20.051002015s for node "old-k8s-version-716021" to be "Ready" ...
I1007 13:46:26.580253 788969 pod_ready.go:36] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I1007 13:46:27.092979 788969 pod_ready.go:79] waiting up to 6m0s for pod "coredns-74ff55c5b-fz8dj" in "kube-system" namespace to be "Ready" ...
I1007 13:46:27.249519 788969 pod_ready.go:93] pod "coredns-74ff55c5b-fz8dj" in "kube-system" namespace has status "Ready":"True"
I1007 13:46:27.249590 788969 pod_ready.go:82] duration metric: took 156.515606ms for pod "coredns-74ff55c5b-fz8dj" in "kube-system" namespace to be "Ready" ...
I1007 13:46:27.249619 788969 pod_ready.go:79] waiting up to 6m0s for pod "etcd-old-k8s-version-716021" in "kube-system" namespace to be "Ready" ...
I1007 13:46:27.296638 788969 pod_ready.go:93] pod "etcd-old-k8s-version-716021" in "kube-system" namespace has status "Ready":"True"
I1007 13:46:27.296720 788969 pod_ready.go:82] duration metric: took 47.080454ms for pod "etcd-old-k8s-version-716021" in "kube-system" namespace to be "Ready" ...
I1007 13:46:27.296752 788969 pod_ready.go:79] waiting up to 6m0s for pod "kube-apiserver-old-k8s-version-716021" in "kube-system" namespace to be "Ready" ...
I1007 13:46:29.312749 788969 pod_ready.go:103] pod "kube-apiserver-old-k8s-version-716021" in "kube-system" namespace has status "Ready":"False"
I1007 13:46:30.571373 788969 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: (14.311461894s)
I1007 13:46:30.571656 788969 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (13.928778686s)
I1007 13:46:30.571841 788969 addons.go:475] Verifying addon metrics-server=true in "old-k8s-version-716021"
I1007 13:46:30.571727 788969 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: (12.967565768s)
I1007 13:46:30.571821 788969 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: (11.754408481s)
I1007 13:46:30.573460 788969 out.go:177] * Some dashboard features require the metrics-server addon. To enable all features please run:
minikube -p old-k8s-version-716021 addons enable metrics-server
I1007 13:46:30.598552 788969 out.go:177] * Enabled addons: metrics-server, storage-provisioner, dashboard, default-storageclass
I1007 13:46:30.600980 788969 addons.go:510] duration metric: took 24.285717237s for enable addons: enabled=[metrics-server storage-provisioner dashboard default-storageclass]
I1007 13:46:31.806981 788969 pod_ready.go:103] pod "kube-apiserver-old-k8s-version-716021" in "kube-system" namespace has status "Ready":"False"
I1007 13:46:33.810705 788969 pod_ready.go:103] pod "kube-apiserver-old-k8s-version-716021" in "kube-system" namespace has status "Ready":"False"
I1007 13:46:36.304379 788969 pod_ready.go:93] pod "kube-apiserver-old-k8s-version-716021" in "kube-system" namespace has status "Ready":"True"
I1007 13:46:36.304451 788969 pod_ready.go:82] duration metric: took 9.007665991s for pod "kube-apiserver-old-k8s-version-716021" in "kube-system" namespace to be "Ready" ...
I1007 13:46:36.304479 788969 pod_ready.go:79] waiting up to 6m0s for pod "kube-controller-manager-old-k8s-version-716021" in "kube-system" namespace to be "Ready" ...
I1007 13:46:38.313068 788969 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-716021" in "kube-system" namespace has status "Ready":"False"
I1007 13:46:40.810765 788969 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-716021" in "kube-system" namespace has status "Ready":"False"
I1007 13:46:43.311100 788969 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-716021" in "kube-system" namespace has status "Ready":"False"
I1007 13:46:45.327161 788969 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-716021" in "kube-system" namespace has status "Ready":"False"
I1007 13:46:47.812665 788969 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-716021" in "kube-system" namespace has status "Ready":"False"
I1007 13:46:50.312343 788969 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-716021" in "kube-system" namespace has status "Ready":"False"
I1007 13:46:52.813812 788969 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-716021" in "kube-system" namespace has status "Ready":"False"
I1007 13:46:55.312032 788969 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-716021" in "kube-system" namespace has status "Ready":"False"
I1007 13:46:57.810669 788969 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-716021" in "kube-system" namespace has status "Ready":"False"
I1007 13:46:59.810779 788969 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-716021" in "kube-system" namespace has status "Ready":"False"
I1007 13:47:01.817163 788969 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-716021" in "kube-system" namespace has status "Ready":"False"
I1007 13:47:04.312106 788969 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-716021" in "kube-system" namespace has status "Ready":"False"
I1007 13:47:06.314767 788969 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-716021" in "kube-system" namespace has status "Ready":"False"
I1007 13:47:08.811500 788969 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-716021" in "kube-system" namespace has status "Ready":"False"
I1007 13:47:10.811668 788969 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-716021" in "kube-system" namespace has status "Ready":"False"
I1007 13:47:12.815043 788969 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-716021" in "kube-system" namespace has status "Ready":"False"
I1007 13:47:14.815102 788969 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-716021" in "kube-system" namespace has status "Ready":"False"
I1007 13:47:17.310444 788969 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-716021" in "kube-system" namespace has status "Ready":"False"
I1007 13:47:19.310986 788969 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-716021" in "kube-system" namespace has status "Ready":"False"
I1007 13:47:21.311478 788969 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-716021" in "kube-system" namespace has status "Ready":"False"
I1007 13:47:23.313778 788969 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-716021" in "kube-system" namespace has status "Ready":"False"
I1007 13:47:25.811416 788969 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-716021" in "kube-system" namespace has status "Ready":"False"
I1007 13:47:27.820147 788969 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-716021" in "kube-system" namespace has status "Ready":"False"
I1007 13:47:29.822185 788969 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-716021" in "kube-system" namespace has status "Ready":"False"
I1007 13:47:32.312523 788969 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-716021" in "kube-system" namespace has status "Ready":"False"
I1007 13:47:34.314786 788969 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-716021" in "kube-system" namespace has status "Ready":"False"
I1007 13:47:36.824207 788969 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-716021" in "kube-system" namespace has status "Ready":"False"
I1007 13:47:39.312769 788969 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-716021" in "kube-system" namespace has status "Ready":"False"
I1007 13:47:41.811539 788969 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-716021" in "kube-system" namespace has status "Ready":"False"
I1007 13:47:43.819839 788969 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-716021" in "kube-system" namespace has status "Ready":"False"
I1007 13:47:46.311911 788969 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-716021" in "kube-system" namespace has status "Ready":"False"
I1007 13:47:48.312191 788969 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-716021" in "kube-system" namespace has status "Ready":"False"
I1007 13:47:50.811830 788969 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-716021" in "kube-system" namespace has status "Ready":"False"
I1007 13:47:53.310894 788969 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-716021" in "kube-system" namespace has status "Ready":"False"
I1007 13:47:55.311229 788969 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-716021" in "kube-system" namespace has status "Ready":"False"
I1007 13:47:56.311516 788969 pod_ready.go:93] pod "kube-controller-manager-old-k8s-version-716021" in "kube-system" namespace has status "Ready":"True"
I1007 13:47:56.311544 788969 pod_ready.go:82] duration metric: took 1m20.007043994s for pod "kube-controller-manager-old-k8s-version-716021" in "kube-system" namespace to be "Ready" ...
I1007 13:47:56.311557 788969 pod_ready.go:79] waiting up to 6m0s for pod "kube-proxy-hdch9" in "kube-system" namespace to be "Ready" ...
I1007 13:47:56.317840 788969 pod_ready.go:93] pod "kube-proxy-hdch9" in "kube-system" namespace has status "Ready":"True"
I1007 13:47:56.317869 788969 pod_ready.go:82] duration metric: took 6.304821ms for pod "kube-proxy-hdch9" in "kube-system" namespace to be "Ready" ...
I1007 13:47:56.317882 788969 pod_ready.go:79] waiting up to 6m0s for pod "kube-scheduler-old-k8s-version-716021" in "kube-system" namespace to be "Ready" ...
I1007 13:47:56.323346 788969 pod_ready.go:93] pod "kube-scheduler-old-k8s-version-716021" in "kube-system" namespace has status "Ready":"True"
I1007 13:47:56.323374 788969 pod_ready.go:82] duration metric: took 5.462529ms for pod "kube-scheduler-old-k8s-version-716021" in "kube-system" namespace to be "Ready" ...
I1007 13:47:56.323387 788969 pod_ready.go:79] waiting up to 6m0s for pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace to be "Ready" ...
I1007 13:47:58.330847 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:48:00.496638 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:48:02.830995 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:48:05.330608 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:48:07.378265 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:48:09.829529 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:48:11.830063 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:48:13.830398 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:48:16.330624 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:48:18.829935 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:48:20.834962 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:48:23.329605 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:48:25.330833 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:48:27.831879 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:48:30.331107 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:48:32.829901 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:48:35.330367 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:48:37.330969 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:48:39.829226 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:48:41.829841 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:48:44.329644 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:48:46.330697 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:48:48.330894 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:48:50.829621 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:48:52.830554 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:48:55.329892 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:48:57.832139 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:49:00.381288 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:49:02.829594 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:49:04.831500 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:49:07.329846 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:49:09.329971 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:49:11.330024 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:49:13.830806 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:49:15.831685 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:49:17.853965 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:49:20.330145 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:49:22.330226 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:49:24.829579 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:49:26.829872 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:49:28.830038 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:49:30.832511 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:49:33.330702 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:49:35.331136 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:49:37.834831 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:49:40.330871 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:49:42.334259 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:49:44.830040 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:49:46.831538 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:49:49.329922 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:49:51.330390 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:49:53.829974 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:49:56.330400 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:49:58.829116 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:50:00.830835 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:50:03.329964 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:50:05.330720 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:50:07.833777 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:50:10.331002 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:50:12.830194 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:50:14.831603 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:50:17.330076 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:50:19.330317 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:50:21.330539 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:50:23.829440 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:50:25.832290 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:50:28.330077 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:50:30.330410 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:50:32.830347 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:50:35.329841 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:50:37.330605 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:50:39.333940 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:50:41.830665 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:50:44.329814 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:50:46.330801 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:50:48.835715 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:50:51.330141 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:50:53.330922 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:50:55.830596 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:50:57.833565 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:51:00.410864 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:51:02.830510 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:51:05.330789 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:51:07.831297 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:51:10.330220 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:51:12.330573 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:51:14.830258 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:51:17.330295 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:51:19.330834 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:51:21.829496 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:51:23.829855 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:51:25.830331 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:51:27.839887 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:51:30.335084 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:51:32.829640 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:51:34.830683 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:51:37.329315 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:51:39.330613 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:51:41.829295 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:51:43.833110 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:51:46.329539 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:51:48.335702 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:51:50.829593 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:51:52.831395 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:51:55.330997 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:51:56.334279 788969 pod_ready.go:82] duration metric: took 4m0.010877247s for pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace to be "Ready" ...
E1007 13:51:56.334361 788969 pod_ready.go:67] WaitExtra: waitPodCondition: context deadline exceeded
I1007 13:51:56.334374 788969 pod_ready.go:39] duration metric: took 5m29.754093121s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I1007 13:51:56.334389 788969 api_server.go:52] waiting for apiserver process to appear ...
I1007 13:51:56.334457 788969 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
I1007 13:51:56.334579 788969 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I1007 13:51:56.412777 788969 cri.go:89] found id: "6438e2a98b44ed7687544147d7fde2facece2b6119ba86ffa996a5b8e7019da7"
I1007 13:51:56.412797 788969 cri.go:89] found id: "dffbe9e7eda4a16ea00f685c861a1d7506d88d6ae76dc1fbd3b528f0186bf960"
I1007 13:51:56.412802 788969 cri.go:89] found id: ""
I1007 13:51:56.412810 788969 logs.go:282] 2 containers: [6438e2a98b44ed7687544147d7fde2facece2b6119ba86ffa996a5b8e7019da7 dffbe9e7eda4a16ea00f685c861a1d7506d88d6ae76dc1fbd3b528f0186bf960]
I1007 13:51:56.412866 788969 ssh_runner.go:195] Run: which crictl
I1007 13:51:56.422463 788969 ssh_runner.go:195] Run: which crictl
I1007 13:51:56.429934 788969 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
I1007 13:51:56.430014 788969 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I1007 13:51:56.500290 788969 cri.go:89] found id: "538e7c613d2fdfcf8bdf655918adbdaa8c80e7d22ee153d71d980bad173f6cd1"
I1007 13:51:56.500315 788969 cri.go:89] found id: "3f8d8d7911069dffad8bf7ce9156d34436c105ed532c7439e0b6bda21c43e87c"
I1007 13:51:56.500320 788969 cri.go:89] found id: ""
I1007 13:51:56.500327 788969 logs.go:282] 2 containers: [538e7c613d2fdfcf8bdf655918adbdaa8c80e7d22ee153d71d980bad173f6cd1 3f8d8d7911069dffad8bf7ce9156d34436c105ed532c7439e0b6bda21c43e87c]
I1007 13:51:56.500384 788969 ssh_runner.go:195] Run: which crictl
I1007 13:51:56.505493 788969 ssh_runner.go:195] Run: which crictl
I1007 13:51:56.511697 788969 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
I1007 13:51:56.511775 788969 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I1007 13:51:56.568360 788969 cri.go:89] found id: "b970f66a7b788465fb1b5efff7470a2a13241205a4b3871615987cd5e8185c0b"
I1007 13:51:56.568387 788969 cri.go:89] found id: "fefa6581f4e4cb7fefe7289a78cf684582ea646cd5283484696218c2863765ed"
I1007 13:51:56.568392 788969 cri.go:89] found id: ""
I1007 13:51:56.568399 788969 logs.go:282] 2 containers: [b970f66a7b788465fb1b5efff7470a2a13241205a4b3871615987cd5e8185c0b fefa6581f4e4cb7fefe7289a78cf684582ea646cd5283484696218c2863765ed]
I1007 13:51:56.568468 788969 ssh_runner.go:195] Run: which crictl
I1007 13:51:56.572933 788969 ssh_runner.go:195] Run: which crictl
I1007 13:51:56.577480 788969 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
I1007 13:51:56.577558 788969 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I1007 13:51:56.637806 788969 cri.go:89] found id: "1e75bdb1fcc164ca7ea09aaa49994e75347b13bbf4549844b1471555f94af297"
I1007 13:51:56.637834 788969 cri.go:89] found id: "3a2ed108143653900fc42a927e9971546f5f58f58c845162e9ad03a74ef4c19f"
I1007 13:51:56.637838 788969 cri.go:89] found id: ""
I1007 13:51:56.637846 788969 logs.go:282] 2 containers: [1e75bdb1fcc164ca7ea09aaa49994e75347b13bbf4549844b1471555f94af297 3a2ed108143653900fc42a927e9971546f5f58f58c845162e9ad03a74ef4c19f]
I1007 13:51:56.637918 788969 ssh_runner.go:195] Run: which crictl
I1007 13:51:56.643411 788969 ssh_runner.go:195] Run: which crictl
I1007 13:51:56.647884 788969 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
I1007 13:51:56.647957 788969 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I1007 13:51:56.750655 788969 cri.go:89] found id: "b47f6084fbcd06d9de3d640a50b2eedabdcfa0e9e99795313dbbf409ba0b34ba"
I1007 13:51:56.750682 788969 cri.go:89] found id: "90271f39ba89eca0f9f411179e611fffa8cb7092df3cd7385b2489d67eb7a32d"
I1007 13:51:56.750687 788969 cri.go:89] found id: ""
I1007 13:51:56.750694 788969 logs.go:282] 2 containers: [b47f6084fbcd06d9de3d640a50b2eedabdcfa0e9e99795313dbbf409ba0b34ba 90271f39ba89eca0f9f411179e611fffa8cb7092df3cd7385b2489d67eb7a32d]
I1007 13:51:56.750755 788969 ssh_runner.go:195] Run: which crictl
I1007 13:51:56.761341 788969 ssh_runner.go:195] Run: which crictl
I1007 13:51:56.767207 788969 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
I1007 13:51:56.767287 788969 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I1007 13:51:56.854493 788969 cri.go:89] found id: "a6e224cfa70000e35a720f8c9ed9661a70147bc5dc65460934496ec9b288fe06"
I1007 13:51:56.854525 788969 cri.go:89] found id: "6ee84abf1b4464314c9cb9e84d60de9b2b00461bb97fe11808df52c7e0f87771"
I1007 13:51:56.854531 788969 cri.go:89] found id: ""
I1007 13:51:56.854538 788969 logs.go:282] 2 containers: [a6e224cfa70000e35a720f8c9ed9661a70147bc5dc65460934496ec9b288fe06 6ee84abf1b4464314c9cb9e84d60de9b2b00461bb97fe11808df52c7e0f87771]
I1007 13:51:56.854606 788969 ssh_runner.go:195] Run: which crictl
I1007 13:51:56.859331 788969 ssh_runner.go:195] Run: which crictl
I1007 13:51:56.863262 788969 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
I1007 13:51:56.863350 788969 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I1007 13:51:56.940414 788969 cri.go:89] found id: "c44e873fb63063161eea0a9a33fcb424a1fca04659773868480c9079f14fcde3"
I1007 13:51:56.940437 788969 cri.go:89] found id: "54c2e6b5d938cc814a93018f032c376c76d65bc1872f0fa55dd63fe950ff317f"
I1007 13:51:56.940442 788969 cri.go:89] found id: ""
I1007 13:51:56.940450 788969 logs.go:282] 2 containers: [c44e873fb63063161eea0a9a33fcb424a1fca04659773868480c9079f14fcde3 54c2e6b5d938cc814a93018f032c376c76d65bc1872f0fa55dd63fe950ff317f]
I1007 13:51:56.940513 788969 ssh_runner.go:195] Run: which crictl
I1007 13:51:56.946919 788969 ssh_runner.go:195] Run: which crictl
I1007 13:51:56.951803 788969 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
I1007 13:51:56.951885 788969 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I1007 13:51:57.012766 788969 cri.go:89] found id: "02588bae23d099926c85f07f669f2281dd82887c6cda051d44c64293d25ce608"
I1007 13:51:57.012792 788969 cri.go:89] found id: ""
I1007 13:51:57.012800 788969 logs.go:282] 1 containers: [02588bae23d099926c85f07f669f2281dd82887c6cda051d44c64293d25ce608]
I1007 13:51:57.012863 788969 ssh_runner.go:195] Run: which crictl
I1007 13:51:57.017491 788969 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
I1007 13:51:57.017580 788969 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I1007 13:51:57.075862 788969 cri.go:89] found id: "94f42c6c49fd89fb1387486b3bfb41e7d9ad24f923a9cbfb3757cab9ba0d589c"
I1007 13:51:57.075894 788969 cri.go:89] found id: "3e11e0da9f75ad4dd8fcceb6b095c49ccfce3438e6b64b5adf91722fb701d656"
I1007 13:51:57.075899 788969 cri.go:89] found id: ""
I1007 13:51:57.075906 788969 logs.go:282] 2 containers: [94f42c6c49fd89fb1387486b3bfb41e7d9ad24f923a9cbfb3757cab9ba0d589c 3e11e0da9f75ad4dd8fcceb6b095c49ccfce3438e6b64b5adf91722fb701d656]
I1007 13:51:57.075967 788969 ssh_runner.go:195] Run: which crictl
I1007 13:51:57.081400 788969 ssh_runner.go:195] Run: which crictl
I1007 13:51:57.085944 788969 logs.go:123] Gathering logs for containerd ...
I1007 13:51:57.085968 788969 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
I1007 13:51:57.162686 788969 logs.go:123] Gathering logs for dmesg ...
I1007 13:51:57.162733 788969 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I1007 13:51:57.179955 788969 logs.go:123] Gathering logs for kube-controller-manager [6ee84abf1b4464314c9cb9e84d60de9b2b00461bb97fe11808df52c7e0f87771] ...
I1007 13:51:57.179991 788969 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 6ee84abf1b4464314c9cb9e84d60de9b2b00461bb97fe11808df52c7e0f87771"
I1007 13:51:57.306063 788969 logs.go:123] Gathering logs for etcd [3f8d8d7911069dffad8bf7ce9156d34436c105ed532c7439e0b6bda21c43e87c] ...
I1007 13:51:57.306099 788969 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 3f8d8d7911069dffad8bf7ce9156d34436c105ed532c7439e0b6bda21c43e87c"
I1007 13:51:57.357347 788969 logs.go:123] Gathering logs for coredns [fefa6581f4e4cb7fefe7289a78cf684582ea646cd5283484696218c2863765ed] ...
I1007 13:51:57.357378 788969 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 fefa6581f4e4cb7fefe7289a78cf684582ea646cd5283484696218c2863765ed"
I1007 13:51:57.419970 788969 logs.go:123] Gathering logs for kube-controller-manager [a6e224cfa70000e35a720f8c9ed9661a70147bc5dc65460934496ec9b288fe06] ...
I1007 13:51:57.420003 788969 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 a6e224cfa70000e35a720f8c9ed9661a70147bc5dc65460934496ec9b288fe06"
I1007 13:51:57.497427 788969 logs.go:123] Gathering logs for kubelet ...
I1007 13:51:57.497465 788969 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W1007 13:51:57.558680 788969 logs.go:138] Found kubelet problem: Oct 07 13:46:26 old-k8s-version-716021 kubelet[666]: E1007 13:46:26.808783 666 reflector.go:138] object-"kube-system"/"coredns": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:old-k8s-version-716021" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-716021' and this object
W1007 13:51:57.559023 788969 logs.go:138] Found kubelet problem: Oct 07 13:46:26 old-k8s-version-716021 kubelet[666]: E1007 13:46:26.854809 666 reflector.go:138] object-"kube-system"/"kube-proxy-token-85z2f": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kube-proxy-token-85z2f" is forbidden: User "system:node:old-k8s-version-716021" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-716021' and this object
W1007 13:51:57.562387 788969 logs.go:138] Found kubelet problem: Oct 07 13:46:26 old-k8s-version-716021 kubelet[666]: E1007 13:46:26.856421 666 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:old-k8s-version-716021" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-716021' and this object
W1007 13:51:57.562607 788969 logs.go:138] Found kubelet problem: Oct 07 13:46:26 old-k8s-version-716021 kubelet[666]: E1007 13:46:26.856819 666 reflector.go:138] object-"kube-system"/"coredns-token-kp44b": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "coredns-token-kp44b" is forbidden: User "system:node:old-k8s-version-716021" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-716021' and this object
W1007 13:51:57.567093 788969 logs.go:138] Found kubelet problem: Oct 07 13:46:28 old-k8s-version-716021 kubelet[666]: E1007 13:46:28.915071 666 pod_workers.go:191] Error syncing pod 184eab58-b771-4e54-8c7c-46985955b403 ("metrics-server-9975d5f86-b7ct2_kube-system(184eab58-b771-4e54-8c7c-46985955b403)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W1007 13:51:57.567283 788969 logs.go:138] Found kubelet problem: Oct 07 13:46:29 old-k8s-version-716021 kubelet[666]: E1007 13:46:29.091904 666 pod_workers.go:191] Error syncing pod 184eab58-b771-4e54-8c7c-46985955b403 ("metrics-server-9975d5f86-b7ct2_kube-system(184eab58-b771-4e54-8c7c-46985955b403)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1007 13:51:57.570040 788969 logs.go:138] Found kubelet problem: Oct 07 13:46:43 old-k8s-version-716021 kubelet[666]: E1007 13:46:43.213529 666 pod_workers.go:191] Error syncing pod 184eab58-b771-4e54-8c7c-46985955b403 ("metrics-server-9975d5f86-b7ct2_kube-system(184eab58-b771-4e54-8c7c-46985955b403)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W1007 13:51:57.571971 788969 logs.go:138] Found kubelet problem: Oct 07 13:46:51 old-k8s-version-716021 kubelet[666]: E1007 13:46:51.378418 666 pod_workers.go:191] Error syncing pod d8c979bf-7b30-4283-aaeb-85e8808af24f ("dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"
W1007 13:51:57.572429 788969 logs.go:138] Found kubelet problem: Oct 07 13:46:52 old-k8s-version-716021 kubelet[666]: E1007 13:46:52.384192 666 pod_workers.go:191] Error syncing pod d8c979bf-7b30-4283-aaeb-85e8808af24f ("dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"
W1007 13:51:57.572755 788969 logs.go:138] Found kubelet problem: Oct 07 13:46:53 old-k8s-version-716021 kubelet[666]: E1007 13:46:53.386690 666 pod_workers.go:191] Error syncing pod d8c979bf-7b30-4283-aaeb-85e8808af24f ("dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"
W1007 13:51:57.573266 788969 logs.go:138] Found kubelet problem: Oct 07 13:46:57 old-k8s-version-716021 kubelet[666]: E1007 13:46:57.207180 666 pod_workers.go:191] Error syncing pod 184eab58-b771-4e54-8c7c-46985955b403 ("metrics-server-9975d5f86-b7ct2_kube-system(184eab58-b771-4e54-8c7c-46985955b403)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1007 13:51:57.573720 788969 logs.go:138] Found kubelet problem: Oct 07 13:47:01 old-k8s-version-716021 kubelet[666]: E1007 13:47:01.413751 666 pod_workers.go:191] Error syncing pod 4cfcc06f-69c5-42d6-bb20-67a3d942cfb0 ("storage-provisioner_kube-system(4cfcc06f-69c5-42d6-bb20-67a3d942cfb0)"), skipping: failed to "StartContainer" for "storage-provisioner" with CrashLoopBackOff: "back-off 10s restarting failed container=storage-provisioner pod=storage-provisioner_kube-system(4cfcc06f-69c5-42d6-bb20-67a3d942cfb0)"
W1007 13:51:57.574645 788969 logs.go:138] Found kubelet problem: Oct 07 13:47:05 old-k8s-version-716021 kubelet[666]: E1007 13:47:05.430539 666 pod_workers.go:191] Error syncing pod d8c979bf-7b30-4283-aaeb-85e8808af24f ("dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"
W1007 13:51:57.577065 788969 logs.go:138] Found kubelet problem: Oct 07 13:47:09 old-k8s-version-716021 kubelet[666]: E1007 13:47:09.218614 666 pod_workers.go:191] Error syncing pod 184eab58-b771-4e54-8c7c-46985955b403 ("metrics-server-9975d5f86-b7ct2_kube-system(184eab58-b771-4e54-8c7c-46985955b403)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W1007 13:51:57.577392 788969 logs.go:138] Found kubelet problem: Oct 07 13:47:12 old-k8s-version-716021 kubelet[666]: E1007 13:47:12.186154 666 pod_workers.go:191] Error syncing pod d8c979bf-7b30-4283-aaeb-85e8808af24f ("dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"
W1007 13:51:57.577711 788969 logs.go:138] Found kubelet problem: Oct 07 13:47:23 old-k8s-version-716021 kubelet[666]: E1007 13:47:23.206886 666 pod_workers.go:191] Error syncing pod 184eab58-b771-4e54-8c7c-46985955b403 ("metrics-server-9975d5f86-b7ct2_kube-system(184eab58-b771-4e54-8c7c-46985955b403)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1007 13:51:57.578040 788969 logs.go:138] Found kubelet problem: Oct 07 13:47:24 old-k8s-version-716021 kubelet[666]: E1007 13:47:24.209098 666 pod_workers.go:191] Error syncing pod d8c979bf-7b30-4283-aaeb-85e8808af24f ("dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"
W1007 13:51:57.578224 788969 logs.go:138] Found kubelet problem: Oct 07 13:47:34 old-k8s-version-716021 kubelet[666]: E1007 13:47:34.211370 666 pod_workers.go:191] Error syncing pod 184eab58-b771-4e54-8c7c-46985955b403 ("metrics-server-9975d5f86-b7ct2_kube-system(184eab58-b771-4e54-8c7c-46985955b403)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1007 13:51:57.578812 788969 logs.go:138] Found kubelet problem: Oct 07 13:47:40 old-k8s-version-716021 kubelet[666]: E1007 13:47:40.564455 666 pod_workers.go:191] Error syncing pod d8c979bf-7b30-4283-aaeb-85e8808af24f ("dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"
W1007 13:51:57.579137 788969 logs.go:138] Found kubelet problem: Oct 07 13:47:42 old-k8s-version-716021 kubelet[666]: E1007 13:47:42.186663 666 pod_workers.go:191] Error syncing pod d8c979bf-7b30-4283-aaeb-85e8808af24f ("dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"
W1007 13:51:57.579319 788969 logs.go:138] Found kubelet problem: Oct 07 13:47:47 old-k8s-version-716021 kubelet[666]: E1007 13:47:47.209688 666 pod_workers.go:191] Error syncing pod 184eab58-b771-4e54-8c7c-46985955b403 ("metrics-server-9975d5f86-b7ct2_kube-system(184eab58-b771-4e54-8c7c-46985955b403)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1007 13:51:57.579644 788969 logs.go:138] Found kubelet problem: Oct 07 13:47:54 old-k8s-version-716021 kubelet[666]: E1007 13:47:54.207353 666 pod_workers.go:191] Error syncing pod d8c979bf-7b30-4283-aaeb-85e8808af24f ("dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"
W1007 13:51:57.582062 788969 logs.go:138] Found kubelet problem: Oct 07 13:47:59 old-k8s-version-716021 kubelet[666]: E1007 13:47:59.222600 666 pod_workers.go:191] Error syncing pod 184eab58-b771-4e54-8c7c-46985955b403 ("metrics-server-9975d5f86-b7ct2_kube-system(184eab58-b771-4e54-8c7c-46985955b403)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W1007 13:51:57.582424 788969 logs.go:138] Found kubelet problem: Oct 07 13:48:07 old-k8s-version-716021 kubelet[666]: E1007 13:48:07.206479 666 pod_workers.go:191] Error syncing pod d8c979bf-7b30-4283-aaeb-85e8808af24f ("dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"
W1007 13:51:57.582648 788969 logs.go:138] Found kubelet problem: Oct 07 13:48:12 old-k8s-version-716021 kubelet[666]: E1007 13:48:12.222632 666 pod_workers.go:191] Error syncing pod 184eab58-b771-4e54-8c7c-46985955b403 ("metrics-server-9975d5f86-b7ct2_kube-system(184eab58-b771-4e54-8c7c-46985955b403)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1007 13:51:57.583311 788969 logs.go:138] Found kubelet problem: Oct 07 13:48:20 old-k8s-version-716021 kubelet[666]: E1007 13:48:20.682098 666 pod_workers.go:191] Error syncing pod d8c979bf-7b30-4283-aaeb-85e8808af24f ("dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"
W1007 13:51:57.583698 788969 logs.go:138] Found kubelet problem: Oct 07 13:48:22 old-k8s-version-716021 kubelet[666]: E1007 13:48:22.186594 666 pod_workers.go:191] Error syncing pod d8c979bf-7b30-4283-aaeb-85e8808af24f ("dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"
W1007 13:51:57.583912 788969 logs.go:138] Found kubelet problem: Oct 07 13:48:23 old-k8s-version-716021 kubelet[666]: E1007 13:48:23.206902 666 pod_workers.go:191] Error syncing pod 184eab58-b771-4e54-8c7c-46985955b403 ("metrics-server-9975d5f86-b7ct2_kube-system(184eab58-b771-4e54-8c7c-46985955b403)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1007 13:51:57.584114 788969 logs.go:138] Found kubelet problem: Oct 07 13:48:35 old-k8s-version-716021 kubelet[666]: E1007 13:48:35.206832 666 pod_workers.go:191] Error syncing pod 184eab58-b771-4e54-8c7c-46985955b403 ("metrics-server-9975d5f86-b7ct2_kube-system(184eab58-b771-4e54-8c7c-46985955b403)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1007 13:51:57.584442 788969 logs.go:138] Found kubelet problem: Oct 07 13:48:36 old-k8s-version-716021 kubelet[666]: E1007 13:48:36.206609 666 pod_workers.go:191] Error syncing pod d8c979bf-7b30-4283-aaeb-85e8808af24f ("dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"
W1007 13:51:57.584626 788969 logs.go:138] Found kubelet problem: Oct 07 13:48:46 old-k8s-version-716021 kubelet[666]: E1007 13:48:46.206819 666 pod_workers.go:191] Error syncing pod 184eab58-b771-4e54-8c7c-46985955b403 ("metrics-server-9975d5f86-b7ct2_kube-system(184eab58-b771-4e54-8c7c-46985955b403)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1007 13:51:57.584987 788969 logs.go:138] Found kubelet problem: Oct 07 13:48:49 old-k8s-version-716021 kubelet[666]: E1007 13:48:49.206451 666 pod_workers.go:191] Error syncing pod d8c979bf-7b30-4283-aaeb-85e8808af24f ("dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"
W1007 13:51:57.585172 788969 logs.go:138] Found kubelet problem: Oct 07 13:49:01 old-k8s-version-716021 kubelet[666]: E1007 13:49:01.206862 666 pod_workers.go:191] Error syncing pod 184eab58-b771-4e54-8c7c-46985955b403 ("metrics-server-9975d5f86-b7ct2_kube-system(184eab58-b771-4e54-8c7c-46985955b403)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1007 13:51:57.585505 788969 logs.go:138] Found kubelet problem: Oct 07 13:49:04 old-k8s-version-716021 kubelet[666]: E1007 13:49:04.210397 666 pod_workers.go:191] Error syncing pod d8c979bf-7b30-4283-aaeb-85e8808af24f ("dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"
W1007 13:51:57.585696 788969 logs.go:138] Found kubelet problem: Oct 07 13:49:16 old-k8s-version-716021 kubelet[666]: E1007 13:49:16.206769 666 pod_workers.go:191] Error syncing pod 184eab58-b771-4e54-8c7c-46985955b403 ("metrics-server-9975d5f86-b7ct2_kube-system(184eab58-b771-4e54-8c7c-46985955b403)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1007 13:51:57.586043 788969 logs.go:138] Found kubelet problem: Oct 07 13:49:19 old-k8s-version-716021 kubelet[666]: E1007 13:49:19.206428 666 pod_workers.go:191] Error syncing pod d8c979bf-7b30-4283-aaeb-85e8808af24f ("dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"
W1007 13:51:57.588462 788969 logs.go:138] Found kubelet problem: Oct 07 13:49:30 old-k8s-version-716021 kubelet[666]: E1007 13:49:30.231019 666 pod_workers.go:191] Error syncing pod 184eab58-b771-4e54-8c7c-46985955b403 ("metrics-server-9975d5f86-b7ct2_kube-system(184eab58-b771-4e54-8c7c-46985955b403)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W1007 13:51:57.588788 788969 logs.go:138] Found kubelet problem: Oct 07 13:49:31 old-k8s-version-716021 kubelet[666]: E1007 13:49:31.206480 666 pod_workers.go:191] Error syncing pod d8c979bf-7b30-4283-aaeb-85e8808af24f ("dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"
W1007 13:51:57.588970 788969 logs.go:138] Found kubelet problem: Oct 07 13:49:45 old-k8s-version-716021 kubelet[666]: E1007 13:49:45.207213 666 pod_workers.go:191] Error syncing pod 184eab58-b771-4e54-8c7c-46985955b403 ("metrics-server-9975d5f86-b7ct2_kube-system(184eab58-b771-4e54-8c7c-46985955b403)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1007 13:51:57.589558 788969 logs.go:138] Found kubelet problem: Oct 07 13:49:46 old-k8s-version-716021 kubelet[666]: E1007 13:49:46.907884 666 pod_workers.go:191] Error syncing pod d8c979bf-7b30-4283-aaeb-85e8808af24f ("dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"
W1007 13:51:57.589896 788969 logs.go:138] Found kubelet problem: Oct 07 13:49:52 old-k8s-version-716021 kubelet[666]: E1007 13:49:52.187043 666 pod_workers.go:191] Error syncing pod d8c979bf-7b30-4283-aaeb-85e8808af24f ("dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"
W1007 13:51:57.590078 788969 logs.go:138] Found kubelet problem: Oct 07 13:49:57 old-k8s-version-716021 kubelet[666]: E1007 13:49:57.214713 666 pod_workers.go:191] Error syncing pod 184eab58-b771-4e54-8c7c-46985955b403 ("metrics-server-9975d5f86-b7ct2_kube-system(184eab58-b771-4e54-8c7c-46985955b403)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1007 13:51:57.590404 788969 logs.go:138] Found kubelet problem: Oct 07 13:50:05 old-k8s-version-716021 kubelet[666]: E1007 13:50:05.206555 666 pod_workers.go:191] Error syncing pod d8c979bf-7b30-4283-aaeb-85e8808af24f ("dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"
W1007 13:51:57.590593 788969 logs.go:138] Found kubelet problem: Oct 07 13:50:08 old-k8s-version-716021 kubelet[666]: E1007 13:50:08.211199 666 pod_workers.go:191] Error syncing pod 184eab58-b771-4e54-8c7c-46985955b403 ("metrics-server-9975d5f86-b7ct2_kube-system(184eab58-b771-4e54-8c7c-46985955b403)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1007 13:51:57.590918 788969 logs.go:138] Found kubelet problem: Oct 07 13:50:17 old-k8s-version-716021 kubelet[666]: E1007 13:50:17.206916 666 pod_workers.go:191] Error syncing pod d8c979bf-7b30-4283-aaeb-85e8808af24f ("dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"
W1007 13:51:57.591102 788969 logs.go:138] Found kubelet problem: Oct 07 13:50:19 old-k8s-version-716021 kubelet[666]: E1007 13:50:19.206748 666 pod_workers.go:191] Error syncing pod 184eab58-b771-4e54-8c7c-46985955b403 ("metrics-server-9975d5f86-b7ct2_kube-system(184eab58-b771-4e54-8c7c-46985955b403)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1007 13:51:57.591430 788969 logs.go:138] Found kubelet problem: Oct 07 13:50:28 old-k8s-version-716021 kubelet[666]: E1007 13:50:28.207831 666 pod_workers.go:191] Error syncing pod d8c979bf-7b30-4283-aaeb-85e8808af24f ("dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"
W1007 13:51:57.591612 788969 logs.go:138] Found kubelet problem: Oct 07 13:50:30 old-k8s-version-716021 kubelet[666]: E1007 13:50:30.211659 666 pod_workers.go:191] Error syncing pod 184eab58-b771-4e54-8c7c-46985955b403 ("metrics-server-9975d5f86-b7ct2_kube-system(184eab58-b771-4e54-8c7c-46985955b403)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1007 13:51:57.591939 788969 logs.go:138] Found kubelet problem: Oct 07 13:50:40 old-k8s-version-716021 kubelet[666]: E1007 13:50:40.210379 666 pod_workers.go:191] Error syncing pod d8c979bf-7b30-4283-aaeb-85e8808af24f ("dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"
W1007 13:51:57.592120 788969 logs.go:138] Found kubelet problem: Oct 07 13:50:45 old-k8s-version-716021 kubelet[666]: E1007 13:50:45.207104 666 pod_workers.go:191] Error syncing pod 184eab58-b771-4e54-8c7c-46985955b403 ("metrics-server-9975d5f86-b7ct2_kube-system(184eab58-b771-4e54-8c7c-46985955b403)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1007 13:51:57.592445 788969 logs.go:138] Found kubelet problem: Oct 07 13:50:53 old-k8s-version-716021 kubelet[666]: E1007 13:50:53.206980 666 pod_workers.go:191] Error syncing pod d8c979bf-7b30-4283-aaeb-85e8808af24f ("dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"
W1007 13:51:57.592626 788969 logs.go:138] Found kubelet problem: Oct 07 13:50:57 old-k8s-version-716021 kubelet[666]: E1007 13:50:57.206804 666 pod_workers.go:191] Error syncing pod 184eab58-b771-4e54-8c7c-46985955b403 ("metrics-server-9975d5f86-b7ct2_kube-system(184eab58-b771-4e54-8c7c-46985955b403)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1007 13:51:57.592951 788969 logs.go:138] Found kubelet problem: Oct 07 13:51:08 old-k8s-version-716021 kubelet[666]: E1007 13:51:08.206532 666 pod_workers.go:191] Error syncing pod d8c979bf-7b30-4283-aaeb-85e8808af24f ("dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"
W1007 13:51:57.593132 788969 logs.go:138] Found kubelet problem: Oct 07 13:51:08 old-k8s-version-716021 kubelet[666]: E1007 13:51:08.207812 666 pod_workers.go:191] Error syncing pod 184eab58-b771-4e54-8c7c-46985955b403 ("metrics-server-9975d5f86-b7ct2_kube-system(184eab58-b771-4e54-8c7c-46985955b403)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1007 13:51:57.593313 788969 logs.go:138] Found kubelet problem: Oct 07 13:51:22 old-k8s-version-716021 kubelet[666]: E1007 13:51:22.206879 666 pod_workers.go:191] Error syncing pod 184eab58-b771-4e54-8c7c-46985955b403 ("metrics-server-9975d5f86-b7ct2_kube-system(184eab58-b771-4e54-8c7c-46985955b403)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1007 13:51:57.593637 788969 logs.go:138] Found kubelet problem: Oct 07 13:51:22 old-k8s-version-716021 kubelet[666]: E1007 13:51:22.208036 666 pod_workers.go:191] Error syncing pod d8c979bf-7b30-4283-aaeb-85e8808af24f ("dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"
W1007 13:51:57.593845 788969 logs.go:138] Found kubelet problem: Oct 07 13:51:33 old-k8s-version-716021 kubelet[666]: E1007 13:51:33.206925 666 pod_workers.go:191] Error syncing pod 184eab58-b771-4e54-8c7c-46985955b403 ("metrics-server-9975d5f86-b7ct2_kube-system(184eab58-b771-4e54-8c7c-46985955b403)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1007 13:51:57.594174 788969 logs.go:138] Found kubelet problem: Oct 07 13:51:34 old-k8s-version-716021 kubelet[666]: E1007 13:51:34.206498 666 pod_workers.go:191] Error syncing pod d8c979bf-7b30-4283-aaeb-85e8808af24f ("dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"
W1007 13:51:57.594357 788969 logs.go:138] Found kubelet problem: Oct 07 13:51:47 old-k8s-version-716021 kubelet[666]: E1007 13:51:47.231399 666 pod_workers.go:191] Error syncing pod 184eab58-b771-4e54-8c7c-46985955b403 ("metrics-server-9975d5f86-b7ct2_kube-system(184eab58-b771-4e54-8c7c-46985955b403)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1007 13:51:57.594690 788969 logs.go:138] Found kubelet problem: Oct 07 13:51:48 old-k8s-version-716021 kubelet[666]: E1007 13:51:48.206953 666 pod_workers.go:191] Error syncing pod d8c979bf-7b30-4283-aaeb-85e8808af24f ("dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"
I1007 13:51:57.594701 788969 logs.go:123] Gathering logs for describe nodes ...
I1007 13:51:57.594714 788969 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I1007 13:51:57.744792 788969 logs.go:123] Gathering logs for etcd [538e7c613d2fdfcf8bdf655918adbdaa8c80e7d22ee153d71d980bad173f6cd1] ...
I1007 13:51:57.744823 788969 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 538e7c613d2fdfcf8bdf655918adbdaa8c80e7d22ee153d71d980bad173f6cd1"
I1007 13:51:57.789489 788969 logs.go:123] Gathering logs for coredns [b970f66a7b788465fb1b5efff7470a2a13241205a4b3871615987cd5e8185c0b] ...
I1007 13:51:57.789522 788969 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 b970f66a7b788465fb1b5efff7470a2a13241205a4b3871615987cd5e8185c0b"
I1007 13:51:57.841342 788969 logs.go:123] Gathering logs for kube-scheduler [3a2ed108143653900fc42a927e9971546f5f58f58c845162e9ad03a74ef4c19f] ...
I1007 13:51:57.841376 788969 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 3a2ed108143653900fc42a927e9971546f5f58f58c845162e9ad03a74ef4c19f"
I1007 13:51:57.885042 788969 logs.go:123] Gathering logs for kube-proxy [b47f6084fbcd06d9de3d640a50b2eedabdcfa0e9e99795313dbbf409ba0b34ba] ...
I1007 13:51:57.885079 788969 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 b47f6084fbcd06d9de3d640a50b2eedabdcfa0e9e99795313dbbf409ba0b34ba"
I1007 13:51:57.928690 788969 logs.go:123] Gathering logs for kube-proxy [90271f39ba89eca0f9f411179e611fffa8cb7092df3cd7385b2489d67eb7a32d] ...
I1007 13:51:57.928720 788969 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 90271f39ba89eca0f9f411179e611fffa8cb7092df3cd7385b2489d67eb7a32d"
I1007 13:51:57.966663 788969 logs.go:123] Gathering logs for kindnet [c44e873fb63063161eea0a9a33fcb424a1fca04659773868480c9079f14fcde3] ...
I1007 13:51:57.966697 788969 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 c44e873fb63063161eea0a9a33fcb424a1fca04659773868480c9079f14fcde3"
I1007 13:51:58.025474 788969 logs.go:123] Gathering logs for kube-apiserver [6438e2a98b44ed7687544147d7fde2facece2b6119ba86ffa996a5b8e7019da7] ...
I1007 13:51:58.025511 788969 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 6438e2a98b44ed7687544147d7fde2facece2b6119ba86ffa996a5b8e7019da7"
I1007 13:51:58.099784 788969 logs.go:123] Gathering logs for kube-apiserver [dffbe9e7eda4a16ea00f685c861a1d7506d88d6ae76dc1fbd3b528f0186bf960] ...
I1007 13:51:58.099828 788969 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 dffbe9e7eda4a16ea00f685c861a1d7506d88d6ae76dc1fbd3b528f0186bf960"
I1007 13:51:58.156884 788969 logs.go:123] Gathering logs for container status ...
I1007 13:51:58.156916 788969 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I1007 13:51:58.245817 788969 logs.go:123] Gathering logs for kubernetes-dashboard [02588bae23d099926c85f07f669f2281dd82887c6cda051d44c64293d25ce608] ...
I1007 13:51:58.245848 788969 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 02588bae23d099926c85f07f669f2281dd82887c6cda051d44c64293d25ce608"
I1007 13:51:58.293375 788969 logs.go:123] Gathering logs for storage-provisioner [94f42c6c49fd89fb1387486b3bfb41e7d9ad24f923a9cbfb3757cab9ba0d589c] ...
I1007 13:51:58.293411 788969 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 94f42c6c49fd89fb1387486b3bfb41e7d9ad24f923a9cbfb3757cab9ba0d589c"
I1007 13:51:58.333307 788969 logs.go:123] Gathering logs for storage-provisioner [3e11e0da9f75ad4dd8fcceb6b095c49ccfce3438e6b64b5adf91722fb701d656] ...
I1007 13:51:58.333338 788969 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 3e11e0da9f75ad4dd8fcceb6b095c49ccfce3438e6b64b5adf91722fb701d656"
I1007 13:51:58.374185 788969 logs.go:123] Gathering logs for kube-scheduler [1e75bdb1fcc164ca7ea09aaa49994e75347b13bbf4549844b1471555f94af297] ...
I1007 13:51:58.374218 788969 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 1e75bdb1fcc164ca7ea09aaa49994e75347b13bbf4549844b1471555f94af297"
I1007 13:51:58.414799 788969 logs.go:123] Gathering logs for kindnet [54c2e6b5d938cc814a93018f032c376c76d65bc1872f0fa55dd63fe950ff317f] ...
I1007 13:51:58.414829 788969 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 54c2e6b5d938cc814a93018f032c376c76d65bc1872f0fa55dd63fe950ff317f"
I1007 13:51:58.473608 788969 out.go:358] Setting ErrFile to fd 2...
I1007 13:51:58.473634 788969 out.go:392] TERM=,COLORTERM=, which probably does not support color
W1007 13:51:58.473748 788969 out.go:270] X Problems detected in kubelet:
X Problems detected in kubelet:
W1007 13:51:58.473763 788969 out.go:270] Oct 07 13:51:22 old-k8s-version-716021 kubelet[666]: E1007 13:51:22.208036 666 pod_workers.go:191] Error syncing pod d8c979bf-7b30-4283-aaeb-85e8808af24f ("dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"
Oct 07 13:51:22 old-k8s-version-716021 kubelet[666]: E1007 13:51:22.208036 666 pod_workers.go:191] Error syncing pod d8c979bf-7b30-4283-aaeb-85e8808af24f ("dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"
W1007 13:51:58.473777 788969 out.go:270] Oct 07 13:51:33 old-k8s-version-716021 kubelet[666]: E1007 13:51:33.206925 666 pod_workers.go:191] Error syncing pod 184eab58-b771-4e54-8c7c-46985955b403 ("metrics-server-9975d5f86-b7ct2_kube-system(184eab58-b771-4e54-8c7c-46985955b403)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Oct 07 13:51:33 old-k8s-version-716021 kubelet[666]: E1007 13:51:33.206925 666 pod_workers.go:191] Error syncing pod 184eab58-b771-4e54-8c7c-46985955b403 ("metrics-server-9975d5f86-b7ct2_kube-system(184eab58-b771-4e54-8c7c-46985955b403)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1007 13:51:58.473786 788969 out.go:270] Oct 07 13:51:34 old-k8s-version-716021 kubelet[666]: E1007 13:51:34.206498 666 pod_workers.go:191] Error syncing pod d8c979bf-7b30-4283-aaeb-85e8808af24f ("dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"
Oct 07 13:51:34 old-k8s-version-716021 kubelet[666]: E1007 13:51:34.206498 666 pod_workers.go:191] Error syncing pod d8c979bf-7b30-4283-aaeb-85e8808af24f ("dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"
W1007 13:51:58.473798 788969 out.go:270] Oct 07 13:51:47 old-k8s-version-716021 kubelet[666]: E1007 13:51:47.231399 666 pod_workers.go:191] Error syncing pod 184eab58-b771-4e54-8c7c-46985955b403 ("metrics-server-9975d5f86-b7ct2_kube-system(184eab58-b771-4e54-8c7c-46985955b403)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Oct 07 13:51:47 old-k8s-version-716021 kubelet[666]: E1007 13:51:47.231399 666 pod_workers.go:191] Error syncing pod 184eab58-b771-4e54-8c7c-46985955b403 ("metrics-server-9975d5f86-b7ct2_kube-system(184eab58-b771-4e54-8c7c-46985955b403)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1007 13:51:58.473804 788969 out.go:270] Oct 07 13:51:48 old-k8s-version-716021 kubelet[666]: E1007 13:51:48.206953 666 pod_workers.go:191] Error syncing pod d8c979bf-7b30-4283-aaeb-85e8808af24f ("dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"
Oct 07 13:51:48 old-k8s-version-716021 kubelet[666]: E1007 13:51:48.206953 666 pod_workers.go:191] Error syncing pod d8c979bf-7b30-4283-aaeb-85e8808af24f ("dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"
I1007 13:51:58.473811 788969 out.go:358] Setting ErrFile to fd 2...
I1007 13:51:58.473817 788969 out.go:392] TERM=,COLORTERM=, which probably does not support color
I1007 13:52:08.474751 788969 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1007 13:52:08.488321 788969 api_server.go:72] duration metric: took 6m2.173367121s to wait for apiserver process to appear ...
I1007 13:52:08.488351 788969 api_server.go:88] waiting for apiserver healthz status ...
I1007 13:52:08.490582 788969 out.go:201]
W1007 13:52:08.492328 788969 out.go:270] X Exiting due to GUEST_START: failed to start node: wait 6m0s for node: wait for healthy API server: apiserver healthz never reported healthy: cluster wait timed out during healthz check
X Exiting due to GUEST_START: failed to start node: wait 6m0s for node: wait for healthy API server: apiserver healthz never reported healthy: cluster wait timed out during healthz check
W1007 13:52:08.492353 788969 out.go:270] *
*
W1007 13:52:08.493335 788969 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I1007 13:52:08.495726 788969 out.go:201]
** /stderr **
start_stop_delete_test.go:259: failed to start minikube post-stop. args "out/minikube-linux-arm64 start -p old-k8s-version-716021 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=containerd --kubernetes-version=v1.20.0": exit status 80
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: docker inspect <======
helpers_test.go:231: (dbg) Run: docker inspect old-k8s-version-716021
helpers_test.go:235: (dbg) docker inspect old-k8s-version-716021:
-- stdout --
[
{
"Id": "ce840d223dfaab846381ea462f7f0deae441d4071b219570d5e4ad687822862e",
"Created": "2024-10-07T13:43:05.221371985Z",
"Path": "/usr/local/bin/entrypoint",
"Args": [
"/sbin/init"
],
"State": {
"Status": "running",
"Running": true,
"Paused": false,
"Restarting": false,
"OOMKilled": false,
"Dead": false,
"Pid": 789183,
"ExitCode": 0,
"Error": "",
"StartedAt": "2024-10-07T13:45:58.146230129Z",
"FinishedAt": "2024-10-07T13:45:57.006420303Z"
},
"Image": "sha256:b5f10d57944829de859b6363a7c57065ccc6b1805dabb3bce283aaecb83f3acc",
"ResolvConfPath": "/var/lib/docker/containers/ce840d223dfaab846381ea462f7f0deae441d4071b219570d5e4ad687822862e/resolv.conf",
"HostnamePath": "/var/lib/docker/containers/ce840d223dfaab846381ea462f7f0deae441d4071b219570d5e4ad687822862e/hostname",
"HostsPath": "/var/lib/docker/containers/ce840d223dfaab846381ea462f7f0deae441d4071b219570d5e4ad687822862e/hosts",
"LogPath": "/var/lib/docker/containers/ce840d223dfaab846381ea462f7f0deae441d4071b219570d5e4ad687822862e/ce840d223dfaab846381ea462f7f0deae441d4071b219570d5e4ad687822862e-json.log",
"Name": "/old-k8s-version-716021",
"RestartCount": 0,
"Driver": "overlay2",
"Platform": "linux",
"MountLabel": "",
"ProcessLabel": "",
"AppArmorProfile": "unconfined",
"ExecIDs": null,
"HostConfig": {
"Binds": [
"/lib/modules:/lib/modules:ro",
"old-k8s-version-716021:/var"
],
"ContainerIDFile": "",
"LogConfig": {
"Type": "json-file",
"Config": {}
},
"NetworkMode": "old-k8s-version-716021",
"PortBindings": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
]
},
"RestartPolicy": {
"Name": "no",
"MaximumRetryCount": 0
},
"AutoRemove": false,
"VolumeDriver": "",
"VolumesFrom": null,
"ConsoleSize": [
0,
0
],
"CapAdd": null,
"CapDrop": null,
"CgroupnsMode": "host",
"Dns": [],
"DnsOptions": [],
"DnsSearch": [],
"ExtraHosts": null,
"GroupAdd": null,
"IpcMode": "private",
"Cgroup": "",
"Links": null,
"OomScoreAdj": 0,
"PidMode": "",
"Privileged": true,
"PublishAllPorts": false,
"ReadonlyRootfs": false,
"SecurityOpt": [
"seccomp=unconfined",
"apparmor=unconfined",
"label=disable"
],
"Tmpfs": {
"/run": "",
"/tmp": ""
},
"UTSMode": "",
"UsernsMode": "",
"ShmSize": 67108864,
"Runtime": "runc",
"Isolation": "",
"CpuShares": 0,
"Memory": 2306867200,
"NanoCpus": 2000000000,
"CgroupParent": "",
"BlkioWeight": 0,
"BlkioWeightDevice": [],
"BlkioDeviceReadBps": [],
"BlkioDeviceWriteBps": [],
"BlkioDeviceReadIOps": [],
"BlkioDeviceWriteIOps": [],
"CpuPeriod": 0,
"CpuQuota": 0,
"CpuRealtimePeriod": 0,
"CpuRealtimeRuntime": 0,
"CpusetCpus": "",
"CpusetMems": "",
"Devices": [],
"DeviceCgroupRules": null,
"DeviceRequests": null,
"MemoryReservation": 0,
"MemorySwap": 4613734400,
"MemorySwappiness": null,
"OomKillDisable": false,
"PidsLimit": null,
"Ulimits": [],
"CpuCount": 0,
"CpuPercent": 0,
"IOMaximumIOps": 0,
"IOMaximumBandwidth": 0,
"MaskedPaths": null,
"ReadonlyPaths": null
},
"GraphDriver": {
"Data": {
"LowerDir": "/var/lib/docker/overlay2/c0e8f50da5990a6bedf8833813b7776b31886924c91cf3beb519d1c9a4cb1ba9-init/diff:/var/lib/docker/overlay2/e63a2c5503af6c1a5c1dd965c5cc29d76da2a1b8721a0b9206304ab209f33143/diff",
"MergedDir": "/var/lib/docker/overlay2/c0e8f50da5990a6bedf8833813b7776b31886924c91cf3beb519d1c9a4cb1ba9/merged",
"UpperDir": "/var/lib/docker/overlay2/c0e8f50da5990a6bedf8833813b7776b31886924c91cf3beb519d1c9a4cb1ba9/diff",
"WorkDir": "/var/lib/docker/overlay2/c0e8f50da5990a6bedf8833813b7776b31886924c91cf3beb519d1c9a4cb1ba9/work"
},
"Name": "overlay2"
},
"Mounts": [
{
"Type": "bind",
"Source": "/lib/modules",
"Destination": "/lib/modules",
"Mode": "ro",
"RW": false,
"Propagation": "rprivate"
},
{
"Type": "volume",
"Name": "old-k8s-version-716021",
"Source": "/var/lib/docker/volumes/old-k8s-version-716021/_data",
"Destination": "/var",
"Driver": "local",
"Mode": "z",
"RW": true,
"Propagation": ""
}
],
"Config": {
"Hostname": "old-k8s-version-716021",
"Domainname": "",
"User": "",
"AttachStdin": false,
"AttachStdout": false,
"AttachStderr": false,
"ExposedPorts": {
"22/tcp": {},
"2376/tcp": {},
"32443/tcp": {},
"5000/tcp": {},
"8443/tcp": {}
},
"Tty": true,
"OpenStdin": false,
"StdinOnce": false,
"Env": [
"container=docker",
"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
],
"Cmd": null,
"Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727731891-master@sha256:d66dfd4a976cf0b4581cac255174cef4031588c4570fa4a795e0b3d42edc9122",
"Volumes": null,
"WorkingDir": "/",
"Entrypoint": [
"/usr/local/bin/entrypoint",
"/sbin/init"
],
"OnBuild": null,
"Labels": {
"created_by.minikube.sigs.k8s.io": "true",
"mode.minikube.sigs.k8s.io": "old-k8s-version-716021",
"name.minikube.sigs.k8s.io": "old-k8s-version-716021",
"role.minikube.sigs.k8s.io": ""
},
"StopSignal": "SIGRTMIN+3"
},
"NetworkSettings": {
"Bridge": "",
"SandboxID": "03994c8b6081ca867a05636fbc894d1b437e873806f955331382e284c83dfe8f",
"SandboxKey": "/var/run/docker/netns/03994c8b6081",
"Ports": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33799"
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33800"
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33803"
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33801"
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33802"
}
]
},
"HairpinMode": false,
"LinkLocalIPv6Address": "",
"LinkLocalIPv6PrefixLen": 0,
"SecondaryIPAddresses": null,
"SecondaryIPv6Addresses": null,
"EndpointID": "",
"Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"IPAddress": "",
"IPPrefixLen": 0,
"IPv6Gateway": "",
"MacAddress": "",
"Networks": {
"old-k8s-version-716021": {
"IPAMConfig": {
"IPv4Address": "192.168.76.2"
},
"Links": null,
"Aliases": null,
"MacAddress": "02:42:c0:a8:4c:02",
"DriverOpts": null,
"NetworkID": "119e3a61963381b47c7d49b0a5a6e41f2814e895bb3e1355d0bc3404d2e8c41a",
"EndpointID": "4a1e6a0450c945720070e513d0885f06d63cd7da40a3b6b3b399bad66d6be45e",
"Gateway": "192.168.76.1",
"IPAddress": "192.168.76.2",
"IPPrefixLen": 24,
"IPv6Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"DNSNames": [
"old-k8s-version-716021",
"ce840d223dfa"
]
}
}
}
}
]
-- /stdout --
helpers_test.go:239: (dbg) Run: out/minikube-linux-arm64 status --format={{.Host}} -p old-k8s-version-716021 -n old-k8s-version-716021
helpers_test.go:244: <<< TestStartStop/group/old-k8s-version/serial/SecondStart FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: minikube logs <======
helpers_test.go:247: (dbg) Run: out/minikube-linux-arm64 -p old-k8s-version-716021 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-arm64 -p old-k8s-version-716021 logs -n 25: (2.208869241s)
helpers_test.go:252: TestStartStop/group/old-k8s-version/serial/SecondStart logs:
-- stdout --
==> Audit <==
|---------|--------------------------------------------------------|---------------------------|---------|---------|---------------------|---------------------|
| Command | Args | Profile | User | Version | Start Time | End Time |
|---------|--------------------------------------------------------|---------------------------|---------|---------|---------------------|---------------------|
| ssh | -p cilium-180537 sudo find | cilium-180537 | jenkins | v1.34.0 | 07 Oct 24 13:41 UTC | |
| | /etc/crio -type f -exec sh -c | | | | | |
| | 'echo {}; cat {}' \; | | | | | |
| ssh | -p cilium-180537 sudo crio | cilium-180537 | jenkins | v1.34.0 | 07 Oct 24 13:41 UTC | |
| | config | | | | | |
| delete | -p cilium-180537 | cilium-180537 | jenkins | v1.34.0 | 07 Oct 24 13:41 UTC | 07 Oct 24 13:41 UTC |
| start | -p force-systemd-env-622009 | force-systemd-env-622009 | jenkins | v1.34.0 | 07 Oct 24 13:41 UTC | 07 Oct 24 13:42 UTC |
| | --memory=2048 | | | | | |
| | --alsologtostderr | | | | | |
| | -v=5 --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| ssh | force-systemd-flag-040234 | force-systemd-flag-040234 | jenkins | v1.34.0 | 07 Oct 24 13:41 UTC | 07 Oct 24 13:41 UTC |
| | ssh cat | | | | | |
| | /etc/containerd/config.toml | | | | | |
| delete | -p force-systemd-flag-040234 | force-systemd-flag-040234 | jenkins | v1.34.0 | 07 Oct 24 13:41 UTC | 07 Oct 24 13:41 UTC |
| start | -p cert-expiration-501751 | cert-expiration-501751 | jenkins | v1.34.0 | 07 Oct 24 13:41 UTC | 07 Oct 24 13:42 UTC |
| | --memory=2048 | | | | | |
| | --cert-expiration=3m | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| ssh | force-systemd-env-622009 | force-systemd-env-622009 | jenkins | v1.34.0 | 07 Oct 24 13:42 UTC | 07 Oct 24 13:42 UTC |
| | ssh cat | | | | | |
| | /etc/containerd/config.toml | | | | | |
| delete | -p force-systemd-env-622009 | force-systemd-env-622009 | jenkins | v1.34.0 | 07 Oct 24 13:42 UTC | 07 Oct 24 13:42 UTC |
| start | -p cert-options-608723 | cert-options-608723 | jenkins | v1.34.0 | 07 Oct 24 13:42 UTC | 07 Oct 24 13:42 UTC |
| | --memory=2048 | | | | | |
| | --apiserver-ips=127.0.0.1 | | | | | |
| | --apiserver-ips=192.168.15.15 | | | | | |
| | --apiserver-names=localhost | | | | | |
| | --apiserver-names=www.google.com | | | | | |
| | --apiserver-port=8555 | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| ssh | cert-options-608723 ssh | cert-options-608723 | jenkins | v1.34.0 | 07 Oct 24 13:42 UTC | 07 Oct 24 13:42 UTC |
| | openssl x509 -text -noout -in | | | | | |
| | /var/lib/minikube/certs/apiserver.crt | | | | | |
| ssh | -p cert-options-608723 -- sudo | cert-options-608723 | jenkins | v1.34.0 | 07 Oct 24 13:42 UTC | 07 Oct 24 13:42 UTC |
| | cat /etc/kubernetes/admin.conf | | | | | |
| delete | -p cert-options-608723 | cert-options-608723 | jenkins | v1.34.0 | 07 Oct 24 13:42 UTC | 07 Oct 24 13:42 UTC |
| start | -p old-k8s-version-716021 | old-k8s-version-716021 | jenkins | v1.34.0 | 07 Oct 24 13:42 UTC | 07 Oct 24 13:45 UTC |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --kvm-network=default | | | | | |
| | --kvm-qemu-uri=qemu:///system | | | | | |
| | --disable-driver-mounts | | | | | |
| | --keep-context=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --kubernetes-version=v1.20.0 | | | | | |
| start | -p cert-expiration-501751 | cert-expiration-501751 | jenkins | v1.34.0 | 07 Oct 24 13:45 UTC | 07 Oct 24 13:45 UTC |
| | --memory=2048 | | | | | |
| | --cert-expiration=8760h | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| addons | enable metrics-server -p old-k8s-version-716021 | old-k8s-version-716021 | jenkins | v1.34.0 | 07 Oct 24 13:45 UTC | 07 Oct 24 13:45 UTC |
| | --images=MetricsServer=registry.k8s.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| delete | -p cert-expiration-501751 | cert-expiration-501751 | jenkins | v1.34.0 | 07 Oct 24 13:45 UTC | 07 Oct 24 13:45 UTC |
| stop | -p old-k8s-version-716021 | old-k8s-version-716021 | jenkins | v1.34.0 | 07 Oct 24 13:45 UTC | 07 Oct 24 13:45 UTC |
| | --alsologtostderr -v=3 | | | | | |
| start | -p no-preload-178678 | no-preload-178678 | jenkins | v1.34.0 | 07 Oct 24 13:45 UTC | 07 Oct 24 13:47 UTC |
| | --memory=2200 | | | | | |
| | --alsologtostderr | | | | | |
| | --wait=true --preload=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --kubernetes-version=v1.31.1 | | | | | |
| addons | enable dashboard -p old-k8s-version-716021 | old-k8s-version-716021 | jenkins | v1.34.0 | 07 Oct 24 13:45 UTC | 07 Oct 24 13:45 UTC |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| start | -p old-k8s-version-716021 | old-k8s-version-716021 | jenkins | v1.34.0 | 07 Oct 24 13:45 UTC | |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --kvm-network=default | | | | | |
| | --kvm-qemu-uri=qemu:///system | | | | | |
| | --disable-driver-mounts | | | | | |
| | --keep-context=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --kubernetes-version=v1.20.0 | | | | | |
| addons | enable metrics-server -p no-preload-178678 | no-preload-178678 | jenkins | v1.34.0 | 07 Oct 24 13:47 UTC | 07 Oct 24 13:47 UTC |
| | --images=MetricsServer=registry.k8s.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| stop | -p no-preload-178678 | no-preload-178678 | jenkins | v1.34.0 | 07 Oct 24 13:47 UTC | 07 Oct 24 13:47 UTC |
| | --alsologtostderr -v=3 | | | | | |
| addons | enable dashboard -p no-preload-178678 | no-preload-178678 | jenkins | v1.34.0 | 07 Oct 24 13:47 UTC | 07 Oct 24 13:47 UTC |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| start | -p no-preload-178678 | no-preload-178678 | jenkins | v1.34.0 | 07 Oct 24 13:47 UTC | 07 Oct 24 13:52 UTC |
| | --memory=2200 | | | | | |
| | --alsologtostderr | | | | | |
| | --wait=true --preload=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --kubernetes-version=v1.31.1 | | | | | |
|---------|--------------------------------------------------------|---------------------------|---------|---------|---------------------|---------------------|
==> Last Start <==
Log file created at: 2024/10/07 13:47:23
Running on machine: ip-172-31-24-2
Binary: Built with gc go1.23.0 for linux/arm64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I1007 13:47:23.810361 794355 out.go:345] Setting OutFile to fd 1 ...
I1007 13:47:23.810828 794355 out.go:392] TERM=,COLORTERM=, which probably does not support color
I1007 13:47:23.810837 794355 out.go:358] Setting ErrFile to fd 2...
I1007 13:47:23.810842 794355 out.go:392] TERM=,COLORTERM=, which probably does not support color
I1007 13:47:23.811371 794355 root.go:338] Updating PATH: /home/jenkins/minikube-integration/18424-574640/.minikube/bin
I1007 13:47:23.811942 794355 out.go:352] Setting JSON to false
I1007 13:47:23.814581 794355 start.go:129] hostinfo: {"hostname":"ip-172-31-24-2","uptime":12593,"bootTime":1728296251,"procs":238,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1070-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"6d436adf-771e-4269-b9a3-c25fd4fca4f5"}
I1007 13:47:23.814694 794355 start.go:139] virtualization:
I1007 13:47:23.817436 794355 out.go:177] * [no-preload-178678] minikube v1.34.0 on Ubuntu 20.04 (arm64)
I1007 13:47:23.821821 794355 out.go:177] - MINIKUBE_LOCATION=18424
I1007 13:47:23.821953 794355 notify.go:220] Checking for updates...
I1007 13:47:23.825095 794355 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I1007 13:47:23.826730 794355 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/18424-574640/kubeconfig
I1007 13:47:23.828463 794355 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/18424-574640/.minikube
I1007 13:47:23.830097 794355 out.go:177] - MINIKUBE_BIN=out/minikube-linux-arm64
I1007 13:47:23.831679 794355 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I1007 13:47:23.834024 794355 config.go:182] Loaded profile config "no-preload-178678": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.31.1
I1007 13:47:23.834606 794355 driver.go:394] Setting default libvirt URI to qemu:///system
I1007 13:47:23.864740 794355 docker.go:123] docker version: linux-27.3.1:Docker Engine - Community
I1007 13:47:23.864882 794355 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I1007 13:47:23.920928 794355 info.go:266] docker info: {ID:J4M5:W6MX:GOX4:4LAQ:VI7E:VJNF:J3OP:OPBH:GF7G:PPY4:WQWD:7N4L Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:40 OomKillDisable:true NGoroutines:52 SystemTime:2024-10-07 13:47:23.910636539 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1070-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:a
arch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214835200 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-24-2 Labels:[] ExperimentalBuild:false ServerVersion:27.3.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c Expected:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c} RuncCommit:{ID:v1.1.14-0-g2c9f560 Expected:v1.1.14-0-g2c9f560} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:[WARNING: bridge
-nf-call-iptables is disabled WARNING: bridge-nf-call-ip6tables is disabled] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.17.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.7]] Warnings:<nil>}}
I1007 13:47:23.921041 794355 docker.go:318] overlay module found
I1007 13:47:23.924415 794355 out.go:177] * Using the docker driver based on existing profile
I1007 13:47:23.926418 794355 start.go:297] selected driver: docker
I1007 13:47:23.926442 794355 start.go:901] validating driver "docker" against &{Name:no-preload-178678 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727731891-master@sha256:d66dfd4a976cf0b4581cac255174cef4031588c4570fa4a795e0b3d42edc9122 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:no-preload-178678 Namespace:default APIServerHAVIP: APIServerN
ame:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false Moun
tString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I1007 13:47:23.926559 794355 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I1007 13:47:23.927222 794355 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I1007 13:47:23.975612 794355 info.go:266] docker info: {ID:J4M5:W6MX:GOX4:4LAQ:VI7E:VJNF:J3OP:OPBH:GF7G:PPY4:WQWD:7N4L Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:40 OomKillDisable:true NGoroutines:52 SystemTime:2024-10-07 13:47:23.965172091 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1070-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:a
arch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214835200 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-24-2 Labels:[] ExperimentalBuild:false ServerVersion:27.3.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c Expected:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c} RuncCommit:{ID:v1.1.14-0-g2c9f560 Expected:v1.1.14-0-g2c9f560} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:[WARNING: bridge
-nf-call-iptables is disabled WARNING: bridge-nf-call-ip6tables is disabled] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.17.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.7]] Warnings:<nil>}}
I1007 13:47:23.976007 794355 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I1007 13:47:23.976039 794355 cni.go:84] Creating CNI manager for ""
I1007 13:47:23.976080 794355 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I1007 13:47:23.976131 794355 start.go:340] cluster config:
{Name:no-preload-178678 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727731891-master@sha256:d66dfd4a976cf0b4581cac255174cef4031588c4570fa4a795e0b3d42edc9122 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:no-preload-178678 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Contain
erRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker Mou
ntIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I1007 13:47:23.978282 794355 out.go:177] * Starting "no-preload-178678" primary control-plane node in "no-preload-178678" cluster
I1007 13:47:23.980343 794355 cache.go:121] Beginning downloading kic base image for docker with containerd
I1007 13:47:23.982028 794355 out.go:177] * Pulling base image v0.0.45-1727731891-master ...
I1007 13:47:23.983934 794355 preload.go:131] Checking if preload exists for k8s version v1.31.1 and runtime containerd
I1007 13:47:23.984094 794355 profile.go:143] Saving config to /home/jenkins/minikube-integration/18424-574640/.minikube/profiles/no-preload-178678/config.json ...
I1007 13:47:23.984186 794355 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727731891-master@sha256:d66dfd4a976cf0b4581cac255174cef4031588c4570fa4a795e0b3d42edc9122 in local docker daemon
I1007 13:47:23.984469 794355 cache.go:107] acquiring lock: {Name:mk47932ca92317b50b1fd9618219d4310898a371 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1007 13:47:23.984555 794355 cache.go:115] /home/jenkins/minikube-integration/18424-574640/.minikube/cache/images/arm64/gcr.io/k8s-minikube/storage-provisioner_v5 exists
I1007 13:47:23.984564 794355 cache.go:96] cache image "gcr.io/k8s-minikube/storage-provisioner:v5" -> "/home/jenkins/minikube-integration/18424-574640/.minikube/cache/images/arm64/gcr.io/k8s-minikube/storage-provisioner_v5" took 102.292µs
I1007 13:47:23.984580 794355 cache.go:80] save to tar file gcr.io/k8s-minikube/storage-provisioner:v5 -> /home/jenkins/minikube-integration/18424-574640/.minikube/cache/images/arm64/gcr.io/k8s-minikube/storage-provisioner_v5 succeeded
I1007 13:47:23.984590 794355 cache.go:107] acquiring lock: {Name:mk68e4312cd665d68e30be9478800e1fcc85644f Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1007 13:47:23.984621 794355 cache.go:115] /home/jenkins/minikube-integration/18424-574640/.minikube/cache/images/arm64/registry.k8s.io/kube-apiserver_v1.31.1 exists
I1007 13:47:23.984626 794355 cache.go:96] cache image "registry.k8s.io/kube-apiserver:v1.31.1" -> "/home/jenkins/minikube-integration/18424-574640/.minikube/cache/images/arm64/registry.k8s.io/kube-apiserver_v1.31.1" took 37.76µs
I1007 13:47:23.984632 794355 cache.go:80] save to tar file registry.k8s.io/kube-apiserver:v1.31.1 -> /home/jenkins/minikube-integration/18424-574640/.minikube/cache/images/arm64/registry.k8s.io/kube-apiserver_v1.31.1 succeeded
I1007 13:47:23.984640 794355 cache.go:107] acquiring lock: {Name:mk4a70f876837ca2fe07cd7bd9abcdbca806555d Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1007 13:47:23.984668 794355 cache.go:115] /home/jenkins/minikube-integration/18424-574640/.minikube/cache/images/arm64/registry.k8s.io/kube-controller-manager_v1.31.1 exists
I1007 13:47:23.984673 794355 cache.go:96] cache image "registry.k8s.io/kube-controller-manager:v1.31.1" -> "/home/jenkins/minikube-integration/18424-574640/.minikube/cache/images/arm64/registry.k8s.io/kube-controller-manager_v1.31.1" took 33.796µs
I1007 13:47:23.984679 794355 cache.go:80] save to tar file registry.k8s.io/kube-controller-manager:v1.31.1 -> /home/jenkins/minikube-integration/18424-574640/.minikube/cache/images/arm64/registry.k8s.io/kube-controller-manager_v1.31.1 succeeded
I1007 13:47:23.984691 794355 cache.go:107] acquiring lock: {Name:mk775e67e03da628dccad10730e434256c53046f Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1007 13:47:23.984717 794355 cache.go:115] /home/jenkins/minikube-integration/18424-574640/.minikube/cache/images/arm64/registry.k8s.io/kube-scheduler_v1.31.1 exists
I1007 13:47:23.984721 794355 cache.go:96] cache image "registry.k8s.io/kube-scheduler:v1.31.1" -> "/home/jenkins/minikube-integration/18424-574640/.minikube/cache/images/arm64/registry.k8s.io/kube-scheduler_v1.31.1" took 35.2µs
I1007 13:47:23.984727 794355 cache.go:80] save to tar file registry.k8s.io/kube-scheduler:v1.31.1 -> /home/jenkins/minikube-integration/18424-574640/.minikube/cache/images/arm64/registry.k8s.io/kube-scheduler_v1.31.1 succeeded
I1007 13:47:23.984741 794355 cache.go:107] acquiring lock: {Name:mk4908d036fcd399d3b6c35dd16f32e979c76a8f Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1007 13:47:23.984766 794355 cache.go:115] /home/jenkins/minikube-integration/18424-574640/.minikube/cache/images/arm64/registry.k8s.io/kube-proxy_v1.31.1 exists
I1007 13:47:23.984771 794355 cache.go:96] cache image "registry.k8s.io/kube-proxy:v1.31.1" -> "/home/jenkins/minikube-integration/18424-574640/.minikube/cache/images/arm64/registry.k8s.io/kube-proxy_v1.31.1" took 36.627µs
I1007 13:47:23.984777 794355 cache.go:80] save to tar file registry.k8s.io/kube-proxy:v1.31.1 -> /home/jenkins/minikube-integration/18424-574640/.minikube/cache/images/arm64/registry.k8s.io/kube-proxy_v1.31.1 succeeded
I1007 13:47:23.984785 794355 cache.go:107] acquiring lock: {Name:mk82dcbc55bf1bbc35605c317a49b0f041074033 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1007 13:47:23.984813 794355 cache.go:115] /home/jenkins/minikube-integration/18424-574640/.minikube/cache/images/arm64/registry.k8s.io/pause_3.10 exists
I1007 13:47:23.984818 794355 cache.go:96] cache image "registry.k8s.io/pause:3.10" -> "/home/jenkins/minikube-integration/18424-574640/.minikube/cache/images/arm64/registry.k8s.io/pause_3.10" took 34.28µs
I1007 13:47:23.984823 794355 cache.go:80] save to tar file registry.k8s.io/pause:3.10 -> /home/jenkins/minikube-integration/18424-574640/.minikube/cache/images/arm64/registry.k8s.io/pause_3.10 succeeded
I1007 13:47:23.984831 794355 cache.go:107] acquiring lock: {Name:mk9f9e65c5c261c0ed0a0726ee7bd5e31b098711 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1007 13:47:23.984860 794355 cache.go:115] /home/jenkins/minikube-integration/18424-574640/.minikube/cache/images/arm64/registry.k8s.io/etcd_3.5.15-0 exists
I1007 13:47:23.984865 794355 cache.go:96] cache image "registry.k8s.io/etcd:3.5.15-0" -> "/home/jenkins/minikube-integration/18424-574640/.minikube/cache/images/arm64/registry.k8s.io/etcd_3.5.15-0" took 34.527µs
I1007 13:47:23.984870 794355 cache.go:80] save to tar file registry.k8s.io/etcd:3.5.15-0 -> /home/jenkins/minikube-integration/18424-574640/.minikube/cache/images/arm64/registry.k8s.io/etcd_3.5.15-0 succeeded
I1007 13:47:23.984878 794355 cache.go:107] acquiring lock: {Name:mk89b5997abefd8b1e88f23a6e013d87b7b19de5 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1007 13:47:23.984902 794355 cache.go:115] /home/jenkins/minikube-integration/18424-574640/.minikube/cache/images/arm64/registry.k8s.io/coredns/coredns_v1.11.3 exists
I1007 13:47:23.984906 794355 cache.go:96] cache image "registry.k8s.io/coredns/coredns:v1.11.3" -> "/home/jenkins/minikube-integration/18424-574640/.minikube/cache/images/arm64/registry.k8s.io/coredns/coredns_v1.11.3" took 28.931µs
I1007 13:47:23.984911 794355 cache.go:80] save to tar file registry.k8s.io/coredns/coredns:v1.11.3 -> /home/jenkins/minikube-integration/18424-574640/.minikube/cache/images/arm64/registry.k8s.io/coredns/coredns_v1.11.3 succeeded
I1007 13:47:23.984916 794355 cache.go:87] Successfully saved all images to host disk.
I1007 13:47:24.009591 794355 image.go:98] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727731891-master@sha256:d66dfd4a976cf0b4581cac255174cef4031588c4570fa4a795e0b3d42edc9122 in local docker daemon, skipping pull
I1007 13:47:24.009623 794355 cache.go:144] gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727731891-master@sha256:d66dfd4a976cf0b4581cac255174cef4031588c4570fa4a795e0b3d42edc9122 exists in daemon, skipping load
I1007 13:47:24.009639 794355 cache.go:194] Successfully downloaded all kic artifacts
I1007 13:47:24.009733 794355 start.go:360] acquireMachinesLock for no-preload-178678: {Name:mkf96e7e9a12542ced4fdaa4061e6224babb39c6 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1007 13:47:24.009807 794355 start.go:364] duration metric: took 53.201µs to acquireMachinesLock for "no-preload-178678"
I1007 13:47:24.009831 794355 start.go:96] Skipping create...Using existing machine configuration
I1007 13:47:24.009837 794355 fix.go:54] fixHost starting:
I1007 13:47:24.010130 794355 cli_runner.go:164] Run: docker container inspect no-preload-178678 --format={{.State.Status}}
I1007 13:47:24.029838 794355 fix.go:112] recreateIfNeeded on no-preload-178678: state=Stopped err=<nil>
W1007 13:47:24.029881 794355 fix.go:138] unexpected machine state, will restart: <nil>
I1007 13:47:24.032276 794355 out.go:177] * Restarting existing docker container for "no-preload-178678" ...
I1007 13:47:23.313778 788969 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-716021" in "kube-system" namespace has status "Ready":"False"
I1007 13:47:25.811416 788969 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-716021" in "kube-system" namespace has status "Ready":"False"
I1007 13:47:24.034064 794355 cli_runner.go:164] Run: docker start no-preload-178678
I1007 13:47:24.391631 794355 cli_runner.go:164] Run: docker container inspect no-preload-178678 --format={{.State.Status}}
I1007 13:47:24.414879 794355 kic.go:430] container "no-preload-178678" state is running.
I1007 13:47:24.415258 794355 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" no-preload-178678
I1007 13:47:24.439534 794355 profile.go:143] Saving config to /home/jenkins/minikube-integration/18424-574640/.minikube/profiles/no-preload-178678/config.json ...
I1007 13:47:24.439793 794355 machine.go:93] provisionDockerMachine start ...
I1007 13:47:24.439918 794355 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-178678
I1007 13:47:24.467643 794355 main.go:141] libmachine: Using SSH client type: native
I1007 13:47:24.467906 794355 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x413c00] 0x416440 <nil> [] 0s} 127.0.0.1 33804 <nil> <nil>}
I1007 13:47:24.467917 794355 main.go:141] libmachine: About to run SSH command:
hostname
I1007 13:47:24.468674 794355 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:47112->127.0.0.1:33804: read: connection reset by peer
I1007 13:47:27.606024 794355 main.go:141] libmachine: SSH cmd err, output: <nil>: no-preload-178678
I1007 13:47:27.606056 794355 ubuntu.go:169] provisioning hostname "no-preload-178678"
I1007 13:47:27.606120 794355 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-178678
I1007 13:47:27.624173 794355 main.go:141] libmachine: Using SSH client type: native
I1007 13:47:27.624431 794355 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x413c00] 0x416440 <nil> [] 0s} 127.0.0.1 33804 <nil> <nil>}
I1007 13:47:27.624443 794355 main.go:141] libmachine: About to run SSH command:
sudo hostname no-preload-178678 && echo "no-preload-178678" | sudo tee /etc/hostname
I1007 13:47:27.771307 794355 main.go:141] libmachine: SSH cmd err, output: <nil>: no-preload-178678
I1007 13:47:27.771396 794355 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-178678
I1007 13:47:27.790716 794355 main.go:141] libmachine: Using SSH client type: native
I1007 13:47:27.790976 794355 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x413c00] 0x416440 <nil> [] 0s} 127.0.0.1 33804 <nil> <nil>}
I1007 13:47:27.791000 794355 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sno-preload-178678' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 no-preload-178678/g' /etc/hosts;
else
echo '127.0.1.1 no-preload-178678' | sudo tee -a /etc/hosts;
fi
fi
I1007 13:47:27.967015 794355 main.go:141] libmachine: SSH cmd err, output: <nil>:
I1007 13:47:27.967044 794355 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/18424-574640/.minikube CaCertPath:/home/jenkins/minikube-integration/18424-574640/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/18424-574640/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/18424-574640/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/18424-574640/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/18424-574640/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/18424-574640/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/18424-574640/.minikube}
I1007 13:47:27.967128 794355 ubuntu.go:177] setting up certificates
I1007 13:47:27.967140 794355 provision.go:84] configureAuth start
I1007 13:47:27.967224 794355 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" no-preload-178678
I1007 13:47:27.990493 794355 provision.go:143] copyHostCerts
I1007 13:47:27.990560 794355 exec_runner.go:144] found /home/jenkins/minikube-integration/18424-574640/.minikube/key.pem, removing ...
I1007 13:47:27.990570 794355 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18424-574640/.minikube/key.pem
I1007 13:47:27.990642 794355 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18424-574640/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/18424-574640/.minikube/key.pem (1679 bytes)
I1007 13:47:27.990749 794355 exec_runner.go:144] found /home/jenkins/minikube-integration/18424-574640/.minikube/ca.pem, removing ...
I1007 13:47:27.990755 794355 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18424-574640/.minikube/ca.pem
I1007 13:47:27.990782 794355 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18424-574640/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/18424-574640/.minikube/ca.pem (1082 bytes)
I1007 13:47:27.990842 794355 exec_runner.go:144] found /home/jenkins/minikube-integration/18424-574640/.minikube/cert.pem, removing ...
I1007 13:47:27.990847 794355 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18424-574640/.minikube/cert.pem
I1007 13:47:27.990871 794355 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18424-574640/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/18424-574640/.minikube/cert.pem (1123 bytes)
I1007 13:47:27.990925 794355 provision.go:117] generating server cert: /home/jenkins/minikube-integration/18424-574640/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/18424-574640/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/18424-574640/.minikube/certs/ca-key.pem org=jenkins.no-preload-178678 san=[127.0.0.1 192.168.85.2 localhost minikube no-preload-178678]
I1007 13:47:28.361168 794355 provision.go:177] copyRemoteCerts
I1007 13:47:28.361294 794355 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I1007 13:47:28.361359 794355 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-178678
I1007 13:47:28.380640 794355 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33804 SSHKeyPath:/home/jenkins/minikube-integration/18424-574640/.minikube/machines/no-preload-178678/id_rsa Username:docker}
I1007 13:47:28.479931 794355 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18424-574640/.minikube/machines/server.pem --> /etc/docker/server.pem (1220 bytes)
I1007 13:47:28.508757 794355 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18424-574640/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I1007 13:47:28.537154 794355 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18424-574640/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
I1007 13:47:28.566746 794355 provision.go:87] duration metric: took 599.574577ms to configureAuth
I1007 13:47:28.566818 794355 ubuntu.go:193] setting minikube options for container-runtime
I1007 13:47:28.567050 794355 config.go:182] Loaded profile config "no-preload-178678": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.31.1
I1007 13:47:28.567065 794355 machine.go:96] duration metric: took 4.127264548s to provisionDockerMachine
I1007 13:47:28.567075 794355 start.go:293] postStartSetup for "no-preload-178678" (driver="docker")
I1007 13:47:28.567105 794355 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I1007 13:47:28.567169 794355 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I1007 13:47:28.567214 794355 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-178678
I1007 13:47:28.584605 794355 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33804 SSHKeyPath:/home/jenkins/minikube-integration/18424-574640/.minikube/machines/no-preload-178678/id_rsa Username:docker}
I1007 13:47:28.684107 794355 ssh_runner.go:195] Run: cat /etc/os-release
I1007 13:47:28.687937 794355 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I1007 13:47:28.687994 794355 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I1007 13:47:28.688005 794355 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I1007 13:47:28.688020 794355 info.go:137] Remote host: Ubuntu 22.04.5 LTS
I1007 13:47:28.688037 794355 filesync.go:126] Scanning /home/jenkins/minikube-integration/18424-574640/.minikube/addons for local assets ...
I1007 13:47:28.688122 794355 filesync.go:126] Scanning /home/jenkins/minikube-integration/18424-574640/.minikube/files for local assets ...
I1007 13:47:28.688236 794355 filesync.go:149] local asset: /home/jenkins/minikube-integration/18424-574640/.minikube/files/etc/ssl/certs/5801632.pem -> 5801632.pem in /etc/ssl/certs
I1007 13:47:28.688388 794355 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I1007 13:47:28.699199 794355 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18424-574640/.minikube/files/etc/ssl/certs/5801632.pem --> /etc/ssl/certs/5801632.pem (1708 bytes)
I1007 13:47:28.725552 794355 start.go:296] duration metric: took 158.442436ms for postStartSetup
I1007 13:47:28.725654 794355 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I1007 13:47:28.725732 794355 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-178678
I1007 13:47:28.743441 794355 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33804 SSHKeyPath:/home/jenkins/minikube-integration/18424-574640/.minikube/machines/no-preload-178678/id_rsa Username:docker}
I1007 13:47:28.839347 794355 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I1007 13:47:28.844212 794355 fix.go:56] duration metric: took 4.834367139s for fixHost
I1007 13:47:28.844242 794355 start.go:83] releasing machines lock for "no-preload-178678", held for 4.834424615s
I1007 13:47:28.844334 794355 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" no-preload-178678
I1007 13:47:28.861884 794355 ssh_runner.go:195] Run: cat /version.json
I1007 13:47:28.861945 794355 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-178678
I1007 13:47:28.862042 794355 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I1007 13:47:28.862107 794355 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-178678
I1007 13:47:28.883575 794355 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33804 SSHKeyPath:/home/jenkins/minikube-integration/18424-574640/.minikube/machines/no-preload-178678/id_rsa Username:docker}
I1007 13:47:28.895565 794355 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33804 SSHKeyPath:/home/jenkins/minikube-integration/18424-574640/.minikube/machines/no-preload-178678/id_rsa Username:docker}
I1007 13:47:28.981762 794355 ssh_runner.go:195] Run: systemctl --version
I1007 13:47:29.138712 794355 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I1007 13:47:29.143849 794355 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
I1007 13:47:29.162519 794355 cni.go:230] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
I1007 13:47:29.162620 794355 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I1007 13:47:29.172007 794355 cni.go:259] no active bridge cni configs found in "/etc/cni/net.d" - nothing to disable
I1007 13:47:29.172035 794355 start.go:495] detecting cgroup driver to use...
I1007 13:47:29.172081 794355 detect.go:187] detected "cgroupfs" cgroup driver on host os
I1007 13:47:29.172136 794355 ssh_runner.go:195] Run: sudo systemctl stop -f crio
I1007 13:47:29.187282 794355 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I1007 13:47:29.200803 794355 docker.go:217] disabling cri-docker service (if available) ...
I1007 13:47:29.200885 794355 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I1007 13:47:29.214549 794355 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I1007 13:47:29.227139 794355 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I1007 13:47:29.319427 794355 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I1007 13:47:29.421165 794355 docker.go:233] disabling docker service ...
I1007 13:47:29.421255 794355 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I1007 13:47:29.435766 794355 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I1007 13:47:29.450913 794355 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I1007 13:47:29.571586 794355 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I1007 13:47:29.667308 794355 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I1007 13:47:29.680765 794355 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock
" | sudo tee /etc/crictl.yaml"
I1007 13:47:29.705879 794355 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.10"|' /etc/containerd/config.toml"
I1007 13:47:29.718006 794355 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
I1007 13:47:29.729206 794355 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...
I1007 13:47:29.729320 794355 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
I1007 13:47:29.741315 794355 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I1007 13:47:29.754021 794355 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
I1007 13:47:29.766851 794355 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I1007 13:47:29.784810 794355 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I1007 13:47:29.796048 794355 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
I1007 13:47:29.809014 794355 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *enable_unprivileged_ports = .*/d' /etc/containerd/config.toml"
I1007 13:47:29.821019 794355 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)\[plugins."io.containerd.grpc.v1.cri"\]|&\n\1 enable_unprivileged_ports = true|' /etc/containerd/config.toml"
I1007 13:47:29.832919 794355 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I1007 13:47:29.844310 794355 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I1007 13:47:29.855015 794355 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1007 13:47:29.958884 794355 ssh_runner.go:195] Run: sudo systemctl restart containerd
I1007 13:47:30.194317 794355 start.go:542] Will wait 60s for socket path /run/containerd/containerd.sock
I1007 13:47:30.194432 794355 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
I1007 13:47:30.199470 794355 start.go:563] Will wait 60s for crictl version
I1007 13:47:30.199552 794355 ssh_runner.go:195] Run: which crictl
I1007 13:47:30.204959 794355 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I1007 13:47:30.257803 794355 start.go:579] Version: 0.1.0
RuntimeName: containerd
RuntimeVersion: 1.7.22
RuntimeApiVersion: v1
I1007 13:47:30.257943 794355 ssh_runner.go:195] Run: containerd --version
I1007 13:47:30.285699 794355 ssh_runner.go:195] Run: containerd --version
I1007 13:47:30.321098 794355 out.go:177] * Preparing Kubernetes v1.31.1 on containerd 1.7.22 ...
I1007 13:47:30.323575 794355 cli_runner.go:164] Run: docker network inspect no-preload-178678 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I1007 13:47:30.339448 794355 ssh_runner.go:195] Run: grep 192.168.85.1 host.minikube.internal$ /etc/hosts
I1007 13:47:30.343355 794355 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.85.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I1007 13:47:30.354634 794355 kubeadm.go:883] updating cluster {Name:no-preload-178678 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727731891-master@sha256:d66dfd4a976cf0b4581cac255174cef4031588c4570fa4a795e0b3d42edc9122 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:no-preload-178678 Namespace:default APIServerHAVIP: APIServerName:minikubeCA AP
IServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jen
kins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I1007 13:47:30.354760 794355 preload.go:131] Checking if preload exists for k8s version v1.31.1 and runtime containerd
I1007 13:47:30.354811 794355 ssh_runner.go:195] Run: sudo crictl images --output json
I1007 13:47:30.391637 794355 containerd.go:627] all images are preloaded for containerd runtime.
I1007 13:47:30.391665 794355 cache_images.go:84] Images are preloaded, skipping loading
I1007 13:47:30.391674 794355 kubeadm.go:934] updating node { 192.168.85.2 8443 v1.31.1 containerd true true} ...
I1007 13:47:30.391777 794355 kubeadm.go:946] kubelet [Unit]
Wants=containerd.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.31.1/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=no-preload-178678 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.85.2
[Install]
config:
{KubernetesVersion:v1.31.1 ClusterName:no-preload-178678 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I1007 13:47:30.391846 794355 ssh_runner.go:195] Run: sudo crictl info
I1007 13:47:30.433946 794355 cni.go:84] Creating CNI manager for ""
I1007 13:47:30.433973 794355 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I1007 13:47:30.433986 794355 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I1007 13:47:30.434009 794355 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.85.2 APIServerPort:8443 KubernetesVersion:v1.31.1 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:no-preload-178678 NodeName:no-preload-178678 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.85.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.85.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodP
ath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///run/containerd/containerd.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I1007 13:47:30.434181 794355 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta3
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.85.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///run/containerd/containerd.sock
name: "no-preload-178678"
kubeletExtraArgs:
node-ip: 192.168.85.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta3
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.85.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.31.1
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
containerRuntimeEndpoint: unix:///run/containerd/containerd.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I1007 13:47:30.434257 794355 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.31.1
I1007 13:47:30.446898 794355 binaries.go:44] Found k8s binaries, skipping transfer
I1007 13:47:30.446973 794355 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I1007 13:47:30.456905 794355 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (321 bytes)
I1007 13:47:30.477199 794355 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I1007 13:47:30.498147 794355 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2171 bytes)
I1007 13:47:30.518864 794355 ssh_runner.go:195] Run: grep 192.168.85.2 control-plane.minikube.internal$ /etc/hosts
I1007 13:47:30.522798 794355 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.85.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I1007 13:47:30.534421 794355 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1007 13:47:30.626595 794355 ssh_runner.go:195] Run: sudo systemctl start kubelet
I1007 13:47:30.643582 794355 certs.go:68] Setting up /home/jenkins/minikube-integration/18424-574640/.minikube/profiles/no-preload-178678 for IP: 192.168.85.2
I1007 13:47:30.643610 794355 certs.go:194] generating shared ca certs ...
I1007 13:47:30.643627 794355 certs.go:226] acquiring lock for ca certs: {Name:mkb94cd23ae3efb673f2949842bd2c98014816e7 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1007 13:47:30.643875 794355 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/18424-574640/.minikube/ca.key
I1007 13:47:30.643926 794355 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/18424-574640/.minikube/proxy-client-ca.key
I1007 13:47:30.643937 794355 certs.go:256] generating profile certs ...
I1007 13:47:30.644027 794355 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/18424-574640/.minikube/profiles/no-preload-178678/client.key
I1007 13:47:30.644109 794355 certs.go:359] skipping valid signed profile cert regeneration for "minikube": /home/jenkins/minikube-integration/18424-574640/.minikube/profiles/no-preload-178678/apiserver.key.e19e5b20
I1007 13:47:30.644160 794355 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/18424-574640/.minikube/profiles/no-preload-178678/proxy-client.key
I1007 13:47:30.644300 794355 certs.go:484] found cert: /home/jenkins/minikube-integration/18424-574640/.minikube/certs/580163.pem (1338 bytes)
W1007 13:47:30.644337 794355 certs.go:480] ignoring /home/jenkins/minikube-integration/18424-574640/.minikube/certs/580163_empty.pem, impossibly tiny 0 bytes
I1007 13:47:30.644350 794355 certs.go:484] found cert: /home/jenkins/minikube-integration/18424-574640/.minikube/certs/ca-key.pem (1679 bytes)
I1007 13:47:30.644374 794355 certs.go:484] found cert: /home/jenkins/minikube-integration/18424-574640/.minikube/certs/ca.pem (1082 bytes)
I1007 13:47:30.644400 794355 certs.go:484] found cert: /home/jenkins/minikube-integration/18424-574640/.minikube/certs/cert.pem (1123 bytes)
I1007 13:47:30.644426 794355 certs.go:484] found cert: /home/jenkins/minikube-integration/18424-574640/.minikube/certs/key.pem (1679 bytes)
I1007 13:47:30.644480 794355 certs.go:484] found cert: /home/jenkins/minikube-integration/18424-574640/.minikube/files/etc/ssl/certs/5801632.pem (1708 bytes)
I1007 13:47:30.645181 794355 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18424-574640/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I1007 13:47:30.675508 794355 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18424-574640/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I1007 13:47:30.702796 794355 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18424-574640/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I1007 13:47:30.728701 794355 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18424-574640/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I1007 13:47:30.763284 794355 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18424-574640/.minikube/profiles/no-preload-178678/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1424 bytes)
I1007 13:47:30.815229 794355 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18424-574640/.minikube/profiles/no-preload-178678/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I1007 13:47:30.854680 794355 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18424-574640/.minikube/profiles/no-preload-178678/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I1007 13:47:30.887250 794355 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18424-574640/.minikube/profiles/no-preload-178678/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I1007 13:47:30.917899 794355 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18424-574640/.minikube/certs/580163.pem --> /usr/share/ca-certificates/580163.pem (1338 bytes)
I1007 13:47:30.953734 794355 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18424-574640/.minikube/files/etc/ssl/certs/5801632.pem --> /usr/share/ca-certificates/5801632.pem (1708 bytes)
I1007 13:47:30.983063 794355 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18424-574640/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I1007 13:47:31.020416 794355 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I1007 13:47:31.041762 794355 ssh_runner.go:195] Run: openssl version
I1007 13:47:31.050558 794355 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/580163.pem && ln -fs /usr/share/ca-certificates/580163.pem /etc/ssl/certs/580163.pem"
I1007 13:47:31.062497 794355 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/580163.pem
I1007 13:47:31.066649 794355 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Oct 7 13:06 /usr/share/ca-certificates/580163.pem
I1007 13:47:31.066749 794355 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/580163.pem
I1007 13:47:31.074290 794355 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/580163.pem /etc/ssl/certs/51391683.0"
I1007 13:47:31.084762 794355 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/5801632.pem && ln -fs /usr/share/ca-certificates/5801632.pem /etc/ssl/certs/5801632.pem"
I1007 13:47:31.095956 794355 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/5801632.pem
I1007 13:47:31.100004 794355 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Oct 7 13:06 /usr/share/ca-certificates/5801632.pem
I1007 13:47:31.100080 794355 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/5801632.pem
I1007 13:47:31.107952 794355 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/5801632.pem /etc/ssl/certs/3ec20f2e.0"
I1007 13:47:31.119141 794355 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I1007 13:47:31.130515 794355 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I1007 13:47:31.134970 794355 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Oct 7 12:56 /usr/share/ca-certificates/minikubeCA.pem
I1007 13:47:31.135043 794355 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I1007 13:47:31.143074 794355 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I1007 13:47:31.153475 794355 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I1007 13:47:31.157431 794355 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
I1007 13:47:31.164602 794355 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
I1007 13:47:31.172307 794355 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
I1007 13:47:31.179676 794355 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
I1007 13:47:31.187428 794355 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
I1007 13:47:31.195719 794355 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
I1007 13:47:31.202836 794355 kubeadm.go:392] StartCluster: {Name:no-preload-178678 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727731891-master@sha256:d66dfd4a976cf0b4581cac255174cef4031588c4570fa4a795e0b3d42edc9122 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:no-preload-178678 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APISe
rverNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkin
s:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I1007 13:47:31.202941 794355 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}
I1007 13:47:31.203005 794355 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I1007 13:47:31.259266 794355 cri.go:89] found id: "dbf736aab37e3211987b3ec8c6931a437a26edc6d5c4bbe04c1d38cd34c8f03f"
I1007 13:47:31.259292 794355 cri.go:89] found id: "3194d5b907e6b8bf8971fb018f25759d55c877260e76b0a7fbda0a3e112940e3"
I1007 13:47:31.259296 794355 cri.go:89] found id: "00c6ca6d455614c7cf1a401b1f8b7521f049d2b692610659ae4683bce57d9e32"
I1007 13:47:31.259301 794355 cri.go:89] found id: "b935711aea707ce61d36b2d0561c37446a26ba3ecdd12f08138b34facf4ba623"
I1007 13:47:31.259306 794355 cri.go:89] found id: "bc043677512aaec562207d47602450f079bea404a98d863a7a9aebd601821d93"
I1007 13:47:31.259311 794355 cri.go:89] found id: "707a20dc9d7501895dfe567a7a779ca40e8fd166c56d5fede07fc9ca7ff99389"
I1007 13:47:31.259314 794355 cri.go:89] found id: "c574ff4369a62adef6d1dfe3942339a4d53449042cdeca6c760f18198a9cbfbf"
I1007 13:47:31.259317 794355 cri.go:89] found id: "1c834176710ac261d54557344fafb1339bee02e3f69697a088561211726a9feb"
I1007 13:47:31.259320 794355 cri.go:89] found id: ""
I1007 13:47:31.259391 794355 ssh_runner.go:195] Run: sudo runc --root /run/containerd/runc/k8s.io list -f json
I1007 13:47:31.291954 794355 cri.go:116] JSON = null
W1007 13:47:31.292020 794355 kubeadm.go:399] unpause failed: list paused: list returned 0 containers, but ps returned 8
I1007 13:47:31.292106 794355 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I1007 13:47:31.308877 794355 kubeadm.go:408] found existing configuration files, will attempt cluster restart
I1007 13:47:31.308901 794355 kubeadm.go:593] restartPrimaryControlPlane start ...
I1007 13:47:31.308964 794355 ssh_runner.go:195] Run: sudo test -d /data/minikube
I1007 13:47:31.325526 794355 kubeadm.go:130] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
stdout:
stderr:
I1007 13:47:31.326225 794355 kubeconfig.go:47] verify endpoint returned: get endpoint: "no-preload-178678" does not appear in /home/jenkins/minikube-integration/18424-574640/kubeconfig
I1007 13:47:31.326534 794355 kubeconfig.go:62] /home/jenkins/minikube-integration/18424-574640/kubeconfig needs updating (will repair): [kubeconfig missing "no-preload-178678" cluster setting kubeconfig missing "no-preload-178678" context setting]
I1007 13:47:31.331527 794355 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18424-574640/kubeconfig: {Name:mk8cb646df388630470eb87db824f7b511497a09 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1007 13:47:31.337102 794355 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
I1007 13:47:31.369933 794355 kubeadm.go:630] The running cluster does not require reconfiguration: 192.168.85.2
I1007 13:47:31.369970 794355 kubeadm.go:597] duration metric: took 61.063115ms to restartPrimaryControlPlane
I1007 13:47:31.369980 794355 kubeadm.go:394] duration metric: took 167.161554ms to StartCluster
I1007 13:47:31.369996 794355 settings.go:142] acquiring lock: {Name:mk8a7c208419d2453ea37ed5e7d0421609f0d046 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1007 13:47:31.370064 794355 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/18424-574640/kubeconfig
I1007 13:47:31.371135 794355 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18424-574640/kubeconfig: {Name:mk8cb646df388630470eb87db824f7b511497a09 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1007 13:47:31.371338 794355 start.go:235] Will wait 6m0s for node &{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:containerd ControlPlane:true Worker:true}
I1007 13:47:31.371727 794355 config.go:182] Loaded profile config "no-preload-178678": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.31.1
I1007 13:47:31.371795 794355 addons.go:507] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:true default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]
I1007 13:47:31.371917 794355 addons.go:69] Setting storage-provisioner=true in profile "no-preload-178678"
I1007 13:47:31.371937 794355 addons.go:234] Setting addon storage-provisioner=true in "no-preload-178678"
W1007 13:47:31.371947 794355 addons.go:243] addon storage-provisioner should already be in state true
I1007 13:47:31.371974 794355 host.go:66] Checking if "no-preload-178678" exists ...
I1007 13:47:31.371982 794355 addons.go:69] Setting default-storageclass=true in profile "no-preload-178678"
I1007 13:47:31.371997 794355 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "no-preload-178678"
I1007 13:47:31.372331 794355 cli_runner.go:164] Run: docker container inspect no-preload-178678 --format={{.State.Status}}
I1007 13:47:31.372455 794355 cli_runner.go:164] Run: docker container inspect no-preload-178678 --format={{.State.Status}}
I1007 13:47:31.374944 794355 addons.go:69] Setting dashboard=true in profile "no-preload-178678"
I1007 13:47:31.376351 794355 addons.go:234] Setting addon dashboard=true in "no-preload-178678"
W1007 13:47:31.376371 794355 addons.go:243] addon dashboard should already be in state true
I1007 13:47:31.376403 794355 host.go:66] Checking if "no-preload-178678" exists ...
I1007 13:47:31.376864 794355 cli_runner.go:164] Run: docker container inspect no-preload-178678 --format={{.State.Status}}
I1007 13:47:31.378500 794355 out.go:177] * Verifying Kubernetes components...
I1007 13:47:31.376253 794355 addons.go:69] Setting metrics-server=true in profile "no-preload-178678"
I1007 13:47:31.383662 794355 addons.go:234] Setting addon metrics-server=true in "no-preload-178678"
W1007 13:47:31.383679 794355 addons.go:243] addon metrics-server should already be in state true
I1007 13:47:31.383722 794355 host.go:66] Checking if "no-preload-178678" exists ...
I1007 13:47:31.384216 794355 cli_runner.go:164] Run: docker container inspect no-preload-178678 --format={{.State.Status}}
I1007 13:47:31.385812 794355 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1007 13:47:31.435881 794355 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I1007 13:47:31.438640 794355 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner.yaml
I1007 13:47:31.438672 794355 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I1007 13:47:31.438771 794355 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-178678
I1007 13:47:31.443727 794355 addons.go:234] Setting addon default-storageclass=true in "no-preload-178678"
W1007 13:47:31.443748 794355 addons.go:243] addon default-storageclass should already be in state true
I1007 13:47:31.443774 794355 host.go:66] Checking if "no-preload-178678" exists ...
I1007 13:47:31.444207 794355 cli_runner.go:164] Run: docker container inspect no-preload-178678 --format={{.State.Status}}
I1007 13:47:31.453313 794355 out.go:177] - Using image docker.io/kubernetesui/dashboard:v2.7.0
I1007 13:47:31.456404 794355 out.go:177] - Using image registry.k8s.io/echoserver:1.4
I1007 13:47:31.460857 794355 addons.go:431] installing /etc/kubernetes/addons/dashboard-ns.yaml
I1007 13:47:31.460885 794355 ssh_runner.go:362] scp dashboard/dashboard-ns.yaml --> /etc/kubernetes/addons/dashboard-ns.yaml (759 bytes)
I1007 13:47:31.460975 794355 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-178678
I1007 13:47:31.489475 794355 out.go:177] - Using image fake.domain/registry.k8s.io/echoserver:1.4
I1007 13:47:27.820147 788969 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-716021" in "kube-system" namespace has status "Ready":"False"
I1007 13:47:29.822185 788969 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-716021" in "kube-system" namespace has status "Ready":"False"
I1007 13:47:32.312523 788969 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-716021" in "kube-system" namespace has status "Ready":"False"
I1007 13:47:31.491566 794355 addons.go:431] installing /etc/kubernetes/addons/metrics-apiservice.yaml
I1007 13:47:31.491598 794355 ssh_runner.go:362] scp metrics-server/metrics-apiservice.yaml --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
I1007 13:47:31.491688 794355 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-178678
I1007 13:47:31.517008 794355 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33804 SSHKeyPath:/home/jenkins/minikube-integration/18424-574640/.minikube/machines/no-preload-178678/id_rsa Username:docker}
I1007 13:47:31.522345 794355 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33804 SSHKeyPath:/home/jenkins/minikube-integration/18424-574640/.minikube/machines/no-preload-178678/id_rsa Username:docker}
I1007 13:47:31.535423 794355 addons.go:431] installing /etc/kubernetes/addons/storageclass.yaml
I1007 13:47:31.535450 794355 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I1007 13:47:31.535521 794355 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-178678
I1007 13:47:31.563334 794355 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33804 SSHKeyPath:/home/jenkins/minikube-integration/18424-574640/.minikube/machines/no-preload-178678/id_rsa Username:docker}
I1007 13:47:31.579597 794355 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33804 SSHKeyPath:/home/jenkins/minikube-integration/18424-574640/.minikube/machines/no-preload-178678/id_rsa Username:docker}
I1007 13:47:31.656014 794355 ssh_runner.go:195] Run: sudo systemctl start kubelet
I1007 13:47:31.701611 794355 node_ready.go:35] waiting up to 6m0s for node "no-preload-178678" to be "Ready" ...
I1007 13:47:31.864648 794355 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I1007 13:47:31.870187 794355 addons.go:431] installing /etc/kubernetes/addons/dashboard-clusterrole.yaml
I1007 13:47:31.870216 794355 ssh_runner.go:362] scp dashboard/dashboard-clusterrole.yaml --> /etc/kubernetes/addons/dashboard-clusterrole.yaml (1001 bytes)
I1007 13:47:31.886446 794355 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I1007 13:47:31.996508 794355 addons.go:431] installing /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml
I1007 13:47:31.996585 794355 ssh_runner.go:362] scp dashboard/dashboard-clusterrolebinding.yaml --> /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml (1018 bytes)
I1007 13:47:32.000095 794355 addons.go:431] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
I1007 13:47:32.000196 794355 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1825 bytes)
I1007 13:47:32.189487 794355 addons.go:431] installing /etc/kubernetes/addons/dashboard-configmap.yaml
I1007 13:47:32.189565 794355 ssh_runner.go:362] scp dashboard/dashboard-configmap.yaml --> /etc/kubernetes/addons/dashboard-configmap.yaml (837 bytes)
I1007 13:47:32.277719 794355 addons.go:431] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
I1007 13:47:32.277818 794355 ssh_runner.go:362] scp metrics-server/metrics-server-rbac.yaml --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
I1007 13:47:32.300025 794355 addons.go:431] installing /etc/kubernetes/addons/dashboard-dp.yaml
I1007 13:47:32.300112 794355 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-dp.yaml (4201 bytes)
W1007 13:47:32.382556 794355 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storage-provisioner.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
I1007 13:47:32.382653 794355 retry.go:31] will retry after 211.563357ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storage-provisioner.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
W1007 13:47:32.422375 794355 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storageclass.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
I1007 13:47:32.422471 794355 retry.go:31] will retry after 296.753315ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storageclass.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
I1007 13:47:32.456997 794355 addons.go:431] installing /etc/kubernetes/addons/metrics-server-service.yaml
I1007 13:47:32.457076 794355 ssh_runner.go:362] scp metrics-server/metrics-server-service.yaml --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
I1007 13:47:32.472338 794355 addons.go:431] installing /etc/kubernetes/addons/dashboard-role.yaml
I1007 13:47:32.472427 794355 ssh_runner.go:362] scp dashboard/dashboard-role.yaml --> /etc/kubernetes/addons/dashboard-role.yaml (1724 bytes)
I1007 13:47:32.553315 794355 addons.go:431] installing /etc/kubernetes/addons/dashboard-rolebinding.yaml
I1007 13:47:32.553402 794355 ssh_runner.go:362] scp dashboard/dashboard-rolebinding.yaml --> /etc/kubernetes/addons/dashboard-rolebinding.yaml (1046 bytes)
I1007 13:47:32.556352 794355 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I1007 13:47:32.594666 794355 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I1007 13:47:32.643749 794355 addons.go:431] installing /etc/kubernetes/addons/dashboard-sa.yaml
I1007 13:47:32.643778 794355 ssh_runner.go:362] scp dashboard/dashboard-sa.yaml --> /etc/kubernetes/addons/dashboard-sa.yaml (837 bytes)
I1007 13:47:32.719721 794355 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I1007 13:47:32.823193 794355 addons.go:431] installing /etc/kubernetes/addons/dashboard-secret.yaml
I1007 13:47:32.823219 794355 ssh_runner.go:362] scp dashboard/dashboard-secret.yaml --> /etc/kubernetes/addons/dashboard-secret.yaml (1389 bytes)
I1007 13:47:33.055548 794355 addons.go:431] installing /etc/kubernetes/addons/dashboard-svc.yaml
I1007 13:47:33.055579 794355 ssh_runner.go:362] scp dashboard/dashboard-svc.yaml --> /etc/kubernetes/addons/dashboard-svc.yaml (1294 bytes)
I1007 13:47:33.202206 794355 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I1007 13:47:34.314786 788969 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-716021" in "kube-system" namespace has status "Ready":"False"
I1007 13:47:36.824207 788969 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-716021" in "kube-system" namespace has status "Ready":"False"
I1007 13:47:36.651662 794355 node_ready.go:49] node "no-preload-178678" has status "Ready":"True"
I1007 13:47:36.651700 794355 node_ready.go:38] duration metric: took 4.950048149s for node "no-preload-178678" to be "Ready" ...
I1007 13:47:36.651712 794355 pod_ready.go:36] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I1007 13:47:36.678600 794355 pod_ready.go:79] waiting up to 6m0s for pod "coredns-7c65d6cfc9-zc8p4" in "kube-system" namespace to be "Ready" ...
I1007 13:47:36.697266 794355 pod_ready.go:93] pod "coredns-7c65d6cfc9-zc8p4" in "kube-system" namespace has status "Ready":"True"
I1007 13:47:36.697294 794355 pod_ready.go:82] duration metric: took 18.653808ms for pod "coredns-7c65d6cfc9-zc8p4" in "kube-system" namespace to be "Ready" ...
I1007 13:47:36.697307 794355 pod_ready.go:79] waiting up to 6m0s for pod "etcd-no-preload-178678" in "kube-system" namespace to be "Ready" ...
I1007 13:47:36.704874 794355 pod_ready.go:93] pod "etcd-no-preload-178678" in "kube-system" namespace has status "Ready":"True"
I1007 13:47:36.704901 794355 pod_ready.go:82] duration metric: took 7.586574ms for pod "etcd-no-preload-178678" in "kube-system" namespace to be "Ready" ...
I1007 13:47:36.704917 794355 pod_ready.go:79] waiting up to 6m0s for pod "kube-apiserver-no-preload-178678" in "kube-system" namespace to be "Ready" ...
I1007 13:47:36.736067 794355 pod_ready.go:93] pod "kube-apiserver-no-preload-178678" in "kube-system" namespace has status "Ready":"True"
I1007 13:47:36.736096 794355 pod_ready.go:82] duration metric: took 31.17053ms for pod "kube-apiserver-no-preload-178678" in "kube-system" namespace to be "Ready" ...
I1007 13:47:36.736110 794355 pod_ready.go:79] waiting up to 6m0s for pod "kube-controller-manager-no-preload-178678" in "kube-system" namespace to be "Ready" ...
I1007 13:47:36.749371 794355 pod_ready.go:93] pod "kube-controller-manager-no-preload-178678" in "kube-system" namespace has status "Ready":"True"
I1007 13:47:36.749398 794355 pod_ready.go:82] duration metric: took 13.278925ms for pod "kube-controller-manager-no-preload-178678" in "kube-system" namespace to be "Ready" ...
I1007 13:47:36.749411 794355 pod_ready.go:79] waiting up to 6m0s for pod "kube-proxy-46xb9" in "kube-system" namespace to be "Ready" ...
I1007 13:47:36.862814 794355 pod_ready.go:93] pod "kube-proxy-46xb9" in "kube-system" namespace has status "Ready":"True"
I1007 13:47:36.862842 794355 pod_ready.go:82] duration metric: took 113.423594ms for pod "kube-proxy-46xb9" in "kube-system" namespace to be "Ready" ...
I1007 13:47:36.862856 794355 pod_ready.go:79] waiting up to 6m0s for pod "kube-scheduler-no-preload-178678" in "kube-system" namespace to be "Ready" ...
I1007 13:47:38.869360 794355 pod_ready.go:103] pod "kube-scheduler-no-preload-178678" in "kube-system" namespace has status "Ready":"False"
I1007 13:47:39.672313 794355 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (7.115867069s)
I1007 13:47:39.672357 794355 addons.go:475] Verifying addon metrics-server=true in "no-preload-178678"
I1007 13:47:39.802921 794355 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: (7.208165181s)
I1007 13:47:39.802988 794355 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: (7.083238741s)
I1007 13:47:39.803242 794355 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: (6.600999886s)
I1007 13:47:39.805256 794355 out.go:177] * Some dashboard features require the metrics-server addon. To enable all features please run:
minikube -p no-preload-178678 addons enable metrics-server
I1007 13:47:39.814087 794355 out.go:177] * Enabled addons: metrics-server, storage-provisioner, dashboard, default-storageclass
I1007 13:47:39.312769 788969 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-716021" in "kube-system" namespace has status "Ready":"False"
I1007 13:47:41.811539 788969 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-716021" in "kube-system" namespace has status "Ready":"False"
I1007 13:47:39.815958 794355 addons.go:510] duration metric: took 8.444172351s for enable addons: enabled=[metrics-server storage-provisioner dashboard default-storageclass]
I1007 13:47:41.368908 794355 pod_ready.go:103] pod "kube-scheduler-no-preload-178678" in "kube-system" namespace has status "Ready":"False"
I1007 13:47:43.370334 794355 pod_ready.go:103] pod "kube-scheduler-no-preload-178678" in "kube-system" namespace has status "Ready":"False"
I1007 13:47:43.819839 788969 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-716021" in "kube-system" namespace has status "Ready":"False"
I1007 13:47:46.311911 788969 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-716021" in "kube-system" namespace has status "Ready":"False"
I1007 13:47:45.380852 794355 pod_ready.go:103] pod "kube-scheduler-no-preload-178678" in "kube-system" namespace has status "Ready":"False"
I1007 13:47:46.869223 794355 pod_ready.go:93] pod "kube-scheduler-no-preload-178678" in "kube-system" namespace has status "Ready":"True"
I1007 13:47:46.869298 794355 pod_ready.go:82] duration metric: took 10.006432803s for pod "kube-scheduler-no-preload-178678" in "kube-system" namespace to be "Ready" ...
I1007 13:47:46.869326 794355 pod_ready.go:79] waiting up to 6m0s for pod "metrics-server-6867b74b74-86hgb" in "kube-system" namespace to be "Ready" ...
I1007 13:47:48.312191 788969 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-716021" in "kube-system" namespace has status "Ready":"False"
I1007 13:47:50.811830 788969 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-716021" in "kube-system" namespace has status "Ready":"False"
I1007 13:47:48.876924 794355 pod_ready.go:103] pod "metrics-server-6867b74b74-86hgb" in "kube-system" namespace has status "Ready":"False"
I1007 13:47:50.878450 794355 pod_ready.go:103] pod "metrics-server-6867b74b74-86hgb" in "kube-system" namespace has status "Ready":"False"
I1007 13:47:53.375602 794355 pod_ready.go:103] pod "metrics-server-6867b74b74-86hgb" in "kube-system" namespace has status "Ready":"False"
I1007 13:47:53.310894 788969 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-716021" in "kube-system" namespace has status "Ready":"False"
I1007 13:47:55.311229 788969 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-716021" in "kube-system" namespace has status "Ready":"False"
I1007 13:47:56.311516 788969 pod_ready.go:93] pod "kube-controller-manager-old-k8s-version-716021" in "kube-system" namespace has status "Ready":"True"
I1007 13:47:56.311544 788969 pod_ready.go:82] duration metric: took 1m20.007043994s for pod "kube-controller-manager-old-k8s-version-716021" in "kube-system" namespace to be "Ready" ...
I1007 13:47:56.311557 788969 pod_ready.go:79] waiting up to 6m0s for pod "kube-proxy-hdch9" in "kube-system" namespace to be "Ready" ...
I1007 13:47:56.317840 788969 pod_ready.go:93] pod "kube-proxy-hdch9" in "kube-system" namespace has status "Ready":"True"
I1007 13:47:56.317869 788969 pod_ready.go:82] duration metric: took 6.304821ms for pod "kube-proxy-hdch9" in "kube-system" namespace to be "Ready" ...
I1007 13:47:56.317882 788969 pod_ready.go:79] waiting up to 6m0s for pod "kube-scheduler-old-k8s-version-716021" in "kube-system" namespace to be "Ready" ...
I1007 13:47:56.323346 788969 pod_ready.go:93] pod "kube-scheduler-old-k8s-version-716021" in "kube-system" namespace has status "Ready":"True"
I1007 13:47:56.323374 788969 pod_ready.go:82] duration metric: took 5.462529ms for pod "kube-scheduler-old-k8s-version-716021" in "kube-system" namespace to be "Ready" ...
I1007 13:47:56.323387 788969 pod_ready.go:79] waiting up to 6m0s for pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace to be "Ready" ...
I1007 13:47:55.375810 794355 pod_ready.go:103] pod "metrics-server-6867b74b74-86hgb" in "kube-system" namespace has status "Ready":"False"
I1007 13:47:57.876325 794355 pod_ready.go:103] pod "metrics-server-6867b74b74-86hgb" in "kube-system" namespace has status "Ready":"False"
I1007 13:47:58.330847 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:48:00.496638 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:48:00.500870 794355 pod_ready.go:103] pod "metrics-server-6867b74b74-86hgb" in "kube-system" namespace has status "Ready":"False"
I1007 13:48:02.875737 794355 pod_ready.go:103] pod "metrics-server-6867b74b74-86hgb" in "kube-system" namespace has status "Ready":"False"
I1007 13:48:02.830995 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:48:05.330608 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:48:07.378265 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:48:04.875871 794355 pod_ready.go:103] pod "metrics-server-6867b74b74-86hgb" in "kube-system" namespace has status "Ready":"False"
I1007 13:48:07.376652 794355 pod_ready.go:103] pod "metrics-server-6867b74b74-86hgb" in "kube-system" namespace has status "Ready":"False"
I1007 13:48:09.829529 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:48:11.830063 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:48:09.875782 794355 pod_ready.go:103] pod "metrics-server-6867b74b74-86hgb" in "kube-system" namespace has status "Ready":"False"
I1007 13:48:12.375731 794355 pod_ready.go:103] pod "metrics-server-6867b74b74-86hgb" in "kube-system" namespace has status "Ready":"False"
I1007 13:48:13.830398 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:48:16.330624 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:48:14.377047 794355 pod_ready.go:103] pod "metrics-server-6867b74b74-86hgb" in "kube-system" namespace has status "Ready":"False"
I1007 13:48:16.875540 794355 pod_ready.go:103] pod "metrics-server-6867b74b74-86hgb" in "kube-system" namespace has status "Ready":"False"
I1007 13:48:18.829935 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:48:20.834962 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:48:18.876235 794355 pod_ready.go:103] pod "metrics-server-6867b74b74-86hgb" in "kube-system" namespace has status "Ready":"False"
I1007 13:48:20.881655 794355 pod_ready.go:103] pod "metrics-server-6867b74b74-86hgb" in "kube-system" namespace has status "Ready":"False"
I1007 13:48:23.375713 794355 pod_ready.go:103] pod "metrics-server-6867b74b74-86hgb" in "kube-system" namespace has status "Ready":"False"
I1007 13:48:23.329605 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:48:25.330833 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:48:25.875084 794355 pod_ready.go:103] pod "metrics-server-6867b74b74-86hgb" in "kube-system" namespace has status "Ready":"False"
I1007 13:48:27.875632 794355 pod_ready.go:103] pod "metrics-server-6867b74b74-86hgb" in "kube-system" namespace has status "Ready":"False"
I1007 13:48:27.831879 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:48:30.331107 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:48:30.375161 794355 pod_ready.go:103] pod "metrics-server-6867b74b74-86hgb" in "kube-system" namespace has status "Ready":"False"
I1007 13:48:32.379649 794355 pod_ready.go:103] pod "metrics-server-6867b74b74-86hgb" in "kube-system" namespace has status "Ready":"False"
I1007 13:48:32.829901 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:48:35.330367 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:48:37.330969 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:48:34.876324 794355 pod_ready.go:103] pod "metrics-server-6867b74b74-86hgb" in "kube-system" namespace has status "Ready":"False"
I1007 13:48:36.877418 794355 pod_ready.go:103] pod "metrics-server-6867b74b74-86hgb" in "kube-system" namespace has status "Ready":"False"
I1007 13:48:39.829226 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:48:41.829841 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:48:39.376024 794355 pod_ready.go:103] pod "metrics-server-6867b74b74-86hgb" in "kube-system" namespace has status "Ready":"False"
I1007 13:48:41.377353 794355 pod_ready.go:103] pod "metrics-server-6867b74b74-86hgb" in "kube-system" namespace has status "Ready":"False"
I1007 13:48:44.329644 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:48:46.330697 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:48:43.875815 794355 pod_ready.go:103] pod "metrics-server-6867b74b74-86hgb" in "kube-system" namespace has status "Ready":"False"
I1007 13:48:46.375861 794355 pod_ready.go:103] pod "metrics-server-6867b74b74-86hgb" in "kube-system" namespace has status "Ready":"False"
I1007 13:48:48.376033 794355 pod_ready.go:103] pod "metrics-server-6867b74b74-86hgb" in "kube-system" namespace has status "Ready":"False"
I1007 13:48:48.330894 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:48:50.829621 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:48:50.376120 794355 pod_ready.go:103] pod "metrics-server-6867b74b74-86hgb" in "kube-system" namespace has status "Ready":"False"
I1007 13:48:52.879026 794355 pod_ready.go:103] pod "metrics-server-6867b74b74-86hgb" in "kube-system" namespace has status "Ready":"False"
I1007 13:48:52.830554 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:48:55.329892 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:48:55.375383 794355 pod_ready.go:103] pod "metrics-server-6867b74b74-86hgb" in "kube-system" namespace has status "Ready":"False"
I1007 13:48:57.376247 794355 pod_ready.go:103] pod "metrics-server-6867b74b74-86hgb" in "kube-system" namespace has status "Ready":"False"
I1007 13:48:57.832139 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:49:00.381288 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:48:59.875695 794355 pod_ready.go:103] pod "metrics-server-6867b74b74-86hgb" in "kube-system" namespace has status "Ready":"False"
I1007 13:49:02.376498 794355 pod_ready.go:103] pod "metrics-server-6867b74b74-86hgb" in "kube-system" namespace has status "Ready":"False"
I1007 13:49:02.829594 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:49:04.831500 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:49:07.329846 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:49:04.876570 794355 pod_ready.go:103] pod "metrics-server-6867b74b74-86hgb" in "kube-system" namespace has status "Ready":"False"
I1007 13:49:07.376065 794355 pod_ready.go:103] pod "metrics-server-6867b74b74-86hgb" in "kube-system" namespace has status "Ready":"False"
I1007 13:49:09.329971 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:49:11.330024 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:49:09.376634 794355 pod_ready.go:103] pod "metrics-server-6867b74b74-86hgb" in "kube-system" namespace has status "Ready":"False"
I1007 13:49:11.877493 794355 pod_ready.go:103] pod "metrics-server-6867b74b74-86hgb" in "kube-system" namespace has status "Ready":"False"
I1007 13:49:13.830806 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:49:15.831685 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:49:14.375363 794355 pod_ready.go:103] pod "metrics-server-6867b74b74-86hgb" in "kube-system" namespace has status "Ready":"False"
I1007 13:49:16.376066 794355 pod_ready.go:103] pod "metrics-server-6867b74b74-86hgb" in "kube-system" namespace has status "Ready":"False"
I1007 13:49:17.853965 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:49:20.330145 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:49:22.330226 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:49:18.876063 794355 pod_ready.go:103] pod "metrics-server-6867b74b74-86hgb" in "kube-system" namespace has status "Ready":"False"
I1007 13:49:21.375742 794355 pod_ready.go:103] pod "metrics-server-6867b74b74-86hgb" in "kube-system" namespace has status "Ready":"False"
I1007 13:49:23.376392 794355 pod_ready.go:103] pod "metrics-server-6867b74b74-86hgb" in "kube-system" namespace has status "Ready":"False"
I1007 13:49:24.829579 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:49:26.829872 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:49:25.875584 794355 pod_ready.go:103] pod "metrics-server-6867b74b74-86hgb" in "kube-system" namespace has status "Ready":"False"
I1007 13:49:28.375008 794355 pod_ready.go:103] pod "metrics-server-6867b74b74-86hgb" in "kube-system" namespace has status "Ready":"False"
I1007 13:49:28.830038 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:49:30.832511 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:49:30.375202 794355 pod_ready.go:103] pod "metrics-server-6867b74b74-86hgb" in "kube-system" namespace has status "Ready":"False"
I1007 13:49:32.375986 794355 pod_ready.go:103] pod "metrics-server-6867b74b74-86hgb" in "kube-system" namespace has status "Ready":"False"
I1007 13:49:33.330702 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:49:35.331136 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:49:34.878999 794355 pod_ready.go:103] pod "metrics-server-6867b74b74-86hgb" in "kube-system" namespace has status "Ready":"False"
I1007 13:49:37.376680 794355 pod_ready.go:103] pod "metrics-server-6867b74b74-86hgb" in "kube-system" namespace has status "Ready":"False"
I1007 13:49:37.834831 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:49:40.330871 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:49:42.334259 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:49:39.876158 794355 pod_ready.go:103] pod "metrics-server-6867b74b74-86hgb" in "kube-system" namespace has status "Ready":"False"
I1007 13:49:42.376774 794355 pod_ready.go:103] pod "metrics-server-6867b74b74-86hgb" in "kube-system" namespace has status "Ready":"False"
I1007 13:49:44.830040 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:49:46.831538 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:49:44.876244 794355 pod_ready.go:103] pod "metrics-server-6867b74b74-86hgb" in "kube-system" namespace has status "Ready":"False"
I1007 13:49:47.376360 794355 pod_ready.go:103] pod "metrics-server-6867b74b74-86hgb" in "kube-system" namespace has status "Ready":"False"
I1007 13:49:49.329922 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:49:51.330390 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:49:49.875683 794355 pod_ready.go:103] pod "metrics-server-6867b74b74-86hgb" in "kube-system" namespace has status "Ready":"False"
I1007 13:49:52.377454 794355 pod_ready.go:103] pod "metrics-server-6867b74b74-86hgb" in "kube-system" namespace has status "Ready":"False"
I1007 13:49:53.829974 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:49:56.330400 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:49:54.876198 794355 pod_ready.go:103] pod "metrics-server-6867b74b74-86hgb" in "kube-system" namespace has status "Ready":"False"
I1007 13:49:57.375504 794355 pod_ready.go:103] pod "metrics-server-6867b74b74-86hgb" in "kube-system" namespace has status "Ready":"False"
I1007 13:49:58.829116 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:50:00.830835 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:49:59.376484 794355 pod_ready.go:103] pod "metrics-server-6867b74b74-86hgb" in "kube-system" namespace has status "Ready":"False"
I1007 13:50:01.383103 794355 pod_ready.go:103] pod "metrics-server-6867b74b74-86hgb" in "kube-system" namespace has status "Ready":"False"
I1007 13:50:03.329964 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:50:05.330720 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:50:03.875764 794355 pod_ready.go:103] pod "metrics-server-6867b74b74-86hgb" in "kube-system" namespace has status "Ready":"False"
I1007 13:50:05.879191 794355 pod_ready.go:103] pod "metrics-server-6867b74b74-86hgb" in "kube-system" namespace has status "Ready":"False"
I1007 13:50:08.376931 794355 pod_ready.go:103] pod "metrics-server-6867b74b74-86hgb" in "kube-system" namespace has status "Ready":"False"
I1007 13:50:07.833777 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:50:10.331002 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:50:10.876186 794355 pod_ready.go:103] pod "metrics-server-6867b74b74-86hgb" in "kube-system" namespace has status "Ready":"False"
I1007 13:50:13.375323 794355 pod_ready.go:103] pod "metrics-server-6867b74b74-86hgb" in "kube-system" namespace has status "Ready":"False"
I1007 13:50:12.830194 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:50:14.831603 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:50:17.330076 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:50:15.375763 794355 pod_ready.go:103] pod "metrics-server-6867b74b74-86hgb" in "kube-system" namespace has status "Ready":"False"
I1007 13:50:17.876544 794355 pod_ready.go:103] pod "metrics-server-6867b74b74-86hgb" in "kube-system" namespace has status "Ready":"False"
I1007 13:50:19.330317 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:50:21.330539 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:50:20.375754 794355 pod_ready.go:103] pod "metrics-server-6867b74b74-86hgb" in "kube-system" namespace has status "Ready":"False"
I1007 13:50:22.376043 794355 pod_ready.go:103] pod "metrics-server-6867b74b74-86hgb" in "kube-system" namespace has status "Ready":"False"
I1007 13:50:23.829440 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:50:25.832290 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:50:24.875715 794355 pod_ready.go:103] pod "metrics-server-6867b74b74-86hgb" in "kube-system" namespace has status "Ready":"False"
I1007 13:50:26.875766 794355 pod_ready.go:103] pod "metrics-server-6867b74b74-86hgb" in "kube-system" namespace has status "Ready":"False"
I1007 13:50:28.330077 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:50:30.330410 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:50:28.876547 794355 pod_ready.go:103] pod "metrics-server-6867b74b74-86hgb" in "kube-system" namespace has status "Ready":"False"
I1007 13:50:31.377901 794355 pod_ready.go:103] pod "metrics-server-6867b74b74-86hgb" in "kube-system" namespace has status "Ready":"False"
I1007 13:50:32.830347 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:50:35.329841 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:50:37.330605 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:50:33.875499 794355 pod_ready.go:103] pod "metrics-server-6867b74b74-86hgb" in "kube-system" namespace has status "Ready":"False"
I1007 13:50:35.876753 794355 pod_ready.go:103] pod "metrics-server-6867b74b74-86hgb" in "kube-system" namespace has status "Ready":"False"
I1007 13:50:38.376127 794355 pod_ready.go:103] pod "metrics-server-6867b74b74-86hgb" in "kube-system" namespace has status "Ready":"False"
I1007 13:50:39.333940 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:50:41.830665 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:50:40.875079 794355 pod_ready.go:103] pod "metrics-server-6867b74b74-86hgb" in "kube-system" namespace has status "Ready":"False"
I1007 13:50:42.875466 794355 pod_ready.go:103] pod "metrics-server-6867b74b74-86hgb" in "kube-system" namespace has status "Ready":"False"
I1007 13:50:44.329814 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:50:46.330801 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:50:44.876007 794355 pod_ready.go:103] pod "metrics-server-6867b74b74-86hgb" in "kube-system" namespace has status "Ready":"False"
I1007 13:50:47.375299 794355 pod_ready.go:103] pod "metrics-server-6867b74b74-86hgb" in "kube-system" namespace has status "Ready":"False"
I1007 13:50:48.835715 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:50:51.330141 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:50:49.375828 794355 pod_ready.go:103] pod "metrics-server-6867b74b74-86hgb" in "kube-system" namespace has status "Ready":"False"
I1007 13:50:51.376034 794355 pod_ready.go:103] pod "metrics-server-6867b74b74-86hgb" in "kube-system" namespace has status "Ready":"False"
I1007 13:50:53.330922 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:50:55.830596 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:50:53.875833 794355 pod_ready.go:103] pod "metrics-server-6867b74b74-86hgb" in "kube-system" namespace has status "Ready":"False"
I1007 13:50:56.375036 794355 pod_ready.go:103] pod "metrics-server-6867b74b74-86hgb" in "kube-system" namespace has status "Ready":"False"
I1007 13:50:58.376603 794355 pod_ready.go:103] pod "metrics-server-6867b74b74-86hgb" in "kube-system" namespace has status "Ready":"False"
I1007 13:50:57.833565 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:51:00.410864 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:51:00.394556 794355 pod_ready.go:103] pod "metrics-server-6867b74b74-86hgb" in "kube-system" namespace has status "Ready":"False"
I1007 13:51:02.875913 794355 pod_ready.go:103] pod "metrics-server-6867b74b74-86hgb" in "kube-system" namespace has status "Ready":"False"
I1007 13:51:02.830510 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:51:05.330789 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:51:04.876428 794355 pod_ready.go:103] pod "metrics-server-6867b74b74-86hgb" in "kube-system" namespace has status "Ready":"False"
I1007 13:51:07.375779 794355 pod_ready.go:103] pod "metrics-server-6867b74b74-86hgb" in "kube-system" namespace has status "Ready":"False"
I1007 13:51:07.831297 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:51:10.330220 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:51:12.330573 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:51:09.876149 794355 pod_ready.go:103] pod "metrics-server-6867b74b74-86hgb" in "kube-system" namespace has status "Ready":"False"
I1007 13:51:11.876601 794355 pod_ready.go:103] pod "metrics-server-6867b74b74-86hgb" in "kube-system" namespace has status "Ready":"False"
I1007 13:51:14.830258 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:51:17.330295 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:51:14.375508 794355 pod_ready.go:103] pod "metrics-server-6867b74b74-86hgb" in "kube-system" namespace has status "Ready":"False"
I1007 13:51:16.875554 794355 pod_ready.go:103] pod "metrics-server-6867b74b74-86hgb" in "kube-system" namespace has status "Ready":"False"
I1007 13:51:19.330834 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:51:21.829496 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:51:18.875717 794355 pod_ready.go:103] pod "metrics-server-6867b74b74-86hgb" in "kube-system" namespace has status "Ready":"False"
I1007 13:51:20.876197 794355 pod_ready.go:103] pod "metrics-server-6867b74b74-86hgb" in "kube-system" namespace has status "Ready":"False"
I1007 13:51:23.376025 794355 pod_ready.go:103] pod "metrics-server-6867b74b74-86hgb" in "kube-system" namespace has status "Ready":"False"
I1007 13:51:23.829855 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:51:25.830331 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:51:25.376185 794355 pod_ready.go:103] pod "metrics-server-6867b74b74-86hgb" in "kube-system" namespace has status "Ready":"False"
I1007 13:51:27.875838 794355 pod_ready.go:103] pod "metrics-server-6867b74b74-86hgb" in "kube-system" namespace has status "Ready":"False"
I1007 13:51:27.839887 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:51:30.335084 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:51:30.376432 794355 pod_ready.go:103] pod "metrics-server-6867b74b74-86hgb" in "kube-system" namespace has status "Ready":"False"
I1007 13:51:32.874961 794355 pod_ready.go:103] pod "metrics-server-6867b74b74-86hgb" in "kube-system" namespace has status "Ready":"False"
I1007 13:51:32.829640 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:51:34.830683 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:51:37.329315 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:51:34.875811 794355 pod_ready.go:103] pod "metrics-server-6867b74b74-86hgb" in "kube-system" namespace has status "Ready":"False"
I1007 13:51:36.876256 794355 pod_ready.go:103] pod "metrics-server-6867b74b74-86hgb" in "kube-system" namespace has status "Ready":"False"
I1007 13:51:39.330613 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:51:41.829295 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:51:39.375427 794355 pod_ready.go:103] pod "metrics-server-6867b74b74-86hgb" in "kube-system" namespace has status "Ready":"False"
I1007 13:51:41.375736 794355 pod_ready.go:103] pod "metrics-server-6867b74b74-86hgb" in "kube-system" namespace has status "Ready":"False"
I1007 13:51:43.375871 794355 pod_ready.go:103] pod "metrics-server-6867b74b74-86hgb" in "kube-system" namespace has status "Ready":"False"
I1007 13:51:43.833110 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:51:46.329539 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:51:45.378865 794355 pod_ready.go:103] pod "metrics-server-6867b74b74-86hgb" in "kube-system" namespace has status "Ready":"False"
I1007 13:51:46.876514 794355 pod_ready.go:82] duration metric: took 4m0.007156897s for pod "metrics-server-6867b74b74-86hgb" in "kube-system" namespace to be "Ready" ...
E1007 13:51:46.876544 794355 pod_ready.go:67] WaitExtra: waitPodCondition: context deadline exceeded
I1007 13:51:46.876554 794355 pod_ready.go:39] duration metric: took 4m10.224827266s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I1007 13:51:46.876570 794355 api_server.go:52] waiting for apiserver process to appear ...
I1007 13:51:46.876604 794355 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
I1007 13:51:46.876668 794355 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I1007 13:51:46.928843 794355 cri.go:89] found id: "43bdf561a58ff5fabe544dd85759243717c93e1c15c722fe3c0a318ca95f5b0d"
I1007 13:51:46.928878 794355 cri.go:89] found id: "bc043677512aaec562207d47602450f079bea404a98d863a7a9aebd601821d93"
I1007 13:51:46.928883 794355 cri.go:89] found id: ""
I1007 13:51:46.928891 794355 logs.go:282] 2 containers: [43bdf561a58ff5fabe544dd85759243717c93e1c15c722fe3c0a318ca95f5b0d bc043677512aaec562207d47602450f079bea404a98d863a7a9aebd601821d93]
I1007 13:51:46.928960 794355 ssh_runner.go:195] Run: which crictl
I1007 13:51:46.932727 794355 ssh_runner.go:195] Run: which crictl
I1007 13:51:46.936597 794355 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
I1007 13:51:46.936695 794355 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I1007 13:51:46.990641 794355 cri.go:89] found id: "33903c7a377f2b08b0fecf23a0c14df9bb3a9c9ec0f64bfa2c22ba01a2ff9d9b"
I1007 13:51:46.990667 794355 cri.go:89] found id: "707a20dc9d7501895dfe567a7a779ca40e8fd166c56d5fede07fc9ca7ff99389"
I1007 13:51:46.990683 794355 cri.go:89] found id: ""
I1007 13:51:46.990692 794355 logs.go:282] 2 containers: [33903c7a377f2b08b0fecf23a0c14df9bb3a9c9ec0f64bfa2c22ba01a2ff9d9b 707a20dc9d7501895dfe567a7a779ca40e8fd166c56d5fede07fc9ca7ff99389]
I1007 13:51:46.990762 794355 ssh_runner.go:195] Run: which crictl
I1007 13:51:46.994672 794355 ssh_runner.go:195] Run: which crictl
I1007 13:51:46.998432 794355 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
I1007 13:51:46.998517 794355 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I1007 13:51:47.038728 794355 cri.go:89] found id: "9a5e89ef652822e1f49fb89e396dfb759057f81942cd30388e30068d53d89879"
I1007 13:51:47.038754 794355 cri.go:89] found id: "dbf736aab37e3211987b3ec8c6931a437a26edc6d5c4bbe04c1d38cd34c8f03f"
I1007 13:51:47.038759 794355 cri.go:89] found id: ""
I1007 13:51:47.038767 794355 logs.go:282] 2 containers: [9a5e89ef652822e1f49fb89e396dfb759057f81942cd30388e30068d53d89879 dbf736aab37e3211987b3ec8c6931a437a26edc6d5c4bbe04c1d38cd34c8f03f]
I1007 13:51:47.038823 794355 ssh_runner.go:195] Run: which crictl
I1007 13:51:47.042991 794355 ssh_runner.go:195] Run: which crictl
I1007 13:51:47.046830 794355 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
I1007 13:51:47.046904 794355 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I1007 13:51:47.091734 794355 cri.go:89] found id: "cd590f5f9108ec9765f17072f326f44cd3c8ab302521c32f26c090cdd981b6f6"
I1007 13:51:47.091757 794355 cri.go:89] found id: "c574ff4369a62adef6d1dfe3942339a4d53449042cdeca6c760f18198a9cbfbf"
I1007 13:51:47.091761 794355 cri.go:89] found id: ""
I1007 13:51:47.091769 794355 logs.go:282] 2 containers: [cd590f5f9108ec9765f17072f326f44cd3c8ab302521c32f26c090cdd981b6f6 c574ff4369a62adef6d1dfe3942339a4d53449042cdeca6c760f18198a9cbfbf]
I1007 13:51:47.091825 794355 ssh_runner.go:195] Run: which crictl
I1007 13:51:47.095655 794355 ssh_runner.go:195] Run: which crictl
I1007 13:51:47.099483 794355 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
I1007 13:51:47.099608 794355 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I1007 13:51:47.139376 794355 cri.go:89] found id: "42bfb9b45ce705d6a68018440dc9e8cb4f11c7bce3abd38a8ea5acab2ef57a6e"
I1007 13:51:47.139400 794355 cri.go:89] found id: "b935711aea707ce61d36b2d0561c37446a26ba3ecdd12f08138b34facf4ba623"
I1007 13:51:47.139405 794355 cri.go:89] found id: ""
I1007 13:51:47.139413 794355 logs.go:282] 2 containers: [42bfb9b45ce705d6a68018440dc9e8cb4f11c7bce3abd38a8ea5acab2ef57a6e b935711aea707ce61d36b2d0561c37446a26ba3ecdd12f08138b34facf4ba623]
I1007 13:51:47.139470 794355 ssh_runner.go:195] Run: which crictl
I1007 13:51:47.143682 794355 ssh_runner.go:195] Run: which crictl
I1007 13:51:47.147465 794355 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
I1007 13:51:47.147540 794355 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I1007 13:51:47.194440 794355 cri.go:89] found id: "ab0b956db3468c6fd8893d641eb706709d5cd0eedcbe8aaee7fe806586346a40"
I1007 13:51:47.194463 794355 cri.go:89] found id: "1c834176710ac261d54557344fafb1339bee02e3f69697a088561211726a9feb"
I1007 13:51:47.194468 794355 cri.go:89] found id: ""
I1007 13:51:47.194475 794355 logs.go:282] 2 containers: [ab0b956db3468c6fd8893d641eb706709d5cd0eedcbe8aaee7fe806586346a40 1c834176710ac261d54557344fafb1339bee02e3f69697a088561211726a9feb]
I1007 13:51:47.194569 794355 ssh_runner.go:195] Run: which crictl
I1007 13:51:47.198421 794355 ssh_runner.go:195] Run: which crictl
I1007 13:51:47.201770 794355 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
I1007 13:51:47.201886 794355 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I1007 13:51:47.253639 794355 cri.go:89] found id: "8eaabe7d610941a8182facd3522da4f8fe7135414350c9246a55dd84e51dc457"
I1007 13:51:47.253778 794355 cri.go:89] found id: "3194d5b907e6b8bf8971fb018f25759d55c877260e76b0a7fbda0a3e112940e3"
I1007 13:51:47.253799 794355 cri.go:89] found id: ""
I1007 13:51:47.253814 794355 logs.go:282] 2 containers: [8eaabe7d610941a8182facd3522da4f8fe7135414350c9246a55dd84e51dc457 3194d5b907e6b8bf8971fb018f25759d55c877260e76b0a7fbda0a3e112940e3]
I1007 13:51:47.253884 794355 ssh_runner.go:195] Run: which crictl
I1007 13:51:47.258080 794355 ssh_runner.go:195] Run: which crictl
I1007 13:51:47.261648 794355 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
I1007 13:51:47.261769 794355 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I1007 13:51:47.307818 794355 cri.go:89] found id: "26f59d548b181b4d23dbd64124417687da7c0d30cffc04a0fddcbe9c4ad969cb"
I1007 13:51:47.307845 794355 cri.go:89] found id: ""
I1007 13:51:47.307854 794355 logs.go:282] 1 containers: [26f59d548b181b4d23dbd64124417687da7c0d30cffc04a0fddcbe9c4ad969cb]
I1007 13:51:47.307930 794355 ssh_runner.go:195] Run: which crictl
I1007 13:51:47.311840 794355 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
I1007 13:51:47.311935 794355 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I1007 13:51:47.354816 794355 cri.go:89] found id: "6dd1df3ff1615192d2ec04bf57a163244d17bfb455a44288e257159641f69817"
I1007 13:51:47.354840 794355 cri.go:89] found id: "f1587851443378e689dc16812fa6726ea857f90f4d96b15adc0b5e91ddbf6286"
I1007 13:51:47.354846 794355 cri.go:89] found id: ""
I1007 13:51:47.354854 794355 logs.go:282] 2 containers: [6dd1df3ff1615192d2ec04bf57a163244d17bfb455a44288e257159641f69817 f1587851443378e689dc16812fa6726ea857f90f4d96b15adc0b5e91ddbf6286]
I1007 13:51:47.354927 794355 ssh_runner.go:195] Run: which crictl
I1007 13:51:47.358550 794355 ssh_runner.go:195] Run: which crictl
I1007 13:51:47.362166 794355 logs.go:123] Gathering logs for coredns [9a5e89ef652822e1f49fb89e396dfb759057f81942cd30388e30068d53d89879] ...
I1007 13:51:47.362197 794355 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 9a5e89ef652822e1f49fb89e396dfb759057f81942cd30388e30068d53d89879"
I1007 13:51:47.411340 794355 logs.go:123] Gathering logs for kube-scheduler [cd590f5f9108ec9765f17072f326f44cd3c8ab302521c32f26c090cdd981b6f6] ...
I1007 13:51:47.411373 794355 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 cd590f5f9108ec9765f17072f326f44cd3c8ab302521c32f26c090cdd981b6f6"
I1007 13:51:47.458852 794355 logs.go:123] Gathering logs for kindnet [3194d5b907e6b8bf8971fb018f25759d55c877260e76b0a7fbda0a3e112940e3] ...
I1007 13:51:47.458886 794355 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 3194d5b907e6b8bf8971fb018f25759d55c877260e76b0a7fbda0a3e112940e3"
I1007 13:51:47.501483 794355 logs.go:123] Gathering logs for describe nodes ...
I1007 13:51:47.501520 794355 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I1007 13:51:47.698624 794355 logs.go:123] Gathering logs for kube-apiserver [43bdf561a58ff5fabe544dd85759243717c93e1c15c722fe3c0a318ca95f5b0d] ...
I1007 13:51:47.698656 794355 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 43bdf561a58ff5fabe544dd85759243717c93e1c15c722fe3c0a318ca95f5b0d"
I1007 13:51:47.755024 794355 logs.go:123] Gathering logs for etcd [707a20dc9d7501895dfe567a7a779ca40e8fd166c56d5fede07fc9ca7ff99389] ...
I1007 13:51:47.755058 794355 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 707a20dc9d7501895dfe567a7a779ca40e8fd166c56d5fede07fc9ca7ff99389"
I1007 13:51:47.813053 794355 logs.go:123] Gathering logs for kube-controller-manager [ab0b956db3468c6fd8893d641eb706709d5cd0eedcbe8aaee7fe806586346a40] ...
I1007 13:51:47.813086 794355 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 ab0b956db3468c6fd8893d641eb706709d5cd0eedcbe8aaee7fe806586346a40"
I1007 13:51:47.886674 794355 logs.go:123] Gathering logs for kubernetes-dashboard [26f59d548b181b4d23dbd64124417687da7c0d30cffc04a0fddcbe9c4ad969cb] ...
I1007 13:51:47.886708 794355 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 26f59d548b181b4d23dbd64124417687da7c0d30cffc04a0fddcbe9c4ad969cb"
I1007 13:51:47.930277 794355 logs.go:123] Gathering logs for storage-provisioner [f1587851443378e689dc16812fa6726ea857f90f4d96b15adc0b5e91ddbf6286] ...
I1007 13:51:47.930308 794355 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 f1587851443378e689dc16812fa6726ea857f90f4d96b15adc0b5e91ddbf6286"
I1007 13:51:47.969751 794355 logs.go:123] Gathering logs for container status ...
I1007 13:51:47.969782 794355 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I1007 13:51:48.017957 794355 logs.go:123] Gathering logs for kube-apiserver [bc043677512aaec562207d47602450f079bea404a98d863a7a9aebd601821d93] ...
I1007 13:51:48.017990 794355 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 bc043677512aaec562207d47602450f079bea404a98d863a7a9aebd601821d93"
I1007 13:51:48.073245 794355 logs.go:123] Gathering logs for etcd [33903c7a377f2b08b0fecf23a0c14df9bb3a9c9ec0f64bfa2c22ba01a2ff9d9b] ...
I1007 13:51:48.073282 794355 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 33903c7a377f2b08b0fecf23a0c14df9bb3a9c9ec0f64bfa2c22ba01a2ff9d9b"
I1007 13:51:48.124783 794355 logs.go:123] Gathering logs for coredns [dbf736aab37e3211987b3ec8c6931a437a26edc6d5c4bbe04c1d38cd34c8f03f] ...
I1007 13:51:48.124835 794355 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 dbf736aab37e3211987b3ec8c6931a437a26edc6d5c4bbe04c1d38cd34c8f03f"
I1007 13:51:48.168174 794355 logs.go:123] Gathering logs for kube-proxy [42bfb9b45ce705d6a68018440dc9e8cb4f11c7bce3abd38a8ea5acab2ef57a6e] ...
I1007 13:51:48.168206 794355 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 42bfb9b45ce705d6a68018440dc9e8cb4f11c7bce3abd38a8ea5acab2ef57a6e"
I1007 13:51:48.219356 794355 logs.go:123] Gathering logs for kube-proxy [b935711aea707ce61d36b2d0561c37446a26ba3ecdd12f08138b34facf4ba623] ...
I1007 13:51:48.219437 794355 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 b935711aea707ce61d36b2d0561c37446a26ba3ecdd12f08138b34facf4ba623"
I1007 13:51:48.270419 794355 logs.go:123] Gathering logs for kubelet ...
I1007 13:51:48.270448 794355 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I1007 13:51:48.354348 794355 logs.go:123] Gathering logs for dmesg ...
I1007 13:51:48.354387 794355 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I1007 13:51:48.375675 794355 logs.go:123] Gathering logs for kube-scheduler [c574ff4369a62adef6d1dfe3942339a4d53449042cdeca6c760f18198a9cbfbf] ...
I1007 13:51:48.375705 794355 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 c574ff4369a62adef6d1dfe3942339a4d53449042cdeca6c760f18198a9cbfbf"
I1007 13:51:48.427057 794355 logs.go:123] Gathering logs for kube-controller-manager [1c834176710ac261d54557344fafb1339bee02e3f69697a088561211726a9feb] ...
I1007 13:51:48.427093 794355 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 1c834176710ac261d54557344fafb1339bee02e3f69697a088561211726a9feb"
I1007 13:51:48.491075 794355 logs.go:123] Gathering logs for kindnet [8eaabe7d610941a8182facd3522da4f8fe7135414350c9246a55dd84e51dc457] ...
I1007 13:51:48.491110 794355 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 8eaabe7d610941a8182facd3522da4f8fe7135414350c9246a55dd84e51dc457"
I1007 13:51:48.537231 794355 logs.go:123] Gathering logs for storage-provisioner [6dd1df3ff1615192d2ec04bf57a163244d17bfb455a44288e257159641f69817] ...
I1007 13:51:48.537263 794355 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 6dd1df3ff1615192d2ec04bf57a163244d17bfb455a44288e257159641f69817"
I1007 13:51:48.579305 794355 logs.go:123] Gathering logs for containerd ...
I1007 13:51:48.579335 794355 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
I1007 13:51:48.335702 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:51:50.829593 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:51:51.147163 794355 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1007 13:51:51.160665 794355 api_server.go:72] duration metric: took 4m19.789284883s to wait for apiserver process to appear ...
I1007 13:51:51.160693 794355 api_server.go:88] waiting for apiserver healthz status ...
I1007 13:51:51.160732 794355 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
I1007 13:51:51.160793 794355 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I1007 13:51:51.202836 794355 cri.go:89] found id: "43bdf561a58ff5fabe544dd85759243717c93e1c15c722fe3c0a318ca95f5b0d"
I1007 13:51:51.202861 794355 cri.go:89] found id: "bc043677512aaec562207d47602450f079bea404a98d863a7a9aebd601821d93"
I1007 13:51:51.202866 794355 cri.go:89] found id: ""
I1007 13:51:51.202874 794355 logs.go:282] 2 containers: [43bdf561a58ff5fabe544dd85759243717c93e1c15c722fe3c0a318ca95f5b0d bc043677512aaec562207d47602450f079bea404a98d863a7a9aebd601821d93]
I1007 13:51:51.202937 794355 ssh_runner.go:195] Run: which crictl
I1007 13:51:51.206946 794355 ssh_runner.go:195] Run: which crictl
I1007 13:51:51.211150 794355 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
I1007 13:51:51.211229 794355 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I1007 13:51:51.260451 794355 cri.go:89] found id: "33903c7a377f2b08b0fecf23a0c14df9bb3a9c9ec0f64bfa2c22ba01a2ff9d9b"
I1007 13:51:51.260473 794355 cri.go:89] found id: "707a20dc9d7501895dfe567a7a779ca40e8fd166c56d5fede07fc9ca7ff99389"
I1007 13:51:51.260478 794355 cri.go:89] found id: ""
I1007 13:51:51.260486 794355 logs.go:282] 2 containers: [33903c7a377f2b08b0fecf23a0c14df9bb3a9c9ec0f64bfa2c22ba01a2ff9d9b 707a20dc9d7501895dfe567a7a779ca40e8fd166c56d5fede07fc9ca7ff99389]
I1007 13:51:51.260551 794355 ssh_runner.go:195] Run: which crictl
I1007 13:51:51.264367 794355 ssh_runner.go:195] Run: which crictl
I1007 13:51:51.268019 794355 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
I1007 13:51:51.268112 794355 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I1007 13:51:51.313956 794355 cri.go:89] found id: "9a5e89ef652822e1f49fb89e396dfb759057f81942cd30388e30068d53d89879"
I1007 13:51:51.313981 794355 cri.go:89] found id: "dbf736aab37e3211987b3ec8c6931a437a26edc6d5c4bbe04c1d38cd34c8f03f"
I1007 13:51:51.313987 794355 cri.go:89] found id: ""
I1007 13:51:51.313995 794355 logs.go:282] 2 containers: [9a5e89ef652822e1f49fb89e396dfb759057f81942cd30388e30068d53d89879 dbf736aab37e3211987b3ec8c6931a437a26edc6d5c4bbe04c1d38cd34c8f03f]
I1007 13:51:51.314055 794355 ssh_runner.go:195] Run: which crictl
I1007 13:51:51.320138 794355 ssh_runner.go:195] Run: which crictl
I1007 13:51:51.323892 794355 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
I1007 13:51:51.323966 794355 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I1007 13:51:51.367224 794355 cri.go:89] found id: "cd590f5f9108ec9765f17072f326f44cd3c8ab302521c32f26c090cdd981b6f6"
I1007 13:51:51.367248 794355 cri.go:89] found id: "c574ff4369a62adef6d1dfe3942339a4d53449042cdeca6c760f18198a9cbfbf"
I1007 13:51:51.367253 794355 cri.go:89] found id: ""
I1007 13:51:51.367261 794355 logs.go:282] 2 containers: [cd590f5f9108ec9765f17072f326f44cd3c8ab302521c32f26c090cdd981b6f6 c574ff4369a62adef6d1dfe3942339a4d53449042cdeca6c760f18198a9cbfbf]
I1007 13:51:51.367318 794355 ssh_runner.go:195] Run: which crictl
I1007 13:51:51.371479 794355 ssh_runner.go:195] Run: which crictl
I1007 13:51:51.375596 794355 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
I1007 13:51:51.375677 794355 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I1007 13:51:51.416509 794355 cri.go:89] found id: "42bfb9b45ce705d6a68018440dc9e8cb4f11c7bce3abd38a8ea5acab2ef57a6e"
I1007 13:51:51.416571 794355 cri.go:89] found id: "b935711aea707ce61d36b2d0561c37446a26ba3ecdd12f08138b34facf4ba623"
I1007 13:51:51.416582 794355 cri.go:89] found id: ""
I1007 13:51:51.416590 794355 logs.go:282] 2 containers: [42bfb9b45ce705d6a68018440dc9e8cb4f11c7bce3abd38a8ea5acab2ef57a6e b935711aea707ce61d36b2d0561c37446a26ba3ecdd12f08138b34facf4ba623]
I1007 13:51:51.416647 794355 ssh_runner.go:195] Run: which crictl
I1007 13:51:51.420368 794355 ssh_runner.go:195] Run: which crictl
I1007 13:51:51.424068 794355 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
I1007 13:51:51.424147 794355 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I1007 13:51:51.471458 794355 cri.go:89] found id: "ab0b956db3468c6fd8893d641eb706709d5cd0eedcbe8aaee7fe806586346a40"
I1007 13:51:51.471482 794355 cri.go:89] found id: "1c834176710ac261d54557344fafb1339bee02e3f69697a088561211726a9feb"
I1007 13:51:51.471487 794355 cri.go:89] found id: ""
I1007 13:51:51.471495 794355 logs.go:282] 2 containers: [ab0b956db3468c6fd8893d641eb706709d5cd0eedcbe8aaee7fe806586346a40 1c834176710ac261d54557344fafb1339bee02e3f69697a088561211726a9feb]
I1007 13:51:51.471549 794355 ssh_runner.go:195] Run: which crictl
I1007 13:51:51.475473 794355 ssh_runner.go:195] Run: which crictl
I1007 13:51:51.478968 794355 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
I1007 13:51:51.479042 794355 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I1007 13:51:51.523170 794355 cri.go:89] found id: "8eaabe7d610941a8182facd3522da4f8fe7135414350c9246a55dd84e51dc457"
I1007 13:51:51.523234 794355 cri.go:89] found id: "3194d5b907e6b8bf8971fb018f25759d55c877260e76b0a7fbda0a3e112940e3"
I1007 13:51:51.523244 794355 cri.go:89] found id: ""
I1007 13:51:51.523252 794355 logs.go:282] 2 containers: [8eaabe7d610941a8182facd3522da4f8fe7135414350c9246a55dd84e51dc457 3194d5b907e6b8bf8971fb018f25759d55c877260e76b0a7fbda0a3e112940e3]
I1007 13:51:51.523314 794355 ssh_runner.go:195] Run: which crictl
I1007 13:51:51.527219 794355 ssh_runner.go:195] Run: which crictl
I1007 13:51:51.531459 794355 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
I1007 13:51:51.531539 794355 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I1007 13:51:51.569549 794355 cri.go:89] found id: "6dd1df3ff1615192d2ec04bf57a163244d17bfb455a44288e257159641f69817"
I1007 13:51:51.569573 794355 cri.go:89] found id: "f1587851443378e689dc16812fa6726ea857f90f4d96b15adc0b5e91ddbf6286"
I1007 13:51:51.569579 794355 cri.go:89] found id: ""
I1007 13:51:51.569586 794355 logs.go:282] 2 containers: [6dd1df3ff1615192d2ec04bf57a163244d17bfb455a44288e257159641f69817 f1587851443378e689dc16812fa6726ea857f90f4d96b15adc0b5e91ddbf6286]
I1007 13:51:51.569641 794355 ssh_runner.go:195] Run: which crictl
I1007 13:51:51.573537 794355 ssh_runner.go:195] Run: which crictl
I1007 13:51:51.577329 794355 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
I1007 13:51:51.577403 794355 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I1007 13:51:51.626409 794355 cri.go:89] found id: "26f59d548b181b4d23dbd64124417687da7c0d30cffc04a0fddcbe9c4ad969cb"
I1007 13:51:51.626434 794355 cri.go:89] found id: ""
I1007 13:51:51.626443 794355 logs.go:282] 1 containers: [26f59d548b181b4d23dbd64124417687da7c0d30cffc04a0fddcbe9c4ad969cb]
I1007 13:51:51.626565 794355 ssh_runner.go:195] Run: which crictl
I1007 13:51:51.630335 794355 logs.go:123] Gathering logs for kube-apiserver [bc043677512aaec562207d47602450f079bea404a98d863a7a9aebd601821d93] ...
I1007 13:51:51.630403 794355 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 bc043677512aaec562207d47602450f079bea404a98d863a7a9aebd601821d93"
I1007 13:51:51.698702 794355 logs.go:123] Gathering logs for etcd [33903c7a377f2b08b0fecf23a0c14df9bb3a9c9ec0f64bfa2c22ba01a2ff9d9b] ...
I1007 13:51:51.698738 794355 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 33903c7a377f2b08b0fecf23a0c14df9bb3a9c9ec0f64bfa2c22ba01a2ff9d9b"
I1007 13:51:51.749079 794355 logs.go:123] Gathering logs for storage-provisioner [f1587851443378e689dc16812fa6726ea857f90f4d96b15adc0b5e91ddbf6286] ...
I1007 13:51:51.749111 794355 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 f1587851443378e689dc16812fa6726ea857f90f4d96b15adc0b5e91ddbf6286"
I1007 13:51:51.808959 794355 logs.go:123] Gathering logs for container status ...
I1007 13:51:51.808990 794355 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I1007 13:51:51.880281 794355 logs.go:123] Gathering logs for describe nodes ...
I1007 13:51:51.880311 794355 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I1007 13:51:52.020771 794355 logs.go:123] Gathering logs for dmesg ...
I1007 13:51:52.020805 794355 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I1007 13:51:52.040720 794355 logs.go:123] Gathering logs for etcd [707a20dc9d7501895dfe567a7a779ca40e8fd166c56d5fede07fc9ca7ff99389] ...
I1007 13:51:52.040752 794355 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 707a20dc9d7501895dfe567a7a779ca40e8fd166c56d5fede07fc9ca7ff99389"
I1007 13:51:52.099965 794355 logs.go:123] Gathering logs for coredns [9a5e89ef652822e1f49fb89e396dfb759057f81942cd30388e30068d53d89879] ...
I1007 13:51:52.100000 794355 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 9a5e89ef652822e1f49fb89e396dfb759057f81942cd30388e30068d53d89879"
I1007 13:51:52.143348 794355 logs.go:123] Gathering logs for coredns [dbf736aab37e3211987b3ec8c6931a437a26edc6d5c4bbe04c1d38cd34c8f03f] ...
I1007 13:51:52.143378 794355 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 dbf736aab37e3211987b3ec8c6931a437a26edc6d5c4bbe04c1d38cd34c8f03f"
I1007 13:51:52.181648 794355 logs.go:123] Gathering logs for kube-scheduler [cd590f5f9108ec9765f17072f326f44cd3c8ab302521c32f26c090cdd981b6f6] ...
I1007 13:51:52.181713 794355 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 cd590f5f9108ec9765f17072f326f44cd3c8ab302521c32f26c090cdd981b6f6"
I1007 13:51:52.243906 794355 logs.go:123] Gathering logs for kubelet ...
I1007 13:51:52.243935 794355 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I1007 13:51:52.326079 794355 logs.go:123] Gathering logs for kindnet [3194d5b907e6b8bf8971fb018f25759d55c877260e76b0a7fbda0a3e112940e3] ...
I1007 13:51:52.326115 794355 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 3194d5b907e6b8bf8971fb018f25759d55c877260e76b0a7fbda0a3e112940e3"
I1007 13:51:52.371249 794355 logs.go:123] Gathering logs for containerd ...
I1007 13:51:52.371277 794355 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
I1007 13:51:52.434154 794355 logs.go:123] Gathering logs for kube-apiserver [43bdf561a58ff5fabe544dd85759243717c93e1c15c722fe3c0a318ca95f5b0d] ...
I1007 13:51:52.434190 794355 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 43bdf561a58ff5fabe544dd85759243717c93e1c15c722fe3c0a318ca95f5b0d"
I1007 13:51:52.490198 794355 logs.go:123] Gathering logs for kube-proxy [42bfb9b45ce705d6a68018440dc9e8cb4f11c7bce3abd38a8ea5acab2ef57a6e] ...
I1007 13:51:52.490276 794355 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 42bfb9b45ce705d6a68018440dc9e8cb4f11c7bce3abd38a8ea5acab2ef57a6e"
I1007 13:51:52.532926 794355 logs.go:123] Gathering logs for kube-proxy [b935711aea707ce61d36b2d0561c37446a26ba3ecdd12f08138b34facf4ba623] ...
I1007 13:51:52.533023 794355 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 b935711aea707ce61d36b2d0561c37446a26ba3ecdd12f08138b34facf4ba623"
I1007 13:51:52.574880 794355 logs.go:123] Gathering logs for kube-controller-manager [ab0b956db3468c6fd8893d641eb706709d5cd0eedcbe8aaee7fe806586346a40] ...
I1007 13:51:52.574958 794355 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 ab0b956db3468c6fd8893d641eb706709d5cd0eedcbe8aaee7fe806586346a40"
I1007 13:51:52.642127 794355 logs.go:123] Gathering logs for kube-controller-manager [1c834176710ac261d54557344fafb1339bee02e3f69697a088561211726a9feb] ...
I1007 13:51:52.642162 794355 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 1c834176710ac261d54557344fafb1339bee02e3f69697a088561211726a9feb"
I1007 13:51:52.711878 794355 logs.go:123] Gathering logs for kindnet [8eaabe7d610941a8182facd3522da4f8fe7135414350c9246a55dd84e51dc457] ...
I1007 13:51:52.711912 794355 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 8eaabe7d610941a8182facd3522da4f8fe7135414350c9246a55dd84e51dc457"
I1007 13:51:52.754733 794355 logs.go:123] Gathering logs for storage-provisioner [6dd1df3ff1615192d2ec04bf57a163244d17bfb455a44288e257159641f69817] ...
I1007 13:51:52.754766 794355 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 6dd1df3ff1615192d2ec04bf57a163244d17bfb455a44288e257159641f69817"
I1007 13:51:52.798642 794355 logs.go:123] Gathering logs for kubernetes-dashboard [26f59d548b181b4d23dbd64124417687da7c0d30cffc04a0fddcbe9c4ad969cb] ...
I1007 13:51:52.798670 794355 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 26f59d548b181b4d23dbd64124417687da7c0d30cffc04a0fddcbe9c4ad969cb"
I1007 13:51:52.854405 794355 logs.go:123] Gathering logs for kube-scheduler [c574ff4369a62adef6d1dfe3942339a4d53449042cdeca6c760f18198a9cbfbf] ...
I1007 13:51:52.854437 794355 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 c574ff4369a62adef6d1dfe3942339a4d53449042cdeca6c760f18198a9cbfbf"
I1007 13:51:52.831395 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:51:55.330997 788969 pod_ready.go:103] pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace has status "Ready":"False"
I1007 13:51:56.334279 788969 pod_ready.go:82] duration metric: took 4m0.010877247s for pod "metrics-server-9975d5f86-b7ct2" in "kube-system" namespace to be "Ready" ...
E1007 13:51:56.334361 788969 pod_ready.go:67] WaitExtra: waitPodCondition: context deadline exceeded
I1007 13:51:56.334374 788969 pod_ready.go:39] duration metric: took 5m29.754093121s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I1007 13:51:56.334389 788969 api_server.go:52] waiting for apiserver process to appear ...
I1007 13:51:56.334457 788969 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
I1007 13:51:56.334579 788969 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I1007 13:51:56.412777 788969 cri.go:89] found id: "6438e2a98b44ed7687544147d7fde2facece2b6119ba86ffa996a5b8e7019da7"
I1007 13:51:56.412797 788969 cri.go:89] found id: "dffbe9e7eda4a16ea00f685c861a1d7506d88d6ae76dc1fbd3b528f0186bf960"
I1007 13:51:56.412802 788969 cri.go:89] found id: ""
I1007 13:51:56.412810 788969 logs.go:282] 2 containers: [6438e2a98b44ed7687544147d7fde2facece2b6119ba86ffa996a5b8e7019da7 dffbe9e7eda4a16ea00f685c861a1d7506d88d6ae76dc1fbd3b528f0186bf960]
I1007 13:51:56.412866 788969 ssh_runner.go:195] Run: which crictl
I1007 13:51:56.422463 788969 ssh_runner.go:195] Run: which crictl
I1007 13:51:56.429934 788969 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
I1007 13:51:56.430014 788969 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I1007 13:51:56.500290 788969 cri.go:89] found id: "538e7c613d2fdfcf8bdf655918adbdaa8c80e7d22ee153d71d980bad173f6cd1"
I1007 13:51:56.500315 788969 cri.go:89] found id: "3f8d8d7911069dffad8bf7ce9156d34436c105ed532c7439e0b6bda21c43e87c"
I1007 13:51:56.500320 788969 cri.go:89] found id: ""
I1007 13:51:56.500327 788969 logs.go:282] 2 containers: [538e7c613d2fdfcf8bdf655918adbdaa8c80e7d22ee153d71d980bad173f6cd1 3f8d8d7911069dffad8bf7ce9156d34436c105ed532c7439e0b6bda21c43e87c]
I1007 13:51:56.500384 788969 ssh_runner.go:195] Run: which crictl
I1007 13:51:56.505493 788969 ssh_runner.go:195] Run: which crictl
I1007 13:51:56.511697 788969 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
I1007 13:51:56.511775 788969 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I1007 13:51:56.568360 788969 cri.go:89] found id: "b970f66a7b788465fb1b5efff7470a2a13241205a4b3871615987cd5e8185c0b"
I1007 13:51:56.568387 788969 cri.go:89] found id: "fefa6581f4e4cb7fefe7289a78cf684582ea646cd5283484696218c2863765ed"
I1007 13:51:56.568392 788969 cri.go:89] found id: ""
I1007 13:51:56.568399 788969 logs.go:282] 2 containers: [b970f66a7b788465fb1b5efff7470a2a13241205a4b3871615987cd5e8185c0b fefa6581f4e4cb7fefe7289a78cf684582ea646cd5283484696218c2863765ed]
I1007 13:51:56.568468 788969 ssh_runner.go:195] Run: which crictl
I1007 13:51:56.572933 788969 ssh_runner.go:195] Run: which crictl
I1007 13:51:56.577480 788969 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
I1007 13:51:56.577558 788969 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I1007 13:51:56.637806 788969 cri.go:89] found id: "1e75bdb1fcc164ca7ea09aaa49994e75347b13bbf4549844b1471555f94af297"
I1007 13:51:56.637834 788969 cri.go:89] found id: "3a2ed108143653900fc42a927e9971546f5f58f58c845162e9ad03a74ef4c19f"
I1007 13:51:56.637838 788969 cri.go:89] found id: ""
I1007 13:51:56.637846 788969 logs.go:282] 2 containers: [1e75bdb1fcc164ca7ea09aaa49994e75347b13bbf4549844b1471555f94af297 3a2ed108143653900fc42a927e9971546f5f58f58c845162e9ad03a74ef4c19f]
I1007 13:51:56.637918 788969 ssh_runner.go:195] Run: which crictl
I1007 13:51:56.643411 788969 ssh_runner.go:195] Run: which crictl
I1007 13:51:56.647884 788969 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
I1007 13:51:56.647957 788969 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I1007 13:51:56.750655 788969 cri.go:89] found id: "b47f6084fbcd06d9de3d640a50b2eedabdcfa0e9e99795313dbbf409ba0b34ba"
I1007 13:51:56.750682 788969 cri.go:89] found id: "90271f39ba89eca0f9f411179e611fffa8cb7092df3cd7385b2489d67eb7a32d"
I1007 13:51:56.750687 788969 cri.go:89] found id: ""
I1007 13:51:56.750694 788969 logs.go:282] 2 containers: [b47f6084fbcd06d9de3d640a50b2eedabdcfa0e9e99795313dbbf409ba0b34ba 90271f39ba89eca0f9f411179e611fffa8cb7092df3cd7385b2489d67eb7a32d]
I1007 13:51:56.750755 788969 ssh_runner.go:195] Run: which crictl
I1007 13:51:56.761341 788969 ssh_runner.go:195] Run: which crictl
I1007 13:51:56.767207 788969 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
I1007 13:51:56.767287 788969 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I1007 13:51:56.854493 788969 cri.go:89] found id: "a6e224cfa70000e35a720f8c9ed9661a70147bc5dc65460934496ec9b288fe06"
I1007 13:51:56.854525 788969 cri.go:89] found id: "6ee84abf1b4464314c9cb9e84d60de9b2b00461bb97fe11808df52c7e0f87771"
I1007 13:51:56.854531 788969 cri.go:89] found id: ""
I1007 13:51:56.854538 788969 logs.go:282] 2 containers: [a6e224cfa70000e35a720f8c9ed9661a70147bc5dc65460934496ec9b288fe06 6ee84abf1b4464314c9cb9e84d60de9b2b00461bb97fe11808df52c7e0f87771]
I1007 13:51:56.854606 788969 ssh_runner.go:195] Run: which crictl
I1007 13:51:56.859331 788969 ssh_runner.go:195] Run: which crictl
I1007 13:51:56.863262 788969 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
I1007 13:51:56.863350 788969 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I1007 13:51:56.940414 788969 cri.go:89] found id: "c44e873fb63063161eea0a9a33fcb424a1fca04659773868480c9079f14fcde3"
I1007 13:51:56.940437 788969 cri.go:89] found id: "54c2e6b5d938cc814a93018f032c376c76d65bc1872f0fa55dd63fe950ff317f"
I1007 13:51:56.940442 788969 cri.go:89] found id: ""
I1007 13:51:56.940450 788969 logs.go:282] 2 containers: [c44e873fb63063161eea0a9a33fcb424a1fca04659773868480c9079f14fcde3 54c2e6b5d938cc814a93018f032c376c76d65bc1872f0fa55dd63fe950ff317f]
I1007 13:51:56.940513 788969 ssh_runner.go:195] Run: which crictl
I1007 13:51:56.946919 788969 ssh_runner.go:195] Run: which crictl
I1007 13:51:56.951803 788969 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
I1007 13:51:56.951885 788969 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I1007 13:51:57.012766 788969 cri.go:89] found id: "02588bae23d099926c85f07f669f2281dd82887c6cda051d44c64293d25ce608"
I1007 13:51:57.012792 788969 cri.go:89] found id: ""
I1007 13:51:57.012800 788969 logs.go:282] 1 containers: [02588bae23d099926c85f07f669f2281dd82887c6cda051d44c64293d25ce608]
I1007 13:51:57.012863 788969 ssh_runner.go:195] Run: which crictl
I1007 13:51:57.017491 788969 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
I1007 13:51:57.017580 788969 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I1007 13:51:57.075862 788969 cri.go:89] found id: "94f42c6c49fd89fb1387486b3bfb41e7d9ad24f923a9cbfb3757cab9ba0d589c"
I1007 13:51:57.075894 788969 cri.go:89] found id: "3e11e0da9f75ad4dd8fcceb6b095c49ccfce3438e6b64b5adf91722fb701d656"
I1007 13:51:57.075899 788969 cri.go:89] found id: ""
I1007 13:51:57.075906 788969 logs.go:282] 2 containers: [94f42c6c49fd89fb1387486b3bfb41e7d9ad24f923a9cbfb3757cab9ba0d589c 3e11e0da9f75ad4dd8fcceb6b095c49ccfce3438e6b64b5adf91722fb701d656]
I1007 13:51:57.075967 788969 ssh_runner.go:195] Run: which crictl
I1007 13:51:57.081400 788969 ssh_runner.go:195] Run: which crictl
I1007 13:51:57.085944 788969 logs.go:123] Gathering logs for containerd ...
I1007 13:51:57.085968 788969 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
I1007 13:51:57.162686 788969 logs.go:123] Gathering logs for dmesg ...
I1007 13:51:57.162733 788969 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I1007 13:51:57.179955 788969 logs.go:123] Gathering logs for kube-controller-manager [6ee84abf1b4464314c9cb9e84d60de9b2b00461bb97fe11808df52c7e0f87771] ...
I1007 13:51:57.179991 788969 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 6ee84abf1b4464314c9cb9e84d60de9b2b00461bb97fe11808df52c7e0f87771"
I1007 13:51:57.306063 788969 logs.go:123] Gathering logs for etcd [3f8d8d7911069dffad8bf7ce9156d34436c105ed532c7439e0b6bda21c43e87c] ...
I1007 13:51:57.306099 788969 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 3f8d8d7911069dffad8bf7ce9156d34436c105ed532c7439e0b6bda21c43e87c"
I1007 13:51:57.357347 788969 logs.go:123] Gathering logs for coredns [fefa6581f4e4cb7fefe7289a78cf684582ea646cd5283484696218c2863765ed] ...
I1007 13:51:57.357378 788969 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 fefa6581f4e4cb7fefe7289a78cf684582ea646cd5283484696218c2863765ed"
I1007 13:51:57.419970 788969 logs.go:123] Gathering logs for kube-controller-manager [a6e224cfa70000e35a720f8c9ed9661a70147bc5dc65460934496ec9b288fe06] ...
I1007 13:51:57.420003 788969 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 a6e224cfa70000e35a720f8c9ed9661a70147bc5dc65460934496ec9b288fe06"
I1007 13:51:57.497427 788969 logs.go:123] Gathering logs for kubelet ...
I1007 13:51:57.497465 788969 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W1007 13:51:57.558680 788969 logs.go:138] Found kubelet problem: Oct 07 13:46:26 old-k8s-version-716021 kubelet[666]: E1007 13:46:26.808783 666 reflector.go:138] object-"kube-system"/"coredns": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:old-k8s-version-716021" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-716021' and this object
W1007 13:51:57.559023 788969 logs.go:138] Found kubelet problem: Oct 07 13:46:26 old-k8s-version-716021 kubelet[666]: E1007 13:46:26.854809 666 reflector.go:138] object-"kube-system"/"kube-proxy-token-85z2f": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kube-proxy-token-85z2f" is forbidden: User "system:node:old-k8s-version-716021" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-716021' and this object
W1007 13:51:57.562387 788969 logs.go:138] Found kubelet problem: Oct 07 13:46:26 old-k8s-version-716021 kubelet[666]: E1007 13:46:26.856421 666 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:old-k8s-version-716021" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-716021' and this object
W1007 13:51:57.562607 788969 logs.go:138] Found kubelet problem: Oct 07 13:46:26 old-k8s-version-716021 kubelet[666]: E1007 13:46:26.856819 666 reflector.go:138] object-"kube-system"/"coredns-token-kp44b": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "coredns-token-kp44b" is forbidden: User "system:node:old-k8s-version-716021" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-716021' and this object
W1007 13:51:57.567093 788969 logs.go:138] Found kubelet problem: Oct 07 13:46:28 old-k8s-version-716021 kubelet[666]: E1007 13:46:28.915071 666 pod_workers.go:191] Error syncing pod 184eab58-b771-4e54-8c7c-46985955b403 ("metrics-server-9975d5f86-b7ct2_kube-system(184eab58-b771-4e54-8c7c-46985955b403)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W1007 13:51:57.567283 788969 logs.go:138] Found kubelet problem: Oct 07 13:46:29 old-k8s-version-716021 kubelet[666]: E1007 13:46:29.091904 666 pod_workers.go:191] Error syncing pod 184eab58-b771-4e54-8c7c-46985955b403 ("metrics-server-9975d5f86-b7ct2_kube-system(184eab58-b771-4e54-8c7c-46985955b403)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1007 13:51:57.570040 788969 logs.go:138] Found kubelet problem: Oct 07 13:46:43 old-k8s-version-716021 kubelet[666]: E1007 13:46:43.213529 666 pod_workers.go:191] Error syncing pod 184eab58-b771-4e54-8c7c-46985955b403 ("metrics-server-9975d5f86-b7ct2_kube-system(184eab58-b771-4e54-8c7c-46985955b403)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W1007 13:51:57.571971 788969 logs.go:138] Found kubelet problem: Oct 07 13:46:51 old-k8s-version-716021 kubelet[666]: E1007 13:46:51.378418 666 pod_workers.go:191] Error syncing pod d8c979bf-7b30-4283-aaeb-85e8808af24f ("dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"
W1007 13:51:57.572429 788969 logs.go:138] Found kubelet problem: Oct 07 13:46:52 old-k8s-version-716021 kubelet[666]: E1007 13:46:52.384192 666 pod_workers.go:191] Error syncing pod d8c979bf-7b30-4283-aaeb-85e8808af24f ("dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"
W1007 13:51:57.572755 788969 logs.go:138] Found kubelet problem: Oct 07 13:46:53 old-k8s-version-716021 kubelet[666]: E1007 13:46:53.386690 666 pod_workers.go:191] Error syncing pod d8c979bf-7b30-4283-aaeb-85e8808af24f ("dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"
W1007 13:51:57.573266 788969 logs.go:138] Found kubelet problem: Oct 07 13:46:57 old-k8s-version-716021 kubelet[666]: E1007 13:46:57.207180 666 pod_workers.go:191] Error syncing pod 184eab58-b771-4e54-8c7c-46985955b403 ("metrics-server-9975d5f86-b7ct2_kube-system(184eab58-b771-4e54-8c7c-46985955b403)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1007 13:51:57.573720 788969 logs.go:138] Found kubelet problem: Oct 07 13:47:01 old-k8s-version-716021 kubelet[666]: E1007 13:47:01.413751 666 pod_workers.go:191] Error syncing pod 4cfcc06f-69c5-42d6-bb20-67a3d942cfb0 ("storage-provisioner_kube-system(4cfcc06f-69c5-42d6-bb20-67a3d942cfb0)"), skipping: failed to "StartContainer" for "storage-provisioner" with CrashLoopBackOff: "back-off 10s restarting failed container=storage-provisioner pod=storage-provisioner_kube-system(4cfcc06f-69c5-42d6-bb20-67a3d942cfb0)"
W1007 13:51:57.574645 788969 logs.go:138] Found kubelet problem: Oct 07 13:47:05 old-k8s-version-716021 kubelet[666]: E1007 13:47:05.430539 666 pod_workers.go:191] Error syncing pod d8c979bf-7b30-4283-aaeb-85e8808af24f ("dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"
W1007 13:51:57.577065 788969 logs.go:138] Found kubelet problem: Oct 07 13:47:09 old-k8s-version-716021 kubelet[666]: E1007 13:47:09.218614 666 pod_workers.go:191] Error syncing pod 184eab58-b771-4e54-8c7c-46985955b403 ("metrics-server-9975d5f86-b7ct2_kube-system(184eab58-b771-4e54-8c7c-46985955b403)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W1007 13:51:57.577392 788969 logs.go:138] Found kubelet problem: Oct 07 13:47:12 old-k8s-version-716021 kubelet[666]: E1007 13:47:12.186154 666 pod_workers.go:191] Error syncing pod d8c979bf-7b30-4283-aaeb-85e8808af24f ("dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"
W1007 13:51:57.577711 788969 logs.go:138] Found kubelet problem: Oct 07 13:47:23 old-k8s-version-716021 kubelet[666]: E1007 13:47:23.206886 666 pod_workers.go:191] Error syncing pod 184eab58-b771-4e54-8c7c-46985955b403 ("metrics-server-9975d5f86-b7ct2_kube-system(184eab58-b771-4e54-8c7c-46985955b403)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1007 13:51:57.578040 788969 logs.go:138] Found kubelet problem: Oct 07 13:47:24 old-k8s-version-716021 kubelet[666]: E1007 13:47:24.209098 666 pod_workers.go:191] Error syncing pod d8c979bf-7b30-4283-aaeb-85e8808af24f ("dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"
W1007 13:51:57.578224 788969 logs.go:138] Found kubelet problem: Oct 07 13:47:34 old-k8s-version-716021 kubelet[666]: E1007 13:47:34.211370 666 pod_workers.go:191] Error syncing pod 184eab58-b771-4e54-8c7c-46985955b403 ("metrics-server-9975d5f86-b7ct2_kube-system(184eab58-b771-4e54-8c7c-46985955b403)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1007 13:51:57.578812 788969 logs.go:138] Found kubelet problem: Oct 07 13:47:40 old-k8s-version-716021 kubelet[666]: E1007 13:47:40.564455 666 pod_workers.go:191] Error syncing pod d8c979bf-7b30-4283-aaeb-85e8808af24f ("dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"
W1007 13:51:57.579137 788969 logs.go:138] Found kubelet problem: Oct 07 13:47:42 old-k8s-version-716021 kubelet[666]: E1007 13:47:42.186663 666 pod_workers.go:191] Error syncing pod d8c979bf-7b30-4283-aaeb-85e8808af24f ("dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"
W1007 13:51:57.579319 788969 logs.go:138] Found kubelet problem: Oct 07 13:47:47 old-k8s-version-716021 kubelet[666]: E1007 13:47:47.209688 666 pod_workers.go:191] Error syncing pod 184eab58-b771-4e54-8c7c-46985955b403 ("metrics-server-9975d5f86-b7ct2_kube-system(184eab58-b771-4e54-8c7c-46985955b403)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1007 13:51:57.579644 788969 logs.go:138] Found kubelet problem: Oct 07 13:47:54 old-k8s-version-716021 kubelet[666]: E1007 13:47:54.207353 666 pod_workers.go:191] Error syncing pod d8c979bf-7b30-4283-aaeb-85e8808af24f ("dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"
W1007 13:51:57.582062 788969 logs.go:138] Found kubelet problem: Oct 07 13:47:59 old-k8s-version-716021 kubelet[666]: E1007 13:47:59.222600 666 pod_workers.go:191] Error syncing pod 184eab58-b771-4e54-8c7c-46985955b403 ("metrics-server-9975d5f86-b7ct2_kube-system(184eab58-b771-4e54-8c7c-46985955b403)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W1007 13:51:57.582424 788969 logs.go:138] Found kubelet problem: Oct 07 13:48:07 old-k8s-version-716021 kubelet[666]: E1007 13:48:07.206479 666 pod_workers.go:191] Error syncing pod d8c979bf-7b30-4283-aaeb-85e8808af24f ("dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"
W1007 13:51:57.582648 788969 logs.go:138] Found kubelet problem: Oct 07 13:48:12 old-k8s-version-716021 kubelet[666]: E1007 13:48:12.222632 666 pod_workers.go:191] Error syncing pod 184eab58-b771-4e54-8c7c-46985955b403 ("metrics-server-9975d5f86-b7ct2_kube-system(184eab58-b771-4e54-8c7c-46985955b403)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1007 13:51:57.583311 788969 logs.go:138] Found kubelet problem: Oct 07 13:48:20 old-k8s-version-716021 kubelet[666]: E1007 13:48:20.682098 666 pod_workers.go:191] Error syncing pod d8c979bf-7b30-4283-aaeb-85e8808af24f ("dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"
W1007 13:51:57.583698 788969 logs.go:138] Found kubelet problem: Oct 07 13:48:22 old-k8s-version-716021 kubelet[666]: E1007 13:48:22.186594 666 pod_workers.go:191] Error syncing pod d8c979bf-7b30-4283-aaeb-85e8808af24f ("dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"
W1007 13:51:57.583912 788969 logs.go:138] Found kubelet problem: Oct 07 13:48:23 old-k8s-version-716021 kubelet[666]: E1007 13:48:23.206902 666 pod_workers.go:191] Error syncing pod 184eab58-b771-4e54-8c7c-46985955b403 ("metrics-server-9975d5f86-b7ct2_kube-system(184eab58-b771-4e54-8c7c-46985955b403)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1007 13:51:57.584114 788969 logs.go:138] Found kubelet problem: Oct 07 13:48:35 old-k8s-version-716021 kubelet[666]: E1007 13:48:35.206832 666 pod_workers.go:191] Error syncing pod 184eab58-b771-4e54-8c7c-46985955b403 ("metrics-server-9975d5f86-b7ct2_kube-system(184eab58-b771-4e54-8c7c-46985955b403)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1007 13:51:57.584442 788969 logs.go:138] Found kubelet problem: Oct 07 13:48:36 old-k8s-version-716021 kubelet[666]: E1007 13:48:36.206609 666 pod_workers.go:191] Error syncing pod d8c979bf-7b30-4283-aaeb-85e8808af24f ("dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"
W1007 13:51:57.584626 788969 logs.go:138] Found kubelet problem: Oct 07 13:48:46 old-k8s-version-716021 kubelet[666]: E1007 13:48:46.206819 666 pod_workers.go:191] Error syncing pod 184eab58-b771-4e54-8c7c-46985955b403 ("metrics-server-9975d5f86-b7ct2_kube-system(184eab58-b771-4e54-8c7c-46985955b403)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1007 13:51:57.584987 788969 logs.go:138] Found kubelet problem: Oct 07 13:48:49 old-k8s-version-716021 kubelet[666]: E1007 13:48:49.206451 666 pod_workers.go:191] Error syncing pod d8c979bf-7b30-4283-aaeb-85e8808af24f ("dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"
W1007 13:51:57.585172 788969 logs.go:138] Found kubelet problem: Oct 07 13:49:01 old-k8s-version-716021 kubelet[666]: E1007 13:49:01.206862 666 pod_workers.go:191] Error syncing pod 184eab58-b771-4e54-8c7c-46985955b403 ("metrics-server-9975d5f86-b7ct2_kube-system(184eab58-b771-4e54-8c7c-46985955b403)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1007 13:51:57.585505 788969 logs.go:138] Found kubelet problem: Oct 07 13:49:04 old-k8s-version-716021 kubelet[666]: E1007 13:49:04.210397 666 pod_workers.go:191] Error syncing pod d8c979bf-7b30-4283-aaeb-85e8808af24f ("dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"
W1007 13:51:57.585696 788969 logs.go:138] Found kubelet problem: Oct 07 13:49:16 old-k8s-version-716021 kubelet[666]: E1007 13:49:16.206769 666 pod_workers.go:191] Error syncing pod 184eab58-b771-4e54-8c7c-46985955b403 ("metrics-server-9975d5f86-b7ct2_kube-system(184eab58-b771-4e54-8c7c-46985955b403)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1007 13:51:57.586043 788969 logs.go:138] Found kubelet problem: Oct 07 13:49:19 old-k8s-version-716021 kubelet[666]: E1007 13:49:19.206428 666 pod_workers.go:191] Error syncing pod d8c979bf-7b30-4283-aaeb-85e8808af24f ("dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"
W1007 13:51:57.588462 788969 logs.go:138] Found kubelet problem: Oct 07 13:49:30 old-k8s-version-716021 kubelet[666]: E1007 13:49:30.231019 666 pod_workers.go:191] Error syncing pod 184eab58-b771-4e54-8c7c-46985955b403 ("metrics-server-9975d5f86-b7ct2_kube-system(184eab58-b771-4e54-8c7c-46985955b403)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W1007 13:51:57.588788 788969 logs.go:138] Found kubelet problem: Oct 07 13:49:31 old-k8s-version-716021 kubelet[666]: E1007 13:49:31.206480 666 pod_workers.go:191] Error syncing pod d8c979bf-7b30-4283-aaeb-85e8808af24f ("dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"
W1007 13:51:57.588970 788969 logs.go:138] Found kubelet problem: Oct 07 13:49:45 old-k8s-version-716021 kubelet[666]: E1007 13:49:45.207213 666 pod_workers.go:191] Error syncing pod 184eab58-b771-4e54-8c7c-46985955b403 ("metrics-server-9975d5f86-b7ct2_kube-system(184eab58-b771-4e54-8c7c-46985955b403)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1007 13:51:57.589558 788969 logs.go:138] Found kubelet problem: Oct 07 13:49:46 old-k8s-version-716021 kubelet[666]: E1007 13:49:46.907884 666 pod_workers.go:191] Error syncing pod d8c979bf-7b30-4283-aaeb-85e8808af24f ("dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"
W1007 13:51:57.589896 788969 logs.go:138] Found kubelet problem: Oct 07 13:49:52 old-k8s-version-716021 kubelet[666]: E1007 13:49:52.187043 666 pod_workers.go:191] Error syncing pod d8c979bf-7b30-4283-aaeb-85e8808af24f ("dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"
W1007 13:51:57.590078 788969 logs.go:138] Found kubelet problem: Oct 07 13:49:57 old-k8s-version-716021 kubelet[666]: E1007 13:49:57.214713 666 pod_workers.go:191] Error syncing pod 184eab58-b771-4e54-8c7c-46985955b403 ("metrics-server-9975d5f86-b7ct2_kube-system(184eab58-b771-4e54-8c7c-46985955b403)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1007 13:51:57.590404 788969 logs.go:138] Found kubelet problem: Oct 07 13:50:05 old-k8s-version-716021 kubelet[666]: E1007 13:50:05.206555 666 pod_workers.go:191] Error syncing pod d8c979bf-7b30-4283-aaeb-85e8808af24f ("dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"
W1007 13:51:57.590593 788969 logs.go:138] Found kubelet problem: Oct 07 13:50:08 old-k8s-version-716021 kubelet[666]: E1007 13:50:08.211199 666 pod_workers.go:191] Error syncing pod 184eab58-b771-4e54-8c7c-46985955b403 ("metrics-server-9975d5f86-b7ct2_kube-system(184eab58-b771-4e54-8c7c-46985955b403)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1007 13:51:57.590918 788969 logs.go:138] Found kubelet problem: Oct 07 13:50:17 old-k8s-version-716021 kubelet[666]: E1007 13:50:17.206916 666 pod_workers.go:191] Error syncing pod d8c979bf-7b30-4283-aaeb-85e8808af24f ("dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"
W1007 13:51:57.591102 788969 logs.go:138] Found kubelet problem: Oct 07 13:50:19 old-k8s-version-716021 kubelet[666]: E1007 13:50:19.206748 666 pod_workers.go:191] Error syncing pod 184eab58-b771-4e54-8c7c-46985955b403 ("metrics-server-9975d5f86-b7ct2_kube-system(184eab58-b771-4e54-8c7c-46985955b403)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1007 13:51:57.591430 788969 logs.go:138] Found kubelet problem: Oct 07 13:50:28 old-k8s-version-716021 kubelet[666]: E1007 13:50:28.207831 666 pod_workers.go:191] Error syncing pod d8c979bf-7b30-4283-aaeb-85e8808af24f ("dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"
W1007 13:51:57.591612 788969 logs.go:138] Found kubelet problem: Oct 07 13:50:30 old-k8s-version-716021 kubelet[666]: E1007 13:50:30.211659 666 pod_workers.go:191] Error syncing pod 184eab58-b771-4e54-8c7c-46985955b403 ("metrics-server-9975d5f86-b7ct2_kube-system(184eab58-b771-4e54-8c7c-46985955b403)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1007 13:51:57.591939 788969 logs.go:138] Found kubelet problem: Oct 07 13:50:40 old-k8s-version-716021 kubelet[666]: E1007 13:50:40.210379 666 pod_workers.go:191] Error syncing pod d8c979bf-7b30-4283-aaeb-85e8808af24f ("dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"
W1007 13:51:57.592120 788969 logs.go:138] Found kubelet problem: Oct 07 13:50:45 old-k8s-version-716021 kubelet[666]: E1007 13:50:45.207104 666 pod_workers.go:191] Error syncing pod 184eab58-b771-4e54-8c7c-46985955b403 ("metrics-server-9975d5f86-b7ct2_kube-system(184eab58-b771-4e54-8c7c-46985955b403)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1007 13:51:57.592445 788969 logs.go:138] Found kubelet problem: Oct 07 13:50:53 old-k8s-version-716021 kubelet[666]: E1007 13:50:53.206980 666 pod_workers.go:191] Error syncing pod d8c979bf-7b30-4283-aaeb-85e8808af24f ("dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"
W1007 13:51:57.592626 788969 logs.go:138] Found kubelet problem: Oct 07 13:50:57 old-k8s-version-716021 kubelet[666]: E1007 13:50:57.206804 666 pod_workers.go:191] Error syncing pod 184eab58-b771-4e54-8c7c-46985955b403 ("metrics-server-9975d5f86-b7ct2_kube-system(184eab58-b771-4e54-8c7c-46985955b403)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1007 13:51:57.592951 788969 logs.go:138] Found kubelet problem: Oct 07 13:51:08 old-k8s-version-716021 kubelet[666]: E1007 13:51:08.206532 666 pod_workers.go:191] Error syncing pod d8c979bf-7b30-4283-aaeb-85e8808af24f ("dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"
W1007 13:51:57.593132 788969 logs.go:138] Found kubelet problem: Oct 07 13:51:08 old-k8s-version-716021 kubelet[666]: E1007 13:51:08.207812 666 pod_workers.go:191] Error syncing pod 184eab58-b771-4e54-8c7c-46985955b403 ("metrics-server-9975d5f86-b7ct2_kube-system(184eab58-b771-4e54-8c7c-46985955b403)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1007 13:51:57.593313 788969 logs.go:138] Found kubelet problem: Oct 07 13:51:22 old-k8s-version-716021 kubelet[666]: E1007 13:51:22.206879 666 pod_workers.go:191] Error syncing pod 184eab58-b771-4e54-8c7c-46985955b403 ("metrics-server-9975d5f86-b7ct2_kube-system(184eab58-b771-4e54-8c7c-46985955b403)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1007 13:51:57.593637 788969 logs.go:138] Found kubelet problem: Oct 07 13:51:22 old-k8s-version-716021 kubelet[666]: E1007 13:51:22.208036 666 pod_workers.go:191] Error syncing pod d8c979bf-7b30-4283-aaeb-85e8808af24f ("dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"
W1007 13:51:57.593845 788969 logs.go:138] Found kubelet problem: Oct 07 13:51:33 old-k8s-version-716021 kubelet[666]: E1007 13:51:33.206925 666 pod_workers.go:191] Error syncing pod 184eab58-b771-4e54-8c7c-46985955b403 ("metrics-server-9975d5f86-b7ct2_kube-system(184eab58-b771-4e54-8c7c-46985955b403)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1007 13:51:57.594174 788969 logs.go:138] Found kubelet problem: Oct 07 13:51:34 old-k8s-version-716021 kubelet[666]: E1007 13:51:34.206498 666 pod_workers.go:191] Error syncing pod d8c979bf-7b30-4283-aaeb-85e8808af24f ("dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"
W1007 13:51:57.594357 788969 logs.go:138] Found kubelet problem: Oct 07 13:51:47 old-k8s-version-716021 kubelet[666]: E1007 13:51:47.231399 666 pod_workers.go:191] Error syncing pod 184eab58-b771-4e54-8c7c-46985955b403 ("metrics-server-9975d5f86-b7ct2_kube-system(184eab58-b771-4e54-8c7c-46985955b403)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1007 13:51:57.594690 788969 logs.go:138] Found kubelet problem: Oct 07 13:51:48 old-k8s-version-716021 kubelet[666]: E1007 13:51:48.206953 666 pod_workers.go:191] Error syncing pod d8c979bf-7b30-4283-aaeb-85e8808af24f ("dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"
I1007 13:51:57.594701 788969 logs.go:123] Gathering logs for describe nodes ...
I1007 13:51:57.594714 788969 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I1007 13:51:55.412158 794355 api_server.go:253] Checking apiserver healthz at https://192.168.85.2:8443/healthz ...
I1007 13:51:55.419819 794355 api_server.go:279] https://192.168.85.2:8443/healthz returned 200:
ok
I1007 13:51:55.420873 794355 api_server.go:141] control plane version: v1.31.1
I1007 13:51:55.420898 794355 api_server.go:131] duration metric: took 4.26019759s to wait for apiserver health ...
I1007 13:51:55.420908 794355 system_pods.go:43] waiting for kube-system pods to appear ...
I1007 13:51:55.420931 794355 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
I1007 13:51:55.420997 794355 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I1007 13:51:55.474665 794355 cri.go:89] found id: "43bdf561a58ff5fabe544dd85759243717c93e1c15c722fe3c0a318ca95f5b0d"
I1007 13:51:55.474690 794355 cri.go:89] found id: "bc043677512aaec562207d47602450f079bea404a98d863a7a9aebd601821d93"
I1007 13:51:55.474696 794355 cri.go:89] found id: ""
I1007 13:51:55.474704 794355 logs.go:282] 2 containers: [43bdf561a58ff5fabe544dd85759243717c93e1c15c722fe3c0a318ca95f5b0d bc043677512aaec562207d47602450f079bea404a98d863a7a9aebd601821d93]
I1007 13:51:55.474761 794355 ssh_runner.go:195] Run: which crictl
I1007 13:51:55.478618 794355 ssh_runner.go:195] Run: which crictl
I1007 13:51:55.482016 794355 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
I1007 13:51:55.482090 794355 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I1007 13:51:55.521042 794355 cri.go:89] found id: "33903c7a377f2b08b0fecf23a0c14df9bb3a9c9ec0f64bfa2c22ba01a2ff9d9b"
I1007 13:51:55.521110 794355 cri.go:89] found id: "707a20dc9d7501895dfe567a7a779ca40e8fd166c56d5fede07fc9ca7ff99389"
I1007 13:51:55.521130 794355 cri.go:89] found id: ""
I1007 13:51:55.521154 794355 logs.go:282] 2 containers: [33903c7a377f2b08b0fecf23a0c14df9bb3a9c9ec0f64bfa2c22ba01a2ff9d9b 707a20dc9d7501895dfe567a7a779ca40e8fd166c56d5fede07fc9ca7ff99389]
I1007 13:51:55.521245 794355 ssh_runner.go:195] Run: which crictl
I1007 13:51:55.525026 794355 ssh_runner.go:195] Run: which crictl
I1007 13:51:55.529230 794355 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
I1007 13:51:55.529304 794355 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I1007 13:51:55.571323 794355 cri.go:89] found id: "9a5e89ef652822e1f49fb89e396dfb759057f81942cd30388e30068d53d89879"
I1007 13:51:55.571348 794355 cri.go:89] found id: "dbf736aab37e3211987b3ec8c6931a437a26edc6d5c4bbe04c1d38cd34c8f03f"
I1007 13:51:55.571353 794355 cri.go:89] found id: ""
I1007 13:51:55.571361 794355 logs.go:282] 2 containers: [9a5e89ef652822e1f49fb89e396dfb759057f81942cd30388e30068d53d89879 dbf736aab37e3211987b3ec8c6931a437a26edc6d5c4bbe04c1d38cd34c8f03f]
I1007 13:51:55.571421 794355 ssh_runner.go:195] Run: which crictl
I1007 13:51:55.575650 794355 ssh_runner.go:195] Run: which crictl
I1007 13:51:55.579289 794355 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
I1007 13:51:55.579363 794355 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I1007 13:51:55.628166 794355 cri.go:89] found id: "cd590f5f9108ec9765f17072f326f44cd3c8ab302521c32f26c090cdd981b6f6"
I1007 13:51:55.628193 794355 cri.go:89] found id: "c574ff4369a62adef6d1dfe3942339a4d53449042cdeca6c760f18198a9cbfbf"
I1007 13:51:55.628199 794355 cri.go:89] found id: ""
I1007 13:51:55.628206 794355 logs.go:282] 2 containers: [cd590f5f9108ec9765f17072f326f44cd3c8ab302521c32f26c090cdd981b6f6 c574ff4369a62adef6d1dfe3942339a4d53449042cdeca6c760f18198a9cbfbf]
I1007 13:51:55.628262 794355 ssh_runner.go:195] Run: which crictl
I1007 13:51:55.632201 794355 ssh_runner.go:195] Run: which crictl
I1007 13:51:55.636006 794355 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
I1007 13:51:55.636086 794355 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I1007 13:51:55.682927 794355 cri.go:89] found id: "42bfb9b45ce705d6a68018440dc9e8cb4f11c7bce3abd38a8ea5acab2ef57a6e"
I1007 13:51:55.682949 794355 cri.go:89] found id: "b935711aea707ce61d36b2d0561c37446a26ba3ecdd12f08138b34facf4ba623"
I1007 13:51:55.682953 794355 cri.go:89] found id: ""
I1007 13:51:55.682960 794355 logs.go:282] 2 containers: [42bfb9b45ce705d6a68018440dc9e8cb4f11c7bce3abd38a8ea5acab2ef57a6e b935711aea707ce61d36b2d0561c37446a26ba3ecdd12f08138b34facf4ba623]
I1007 13:51:55.683017 794355 ssh_runner.go:195] Run: which crictl
I1007 13:51:55.686777 794355 ssh_runner.go:195] Run: which crictl
I1007 13:51:55.690282 794355 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
I1007 13:51:55.690379 794355 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I1007 13:51:55.729466 794355 cri.go:89] found id: "ab0b956db3468c6fd8893d641eb706709d5cd0eedcbe8aaee7fe806586346a40"
I1007 13:51:55.729493 794355 cri.go:89] found id: "1c834176710ac261d54557344fafb1339bee02e3f69697a088561211726a9feb"
I1007 13:51:55.729506 794355 cri.go:89] found id: ""
I1007 13:51:55.729513 794355 logs.go:282] 2 containers: [ab0b956db3468c6fd8893d641eb706709d5cd0eedcbe8aaee7fe806586346a40 1c834176710ac261d54557344fafb1339bee02e3f69697a088561211726a9feb]
I1007 13:51:55.729596 794355 ssh_runner.go:195] Run: which crictl
I1007 13:51:55.734118 794355 ssh_runner.go:195] Run: which crictl
I1007 13:51:55.738775 794355 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
I1007 13:51:55.738883 794355 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I1007 13:51:55.778460 794355 cri.go:89] found id: "8eaabe7d610941a8182facd3522da4f8fe7135414350c9246a55dd84e51dc457"
I1007 13:51:55.778484 794355 cri.go:89] found id: "3194d5b907e6b8bf8971fb018f25759d55c877260e76b0a7fbda0a3e112940e3"
I1007 13:51:55.778490 794355 cri.go:89] found id: ""
I1007 13:51:55.778498 794355 logs.go:282] 2 containers: [8eaabe7d610941a8182facd3522da4f8fe7135414350c9246a55dd84e51dc457 3194d5b907e6b8bf8971fb018f25759d55c877260e76b0a7fbda0a3e112940e3]
I1007 13:51:55.778603 794355 ssh_runner.go:195] Run: which crictl
I1007 13:51:55.782515 794355 ssh_runner.go:195] Run: which crictl
I1007 13:51:55.786145 794355 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
I1007 13:51:55.786221 794355 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I1007 13:51:55.836777 794355 cri.go:89] found id: "6dd1df3ff1615192d2ec04bf57a163244d17bfb455a44288e257159641f69817"
I1007 13:51:55.836813 794355 cri.go:89] found id: "f1587851443378e689dc16812fa6726ea857f90f4d96b15adc0b5e91ddbf6286"
I1007 13:51:55.836819 794355 cri.go:89] found id: ""
I1007 13:51:55.836853 794355 logs.go:282] 2 containers: [6dd1df3ff1615192d2ec04bf57a163244d17bfb455a44288e257159641f69817 f1587851443378e689dc16812fa6726ea857f90f4d96b15adc0b5e91ddbf6286]
I1007 13:51:55.836927 794355 ssh_runner.go:195] Run: which crictl
I1007 13:51:55.841192 794355 ssh_runner.go:195] Run: which crictl
I1007 13:51:55.845144 794355 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
I1007 13:51:55.845219 794355 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I1007 13:51:55.885486 794355 cri.go:89] found id: "26f59d548b181b4d23dbd64124417687da7c0d30cffc04a0fddcbe9c4ad969cb"
I1007 13:51:55.885556 794355 cri.go:89] found id: ""
I1007 13:51:55.885579 794355 logs.go:282] 1 containers: [26f59d548b181b4d23dbd64124417687da7c0d30cffc04a0fddcbe9c4ad969cb]
I1007 13:51:55.885717 794355 ssh_runner.go:195] Run: which crictl
I1007 13:51:55.889559 794355 logs.go:123] Gathering logs for kubernetes-dashboard [26f59d548b181b4d23dbd64124417687da7c0d30cffc04a0fddcbe9c4ad969cb] ...
I1007 13:51:55.889634 794355 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 26f59d548b181b4d23dbd64124417687da7c0d30cffc04a0fddcbe9c4ad969cb"
I1007 13:51:55.936361 794355 logs.go:123] Gathering logs for containerd ...
I1007 13:51:55.936392 794355 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
I1007 13:51:56.000048 794355 logs.go:123] Gathering logs for container status ...
I1007 13:51:56.000087 794355 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I1007 13:51:56.074551 794355 logs.go:123] Gathering logs for kube-apiserver [43bdf561a58ff5fabe544dd85759243717c93e1c15c722fe3c0a318ca95f5b0d] ...
I1007 13:51:56.074589 794355 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 43bdf561a58ff5fabe544dd85759243717c93e1c15c722fe3c0a318ca95f5b0d"
I1007 13:51:56.130585 794355 logs.go:123] Gathering logs for etcd [33903c7a377f2b08b0fecf23a0c14df9bb3a9c9ec0f64bfa2c22ba01a2ff9d9b] ...
I1007 13:51:56.130621 794355 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 33903c7a377f2b08b0fecf23a0c14df9bb3a9c9ec0f64bfa2c22ba01a2ff9d9b"
I1007 13:51:56.195750 794355 logs.go:123] Gathering logs for kube-proxy [b935711aea707ce61d36b2d0561c37446a26ba3ecdd12f08138b34facf4ba623] ...
I1007 13:51:56.195786 794355 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 b935711aea707ce61d36b2d0561c37446a26ba3ecdd12f08138b34facf4ba623"
I1007 13:51:56.254965 794355 logs.go:123] Gathering logs for kindnet [8eaabe7d610941a8182facd3522da4f8fe7135414350c9246a55dd84e51dc457] ...
I1007 13:51:56.254992 794355 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 8eaabe7d610941a8182facd3522da4f8fe7135414350c9246a55dd84e51dc457"
I1007 13:51:56.297322 794355 logs.go:123] Gathering logs for kindnet [3194d5b907e6b8bf8971fb018f25759d55c877260e76b0a7fbda0a3e112940e3] ...
I1007 13:51:56.297355 794355 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 3194d5b907e6b8bf8971fb018f25759d55c877260e76b0a7fbda0a3e112940e3"
I1007 13:51:56.365756 794355 logs.go:123] Gathering logs for kube-controller-manager [ab0b956db3468c6fd8893d641eb706709d5cd0eedcbe8aaee7fe806586346a40] ...
I1007 13:51:56.365839 794355 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 ab0b956db3468c6fd8893d641eb706709d5cd0eedcbe8aaee7fe806586346a40"
I1007 13:51:56.455989 794355 logs.go:123] Gathering logs for storage-provisioner [f1587851443378e689dc16812fa6726ea857f90f4d96b15adc0b5e91ddbf6286] ...
I1007 13:51:56.456164 794355 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 f1587851443378e689dc16812fa6726ea857f90f4d96b15adc0b5e91ddbf6286"
I1007 13:51:56.509343 794355 logs.go:123] Gathering logs for kubelet ...
I1007 13:51:56.509370 794355 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I1007 13:51:56.596907 794355 logs.go:123] Gathering logs for dmesg ...
I1007 13:51:56.596991 794355 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I1007 13:51:56.615518 794355 logs.go:123] Gathering logs for coredns [dbf736aab37e3211987b3ec8c6931a437a26edc6d5c4bbe04c1d38cd34c8f03f] ...
I1007 13:51:56.615546 794355 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 dbf736aab37e3211987b3ec8c6931a437a26edc6d5c4bbe04c1d38cd34c8f03f"
I1007 13:51:56.681777 794355 logs.go:123] Gathering logs for kube-scheduler [c574ff4369a62adef6d1dfe3942339a4d53449042cdeca6c760f18198a9cbfbf] ...
I1007 13:51:56.681806 794355 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 c574ff4369a62adef6d1dfe3942339a4d53449042cdeca6c760f18198a9cbfbf"
I1007 13:51:56.787475 794355 logs.go:123] Gathering logs for kube-proxy [42bfb9b45ce705d6a68018440dc9e8cb4f11c7bce3abd38a8ea5acab2ef57a6e] ...
I1007 13:51:56.787629 794355 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 42bfb9b45ce705d6a68018440dc9e8cb4f11c7bce3abd38a8ea5acab2ef57a6e"
I1007 13:51:56.878780 794355 logs.go:123] Gathering logs for kube-controller-manager [1c834176710ac261d54557344fafb1339bee02e3f69697a088561211726a9feb] ...
I1007 13:51:56.878885 794355 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 1c834176710ac261d54557344fafb1339bee02e3f69697a088561211726a9feb"
I1007 13:51:56.980343 794355 logs.go:123] Gathering logs for storage-provisioner [6dd1df3ff1615192d2ec04bf57a163244d17bfb455a44288e257159641f69817] ...
I1007 13:51:56.980461 794355 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 6dd1df3ff1615192d2ec04bf57a163244d17bfb455a44288e257159641f69817"
I1007 13:51:57.036489 794355 logs.go:123] Gathering logs for describe nodes ...
I1007 13:51:57.036517 794355 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I1007 13:51:57.207379 794355 logs.go:123] Gathering logs for kube-apiserver [bc043677512aaec562207d47602450f079bea404a98d863a7a9aebd601821d93] ...
I1007 13:51:57.207414 794355 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 bc043677512aaec562207d47602450f079bea404a98d863a7a9aebd601821d93"
I1007 13:51:57.281825 794355 logs.go:123] Gathering logs for etcd [707a20dc9d7501895dfe567a7a779ca40e8fd166c56d5fede07fc9ca7ff99389] ...
I1007 13:51:57.281859 794355 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 707a20dc9d7501895dfe567a7a779ca40e8fd166c56d5fede07fc9ca7ff99389"
I1007 13:51:57.382058 794355 logs.go:123] Gathering logs for coredns [9a5e89ef652822e1f49fb89e396dfb759057f81942cd30388e30068d53d89879] ...
I1007 13:51:57.382104 794355 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 9a5e89ef652822e1f49fb89e396dfb759057f81942cd30388e30068d53d89879"
I1007 13:51:57.464662 794355 logs.go:123] Gathering logs for kube-scheduler [cd590f5f9108ec9765f17072f326f44cd3c8ab302521c32f26c090cdd981b6f6] ...
I1007 13:51:57.464696 794355 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 cd590f5f9108ec9765f17072f326f44cd3c8ab302521c32f26c090cdd981b6f6"
I1007 13:52:00.045811 794355 system_pods.go:59] 9 kube-system pods found
I1007 13:52:00.045877 794355 system_pods.go:61] "coredns-7c65d6cfc9-zc8p4" [e4bacbd6-70bf-47ea-b1e3-6618add65b1e] Running
I1007 13:52:00.045886 794355 system_pods.go:61] "etcd-no-preload-178678" [f00c456c-ffcf-45dc-8454-c47b26699dc9] Running
I1007 13:52:00.045891 794355 system_pods.go:61] "kindnet-ch2lw" [f1611838-bc60-417c-b7bb-30af2b5ba670] Running
I1007 13:52:00.045897 794355 system_pods.go:61] "kube-apiserver-no-preload-178678" [3ed070dd-a821-417b-84e6-8b932a9e052c] Running
I1007 13:52:00.045902 794355 system_pods.go:61] "kube-controller-manager-no-preload-178678" [e408fc97-6fd6-4dd3-a303-d926cb3c853a] Running
I1007 13:52:00.045907 794355 system_pods.go:61] "kube-proxy-46xb9" [f66cede8-762c-4704-a591-cff23ceab2d8] Running
I1007 13:52:00.045911 794355 system_pods.go:61] "kube-scheduler-no-preload-178678" [94923977-0f6a-40d4-a2ef-fc673171c650] Running
I1007 13:52:00.045919 794355 system_pods.go:61] "metrics-server-6867b74b74-86hgb" [eb62f0a4-9997-4d81-9c84-bd15b1cf8490] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I1007 13:52:00.045926 794355 system_pods.go:61] "storage-provisioner" [7b866838-0573-40ec-8ff2-1ce324bde301] Running
I1007 13:52:00.045934 794355 system_pods.go:74] duration metric: took 4.625019474s to wait for pod list to return data ...
I1007 13:52:00.045951 794355 default_sa.go:34] waiting for default service account to be created ...
I1007 13:52:00.071456 794355 default_sa.go:45] found service account: "default"
I1007 13:52:00.071484 794355 default_sa.go:55] duration metric: took 25.52475ms for default service account to be created ...
I1007 13:52:00.071495 794355 system_pods.go:116] waiting for k8s-apps to be running ...
I1007 13:52:00.094822 794355 system_pods.go:86] 9 kube-system pods found
I1007 13:52:00.094931 794355 system_pods.go:89] "coredns-7c65d6cfc9-zc8p4" [e4bacbd6-70bf-47ea-b1e3-6618add65b1e] Running
I1007 13:52:00.094958 794355 system_pods.go:89] "etcd-no-preload-178678" [f00c456c-ffcf-45dc-8454-c47b26699dc9] Running
I1007 13:52:00.095008 794355 system_pods.go:89] "kindnet-ch2lw" [f1611838-bc60-417c-b7bb-30af2b5ba670] Running
I1007 13:52:00.095038 794355 system_pods.go:89] "kube-apiserver-no-preload-178678" [3ed070dd-a821-417b-84e6-8b932a9e052c] Running
I1007 13:52:00.095071 794355 system_pods.go:89] "kube-controller-manager-no-preload-178678" [e408fc97-6fd6-4dd3-a303-d926cb3c853a] Running
I1007 13:52:00.095123 794355 system_pods.go:89] "kube-proxy-46xb9" [f66cede8-762c-4704-a591-cff23ceab2d8] Running
I1007 13:52:00.095157 794355 system_pods.go:89] "kube-scheduler-no-preload-178678" [94923977-0f6a-40d4-a2ef-fc673171c650] Running
I1007 13:52:00.095187 794355 system_pods.go:89] "metrics-server-6867b74b74-86hgb" [eb62f0a4-9997-4d81-9c84-bd15b1cf8490] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I1007 13:52:00.095211 794355 system_pods.go:89] "storage-provisioner" [7b866838-0573-40ec-8ff2-1ce324bde301] Running
I1007 13:52:00.095252 794355 system_pods.go:126] duration metric: took 23.749368ms to wait for k8s-apps to be running ...
I1007 13:52:00.095278 794355 system_svc.go:44] waiting for kubelet service to be running ....
I1007 13:52:00.095381 794355 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I1007 13:52:00.178431 794355 system_svc.go:56] duration metric: took 83.141665ms WaitForService to wait for kubelet
I1007 13:52:00.178464 794355 kubeadm.go:582] duration metric: took 4m28.807087418s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I1007 13:52:00.178488 794355 node_conditions.go:102] verifying NodePressure condition ...
I1007 13:52:00.188980 794355 node_conditions.go:122] node storage ephemeral capacity is 203034800Ki
I1007 13:52:00.189014 794355 node_conditions.go:123] node cpu capacity is 2
I1007 13:52:00.189027 794355 node_conditions.go:105] duration metric: took 10.534024ms to run NodePressure ...
I1007 13:52:00.189042 794355 start.go:241] waiting for startup goroutines ...
I1007 13:52:00.189049 794355 start.go:246] waiting for cluster config update ...
I1007 13:52:00.189060 794355 start.go:255] writing updated cluster config ...
I1007 13:52:00.189412 794355 ssh_runner.go:195] Run: rm -f paused
I1007 13:52:00.407758 794355 start.go:600] kubectl: 1.31.1, cluster: 1.31.1 (minor skew: 0)
I1007 13:52:00.411379 794355 out.go:177] * Done! kubectl is now configured to use "no-preload-178678" cluster and "default" namespace by default
I1007 13:51:57.744792 788969 logs.go:123] Gathering logs for etcd [538e7c613d2fdfcf8bdf655918adbdaa8c80e7d22ee153d71d980bad173f6cd1] ...
I1007 13:51:57.744823 788969 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 538e7c613d2fdfcf8bdf655918adbdaa8c80e7d22ee153d71d980bad173f6cd1"
I1007 13:51:57.789489 788969 logs.go:123] Gathering logs for coredns [b970f66a7b788465fb1b5efff7470a2a13241205a4b3871615987cd5e8185c0b] ...
I1007 13:51:57.789522 788969 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 b970f66a7b788465fb1b5efff7470a2a13241205a4b3871615987cd5e8185c0b"
I1007 13:51:57.841342 788969 logs.go:123] Gathering logs for kube-scheduler [3a2ed108143653900fc42a927e9971546f5f58f58c845162e9ad03a74ef4c19f] ...
I1007 13:51:57.841376 788969 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 3a2ed108143653900fc42a927e9971546f5f58f58c845162e9ad03a74ef4c19f"
I1007 13:51:57.885042 788969 logs.go:123] Gathering logs for kube-proxy [b47f6084fbcd06d9de3d640a50b2eedabdcfa0e9e99795313dbbf409ba0b34ba] ...
I1007 13:51:57.885079 788969 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 b47f6084fbcd06d9de3d640a50b2eedabdcfa0e9e99795313dbbf409ba0b34ba"
I1007 13:51:57.928690 788969 logs.go:123] Gathering logs for kube-proxy [90271f39ba89eca0f9f411179e611fffa8cb7092df3cd7385b2489d67eb7a32d] ...
I1007 13:51:57.928720 788969 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 90271f39ba89eca0f9f411179e611fffa8cb7092df3cd7385b2489d67eb7a32d"
I1007 13:51:57.966663 788969 logs.go:123] Gathering logs for kindnet [c44e873fb63063161eea0a9a33fcb424a1fca04659773868480c9079f14fcde3] ...
I1007 13:51:57.966697 788969 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 c44e873fb63063161eea0a9a33fcb424a1fca04659773868480c9079f14fcde3"
I1007 13:51:58.025474 788969 logs.go:123] Gathering logs for kube-apiserver [6438e2a98b44ed7687544147d7fde2facece2b6119ba86ffa996a5b8e7019da7] ...
I1007 13:51:58.025511 788969 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 6438e2a98b44ed7687544147d7fde2facece2b6119ba86ffa996a5b8e7019da7"
I1007 13:51:58.099784 788969 logs.go:123] Gathering logs for kube-apiserver [dffbe9e7eda4a16ea00f685c861a1d7506d88d6ae76dc1fbd3b528f0186bf960] ...
I1007 13:51:58.099828 788969 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 dffbe9e7eda4a16ea00f685c861a1d7506d88d6ae76dc1fbd3b528f0186bf960"
I1007 13:51:58.156884 788969 logs.go:123] Gathering logs for container status ...
I1007 13:51:58.156916 788969 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I1007 13:51:58.245817 788969 logs.go:123] Gathering logs for kubernetes-dashboard [02588bae23d099926c85f07f669f2281dd82887c6cda051d44c64293d25ce608] ...
I1007 13:51:58.245848 788969 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 02588bae23d099926c85f07f669f2281dd82887c6cda051d44c64293d25ce608"
I1007 13:51:58.293375 788969 logs.go:123] Gathering logs for storage-provisioner [94f42c6c49fd89fb1387486b3bfb41e7d9ad24f923a9cbfb3757cab9ba0d589c] ...
I1007 13:51:58.293411 788969 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 94f42c6c49fd89fb1387486b3bfb41e7d9ad24f923a9cbfb3757cab9ba0d589c"
I1007 13:51:58.333307 788969 logs.go:123] Gathering logs for storage-provisioner [3e11e0da9f75ad4dd8fcceb6b095c49ccfce3438e6b64b5adf91722fb701d656] ...
I1007 13:51:58.333338 788969 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 3e11e0da9f75ad4dd8fcceb6b095c49ccfce3438e6b64b5adf91722fb701d656"
I1007 13:51:58.374185 788969 logs.go:123] Gathering logs for kube-scheduler [1e75bdb1fcc164ca7ea09aaa49994e75347b13bbf4549844b1471555f94af297] ...
I1007 13:51:58.374218 788969 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 1e75bdb1fcc164ca7ea09aaa49994e75347b13bbf4549844b1471555f94af297"
I1007 13:51:58.414799 788969 logs.go:123] Gathering logs for kindnet [54c2e6b5d938cc814a93018f032c376c76d65bc1872f0fa55dd63fe950ff317f] ...
I1007 13:51:58.414829 788969 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 54c2e6b5d938cc814a93018f032c376c76d65bc1872f0fa55dd63fe950ff317f"
I1007 13:51:58.473608 788969 out.go:358] Setting ErrFile to fd 2...
I1007 13:51:58.473634 788969 out.go:392] TERM=,COLORTERM=, which probably does not support color
W1007 13:51:58.473748 788969 out.go:270] X Problems detected in kubelet:
W1007 13:51:58.473763 788969 out.go:270] Oct 07 13:51:22 old-k8s-version-716021 kubelet[666]: E1007 13:51:22.208036 666 pod_workers.go:191] Error syncing pod d8c979bf-7b30-4283-aaeb-85e8808af24f ("dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"
W1007 13:51:58.473777 788969 out.go:270] Oct 07 13:51:33 old-k8s-version-716021 kubelet[666]: E1007 13:51:33.206925 666 pod_workers.go:191] Error syncing pod 184eab58-b771-4e54-8c7c-46985955b403 ("metrics-server-9975d5f86-b7ct2_kube-system(184eab58-b771-4e54-8c7c-46985955b403)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1007 13:51:58.473786 788969 out.go:270] Oct 07 13:51:34 old-k8s-version-716021 kubelet[666]: E1007 13:51:34.206498 666 pod_workers.go:191] Error syncing pod d8c979bf-7b30-4283-aaeb-85e8808af24f ("dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"
W1007 13:51:58.473798 788969 out.go:270] Oct 07 13:51:47 old-k8s-version-716021 kubelet[666]: E1007 13:51:47.231399 666 pod_workers.go:191] Error syncing pod 184eab58-b771-4e54-8c7c-46985955b403 ("metrics-server-9975d5f86-b7ct2_kube-system(184eab58-b771-4e54-8c7c-46985955b403)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W1007 13:51:58.473804 788969 out.go:270] Oct 07 13:51:48 old-k8s-version-716021 kubelet[666]: E1007 13:51:48.206953 666 pod_workers.go:191] Error syncing pod d8c979bf-7b30-4283-aaeb-85e8808af24f ("dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"
I1007 13:51:58.473811 788969 out.go:358] Setting ErrFile to fd 2...
I1007 13:51:58.473817 788969 out.go:392] TERM=,COLORTERM=, which probably does not support color
I1007 13:52:08.474751 788969 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1007 13:52:08.488321 788969 api_server.go:72] duration metric: took 6m2.173367121s to wait for apiserver process to appear ...
I1007 13:52:08.488351 788969 api_server.go:88] waiting for apiserver healthz status ...
I1007 13:52:08.490582 788969 out.go:201]
W1007 13:52:08.492328 788969 out.go:270] X Exiting due to GUEST_START: failed to start node: wait 6m0s for node: wait for healthy API server: apiserver healthz never reported healthy: cluster wait timed out during healthz check
W1007 13:52:08.492353 788969 out.go:270] *
W1007 13:52:08.493335 788969 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I1007 13:52:08.495726 788969 out.go:201]
==> container status <==
CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID POD
b1a44caebf01b 523cad1a4df73 2 minutes ago Exited dashboard-metrics-scraper 5 05af15c10037d dashboard-metrics-scraper-8d5bb5db8-wxkkm
94f42c6c49fd8 ba04bb24b9575 4 minutes ago Running storage-provisioner 2 e63807b671ca8 storage-provisioner
02588bae23d09 20b332c9a70d8 5 minutes ago Running kubernetes-dashboard 0 7fcf8804d2b90 kubernetes-dashboard-cd95d586-pm244
b47f6084fbcd0 25a5233254979 5 minutes ago Running kube-proxy 1 2d8edbeddda57 kube-proxy-hdch9
b970f66a7b788 db91994f4ee8f 5 minutes ago Running coredns 1 8eb524b0aa304 coredns-74ff55c5b-fz8dj
3e11e0da9f75a ba04bb24b9575 5 minutes ago Exited storage-provisioner 1 e63807b671ca8 storage-provisioner
7ded2000d7812 1611cd07b61d5 5 minutes ago Running busybox 1 31c68e5fa68c2 busybox
c44e873fb6306 6a23fa8fd2b78 5 minutes ago Running kindnet-cni 1 534b5e3352955 kindnet-z4nmp
1e75bdb1fcc16 e7605f88f17d6 5 minutes ago Running kube-scheduler 1 cc42cd42180b9 kube-scheduler-old-k8s-version-716021
6438e2a98b44e 2c08bbbc02d3a 5 minutes ago Running kube-apiserver 1 5cbb50c59ca83 kube-apiserver-old-k8s-version-716021
538e7c613d2fd 05b738aa1bc63 5 minutes ago Running etcd 1 4c48d9c534013 etcd-old-k8s-version-716021
a6e224cfa7000 1df8a2b116bd1 5 minutes ago Running kube-controller-manager 1 bad38031296b9 kube-controller-manager-old-k8s-version-716021
24887212160b5 1611cd07b61d5 6 minutes ago Exited busybox 0 db5520e44465a busybox
fefa6581f4e4c db91994f4ee8f 7 minutes ago Exited coredns 0 da2ebe1ddf664 coredns-74ff55c5b-fz8dj
54c2e6b5d938c 6a23fa8fd2b78 8 minutes ago Exited kindnet-cni 0 8639199b50925 kindnet-z4nmp
90271f39ba89e 25a5233254979 8 minutes ago Exited kube-proxy 0 fd9abf7611289 kube-proxy-hdch9
3a2ed10814365 e7605f88f17d6 8 minutes ago Exited kube-scheduler 0 e7cbd8b595e3d kube-scheduler-old-k8s-version-716021
6ee84abf1b446 1df8a2b116bd1 8 minutes ago Exited kube-controller-manager 0 15c46d0e64b96 kube-controller-manager-old-k8s-version-716021
dffbe9e7eda4a 2c08bbbc02d3a 8 minutes ago Exited kube-apiserver 0 3328ae097f0e2 kube-apiserver-old-k8s-version-716021
3f8d8d7911069 05b738aa1bc63 8 minutes ago Exited etcd 0 b44d36abf943f etcd-old-k8s-version-716021
==> containerd <==
Oct 07 13:47:59 old-k8s-version-716021 containerd[570]: time="2024-10-07T13:47:59.220520631Z" level=info msg="trying next host" error="failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host" host=fake.domain
Oct 07 13:47:59 old-k8s-version-716021 containerd[570]: time="2024-10-07T13:47:59.222002872Z" level=error msg="PullImage \"fake.domain/registry.k8s.io/echoserver:1.4\" failed" error="failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
Oct 07 13:47:59 old-k8s-version-716021 containerd[570]: time="2024-10-07T13:47:59.222042265Z" level=info msg="stop pulling image fake.domain/registry.k8s.io/echoserver:1.4: active requests=0, bytes read=0"
Oct 07 13:48:20 old-k8s-version-716021 containerd[570]: time="2024-10-07T13:48:20.214039485Z" level=info msg="CreateContainer within sandbox \"05af15c10037d7ea18db6f86a27c932584f850c006325c6996c541a38c7745fb\" for container name:\"dashboard-metrics-scraper\" attempt:4"
Oct 07 13:48:20 old-k8s-version-716021 containerd[570]: time="2024-10-07T13:48:20.243296904Z" level=info msg="CreateContainer within sandbox \"05af15c10037d7ea18db6f86a27c932584f850c006325c6996c541a38c7745fb\" for name:\"dashboard-metrics-scraper\" attempt:4 returns container id \"df8025f070c9a15108aeb64733a1ae4c6c18f523dce5d735af58a52d15bb96fe\""
Oct 07 13:48:20 old-k8s-version-716021 containerd[570]: time="2024-10-07T13:48:20.244004159Z" level=info msg="StartContainer for \"df8025f070c9a15108aeb64733a1ae4c6c18f523dce5d735af58a52d15bb96fe\""
Oct 07 13:48:20 old-k8s-version-716021 containerd[570]: time="2024-10-07T13:48:20.321290752Z" level=info msg="StartContainer for \"df8025f070c9a15108aeb64733a1ae4c6c18f523dce5d735af58a52d15bb96fe\" returns successfully"
Oct 07 13:48:20 old-k8s-version-716021 containerd[570]: time="2024-10-07T13:48:20.355269165Z" level=info msg="shim disconnected" id=df8025f070c9a15108aeb64733a1ae4c6c18f523dce5d735af58a52d15bb96fe namespace=k8s.io
Oct 07 13:48:20 old-k8s-version-716021 containerd[570]: time="2024-10-07T13:48:20.355339482Z" level=warning msg="cleaning up after shim disconnected" id=df8025f070c9a15108aeb64733a1ae4c6c18f523dce5d735af58a52d15bb96fe namespace=k8s.io
Oct 07 13:48:20 old-k8s-version-716021 containerd[570]: time="2024-10-07T13:48:20.355352659Z" level=info msg="cleaning up dead shim" namespace=k8s.io
Oct 07 13:48:20 old-k8s-version-716021 containerd[570]: time="2024-10-07T13:48:20.683968893Z" level=info msg="RemoveContainer for \"5cced56ee0a9bbca8b852f15a235d02404a8bcad5e386e9cfae43e5e46636036\""
Oct 07 13:48:20 old-k8s-version-716021 containerd[570]: time="2024-10-07T13:48:20.690019097Z" level=info msg="RemoveContainer for \"5cced56ee0a9bbca8b852f15a235d02404a8bcad5e386e9cfae43e5e46636036\" returns successfully"
Oct 07 13:49:30 old-k8s-version-716021 containerd[570]: time="2024-10-07T13:49:30.208895536Z" level=info msg="PullImage \"fake.domain/registry.k8s.io/echoserver:1.4\""
Oct 07 13:49:30 old-k8s-version-716021 containerd[570]: time="2024-10-07T13:49:30.216597710Z" level=info msg="trying next host" error="failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host" host=fake.domain
Oct 07 13:49:30 old-k8s-version-716021 containerd[570]: time="2024-10-07T13:49:30.228432957Z" level=error msg="PullImage \"fake.domain/registry.k8s.io/echoserver:1.4\" failed" error="failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
Oct 07 13:49:30 old-k8s-version-716021 containerd[570]: time="2024-10-07T13:49:30.228486675Z" level=info msg="stop pulling image fake.domain/registry.k8s.io/echoserver:1.4: active requests=0, bytes read=0"
Oct 07 13:49:46 old-k8s-version-716021 containerd[570]: time="2024-10-07T13:49:46.209305746Z" level=info msg="CreateContainer within sandbox \"05af15c10037d7ea18db6f86a27c932584f850c006325c6996c541a38c7745fb\" for container name:\"dashboard-metrics-scraper\" attempt:5"
Oct 07 13:49:46 old-k8s-version-716021 containerd[570]: time="2024-10-07T13:49:46.229880173Z" level=info msg="CreateContainer within sandbox \"05af15c10037d7ea18db6f86a27c932584f850c006325c6996c541a38c7745fb\" for name:\"dashboard-metrics-scraper\" attempt:5 returns container id \"b1a44caebf01b9247c1eb127bdfd3b98f523126bafeeb49a9daec6b059aae228\""
Oct 07 13:49:46 old-k8s-version-716021 containerd[570]: time="2024-10-07T13:49:46.230562517Z" level=info msg="StartContainer for \"b1a44caebf01b9247c1eb127bdfd3b98f523126bafeeb49a9daec6b059aae228\""
Oct 07 13:49:46 old-k8s-version-716021 containerd[570]: time="2024-10-07T13:49:46.296978460Z" level=info msg="StartContainer for \"b1a44caebf01b9247c1eb127bdfd3b98f523126bafeeb49a9daec6b059aae228\" returns successfully"
Oct 07 13:49:46 old-k8s-version-716021 containerd[570]: time="2024-10-07T13:49:46.324308442Z" level=info msg="shim disconnected" id=b1a44caebf01b9247c1eb127bdfd3b98f523126bafeeb49a9daec6b059aae228 namespace=k8s.io
Oct 07 13:49:46 old-k8s-version-716021 containerd[570]: time="2024-10-07T13:49:46.324369905Z" level=warning msg="cleaning up after shim disconnected" id=b1a44caebf01b9247c1eb127bdfd3b98f523126bafeeb49a9daec6b059aae228 namespace=k8s.io
Oct 07 13:49:46 old-k8s-version-716021 containerd[570]: time="2024-10-07T13:49:46.324379464Z" level=info msg="cleaning up dead shim" namespace=k8s.io
Oct 07 13:49:46 old-k8s-version-716021 containerd[570]: time="2024-10-07T13:49:46.910028059Z" level=info msg="RemoveContainer for \"df8025f070c9a15108aeb64733a1ae4c6c18f523dce5d735af58a52d15bb96fe\""
Oct 07 13:49:46 old-k8s-version-716021 containerd[570]: time="2024-10-07T13:49:46.917534454Z" level=info msg="RemoveContainer for \"df8025f070c9a15108aeb64733a1ae4c6c18f523dce5d735af58a52d15bb96fe\" returns successfully"
==> coredns [b970f66a7b788465fb1b5efff7470a2a13241205a4b3871615987cd5e8185c0b] <==
.:53
[INFO] plugin/reload: Running configuration MD5 = b494d968e357ba1b925cee838fbd78ed
CoreDNS-1.7.0
linux/arm64, go1.14.4, f59c03d
[INFO] 127.0.0.1:58658 - 41045 "HINFO IN 8434989929753176642.3607726803472426746. udp 57 false 512" NXDOMAIN qr,rd,ra 57 0.042331802s
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/ready: Still waiting on: "kubernetes"
I1007 13:47:00.529333 1 trace.go:116] Trace[2019727887]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125 (started: 2024-10-07 13:46:30.528767829 +0000 UTC m=+0.037881935) (total time: 30.00044496s):
Trace[2019727887]: [30.00044496s] [30.00044496s] END
E1007 13:47:00.529382 1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to list *v1.Service: Get "https://10.96.0.1:443/api/v1/services?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
I1007 13:47:00.531089 1 trace.go:116] Trace[939984059]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125 (started: 2024-10-07 13:46:30.529563582 +0000 UTC m=+0.038677672) (total time: 30.00148428s):
Trace[939984059]: [30.00148428s] [30.00148428s] END
E1007 13:47:00.531126 1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to list *v1.Endpoints: Get "https://10.96.0.1:443/api/v1/endpoints?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
I1007 13:47:00.533131 1 trace.go:116] Trace[1474941318]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125 (started: 2024-10-07 13:46:30.530980217 +0000 UTC m=+0.040094323) (total time: 30.002114817s):
Trace[1474941318]: [30.002114817s] [30.002114817s] END
E1007 13:47:00.533198 1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to list *v1.Namespace: Get "https://10.96.0.1:443/api/v1/namespaces?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
==> coredns [fefa6581f4e4cb7fefe7289a78cf684582ea646cd5283484696218c2863765ed] <==
.:53
[INFO] plugin/reload: Running configuration MD5 = b494d968e357ba1b925cee838fbd78ed
CoreDNS-1.7.0
linux/arm64, go1.14.4, f59c03d
[INFO] 127.0.0.1:40669 - 22419 "HINFO IN 3949177277945759547.2442513995244647269. udp 57 false 512" NXDOMAIN qr,rd,ra 57 0.012140292s
==> describe nodes <==
Name: old-k8s-version-716021
Roles: control-plane,master
Labels: beta.kubernetes.io/arch=arm64
beta.kubernetes.io/os=linux
kubernetes.io/arch=arm64
kubernetes.io/hostname=old-k8s-version-716021
kubernetes.io/os=linux
minikube.k8s.io/commit=aced4bb0374ad4c19753bf24eee8bc7aa8774c9c
minikube.k8s.io/name=old-k8s-version-716021
minikube.k8s.io/primary=true
minikube.k8s.io/updated_at=2024_10_07T13_43_44_0700
minikube.k8s.io/version=v1.34.0
node-role.kubernetes.io/control-plane=
node-role.kubernetes.io/master=
Annotations: kubeadm.alpha.kubernetes.io/cri-socket: /run/containerd/containerd.sock
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Mon, 07 Oct 2024 13:43:40 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: old-k8s-version-716021
AcquireTime: <unset>
RenewTime: Mon, 07 Oct 2024 13:52:09 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Mon, 07 Oct 2024 13:47:17 +0000 Mon, 07 Oct 2024 13:43:34 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Mon, 07 Oct 2024 13:47:17 +0000 Mon, 07 Oct 2024 13:43:34 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Mon, 07 Oct 2024 13:47:17 +0000 Mon, 07 Oct 2024 13:43:34 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Mon, 07 Oct 2024 13:47:17 +0000 Mon, 07 Oct 2024 13:43:58 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.76.2
Hostname: old-k8s-version-716021
Capacity:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022300Ki
pods: 110
Allocatable:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022300Ki
pods: 110
System Info:
Machine ID: f005b51b0a64468d8335f0369cec4f73
System UUID: fb3e183d-5e41-4e52-a02f-96bcb2f620a0
Boot ID: 21f414e1-c967-4988-b7c1-53380c0b20c8
Kernel Version: 5.15.0-1070-aws
OS Image: Ubuntu 22.04.5 LTS
Operating System: linux
Architecture: arm64
Container Runtime Version: containerd://1.7.22
Kubelet Version: v1.20.0
Kube-Proxy Version: v1.20.0
PodCIDR: 10.244.0.0/24
PodCIDRs: 10.244.0.0/24
Non-terminated Pods: (12 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits AGE
--------- ---- ------------ ---------- --------------- ------------- ---
default busybox 0 (0%) 0 (0%) 0 (0%) 0 (0%) 6m37s
kube-system coredns-74ff55c5b-fz8dj 100m (5%) 0 (0%) 70Mi (0%) 170Mi (2%) 8m12s
kube-system etcd-old-k8s-version-716021 100m (5%) 0 (0%) 100Mi (1%) 0 (0%) 8m18s
kube-system kindnet-z4nmp 100m (5%) 100m (5%) 50Mi (0%) 50Mi (0%) 8m11s
kube-system kube-apiserver-old-k8s-version-716021 250m (12%) 0 (0%) 0 (0%) 0 (0%) 8m18s
kube-system kube-controller-manager-old-k8s-version-716021 200m (10%) 0 (0%) 0 (0%) 0 (0%) 8m18s
kube-system kube-proxy-hdch9 0 (0%) 0 (0%) 0 (0%) 0 (0%) 8m11s
kube-system kube-scheduler-old-k8s-version-716021 100m (5%) 0 (0%) 0 (0%) 0 (0%) 8m18s
kube-system metrics-server-9975d5f86-b7ct2 100m (5%) 0 (0%) 200Mi (2%) 0 (0%) 6m26s
kube-system storage-provisioner 0 (0%) 0 (0%) 0 (0%) 0 (0%) 8m10s
kubernetes-dashboard dashboard-metrics-scraper-8d5bb5db8-wxkkm 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m25s
kubernetes-dashboard kubernetes-dashboard-cd95d586-pm244 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m25s
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 950m (47%) 100m (5%)
memory 420Mi (5%) 220Mi (2%)
ephemeral-storage 100Mi (0%) 0 (0%)
hugepages-1Gi 0 (0%) 0 (0%)
hugepages-2Mi 0 (0%) 0 (0%)
hugepages-32Mi 0 (0%) 0 (0%)
hugepages-64Ki 0 (0%) 0 (0%)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal NodeHasSufficientMemory 8m37s (x5 over 8m37s) kubelet Node old-k8s-version-716021 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 8m37s (x4 over 8m37s) kubelet Node old-k8s-version-716021 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 8m37s (x4 over 8m37s) kubelet Node old-k8s-version-716021 status is now: NodeHasSufficientPID
Normal Starting 8m19s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 8m19s kubelet Node old-k8s-version-716021 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 8m19s kubelet Node old-k8s-version-716021 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 8m19s kubelet Node old-k8s-version-716021 status is now: NodeHasSufficientPID
Normal NodeAllocatableEnforced 8m18s kubelet Updated Node Allocatable limit across pods
Normal NodeReady 8m12s kubelet Node old-k8s-version-716021 status is now: NodeReady
Normal Starting 8m10s kube-proxy Starting kube-proxy.
Normal Starting 5m56s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 5m56s (x8 over 5m56s) kubelet Node old-k8s-version-716021 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 5m56s (x8 over 5m56s) kubelet Node old-k8s-version-716021 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 5m56s (x7 over 5m56s) kubelet Node old-k8s-version-716021 status is now: NodeHasSufficientPID
Normal NodeAllocatableEnforced 5m56s kubelet Updated Node Allocatable limit across pods
Normal Starting 5m40s kube-proxy Starting kube-proxy.
==> dmesg <==
[Oct 7 12:30] overlayfs: '/var/lib/containers/storage/overlay/l/7FOWQIVXOWACA56BLQVF4JJOLY' not a directory
[ +0.109813] overlayfs: '/var/lib/containers/storage/overlay/l/7FOWQIVXOWACA56BLQVF4JJOLY' not a directory
==> etcd [3f8d8d7911069dffad8bf7ce9156d34436c105ed532c7439e0b6bda21c43e87c] <==
raft2024/10/07 13:43:34 INFO: ea7e25599daad906 became candidate at term 2
raft2024/10/07 13:43:34 INFO: ea7e25599daad906 received MsgVoteResp from ea7e25599daad906 at term 2
raft2024/10/07 13:43:34 INFO: ea7e25599daad906 became leader at term 2
raft2024/10/07 13:43:34 INFO: raft.node: ea7e25599daad906 elected leader ea7e25599daad906 at term 2
2024-10-07 13:43:34.142265 I | etcdserver: published {Name:old-k8s-version-716021 ClientURLs:[https://192.168.76.2:2379]} to cluster 6f20f2c4b2fb5f8a
2024-10-07 13:43:34.142335 I | embed: ready to serve client requests
2024-10-07 13:43:34.142603 I | etcdserver: setting up the initial cluster version to 3.4
2024-10-07 13:43:34.142771 I | embed: ready to serve client requests
2024-10-07 13:43:34.144100 I | embed: serving client requests on 192.168.76.2:2379
2024-10-07 13:43:34.147113 N | etcdserver/membership: set the initial cluster version to 3.4
2024-10-07 13:43:34.147372 I | etcdserver/api: enabled capabilities for version 3.4
2024-10-07 13:43:34.186057 I | embed: serving client requests on 127.0.0.1:2379
2024-10-07 13:43:53.718746 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-10-07 13:43:54.748513 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-10-07 13:44:04.748517 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-10-07 13:44:14.748454 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-10-07 13:44:24.748557 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-10-07 13:44:34.748533 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-10-07 13:44:44.748560 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-10-07 13:44:54.748464 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-10-07 13:45:04.748466 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-10-07 13:45:14.748526 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-10-07 13:45:24.748501 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-10-07 13:45:34.748561 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-10-07 13:45:44.748587 I | etcdserver/api/etcdhttp: /health OK (status code 200)
==> etcd [538e7c613d2fdfcf8bdf655918adbdaa8c80e7d22ee153d71d980bad173f6cd1] <==
2024-10-07 13:48:02.748132 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-10-07 13:48:12.747821 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-10-07 13:48:22.747980 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-10-07 13:48:32.747836 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-10-07 13:48:42.748056 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-10-07 13:48:52.747895 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-10-07 13:49:02.748005 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-10-07 13:49:12.747779 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-10-07 13:49:22.747934 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-10-07 13:49:32.747997 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-10-07 13:49:42.748060 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-10-07 13:49:52.747876 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-10-07 13:50:02.747754 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-10-07 13:50:12.747913 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-10-07 13:50:22.747862 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-10-07 13:50:32.747906 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-10-07 13:50:42.747837 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-10-07 13:50:52.747941 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-10-07 13:51:02.747937 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-10-07 13:51:12.748079 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-10-07 13:51:22.747904 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-10-07 13:51:32.747983 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-10-07 13:51:42.747883 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-10-07 13:51:52.747893 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-10-07 13:52:02.748061 I | etcdserver/api/etcdhttp: /health OK (status code 200)
==> kernel <==
13:52:10 up 3:34, 0 users, load average: 0.98, 1.93, 2.49
Linux old-k8s-version-716021 5.15.0-1070-aws #76~20.04.1-Ubuntu SMP Mon Sep 2 12:20:48 UTC 2024 aarch64 aarch64 aarch64 GNU/Linux
PRETTY_NAME="Ubuntu 22.04.5 LTS"
==> kindnet [54c2e6b5d938cc814a93018f032c376c76d65bc1872f0fa55dd63fe950ff317f] <==
I1007 13:44:02.819896 1 controller.go:338] Waiting for informer caches to sync
I1007 13:44:02.819916 1 shared_informer.go:313] Waiting for caches to sync for kube-network-policies
I1007 13:44:03.020245 1 shared_informer.go:320] Caches are synced for kube-network-policies
I1007 13:44:03.020282 1 metrics.go:61] Registering metrics
I1007 13:44:03.020361 1 controller.go:374] Syncing nftables rules
I1007 13:44:12.822538 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I1007 13:44:12.822658 1 main.go:299] handling current node
I1007 13:44:22.818808 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I1007 13:44:22.818845 1 main.go:299] handling current node
I1007 13:44:32.823840 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I1007 13:44:32.823875 1 main.go:299] handling current node
I1007 13:44:42.826820 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I1007 13:44:42.827040 1 main.go:299] handling current node
I1007 13:44:52.819235 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I1007 13:44:52.819268 1 main.go:299] handling current node
I1007 13:45:02.818818 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I1007 13:45:02.818862 1 main.go:299] handling current node
I1007 13:45:12.827139 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I1007 13:45:12.827176 1 main.go:299] handling current node
I1007 13:45:22.821794 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I1007 13:45:22.821832 1 main.go:299] handling current node
I1007 13:45:32.825768 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I1007 13:45:32.825802 1 main.go:299] handling current node
I1007 13:45:42.824677 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I1007 13:45:42.824711 1 main.go:299] handling current node
==> kindnet [c44e873fb63063161eea0a9a33fcb424a1fca04659773868480c9079f14fcde3] <==
I1007 13:50:09.930200 1 main.go:299] handling current node
I1007 13:50:19.932031 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I1007 13:50:19.932061 1 main.go:299] handling current node
I1007 13:50:29.923177 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I1007 13:50:29.923213 1 main.go:299] handling current node
I1007 13:50:39.926956 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I1007 13:50:39.926993 1 main.go:299] handling current node
I1007 13:50:49.925884 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I1007 13:50:49.925991 1 main.go:299] handling current node
I1007 13:50:59.931208 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I1007 13:50:59.931244 1 main.go:299] handling current node
I1007 13:51:09.929077 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I1007 13:51:09.929116 1 main.go:299] handling current node
I1007 13:51:19.929785 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I1007 13:51:19.929823 1 main.go:299] handling current node
I1007 13:51:29.923425 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I1007 13:51:29.923463 1 main.go:299] handling current node
I1007 13:51:39.929304 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I1007 13:51:39.929341 1 main.go:299] handling current node
I1007 13:51:49.932255 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I1007 13:51:49.932537 1 main.go:299] handling current node
I1007 13:51:59.932049 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I1007 13:51:59.932153 1 main.go:299] handling current node
I1007 13:52:09.929752 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I1007 13:52:09.929785 1 main.go:299] handling current node
==> kube-apiserver [6438e2a98b44ed7687544147d7fde2facece2b6119ba86ffa996a5b8e7019da7] <==
I1007 13:48:59.163886 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I1007 13:48:59.163897 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
W1007 13:49:30.677024 1 handler_proxy.go:102] no RequestInfo found in the context
E1007 13:49:30.677103 1 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I1007 13:49:30.677112 1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
I1007 13:49:31.478845 1 client.go:360] parsed scheme: "passthrough"
I1007 13:49:31.478891 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I1007 13:49:31.478901 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I1007 13:50:03.435282 1 client.go:360] parsed scheme: "passthrough"
I1007 13:50:03.435327 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I1007 13:50:03.435336 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I1007 13:50:38.788774 1 client.go:360] parsed scheme: "passthrough"
I1007 13:50:38.788819 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I1007 13:50:38.788828 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I1007 13:51:11.378982 1 client.go:360] parsed scheme: "passthrough"
I1007 13:51:11.379027 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I1007 13:51:11.379036 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
W1007 13:51:27.833490 1 handler_proxy.go:102] no RequestInfo found in the context
E1007 13:51:27.833778 1 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I1007 13:51:27.833790 1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
I1007 13:51:50.957540 1 client.go:360] parsed scheme: "passthrough"
I1007 13:51:50.957586 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I1007 13:51:50.957625 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
==> kube-apiserver [dffbe9e7eda4a16ea00f685c861a1d7506d88d6ae76dc1fbd3b528f0186bf960] <==
I1007 13:43:41.105036 1 controller.go:132] OpenAPI AggregationController: action for item : Nothing (removed from the queue).
I1007 13:43:41.105070 1 controller.go:132] OpenAPI AggregationController: action for item k8s_internal_local_delegation_chain_0000000000: Nothing (removed from the queue).
I1007 13:43:41.137501 1 storage_scheduling.go:132] created PriorityClass system-node-critical with value 2000001000
I1007 13:43:41.143835 1 storage_scheduling.go:132] created PriorityClass system-cluster-critical with value 2000000000
I1007 13:43:41.143859 1 storage_scheduling.go:148] all system priority classes are created successfully or already exist.
I1007 13:43:41.649371 1 controller.go:606] quota admission added evaluator for: roles.rbac.authorization.k8s.io
I1007 13:43:41.694835 1 controller.go:606] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io
W1007 13:43:41.789937 1 lease.go:233] Resetting endpoints for master service "kubernetes" to [192.168.76.2]
I1007 13:43:41.791169 1 controller.go:606] quota admission added evaluator for: endpoints
I1007 13:43:41.795886 1 controller.go:606] quota admission added evaluator for: endpointslices.discovery.k8s.io
I1007 13:43:42.742090 1 controller.go:606] quota admission added evaluator for: serviceaccounts
I1007 13:43:43.394655 1 controller.go:606] quota admission added evaluator for: deployments.apps
I1007 13:43:43.444123 1 controller.go:606] quota admission added evaluator for: daemonsets.apps
I1007 13:43:51.856855 1 controller.go:606] quota admission added evaluator for: leases.coordination.k8s.io
I1007 13:43:58.803051 1 controller.go:606] quota admission added evaluator for: replicasets.apps
I1007 13:43:59.009701 1 controller.go:606] quota admission added evaluator for: controllerrevisions.apps
I1007 13:44:07.521562 1 client.go:360] parsed scheme: "passthrough"
I1007 13:44:07.521607 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I1007 13:44:07.521616 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I1007 13:44:37.788665 1 client.go:360] parsed scheme: "passthrough"
I1007 13:44:37.788780 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I1007 13:44:37.788809 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I1007 13:45:11.255518 1 client.go:360] parsed scheme: "passthrough"
I1007 13:45:11.255573 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I1007 13:45:11.255583 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
==> kube-controller-manager [6ee84abf1b4464314c9cb9e84d60de9b2b00461bb97fe11808df52c7e0f87771] <==
I1007 13:43:58.970244 1 shared_informer.go:247] Caches are synced for attach detach
I1007 13:43:58.970690 1 shared_informer.go:247] Caches are synced for endpoint_slice
I1007 13:43:58.970885 1 shared_informer.go:247] Caches are synced for taint
I1007 13:43:58.970971 1 node_lifecycle_controller.go:1429] Initializing eviction metric for zone:
I1007 13:43:58.970280 1 shared_informer.go:247] Caches are synced for daemon sets
W1007 13:43:58.977772 1 node_lifecycle_controller.go:1044] Missing timestamp for Node old-k8s-version-716021. Assuming now as a timestamp.
I1007 13:43:58.987224 1 node_lifecycle_controller.go:1195] Controller detected that all Nodes are not-Ready. Entering master disruption mode.
I1007 13:43:58.978236 1 range_allocator.go:373] Set node old-k8s-version-716021 PodCIDR to [10.244.0.0/24]
I1007 13:43:58.979484 1 taint_manager.go:187] Starting NoExecuteTaintManager
I1007 13:43:58.979579 1 event.go:291] "Event occurred" object="old-k8s-version-716021" kind="Node" apiVersion="v1" type="Normal" reason="RegisteredNode" message="Node old-k8s-version-716021 event: Registered Node old-k8s-version-716021 in Controller"
I1007 13:43:59.034859 1 event.go:291] "Event occurred" object="kube-system/kube-proxy" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kube-proxy-hdch9"
I1007 13:43:59.039425 1 event.go:291] "Event occurred" object="kube-system/kindnet" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kindnet-z4nmp"
I1007 13:43:59.100403 1 shared_informer.go:240] Waiting for caches to sync for garbage collector
E1007 13:43:59.102041 1 daemon_controller.go:320] kube-system/kube-proxy failed with : error storing status for daemon set &v1.DaemonSet{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"kube-proxy", GenerateName:"", Namespace:"kube-system", SelfLink:"", UID:"b68eb93c-4844-460e-9240-1b835468c690", ResourceVersion:"258", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63863905423, loc:(*time.Location)(0x632eb80)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"k8s-app":"kube-proxy"}, Annotations:map[string]string{"deprecated.daemonset.template.generation":"1"}, OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry{v1.ManagedFieldsEntry{Manager:"kubeadm", Operation:"Update", APIVersion:"apps/v1", Time:(*v1.Time)(0x4001301b60), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0x4001301b80)}}}, Spec:v1.DaemonSetSpec{Selector:(*v1.
LabelSelector)(0x4001301ba0), Template:v1.PodTemplateSpec{ObjectMeta:v1.ObjectMeta{Name:"", GenerateName:"", Namespace:"", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"k8s-app":"kube-proxy"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v1.PodSpec{Volumes:[]v1.Volume{v1.Volume{Name:"kube-proxy", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(nil), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.Gl
usterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(0x40015461c0), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}, v1.Volume{Name:"xtables-lock", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0x4001301
bc0), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeS
ource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}, v1.Volume{Name:"lib-modules", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0x4001301be0), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil),
AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}}, InitContainers:[]v1.Container(nil), Containers:[]v1.Container{v1.Container{Name:"kube-proxy", Image:"k8s.gcr.io/kube-proxy:v1.20.0", Command:[]string{"/usr/local/bin/kube-proxy", "--config=/var/lib/kube-proxy/config.conf", "--hostname-override=$(NODE_NAME)"}, Args:[]string(nil), WorkingDir:"", Ports:[]v1.ContainerPort(nil), EnvFrom:[]v1.EnvFromSource(nil), Env:[]v1.EnvVar{v1.EnvVar{Name:"NODE_NAME", Value:"", ValueFrom:(*v1.EnvVarSource)(0x4001301c20)}}, Resources:v1.R
esourceRequirements{Limits:v1.ResourceList(nil), Requests:v1.ResourceList(nil)}, VolumeMounts:[]v1.VolumeMount{v1.VolumeMount{Name:"kube-proxy", ReadOnly:false, MountPath:"/var/lib/kube-proxy", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"xtables-lock", ReadOnly:false, MountPath:"/run/xtables.lock", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"lib-modules", ReadOnly:true, MountPath:"/lib/modules", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}}, VolumeDevices:[]v1.VolumeDevice(nil), LivenessProbe:(*v1.Probe)(nil), ReadinessProbe:(*v1.Probe)(nil), StartupProbe:(*v1.Probe)(nil), Lifecycle:(*v1.Lifecycle)(nil), TerminationMessagePath:"/dev/termination-log", TerminationMessagePolicy:"File", ImagePullPolicy:"IfNotPresent", SecurityContext:(*v1.SecurityContext)(0x400142d860), Stdin:false, StdinOnce:false, TTY:false}}, EphemeralContainers:[]v1.EphemeralContainer(nil), RestartPo
licy:"Always", TerminationGracePeriodSeconds:(*int64)(0x40009537c8), ActiveDeadlineSeconds:(*int64)(nil), DNSPolicy:"ClusterFirst", NodeSelector:map[string]string{"kubernetes.io/os":"linux"}, ServiceAccountName:"kube-proxy", DeprecatedServiceAccount:"kube-proxy", AutomountServiceAccountToken:(*bool)(nil), NodeName:"", HostNetwork:true, HostPID:false, HostIPC:false, ShareProcessNamespace:(*bool)(nil), SecurityContext:(*v1.PodSecurityContext)(0x40002dc8c0), ImagePullSecrets:[]v1.LocalObjectReference(nil), Hostname:"", Subdomain:"", Affinity:(*v1.Affinity)(nil), SchedulerName:"default-scheduler", Tolerations:[]v1.Toleration{v1.Toleration{Key:"CriticalAddonsOnly", Operator:"Exists", Value:"", Effect:"", TolerationSeconds:(*int64)(nil)}, v1.Toleration{Key:"", Operator:"Exists", Value:"", Effect:"", TolerationSeconds:(*int64)(nil)}}, HostAliases:[]v1.HostAlias(nil), PriorityClassName:"system-node-critical", Priority:(*int32)(nil), DNSConfig:(*v1.PodDNSConfig)(nil), ReadinessGates:[]v1.PodReadinessGate(nil), Runtime
ClassName:(*string)(nil), EnableServiceLinks:(*bool)(nil), PreemptionPolicy:(*v1.PreemptionPolicy)(nil), Overhead:v1.ResourceList(nil), TopologySpreadConstraints:[]v1.TopologySpreadConstraint(nil), SetHostnameAsFQDN:(*bool)(nil)}}, UpdateStrategy:v1.DaemonSetUpdateStrategy{Type:"RollingUpdate", RollingUpdate:(*v1.RollingUpdateDaemonSet)(0x4000716ef0)}, MinReadySeconds:0, RevisionHistoryLimit:(*int32)(0x4000953828)}, Status:v1.DaemonSetStatus{CurrentNumberScheduled:0, NumberMisscheduled:0, DesiredNumberScheduled:0, NumberReady:0, ObservedGeneration:0, UpdatedNumberScheduled:0, NumberAvailable:0, NumberUnavailable:0, CollisionCount:(*int32)(nil), Conditions:[]v1.DaemonSetCondition(nil)}}: Operation cannot be fulfilled on daemonsets.apps "kube-proxy": the object has been modified; please apply your changes to the latest version and try again
E1007 13:43:59.104992 1 daemon_controller.go:320] kube-system/kindnet failed with : error storing status for daemon set &v1.DaemonSet{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"kindnet", GenerateName:"", Namespace:"kube-system", SelfLink:"", UID:"cbda029c-7cd1-4301-80cf-4e3836ef7b97", ResourceVersion:"266", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63863905424, loc:(*time.Location)(0x632eb80)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"app":"kindnet", "k8s-app":"kindnet", "tier":"node"}, Annotations:map[string]string{"deprecated.daemonset.template.generation":"1", "kubectl.kubernetes.io/last-applied-configuration":"{\"apiVersion\":\"apps/v1\",\"kind\":\"DaemonSet\",\"metadata\":{\"annotations\":{},\"labels\":{\"app\":\"kindnet\",\"k8s-app\":\"kindnet\",\"tier\":\"node\"},\"name\":\"kindnet\",\"namespace\":\"kube-system\"},\"spec\":{\"selector\":{\"matchLabels\":{\"app\":\"k
indnet\"}},\"template\":{\"metadata\":{\"labels\":{\"app\":\"kindnet\",\"k8s-app\":\"kindnet\",\"tier\":\"node\"}},\"spec\":{\"containers\":[{\"env\":[{\"name\":\"HOST_IP\",\"valueFrom\":{\"fieldRef\":{\"fieldPath\":\"status.hostIP\"}}},{\"name\":\"POD_IP\",\"valueFrom\":{\"fieldRef\":{\"fieldPath\":\"status.podIP\"}}},{\"name\":\"POD_SUBNET\",\"value\":\"10.244.0.0/16\"}],\"image\":\"docker.io/kindest/kindnetd:v20240813-c6f155d6\",\"name\":\"kindnet-cni\",\"resources\":{\"limits\":{\"cpu\":\"100m\",\"memory\":\"50Mi\"},\"requests\":{\"cpu\":\"100m\",\"memory\":\"50Mi\"}},\"securityContext\":{\"capabilities\":{\"add\":[\"NET_RAW\",\"NET_ADMIN\"]},\"privileged\":false},\"volumeMounts\":[{\"mountPath\":\"/etc/cni/net.d\",\"name\":\"cni-cfg\"},{\"mountPath\":\"/run/xtables.lock\",\"name\":\"xtables-lock\",\"readOnly\":false},{\"mountPath\":\"/lib/modules\",\"name\":\"lib-modules\",\"readOnly\":true}]}],\"hostNetwork\":true,\"serviceAccountName\":\"kindnet\",\"tolerations\":[{\"effect\":\"NoSchedule\",\"operator\
":\"Exists\"}],\"volumes\":[{\"hostPath\":{\"path\":\"/etc/cni/net.d\",\"type\":\"DirectoryOrCreate\"},\"name\":\"cni-cfg\"},{\"hostPath\":{\"path\":\"/run/xtables.lock\",\"type\":\"FileOrCreate\"},\"name\":\"xtables-lock\"},{\"hostPath\":{\"path\":\"/lib/modules\"},\"name\":\"lib-modules\"}]}}}}\n"}, OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry{v1.ManagedFieldsEntry{Manager:"kubectl-client-side-apply", Operation:"Update", APIVersion:"apps/v1", Time:(*v1.Time)(0x4001301c80), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0x4001301ca0)}}}, Spec:v1.DaemonSetSpec{Selector:(*v1.LabelSelector)(0x4001301cc0), Template:v1.PodTemplateSpec{ObjectMeta:v1.ObjectMeta{Name:"", GenerateName:"", Namespace:"", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string
{"app":"kindnet", "k8s-app":"kindnet", "tier":"node"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v1.PodSpec{Volumes:[]v1.Volume{v1.Volume{Name:"cni-cfg", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0x4001301ce0), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil),
FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}, v1.Volume{Name:"xtables-lock", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0x4001301d00), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.Glust
erfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}, v1.Volume{Name:"lib-modules", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0x4001301d20), EmptyDi
r:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil),
PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}}, InitContainers:[]v1.Container(nil), Containers:[]v1.Container{v1.Container{Name:"kindnet-cni", Image:"docker.io/kindest/kindnetd:v20240813-c6f155d6", Command:[]string(nil), Args:[]string(nil), WorkingDir:"", Ports:[]v1.ContainerPort(nil), EnvFrom:[]v1.EnvFromSource(nil), Env:[]v1.EnvVar{v1.EnvVar{Name:"HOST_IP", Value:"", ValueFrom:(*v1.EnvVarSource)(0x4001301d40)}, v1.EnvVar{Name:"POD_IP", Value:"", ValueFrom:(*v1.EnvVarSource)(0x4001301d80)}, v1.EnvVar{Name:"POD_SUBNET", Value:"10.244.0.0/16", ValueFrom:(*v1.EnvVarSource)(nil)}}, Resources:v1.ResourceRequirements{Limits:v1.ResourceList{"cpu":resource.Quantity{i:resource.int64Amount{value:100, scale:-3}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"100m", Format:"DecimalSI"}, "memory":resource.Quantity{i:resource.int64Amount{value:52428800, scale:
0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"50Mi", Format:"BinarySI"}}, Requests:v1.ResourceList{"cpu":resource.Quantity{i:resource.int64Amount{value:100, scale:-3}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"100m", Format:"DecimalSI"}, "memory":resource.Quantity{i:resource.int64Amount{value:52428800, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"50Mi", Format:"BinarySI"}}}, VolumeMounts:[]v1.VolumeMount{v1.VolumeMount{Name:"cni-cfg", ReadOnly:false, MountPath:"/etc/cni/net.d", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"xtables-lock", ReadOnly:false, MountPath:"/run/xtables.lock", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"lib-modules", ReadOnly:true, MountPath:"/lib/modules", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}}, VolumeDevices:[]v1.VolumeDevice(nil), LivenessProbe:(*v1.Probe)(nil), ReadinessProbe:(*v1.Probe)(nil), StartupProbe:
(*v1.Probe)(nil), Lifecycle:(*v1.Lifecycle)(nil), TerminationMessagePath:"/dev/termination-log", TerminationMessagePolicy:"File", ImagePullPolicy:"IfNotPresent", SecurityContext:(*v1.SecurityContext)(0x400142dc80), Stdin:false, StdinOnce:false, TTY:false}}, EphemeralContainers:[]v1.EphemeralContainer(nil), RestartPolicy:"Always", TerminationGracePeriodSeconds:(*int64)(0x4000953a68), ActiveDeadlineSeconds:(*int64)(nil), DNSPolicy:"ClusterFirst", NodeSelector:map[string]string(nil), ServiceAccountName:"kindnet", DeprecatedServiceAccount:"kindnet", AutomountServiceAccountToken:(*bool)(nil), NodeName:"", HostNetwork:true, HostPID:false, HostIPC:false, ShareProcessNamespace:(*bool)(nil), SecurityContext:(*v1.PodSecurityContext)(0x40002dc930), ImagePullSecrets:[]v1.LocalObjectReference(nil), Hostname:"", Subdomain:"", Affinity:(*v1.Affinity)(nil), SchedulerName:"default-scheduler", Tolerations:[]v1.Toleration{v1.Toleration{Key:"", Operator:"Exists", Value:"", Effect:"NoSchedule", TolerationSeconds:(*int64)(nil)}},
HostAliases:[]v1.HostAlias(nil), PriorityClassName:"", Priority:(*int32)(nil), DNSConfig:(*v1.PodDNSConfig)(nil), ReadinessGates:[]v1.PodReadinessGate(nil), RuntimeClassName:(*string)(nil), EnableServiceLinks:(*bool)(nil), PreemptionPolicy:(*v1.PreemptionPolicy)(nil), Overhead:v1.ResourceList(nil), TopologySpreadConstraints:[]v1.TopologySpreadConstraint(nil), SetHostnameAsFQDN:(*bool)(nil)}}, UpdateStrategy:v1.DaemonSetUpdateStrategy{Type:"RollingUpdate", RollingUpdate:(*v1.RollingUpdateDaemonSet)(0x4000716ef8)}, MinReadySeconds:0, RevisionHistoryLimit:(*int32)(0x4000953ac0)}, Status:v1.DaemonSetStatus{CurrentNumberScheduled:0, NumberMisscheduled:0, DesiredNumberScheduled:0, NumberReady:0, ObservedGeneration:0, UpdatedNumberScheduled:0, NumberAvailable:0, NumberUnavailable:0, CollisionCount:(*int32)(nil), Conditions:[]v1.DaemonSetCondition(nil)}}: Operation cannot be fulfilled on daemonsets.apps "kindnet": the object has been modified; please apply your changes to the latest version and try again
E1007 13:43:59.147243 1 daemon_controller.go:320] kube-system/kindnet failed with : error storing status for daemon set &v1.DaemonSet{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"kindnet", GenerateName:"", Namespace:"kube-system", SelfLink:"", UID:"cbda029c-7cd1-4301-80cf-4e3836ef7b97", ResourceVersion:"418", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63863905424, loc:(*time.Location)(0x632eb80)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"app":"kindnet", "k8s-app":"kindnet", "tier":"node"}, Annotations:map[string]string{"deprecated.daemonset.template.generation":"1", "kubectl.kubernetes.io/last-applied-configuration":"{\"apiVersion\":\"apps/v1\",\"kind\":\"DaemonSet\",\"metadata\":{\"annotations\":{},\"labels\":{\"app\":\"kindnet\",\"k8s-app\":\"kindnet\",\"tier\":\"node\"},\"name\":\"kindnet\",\"namespace\":\"kube-system\"},\"spec\":{\"selector\":{\"matchLabels\":{\"app\":\"k
indnet\"}},\"template\":{\"metadata\":{\"labels\":{\"app\":\"kindnet\",\"k8s-app\":\"kindnet\",\"tier\":\"node\"}},\"spec\":{\"containers\":[{\"env\":[{\"name\":\"HOST_IP\",\"valueFrom\":{\"fieldRef\":{\"fieldPath\":\"status.hostIP\"}}},{\"name\":\"POD_IP\",\"valueFrom\":{\"fieldRef\":{\"fieldPath\":\"status.podIP\"}}},{\"name\":\"POD_SUBNET\",\"value\":\"10.244.0.0/16\"}],\"image\":\"docker.io/kindest/kindnetd:v20240813-c6f155d6\",\"name\":\"kindnet-cni\",\"resources\":{\"limits\":{\"cpu\":\"100m\",\"memory\":\"50Mi\"},\"requests\":{\"cpu\":\"100m\",\"memory\":\"50Mi\"}},\"securityContext\":{\"capabilities\":{\"add\":[\"NET_RAW\",\"NET_ADMIN\"]},\"privileged\":false},\"volumeMounts\":[{\"mountPath\":\"/etc/cni/net.d\",\"name\":\"cni-cfg\"},{\"mountPath\":\"/run/xtables.lock\",\"name\":\"xtables-lock\",\"readOnly\":false},{\"mountPath\":\"/lib/modules\",\"name\":\"lib-modules\",\"readOnly\":true}]}],\"hostNetwork\":true,\"serviceAccountName\":\"kindnet\",\"tolerations\":[{\"effect\":\"NoSchedule\",\"operator\
":\"Exists\"}],\"volumes\":[{\"hostPath\":{\"path\":\"/etc/cni/net.d\",\"type\":\"DirectoryOrCreate\"},\"name\":\"cni-cfg\"},{\"hostPath\":{\"path\":\"/run/xtables.lock\",\"type\":\"FileOrCreate\"},\"name\":\"xtables-lock\"},{\"hostPath\":{\"path\":\"/lib/modules\"},\"name\":\"lib-modules\"}]}}}}\n"}, OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry{v1.ManagedFieldsEntry{Manager:"kubectl-client-side-apply", Operation:"Update", APIVersion:"apps/v1", Time:(*v1.Time)(0x4001e93140), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0x4001e93160)}, v1.ManagedFieldsEntry{Manager:"kube-controller-manager", Operation:"Update", APIVersion:"apps/v1", Time:(*v1.Time)(0x4001e93180), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0x4001e931a0)}}}, Spec:v1.DaemonSetSpec{Selector:(*v1.LabelSelector)(0x4001e931c0), Template:v1.PodTemplateSpec{ObjectMeta:v1.ObjectMeta{Name:"", GenerateName:"", Namespace:"", SelfLink:"", UID:"", ResourceVersion:"", Generatio
n:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"app":"kindnet", "k8s-app":"kindnet", "tier":"node"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v1.PodSpec{Volumes:[]v1.Volume{v1.Volume{Name:"cni-cfg", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0x4001e931e0), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:
(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}, v1.Volume{Name:"xtables-lock", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0x4001e93200), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlo
ckStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CS
I:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}, v1.Volume{Name:"lib-modules", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0x4001e93220), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Q
uobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}}, InitContainers:[]v1.Container(nil), Containers:[]v1.Container{v1.Container{Name:"kindnet-cni", Image:"docker.io/kindest/kindnetd:v20240813-c6f155d6", Command:[]string(nil), Args:[]string(nil), WorkingDir:"", Ports:[]v1.ContainerPort(nil), EnvFrom:[]v1.EnvFromSource(nil), Env:[]v1.EnvVar{v1.EnvVar{Name:"HOST_IP", Value:"", ValueFrom:(*v1.EnvVarSource)(0x4001e93240)}, v1.EnvVar{Name:"POD_IP", Value:"", ValueFrom:(*v1.EnvVarSource)(0x4001e93280)}, v1.EnvVar{Name:"POD_SUBNET", Value:"10.244.0.0/16", ValueFrom:(*v1.EnvVarSource)(nil)}}, Resources:v1.ResourceRequirements{Limits:v1.ResourceList{"cpu":resource.Quantity{i
:resource.int64Amount{value:100, scale:-3}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"100m", Format:"DecimalSI"}, "memory":resource.Quantity{i:resource.int64Amount{value:52428800, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"50Mi", Format:"BinarySI"}}, Requests:v1.ResourceList{"cpu":resource.Quantity{i:resource.int64Amount{value:100, scale:-3}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"100m", Format:"DecimalSI"}, "memory":resource.Quantity{i:resource.int64Amount{value:52428800, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"50Mi", Format:"BinarySI"}}}, VolumeMounts:[]v1.VolumeMount{v1.VolumeMount{Name:"cni-cfg", ReadOnly:false, MountPath:"/etc/cni/net.d", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"xtables-lock", ReadOnly:false, MountPath:"/run/xtables.lock", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"lib-modules", ReadOnly:true, MountPath:"/lib/modules", Sub
Path:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}}, VolumeDevices:[]v1.VolumeDevice(nil), LivenessProbe:(*v1.Probe)(nil), ReadinessProbe:(*v1.Probe)(nil), StartupProbe:(*v1.Probe)(nil), Lifecycle:(*v1.Lifecycle)(nil), TerminationMessagePath:"/dev/termination-log", TerminationMessagePolicy:"File", ImagePullPolicy:"IfNotPresent", SecurityContext:(*v1.SecurityContext)(0x4001e88ea0), Stdin:false, StdinOnce:false, TTY:false}}, EphemeralContainers:[]v1.EphemeralContainer(nil), RestartPolicy:"Always", TerminationGracePeriodSeconds:(*int64)(0x4001e86fb8), ActiveDeadlineSeconds:(*int64)(nil), DNSPolicy:"ClusterFirst", NodeSelector:map[string]string(nil), ServiceAccountName:"kindnet", DeprecatedServiceAccount:"kindnet", AutomountServiceAccountToken:(*bool)(nil), NodeName:"", HostNetwork:true, HostPID:false, HostIPC:false, ShareProcessNamespace:(*bool)(nil), SecurityContext:(*v1.PodSecurityContext)(0x40004cd650), ImagePullSecrets:[]v1.LocalObjectReference(nil), Hostname:"", Subdomain:"", Affinit
y:(*v1.Affinity)(nil), SchedulerName:"default-scheduler", Tolerations:[]v1.Toleration{v1.Toleration{Key:"", Operator:"Exists", Value:"", Effect:"NoSchedule", TolerationSeconds:(*int64)(nil)}}, HostAliases:[]v1.HostAlias(nil), PriorityClassName:"", Priority:(*int32)(nil), DNSConfig:(*v1.PodDNSConfig)(nil), ReadinessGates:[]v1.PodReadinessGate(nil), RuntimeClassName:(*string)(nil), EnableServiceLinks:(*bool)(nil), PreemptionPolicy:(*v1.PreemptionPolicy)(nil), Overhead:v1.ResourceList(nil), TopologySpreadConstraints:[]v1.TopologySpreadConstraint(nil), SetHostnameAsFQDN:(*bool)(nil)}}, UpdateStrategy:v1.DaemonSetUpdateStrategy{Type:"RollingUpdate", RollingUpdate:(*v1.RollingUpdateDaemonSet)(0x4000115a08)}, MinReadySeconds:0, RevisionHistoryLimit:(*int32)(0x4001e87000)}, Status:v1.DaemonSetStatus{CurrentNumberScheduled:0, NumberMisscheduled:0, DesiredNumberScheduled:1, NumberReady:0, ObservedGeneration:1, UpdatedNumberScheduled:0, NumberAvailable:0, NumberUnavailable:1, CollisionCount:(*int32)(nil), Conditions:[]v
1.DaemonSetCondition(nil)}}: Operation cannot be fulfilled on daemonsets.apps "kindnet": the object has been modified; please apply your changes to the latest version and try again
I1007 13:43:59.415561 1 shared_informer.go:247] Caches are synced for garbage collector
I1007 13:43:59.415586 1 garbagecollector.go:151] Garbage collector: all resource monitors have synced. Proceeding to collect garbage
I1007 13:43:59.416416 1 shared_informer.go:247] Caches are synced for garbage collector
I1007 13:44:00.947138 1 event.go:291] "Event occurred" object="kube-system/coredns" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled down replica set coredns-74ff55c5b to 1"
I1007 13:44:00.972043 1 event.go:291] "Event occurred" object="kube-system/coredns-74ff55c5b" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulDelete" message="Deleted pod: coredns-74ff55c5b-86shr"
I1007 13:44:03.987678 1 node_lifecycle_controller.go:1222] Controller detected that some Nodes are Ready. Exiting master disruption mode.
I1007 13:45:43.753088 1 event.go:291] "Event occurred" object="kube-system/metrics-server" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set metrics-server-9975d5f86 to 1"
E1007 13:45:44.050231 1 clusterroleaggregation_controller.go:181] edit failed with : Operation cannot be fulfilled on clusterroles.rbac.authorization.k8s.io "edit": the object has been modified; please apply your changes to the latest version and try again
E1007 13:45:44.050331 1 clusterroleaggregation_controller.go:181] admin failed with : Operation cannot be fulfilled on clusterroles.rbac.authorization.k8s.io "admin": the object has been modified; please apply your changes to the latest version and try again
==> kube-controller-manager [a6e224cfa70000e35a720f8c9ed9661a70147bc5dc65460934496ec9b288fe06] <==
I1007 13:47:50.427466 1 request.go:655] Throttling request took 1.047952556s, request: GET:https://192.168.76.2:8443/apis/extensions/v1beta1?timeout=32s
W1007 13:47:51.279079 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E1007 13:48:17.315614 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I1007 13:48:22.929655 1 request.go:655] Throttling request took 1.048184797s, request: GET:https://192.168.76.2:8443/apis/events.k8s.io/v1?timeout=32s
W1007 13:48:23.780985 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E1007 13:48:47.817497 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I1007 13:48:55.431448 1 request.go:655] Throttling request took 1.048352679s, request: GET:https://192.168.76.2:8443/apis/apiextensions.k8s.io/v1beta1?timeout=32s
W1007 13:48:56.283485 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E1007 13:49:18.319381 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I1007 13:49:27.933845 1 request.go:655] Throttling request took 1.048382921s, request: GET:https://192.168.76.2:8443/apis/storage.k8s.io/v1beta1?timeout=32s
W1007 13:49:28.785561 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E1007 13:49:48.822191 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I1007 13:50:00.437247 1 request.go:655] Throttling request took 1.049197471s, request: GET:https://192.168.76.2:8443/apis/scheduling.k8s.io/v1?timeout=32s
W1007 13:50:01.287806 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E1007 13:50:19.324383 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I1007 13:50:32.938326 1 request.go:655] Throttling request took 1.04737806s, request: GET:https://192.168.76.2:8443/apis/extensions/v1beta1?timeout=32s
W1007 13:50:33.789820 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E1007 13:50:49.826799 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I1007 13:51:05.441439 1 request.go:655] Throttling request took 1.049329447s, request: GET:https://192.168.76.2:8443/apis/rbac.authorization.k8s.io/v1?timeout=32s
W1007 13:51:06.291943 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E1007 13:51:20.329125 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I1007 13:51:37.942330 1 request.go:655] Throttling request took 1.048381579s, request: GET:https://192.168.76.2:8443/apis/apiextensions.k8s.io/v1?timeout=32s
W1007 13:51:38.793874 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E1007 13:51:50.831944 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I1007 13:52:10.444901 1 request.go:655] Throttling request took 1.013193807s, request: GET:https://192.168.76.2:8443/apis/extensions/v1beta1?timeout=32s
==> kube-proxy [90271f39ba89eca0f9f411179e611fffa8cb7092df3cd7385b2489d67eb7a32d] <==
I1007 13:44:00.145956 1 node.go:172] Successfully retrieved node IP: 192.168.76.2
I1007 13:44:00.146098 1 server_others.go:142] kube-proxy node IP is an IPv4 address (192.168.76.2), assume IPv4 operation
W1007 13:44:00.250972 1 server_others.go:578] Unknown proxy mode "", assuming iptables proxy
I1007 13:44:00.251098 1 server_others.go:185] Using iptables Proxier.
I1007 13:44:00.251357 1 server.go:650] Version: v1.20.0
I1007 13:44:00.252035 1 config.go:315] Starting service config controller
I1007 13:44:00.252059 1 shared_informer.go:240] Waiting for caches to sync for service config
I1007 13:44:00.255433 1 config.go:224] Starting endpoint slice config controller
I1007 13:44:00.255465 1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config
I1007 13:44:00.352286 1 shared_informer.go:247] Caches are synced for service config
I1007 13:44:00.359334 1 shared_informer.go:247] Caches are synced for endpoint slice config
==> kube-proxy [b47f6084fbcd06d9de3d640a50b2eedabdcfa0e9e99795313dbbf409ba0b34ba] <==
I1007 13:46:30.904457 1 node.go:172] Successfully retrieved node IP: 192.168.76.2
I1007 13:46:30.904536 1 server_others.go:142] kube-proxy node IP is an IPv4 address (192.168.76.2), assume IPv4 operation
W1007 13:46:30.927102 1 server_others.go:578] Unknown proxy mode "", assuming iptables proxy
I1007 13:46:30.927291 1 server_others.go:185] Using iptables Proxier.
I1007 13:46:30.927853 1 server.go:650] Version: v1.20.0
I1007 13:46:30.928705 1 config.go:315] Starting service config controller
I1007 13:46:30.928842 1 shared_informer.go:240] Waiting for caches to sync for service config
I1007 13:46:30.928945 1 config.go:224] Starting endpoint slice config controller
I1007 13:46:30.929023 1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config
I1007 13:46:31.029060 1 shared_informer.go:247] Caches are synced for service config
I1007 13:46:31.029292 1 shared_informer.go:247] Caches are synced for endpoint slice config
==> kube-scheduler [1e75bdb1fcc164ca7ea09aaa49994e75347b13bbf4549844b1471555f94af297] <==
I1007 13:46:18.291780 1 serving.go:331] Generated self-signed cert in-memory
W1007 13:46:26.724674 1 requestheader_controller.go:193] Unable to get configmap/extension-apiserver-authentication in kube-system. Usually fixed by 'kubectl create rolebinding -n kube-system ROLEBINDING_NAME --role=extension-apiserver-authentication-reader --serviceaccount=YOUR_NS:YOUR_SA'
W1007 13:46:26.727853 1 authentication.go:332] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"
W1007 13:46:26.727887 1 authentication.go:333] Continuing without authentication configuration. This may treat all requests as anonymous.
W1007 13:46:26.727896 1 authentication.go:334] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false
I1007 13:46:26.968380 1 secure_serving.go:197] Serving securely on 127.0.0.1:10259
I1007 13:46:26.981976 1 configmap_cafile_content.go:202] Starting client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I1007 13:46:26.982006 1 shared_informer.go:240] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I1007 13:46:26.982029 1 tlsconfig.go:240] Starting DynamicServingCertificateController
I1007 13:46:27.182261 1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
==> kube-scheduler [3a2ed108143653900fc42a927e9971546f5f58f58c845162e9ad03a74ef4c19f] <==
W1007 13:43:40.253157 1 requestheader_controller.go:193] Unable to get configmap/extension-apiserver-authentication in kube-system. Usually fixed by 'kubectl create rolebinding -n kube-system ROLEBINDING_NAME --role=extension-apiserver-authentication-reader --serviceaccount=YOUR_NS:YOUR_SA'
W1007 13:43:40.253335 1 authentication.go:332] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"
W1007 13:43:40.253355 1 authentication.go:333] Continuing without authentication configuration. This may treat all requests as anonymous.
W1007 13:43:40.253361 1 authentication.go:334] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false
I1007 13:43:40.349431 1 secure_serving.go:197] Serving securely on 127.0.0.1:10259
I1007 13:43:40.349769 1 configmap_cafile_content.go:202] Starting client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I1007 13:43:40.353733 1 shared_informer.go:240] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I1007 13:43:40.353946 1 tlsconfig.go:240] Starting DynamicServingCertificateController
E1007 13:43:40.379707 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
E1007 13:43:40.380015 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
E1007 13:43:40.380222 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
E1007 13:43:40.381651 1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
E1007 13:43:40.382085 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1beta1.PodDisruptionBudget: failed to list *v1beta1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
E1007 13:43:40.382292 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
E1007 13:43:40.382553 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
E1007 13:43:40.382771 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
E1007 13:43:40.382798 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
E1007 13:43:40.397451 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
E1007 13:43:40.397815 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
E1007 13:43:40.397893 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
E1007 13:43:41.223490 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1beta1.PodDisruptionBudget: failed to list *v1beta1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
E1007 13:43:41.257068 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
E1007 13:43:41.274574 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
E1007 13:43:41.366758 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
I1007 13:43:41.854593 1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
==> kubelet <==
Oct 07 13:50:19 old-k8s-version-716021 kubelet[666]: E1007 13:50:19.206748 666 pod_workers.go:191] Error syncing pod 184eab58-b771-4e54-8c7c-46985955b403 ("metrics-server-9975d5f86-b7ct2_kube-system(184eab58-b771-4e54-8c7c-46985955b403)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Oct 07 13:50:28 old-k8s-version-716021 kubelet[666]: I1007 13:50:28.206863 666 scope.go:95] [topologymanager] RemoveContainer - Container ID: b1a44caebf01b9247c1eb127bdfd3b98f523126bafeeb49a9daec6b059aae228
Oct 07 13:50:28 old-k8s-version-716021 kubelet[666]: E1007 13:50:28.207831 666 pod_workers.go:191] Error syncing pod d8c979bf-7b30-4283-aaeb-85e8808af24f ("dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"
Oct 07 13:50:30 old-k8s-version-716021 kubelet[666]: E1007 13:50:30.211659 666 pod_workers.go:191] Error syncing pod 184eab58-b771-4e54-8c7c-46985955b403 ("metrics-server-9975d5f86-b7ct2_kube-system(184eab58-b771-4e54-8c7c-46985955b403)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Oct 07 13:50:40 old-k8s-version-716021 kubelet[666]: I1007 13:50:40.210036 666 scope.go:95] [topologymanager] RemoveContainer - Container ID: b1a44caebf01b9247c1eb127bdfd3b98f523126bafeeb49a9daec6b059aae228
Oct 07 13:50:40 old-k8s-version-716021 kubelet[666]: E1007 13:50:40.210379 666 pod_workers.go:191] Error syncing pod d8c979bf-7b30-4283-aaeb-85e8808af24f ("dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"
Oct 07 13:50:45 old-k8s-version-716021 kubelet[666]: E1007 13:50:45.207104 666 pod_workers.go:191] Error syncing pod 184eab58-b771-4e54-8c7c-46985955b403 ("metrics-server-9975d5f86-b7ct2_kube-system(184eab58-b771-4e54-8c7c-46985955b403)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Oct 07 13:50:53 old-k8s-version-716021 kubelet[666]: I1007 13:50:53.206149 666 scope.go:95] [topologymanager] RemoveContainer - Container ID: b1a44caebf01b9247c1eb127bdfd3b98f523126bafeeb49a9daec6b059aae228
Oct 07 13:50:53 old-k8s-version-716021 kubelet[666]: E1007 13:50:53.206980 666 pod_workers.go:191] Error syncing pod d8c979bf-7b30-4283-aaeb-85e8808af24f ("dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"
Oct 07 13:50:57 old-k8s-version-716021 kubelet[666]: E1007 13:50:57.206804 666 pod_workers.go:191] Error syncing pod 184eab58-b771-4e54-8c7c-46985955b403 ("metrics-server-9975d5f86-b7ct2_kube-system(184eab58-b771-4e54-8c7c-46985955b403)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Oct 07 13:51:08 old-k8s-version-716021 kubelet[666]: I1007 13:51:08.206132 666 scope.go:95] [topologymanager] RemoveContainer - Container ID: b1a44caebf01b9247c1eb127bdfd3b98f523126bafeeb49a9daec6b059aae228
Oct 07 13:51:08 old-k8s-version-716021 kubelet[666]: E1007 13:51:08.206532 666 pod_workers.go:191] Error syncing pod d8c979bf-7b30-4283-aaeb-85e8808af24f ("dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"
Oct 07 13:51:08 old-k8s-version-716021 kubelet[666]: E1007 13:51:08.207812 666 pod_workers.go:191] Error syncing pod 184eab58-b771-4e54-8c7c-46985955b403 ("metrics-server-9975d5f86-b7ct2_kube-system(184eab58-b771-4e54-8c7c-46985955b403)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Oct 07 13:51:22 old-k8s-version-716021 kubelet[666]: E1007 13:51:22.206879 666 pod_workers.go:191] Error syncing pod 184eab58-b771-4e54-8c7c-46985955b403 ("metrics-server-9975d5f86-b7ct2_kube-system(184eab58-b771-4e54-8c7c-46985955b403)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Oct 07 13:51:22 old-k8s-version-716021 kubelet[666]: I1007 13:51:22.207713 666 scope.go:95] [topologymanager] RemoveContainer - Container ID: b1a44caebf01b9247c1eb127bdfd3b98f523126bafeeb49a9daec6b059aae228
Oct 07 13:51:22 old-k8s-version-716021 kubelet[666]: E1007 13:51:22.208036 666 pod_workers.go:191] Error syncing pod d8c979bf-7b30-4283-aaeb-85e8808af24f ("dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"
Oct 07 13:51:33 old-k8s-version-716021 kubelet[666]: E1007 13:51:33.206925 666 pod_workers.go:191] Error syncing pod 184eab58-b771-4e54-8c7c-46985955b403 ("metrics-server-9975d5f86-b7ct2_kube-system(184eab58-b771-4e54-8c7c-46985955b403)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Oct 07 13:51:34 old-k8s-version-716021 kubelet[666]: I1007 13:51:34.206073 666 scope.go:95] [topologymanager] RemoveContainer - Container ID: b1a44caebf01b9247c1eb127bdfd3b98f523126bafeeb49a9daec6b059aae228
Oct 07 13:51:34 old-k8s-version-716021 kubelet[666]: E1007 13:51:34.206498 666 pod_workers.go:191] Error syncing pod d8c979bf-7b30-4283-aaeb-85e8808af24f ("dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"
Oct 07 13:51:47 old-k8s-version-716021 kubelet[666]: E1007 13:51:47.231399 666 pod_workers.go:191] Error syncing pod 184eab58-b771-4e54-8c7c-46985955b403 ("metrics-server-9975d5f86-b7ct2_kube-system(184eab58-b771-4e54-8c7c-46985955b403)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Oct 07 13:51:48 old-k8s-version-716021 kubelet[666]: I1007 13:51:48.206650 666 scope.go:95] [topologymanager] RemoveContainer - Container ID: b1a44caebf01b9247c1eb127bdfd3b98f523126bafeeb49a9daec6b059aae228
Oct 07 13:51:48 old-k8s-version-716021 kubelet[666]: E1007 13:51:48.206953 666 pod_workers.go:191] Error syncing pod d8c979bf-7b30-4283-aaeb-85e8808af24f ("dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"
Oct 07 13:52:01 old-k8s-version-716021 kubelet[666]: I1007 13:52:01.206118 666 scope.go:95] [topologymanager] RemoveContainer - Container ID: b1a44caebf01b9247c1eb127bdfd3b98f523126bafeeb49a9daec6b059aae228
Oct 07 13:52:01 old-k8s-version-716021 kubelet[666]: E1007 13:52:01.206466 666 pod_workers.go:191] Error syncing pod d8c979bf-7b30-4283-aaeb-85e8808af24f ("dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wxkkm_kubernetes-dashboard(d8c979bf-7b30-4283-aaeb-85e8808af24f)"
Oct 07 13:52:03 old-k8s-version-716021 kubelet[666]: E1007 13:52:03.206958 666 pod_workers.go:191] Error syncing pod 184eab58-b771-4e54-8c7c-46985955b403 ("metrics-server-9975d5f86-b7ct2_kube-system(184eab58-b771-4e54-8c7c-46985955b403)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
==> kubernetes-dashboard [02588bae23d099926c85f07f669f2281dd82887c6cda051d44c64293d25ce608] <==
2024/10/07 13:46:54 Using namespace: kubernetes-dashboard
2024/10/07 13:46:54 Using in-cluster config to connect to apiserver
2024/10/07 13:46:54 Using secret token for csrf signing
2024/10/07 13:46:54 Initializing csrf token from kubernetes-dashboard-csrf secret
2024/10/07 13:46:54 Empty token. Generating and storing in a secret kubernetes-dashboard-csrf
2024/10/07 13:46:54 Successful initial request to the apiserver, version: v1.20.0
2024/10/07 13:46:54 Generating JWE encryption key
2024/10/07 13:46:54 New synchronizer has been registered: kubernetes-dashboard-key-holder-kubernetes-dashboard. Starting
2024/10/07 13:46:54 Starting secret synchronizer for kubernetes-dashboard-key-holder in namespace kubernetes-dashboard
2024/10/07 13:46:54 Initializing JWE encryption key from synchronized object
2024/10/07 13:46:54 Creating in-cluster Sidecar client
2024/10/07 13:46:54 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/10/07 13:46:54 Serving insecurely on HTTP port: 9090
2024/10/07 13:47:24 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/10/07 13:47:54 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/10/07 13:48:24 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/10/07 13:48:54 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/10/07 13:49:24 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/10/07 13:49:54 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/10/07 13:50:24 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/10/07 13:50:54 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/10/07 13:51:24 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/10/07 13:51:54 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/10/07 13:46:54 Starting overwatch
==> storage-provisioner [3e11e0da9f75ad4dd8fcceb6b095c49ccfce3438e6b64b5adf91722fb701d656] <==
I1007 13:46:30.597251 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
F1007 13:47:00.602012 1 main.go:39] error getting server version: Get "https://10.96.0.1:443/version?timeout=32s": dial tcp 10.96.0.1:443: i/o timeout
==> storage-provisioner [94f42c6c49fd89fb1387486b3bfb41e7d9ad24f923a9cbfb3757cab9ba0d589c] <==
I1007 13:47:12.309683 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
I1007 13:47:12.330891 1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
I1007 13:47:12.331399 1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
I1007 13:47:29.798616 1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
I1007 13:47:29.798916 1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_old-k8s-version-716021_239d44ce-d2d6-4f0e-b00b-4cd5ebdfeb87!
I1007 13:47:29.799724 1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"5cb77622-d157-4ccc-9b60-30abcf10b5f1", APIVersion:"v1", ResourceVersion:"841", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' old-k8s-version-716021_239d44ce-d2d6-4f0e-b00b-4cd5ebdfeb87 became leader
I1007 13:47:29.902403 1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_old-k8s-version-716021_239d44ce-d2d6-4f0e-b00b-4cd5ebdfeb87!
-- /stdout --
helpers_test.go:254: (dbg) Run: out/minikube-linux-arm64 status --format={{.APIServer}} -p old-k8s-version-716021 -n old-k8s-version-716021
helpers_test.go:261: (dbg) Run: kubectl --context old-k8s-version-716021 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:272: non-running pods: metrics-server-9975d5f86-b7ct2
helpers_test.go:274: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: describe non-running pods <======
helpers_test.go:277: (dbg) Run: kubectl --context old-k8s-version-716021 describe pod metrics-server-9975d5f86-b7ct2
helpers_test.go:277: (dbg) Non-zero exit: kubectl --context old-k8s-version-716021 describe pod metrics-server-9975d5f86-b7ct2: exit status 1 (107.638485ms)
** stderr **
Error from server (NotFound): pods "metrics-server-9975d5f86-b7ct2" not found
** /stderr **
helpers_test.go:279: kubectl --context old-k8s-version-716021 describe pod metrics-server-9975d5f86-b7ct2: exit status 1
--- FAIL: TestStartStop/group/old-k8s-version/serial/SecondStart (374.37s)