=== RUN TestStartStop/group/old-k8s-version/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run: out/minikube-linux-arm64 start -p old-k8s-version-070145 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=containerd --kubernetes-version=v1.20.0
start_stop_delete_test.go:256: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p old-k8s-version-070145 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=containerd --kubernetes-version=v1.20.0: exit status 102 (6m20.741472798s)
-- stdout --
* [old-k8s-version-070145] minikube v1.32.0 on Ubuntu 20.04 (arm64)
- MINIKUBE_LOCATION=18350
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/18350-741028/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/18350-741028/.minikube
- MINIKUBE_BIN=out/minikube-linux-arm64
- MINIKUBE_FORCE_SYSTEMD=
* Kubernetes 1.28.4 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.28.4
* Using the docker driver based on existing profile
* Starting "old-k8s-version-070145" primary control-plane node in "old-k8s-version-070145" cluster
* Pulling base image v0.0.42-1708944392-18244 ...
* Restarting existing docker container for "old-k8s-version-070145" ...
* Preparing Kubernetes v1.20.0 on containerd 1.6.28 ...
* Verifying Kubernetes components...
- Using image gcr.io/k8s-minikube/storage-provisioner:v5
- Using image registry.k8s.io/echoserver:1.4
- Using image fake.domain/registry.k8s.io/echoserver:1.4
- Using image docker.io/kubernetesui/dashboard:v2.7.0
* Some dashboard features require the metrics-server addon. To enable all features please run:
minikube -p old-k8s-version-070145 addons enable metrics-server
* Enabled addons: dashboard, storage-provisioner, metrics-server, default-storageclass
-- /stdout --
** stderr **
I0311 13:35:02.163032 944071 out.go:291] Setting OutFile to fd 1 ...
I0311 13:35:02.163387 944071 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0311 13:35:02.163402 944071 out.go:304] Setting ErrFile to fd 2...
I0311 13:35:02.163409 944071 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0311 13:35:02.163667 944071 root.go:338] Updating PATH: /home/jenkins/minikube-integration/18350-741028/.minikube/bin
I0311 13:35:02.164057 944071 out.go:298] Setting JSON to false
I0311 13:35:02.165506 944071 start.go:129] hostinfo: {"hostname":"ip-172-31-31-251","uptime":19047,"bootTime":1710145056,"procs":192,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1055-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"982e3628-3742-4b3e-bb63-ac1b07660ec7"}
I0311 13:35:02.165633 944071 start.go:139] virtualization:
I0311 13:35:02.169452 944071 out.go:177] * [old-k8s-version-070145] minikube v1.32.0 on Ubuntu 20.04 (arm64)
I0311 13:35:02.172823 944071 out.go:177] - MINIKUBE_LOCATION=18350
I0311 13:35:02.175011 944071 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0311 13:35:02.173089 944071 notify.go:220] Checking for updates...
I0311 13:35:02.177163 944071 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/18350-741028/kubeconfig
I0311 13:35:02.179361 944071 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/18350-741028/.minikube
I0311 13:35:02.181950 944071 out.go:177] - MINIKUBE_BIN=out/minikube-linux-arm64
I0311 13:35:02.183891 944071 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0311 13:35:02.186400 944071 config.go:182] Loaded profile config "old-k8s-version-070145": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0
I0311 13:35:02.189042 944071 out.go:177] * Kubernetes 1.28.4 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.28.4
I0311 13:35:02.191067 944071 driver.go:392] Setting default libvirt URI to qemu:///system
I0311 13:35:02.229552 944071 docker.go:122] docker version: linux-25.0.4:Docker Engine - Community
I0311 13:35:02.229661 944071 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0311 13:35:02.309183 944071 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:55 OomKillDisable:true NGoroutines:71 SystemTime:2024-03-11 13:35:02.298723935 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1055-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215035904 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:25.0.4 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:ae07eda36dd25f8a1b98dfbf587313b99c0190bb Expected:ae07eda36dd25f8a1b98dfbf587313b99c0190bb} RuncCommit:{ID:v1.1.12-0-g51d5e94 Expected:v1.1.12-0-g51d5e94} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.13.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.24.7]] Warnings:<nil>}}
I0311 13:35:02.309342 944071 docker.go:295] overlay module found
I0311 13:35:02.315100 944071 out.go:177] * Using the docker driver based on existing profile
I0311 13:35:02.317172 944071 start.go:297] selected driver: docker
I0311 13:35:02.317197 944071 start.go:901] validating driver "docker" against &{Name:old-k8s-version-070145 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-070145 Namespace:default APIServerHAVIP: AP
IServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:fa
lse MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0311 13:35:02.317316 944071 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0311 13:35:02.317906 944071 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0311 13:35:02.372039 944071 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:55 OomKillDisable:true NGoroutines:71 SystemTime:2024-03-11 13:35:02.363104117 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1055-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215035904 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:25.0.4 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:ae07eda36dd25f8a1b98dfbf587313b99c0190bb Expected:ae07eda36dd25f8a1b98dfbf587313b99c0190bb} RuncCommit:{ID:v1.1.12-0-g51d5e94 Expected:v1.1.12-0-g51d5e94} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.13.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.24.7]] Warnings:<nil>}}
I0311 13:35:02.372433 944071 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0311 13:35:02.372468 944071 cni.go:84] Creating CNI manager for ""
I0311 13:35:02.372485 944071 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0311 13:35:02.372527 944071 start.go:340] cluster config:
{Name:old-k8s-version-070145 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-070145 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local
ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:do
cker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0311 13:35:02.375054 944071 out.go:177] * Starting "old-k8s-version-070145" primary control-plane node in "old-k8s-version-070145" cluster
I0311 13:35:02.376997 944071 cache.go:121] Beginning downloading kic base image for docker with containerd
I0311 13:35:02.378734 944071 out.go:177] * Pulling base image v0.0.42-1708944392-18244 ...
I0311 13:35:02.380506 944071 preload.go:132] Checking if preload exists for k8s version v1.20.0 and runtime containerd
I0311 13:35:02.380567 944071 preload.go:147] Found local preload: /home/jenkins/minikube-integration/18350-741028/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-containerd-overlay2-arm64.tar.lz4
I0311 13:35:02.380595 944071 cache.go:56] Caching tarball of preloaded images
I0311 13:35:02.380609 944071 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 in local docker daemon
I0311 13:35:02.380682 944071 preload.go:173] Found /home/jenkins/minikube-integration/18350-741028/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-containerd-overlay2-arm64.tar.lz4 in cache, skipping download
I0311 13:35:02.380691 944071 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on containerd
I0311 13:35:02.380837 944071 profile.go:142] Saving config to /home/jenkins/minikube-integration/18350-741028/.minikube/profiles/old-k8s-version-070145/config.json ...
I0311 13:35:02.403554 944071 image.go:83] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 in local docker daemon, skipping pull
I0311 13:35:02.403579 944071 cache.go:144] gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 exists in daemon, skipping load
I0311 13:35:02.403597 944071 cache.go:194] Successfully downloaded all kic artifacts
I0311 13:35:02.403626 944071 start.go:360] acquireMachinesLock for old-k8s-version-070145: {Name:mkbdf339bb42f6ca666483787f07aea7b59195a1 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0311 13:35:02.403745 944071 start.go:364] duration metric: took 51.339µs to acquireMachinesLock for "old-k8s-version-070145"
I0311 13:35:02.403777 944071 start.go:96] Skipping create...Using existing machine configuration
I0311 13:35:02.403796 944071 fix.go:54] fixHost starting:
I0311 13:35:02.404072 944071 cli_runner.go:164] Run: docker container inspect old-k8s-version-070145 --format={{.State.Status}}
I0311 13:35:02.420295 944071 fix.go:112] recreateIfNeeded on old-k8s-version-070145: state=Stopped err=<nil>
W0311 13:35:02.420327 944071 fix.go:138] unexpected machine state, will restart: <nil>
I0311 13:35:02.422778 944071 out.go:177] * Restarting existing docker container for "old-k8s-version-070145" ...
I0311 13:35:02.424920 944071 cli_runner.go:164] Run: docker start old-k8s-version-070145
I0311 13:35:02.778074 944071 cli_runner.go:164] Run: docker container inspect old-k8s-version-070145 --format={{.State.Status}}
I0311 13:35:02.805004 944071 kic.go:430] container "old-k8s-version-070145" state is running.
I0311 13:35:02.805393 944071 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-070145
I0311 13:35:02.838293 944071 profile.go:142] Saving config to /home/jenkins/minikube-integration/18350-741028/.minikube/profiles/old-k8s-version-070145/config.json ...
I0311 13:35:02.838550 944071 machine.go:94] provisionDockerMachine start ...
I0311 13:35:02.838614 944071 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-070145
I0311 13:35:02.868324 944071 main.go:141] libmachine: Using SSH client type: native
I0311 13:35:02.868604 944071 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e1ca0] 0x3e4500 <nil> [] 0s} 127.0.0.1 34038 <nil> <nil>}
I0311 13:35:02.868613 944071 main.go:141] libmachine: About to run SSH command:
hostname
I0311 13:35:02.869598 944071 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: EOF
I0311 13:35:06.025174 944071 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-070145
I0311 13:35:06.025205 944071 ubuntu.go:169] provisioning hostname "old-k8s-version-070145"
I0311 13:35:06.025276 944071 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-070145
I0311 13:35:06.068536 944071 main.go:141] libmachine: Using SSH client type: native
I0311 13:35:06.068830 944071 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e1ca0] 0x3e4500 <nil> [] 0s} 127.0.0.1 34038 <nil> <nil>}
I0311 13:35:06.068849 944071 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-070145 && echo "old-k8s-version-070145" | sudo tee /etc/hostname
I0311 13:35:06.244137 944071 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-070145
I0311 13:35:06.244214 944071 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-070145
I0311 13:35:06.269721 944071 main.go:141] libmachine: Using SSH client type: native
I0311 13:35:06.269995 944071 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e1ca0] 0x3e4500 <nil> [] 0s} 127.0.0.1 34038 <nil> <nil>}
I0311 13:35:06.270019 944071 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-070145' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-070145/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-070145' | sudo tee -a /etc/hosts;
fi
fi
I0311 13:35:06.424306 944071 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0311 13:35:06.424337 944071 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/18350-741028/.minikube CaCertPath:/home/jenkins/minikube-integration/18350-741028/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/18350-741028/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/18350-741028/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/18350-741028/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/18350-741028/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/18350-741028/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/18350-741028/.minikube}
I0311 13:35:06.424357 944071 ubuntu.go:177] setting up certificates
I0311 13:35:06.424366 944071 provision.go:84] configureAuth start
I0311 13:35:06.424430 944071 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-070145
I0311 13:35:06.462283 944071 provision.go:143] copyHostCerts
I0311 13:35:06.462358 944071 exec_runner.go:144] found /home/jenkins/minikube-integration/18350-741028/.minikube/ca.pem, removing ...
I0311 13:35:06.462367 944071 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18350-741028/.minikube/ca.pem
I0311 13:35:06.462440 944071 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18350-741028/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/18350-741028/.minikube/ca.pem (1078 bytes)
I0311 13:35:06.462534 944071 exec_runner.go:144] found /home/jenkins/minikube-integration/18350-741028/.minikube/cert.pem, removing ...
I0311 13:35:06.462539 944071 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18350-741028/.minikube/cert.pem
I0311 13:35:06.462564 944071 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18350-741028/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/18350-741028/.minikube/cert.pem (1123 bytes)
I0311 13:35:06.462613 944071 exec_runner.go:144] found /home/jenkins/minikube-integration/18350-741028/.minikube/key.pem, removing ...
I0311 13:35:06.462617 944071 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18350-741028/.minikube/key.pem
I0311 13:35:06.462639 944071 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18350-741028/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/18350-741028/.minikube/key.pem (1675 bytes)
I0311 13:35:06.462682 944071 provision.go:117] generating server cert: /home/jenkins/minikube-integration/18350-741028/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/18350-741028/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/18350-741028/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-070145 san=[127.0.0.1 192.168.76.2 localhost minikube old-k8s-version-070145]
I0311 13:35:07.247552 944071 provision.go:177] copyRemoteCerts
I0311 13:35:07.247629 944071 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0311 13:35:07.247676 944071 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-070145
I0311 13:35:07.271885 944071 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34038 SSHKeyPath:/home/jenkins/minikube-integration/18350-741028/.minikube/machines/old-k8s-version-070145/id_rsa Username:docker}
I0311 13:35:07.375107 944071 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18350-741028/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0311 13:35:07.416200 944071 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18350-741028/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0311 13:35:07.455973 944071 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18350-741028/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0311 13:35:07.504047 944071 provision.go:87] duration metric: took 1.079655131s to configureAuth
I0311 13:35:07.504080 944071 ubuntu.go:193] setting minikube options for container-runtime
I0311 13:35:07.504276 944071 config.go:182] Loaded profile config "old-k8s-version-070145": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0
I0311 13:35:07.504290 944071 machine.go:97] duration metric: took 4.665731382s to provisionDockerMachine
I0311 13:35:07.504299 944071 start.go:293] postStartSetup for "old-k8s-version-070145" (driver="docker")
I0311 13:35:07.504317 944071 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0311 13:35:07.504375 944071 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0311 13:35:07.504420 944071 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-070145
I0311 13:35:07.546681 944071 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34038 SSHKeyPath:/home/jenkins/minikube-integration/18350-741028/.minikube/machines/old-k8s-version-070145/id_rsa Username:docker}
I0311 13:35:07.659129 944071 ssh_runner.go:195] Run: cat /etc/os-release
I0311 13:35:07.662582 944071 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0311 13:35:07.662621 944071 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0311 13:35:07.662633 944071 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0311 13:35:07.662640 944071 info.go:137] Remote host: Ubuntu 22.04.3 LTS
I0311 13:35:07.662656 944071 filesync.go:126] Scanning /home/jenkins/minikube-integration/18350-741028/.minikube/addons for local assets ...
I0311 13:35:07.662730 944071 filesync.go:126] Scanning /home/jenkins/minikube-integration/18350-741028/.minikube/files for local assets ...
I0311 13:35:07.662824 944071 filesync.go:149] local asset: /home/jenkins/minikube-integration/18350-741028/.minikube/files/etc/ssl/certs/7464802.pem -> 7464802.pem in /etc/ssl/certs
I0311 13:35:07.662944 944071 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0311 13:35:07.675174 944071 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18350-741028/.minikube/files/etc/ssl/certs/7464802.pem --> /etc/ssl/certs/7464802.pem (1708 bytes)
I0311 13:35:07.714819 944071 start.go:296] duration metric: took 210.497871ms for postStartSetup
I0311 13:35:07.714903 944071 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0311 13:35:07.714950 944071 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-070145
I0311 13:35:07.739169 944071 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34038 SSHKeyPath:/home/jenkins/minikube-integration/18350-741028/.minikube/machines/old-k8s-version-070145/id_rsa Username:docker}
I0311 13:35:07.841624 944071 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I0311 13:35:07.850075 944071 fix.go:56] duration metric: took 5.446279115s for fixHost
I0311 13:35:07.850098 944071 start.go:83] releasing machines lock for "old-k8s-version-070145", held for 5.44634108s
I0311 13:35:07.850174 944071 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-070145
I0311 13:35:07.877869 944071 ssh_runner.go:195] Run: cat /version.json
I0311 13:35:07.877922 944071 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-070145
I0311 13:35:07.878211 944071 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0311 13:35:07.878254 944071 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-070145
I0311 13:35:07.911284 944071 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34038 SSHKeyPath:/home/jenkins/minikube-integration/18350-741028/.minikube/machines/old-k8s-version-070145/id_rsa Username:docker}
I0311 13:35:07.916411 944071 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34038 SSHKeyPath:/home/jenkins/minikube-integration/18350-741028/.minikube/machines/old-k8s-version-070145/id_rsa Username:docker}
I0311 13:35:08.020500 944071 ssh_runner.go:195] Run: systemctl --version
I0311 13:35:08.170429 944071 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I0311 13:35:08.178306 944071 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
I0311 13:35:08.214411 944071 cni.go:230] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
I0311 13:35:08.214524 944071 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0311 13:35:08.228730 944071 cni.go:259] no active bridge cni configs found in "/etc/cni/net.d" - nothing to disable
I0311 13:35:08.228768 944071 start.go:494] detecting cgroup driver to use...
I0311 13:35:08.228825 944071 detect.go:196] detected "cgroupfs" cgroup driver on host os
I0311 13:35:08.228898 944071 ssh_runner.go:195] Run: sudo systemctl stop -f crio
I0311 13:35:08.248890 944071 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I0311 13:35:08.266881 944071 docker.go:217] disabling cri-docker service (if available) ...
I0311 13:35:08.266972 944071 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0311 13:35:08.281030 944071 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0311 13:35:08.294331 944071 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0311 13:35:08.435913 944071 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0311 13:35:08.583532 944071 docker.go:233] disabling docker service ...
I0311 13:35:08.583598 944071 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0311 13:35:08.603029 944071 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0311 13:35:08.625280 944071 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0311 13:35:08.790642 944071 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0311 13:35:08.935940 944071 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0311 13:35:08.955574 944071 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock
" | sudo tee /etc/crictl.yaml"
I0311 13:35:08.979014 944071 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.2"|' /etc/containerd/config.toml"
I0311 13:35:08.995642 944071 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
I0311 13:35:09.007512 944071 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...
I0311 13:35:09.007643 944071 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
I0311 13:35:09.022468 944071 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0311 13:35:09.038101 944071 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
I0311 13:35:09.049099 944071 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0311 13:35:09.069203 944071 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0311 13:35:09.082946 944071 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
I0311 13:35:09.098197 944071 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0311 13:35:09.111220 944071 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0311 13:35:09.124324 944071 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0311 13:35:09.261628 944071 ssh_runner.go:195] Run: sudo systemctl restart containerd
I0311 13:35:09.520501 944071 start.go:541] Will wait 60s for socket path /run/containerd/containerd.sock
I0311 13:35:09.520600 944071 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
I0311 13:35:09.525684 944071 start.go:562] Will wait 60s for crictl version
I0311 13:35:09.525778 944071 ssh_runner.go:195] Run: which crictl
I0311 13:35:09.529666 944071 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0311 13:35:09.599259 944071 start.go:578] Version: 0.1.0
RuntimeName: containerd
RuntimeVersion: 1.6.28
RuntimeApiVersion: v1
I0311 13:35:09.599352 944071 ssh_runner.go:195] Run: containerd --version
I0311 13:35:09.642743 944071 ssh_runner.go:195] Run: containerd --version
I0311 13:35:09.672608 944071 out.go:177] * Preparing Kubernetes v1.20.0 on containerd 1.6.28 ...
I0311 13:35:09.674459 944071 cli_runner.go:164] Run: docker network inspect old-k8s-version-070145 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0311 13:35:09.700937 944071 ssh_runner.go:195] Run: grep 192.168.76.1 host.minikube.internal$ /etc/hosts
I0311 13:35:09.704671 944071 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.76.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0311 13:35:09.720077 944071 kubeadm.go:877] updating cluster {Name:old-k8s-version-070145 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-070145 Namespace:default APIServerHAVIP: APIServerName:minik
ubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/
home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0311 13:35:09.720198 944071 preload.go:132] Checking if preload exists for k8s version v1.20.0 and runtime containerd
I0311 13:35:09.720272 944071 ssh_runner.go:195] Run: sudo crictl images --output json
I0311 13:35:09.770048 944071 containerd.go:612] all images are preloaded for containerd runtime.
I0311 13:35:09.770073 944071 containerd.go:519] Images already preloaded, skipping extraction
I0311 13:35:09.770169 944071 ssh_runner.go:195] Run: sudo crictl images --output json
I0311 13:35:09.832803 944071 containerd.go:612] all images are preloaded for containerd runtime.
I0311 13:35:09.832826 944071 cache_images.go:84] Images are preloaded, skipping loading
I0311 13:35:09.832834 944071 kubeadm.go:928] updating node { 192.168.76.2 8443 v1.20.0 containerd true true} ...
I0311 13:35:09.832949 944071 kubeadm.go:940] kubelet [Unit]
Wants=containerd.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///run/containerd/containerd.sock --hostname-override=old-k8s-version-070145 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.76.2
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-070145 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0311 13:35:09.833019 944071 ssh_runner.go:195] Run: sudo crictl info
I0311 13:35:09.882603 944071 cni.go:84] Creating CNI manager for ""
I0311 13:35:09.882631 944071 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0311 13:35:09.882643 944071 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0311 13:35:09.882703 944071 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.76.2 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-070145 NodeName:old-k8s-version-070145 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.76.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.76.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt
StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0311 13:35:09.882893 944071 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.76.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /run/containerd/containerd.sock
name: "old-k8s-version-070145"
kubeletExtraArgs:
node-ip: 192.168.76.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.76.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0311 13:35:09.882988 944071 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0311 13:35:09.893232 944071 binaries.go:44] Found k8s binaries, skipping transfer
I0311 13:35:09.893327 944071 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0311 13:35:09.902875 944071 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (442 bytes)
I0311 13:35:09.922553 944071 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0311 13:35:09.958173 944071 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2125 bytes)
I0311 13:35:09.983549 944071 ssh_runner.go:195] Run: grep 192.168.76.2 control-plane.minikube.internal$ /etc/hosts
I0311 13:35:09.987580 944071 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.76.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0311 13:35:09.999186 944071 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0311 13:35:10.153935 944071 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0311 13:35:10.172332 944071 certs.go:68] Setting up /home/jenkins/minikube-integration/18350-741028/.minikube/profiles/old-k8s-version-070145 for IP: 192.168.76.2
I0311 13:35:10.172352 944071 certs.go:194] generating shared ca certs ...
I0311 13:35:10.172370 944071 certs.go:226] acquiring lock for ca certs: {Name:mk7162cd9946a461c84d2f2cea8ea4b87fd89373 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0311 13:35:10.172501 944071 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/18350-741028/.minikube/ca.key
I0311 13:35:10.172545 944071 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/18350-741028/.minikube/proxy-client-ca.key
I0311 13:35:10.172553 944071 certs.go:256] generating profile certs ...
I0311 13:35:10.172634 944071 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/18350-741028/.minikube/profiles/old-k8s-version-070145/client.key
I0311 13:35:10.172701 944071 certs.go:359] skipping valid signed profile cert regeneration for "minikube": /home/jenkins/minikube-integration/18350-741028/.minikube/profiles/old-k8s-version-070145/apiserver.key.0e765760
I0311 13:35:10.172740 944071 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/18350-741028/.minikube/profiles/old-k8s-version-070145/proxy-client.key
I0311 13:35:10.172978 944071 certs.go:484] found cert: /home/jenkins/minikube-integration/18350-741028/.minikube/certs/746480.pem (1338 bytes)
W0311 13:35:10.173024 944071 certs.go:480] ignoring /home/jenkins/minikube-integration/18350-741028/.minikube/certs/746480_empty.pem, impossibly tiny 0 bytes
I0311 13:35:10.173046 944071 certs.go:484] found cert: /home/jenkins/minikube-integration/18350-741028/.minikube/certs/ca-key.pem (1679 bytes)
I0311 13:35:10.173072 944071 certs.go:484] found cert: /home/jenkins/minikube-integration/18350-741028/.minikube/certs/ca.pem (1078 bytes)
I0311 13:35:10.173095 944071 certs.go:484] found cert: /home/jenkins/minikube-integration/18350-741028/.minikube/certs/cert.pem (1123 bytes)
I0311 13:35:10.173127 944071 certs.go:484] found cert: /home/jenkins/minikube-integration/18350-741028/.minikube/certs/key.pem (1675 bytes)
I0311 13:35:10.173174 944071 certs.go:484] found cert: /home/jenkins/minikube-integration/18350-741028/.minikube/files/etc/ssl/certs/7464802.pem (1708 bytes)
I0311 13:35:10.173849 944071 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18350-741028/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0311 13:35:10.225155 944071 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18350-741028/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0311 13:35:10.259600 944071 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18350-741028/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0311 13:35:10.293897 944071 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18350-741028/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0311 13:35:10.322373 944071 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18350-741028/.minikube/profiles/old-k8s-version-070145/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0311 13:35:10.357188 944071 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18350-741028/.minikube/profiles/old-k8s-version-070145/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0311 13:35:10.387122 944071 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18350-741028/.minikube/profiles/old-k8s-version-070145/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0311 13:35:10.419737 944071 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18350-741028/.minikube/profiles/old-k8s-version-070145/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0311 13:35:10.474871 944071 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18350-741028/.minikube/files/etc/ssl/certs/7464802.pem --> /usr/share/ca-certificates/7464802.pem (1708 bytes)
I0311 13:35:10.518312 944071 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18350-741028/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0311 13:35:10.556546 944071 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18350-741028/.minikube/certs/746480.pem --> /usr/share/ca-certificates/746480.pem (1338 bytes)
I0311 13:35:10.589326 944071 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0311 13:35:10.612412 944071 ssh_runner.go:195] Run: openssl version
I0311 13:35:10.618751 944071 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0311 13:35:10.629840 944071 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0311 13:35:10.635485 944071 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Mar 11 12:48 /usr/share/ca-certificates/minikubeCA.pem
I0311 13:35:10.635598 944071 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0311 13:35:10.644118 944071 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0311 13:35:10.653795 944071 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/746480.pem && ln -fs /usr/share/ca-certificates/746480.pem /etc/ssl/certs/746480.pem"
I0311 13:35:10.663947 944071 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/746480.pem
I0311 13:35:10.668235 944071 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Mar 11 12:54 /usr/share/ca-certificates/746480.pem
I0311 13:35:10.668347 944071 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/746480.pem
I0311 13:35:10.676094 944071 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/746480.pem /etc/ssl/certs/51391683.0"
I0311 13:35:10.685725 944071 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/7464802.pem && ln -fs /usr/share/ca-certificates/7464802.pem /etc/ssl/certs/7464802.pem"
I0311 13:35:10.699418 944071 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/7464802.pem
I0311 13:35:10.704251 944071 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Mar 11 12:54 /usr/share/ca-certificates/7464802.pem
I0311 13:35:10.704368 944071 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/7464802.pem
I0311 13:35:10.711745 944071 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/7464802.pem /etc/ssl/certs/3ec20f2e.0"
I0311 13:35:10.722190 944071 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0311 13:35:10.727097 944071 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
I0311 13:35:10.735142 944071 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
I0311 13:35:10.744055 944071 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
I0311 13:35:10.751730 944071 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
I0311 13:35:10.759584 944071 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
I0311 13:35:10.767111 944071 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
I0311 13:35:10.774515 944071 kubeadm.go:391] StartCluster: {Name:old-k8s-version-070145 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-070145 Namespace:default APIServerHAVIP: APIServerName:minikube
CA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/hom
e/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0311 13:35:10.774681 944071 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}
I0311 13:35:10.774779 944071 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0311 13:35:10.834338 944071 cri.go:89] found id: "6f6759a5fa53b61d59a4eb3efed14f78f772e070b07ebae287535c7bd97f6ac7"
I0311 13:35:10.834415 944071 cri.go:89] found id: "a0fc5e182b8975f62b8f621229dd8ec04d5316e628f77ffe9047483f9e338afe"
I0311 13:35:10.834441 944071 cri.go:89] found id: "596979946483c91004b096e33257a14f33b32425e5bf1c3030c3b9a18ac24a20"
I0311 13:35:10.834463 944071 cri.go:89] found id: "8334568a27c354d62138974eb15c381240354c69ff9cc3334aafb99945f69298"
I0311 13:35:10.834494 944071 cri.go:89] found id: "ee7a5ecb39413c27e23ab32527a89da9064b17f58353410a2e96d56978c5b575"
I0311 13:35:10.834513 944071 cri.go:89] found id: "2a8386dbbc357521701b6779041b13f7ac23bf6efa6e4648879ae34ab9456918"
I0311 13:35:10.834532 944071 cri.go:89] found id: "18ba14631e2229013a95152ecc7bd700ff0dc021cd44274d5c5657ffb75ed347"
I0311 13:35:10.834553 944071 cri.go:89] found id: "5ce8ca658a489eed2dbd049d4848b82cf2f879b98316ff0a5e0f9b0ff9f2962e"
I0311 13:35:10.834581 944071 cri.go:89] found id: "1efd3d3c6b431a8f6d76e245d3ec7ab63c30f2b096c264acd026c38d4878a67f"
I0311 13:35:10.834610 944071 cri.go:89] found id: ""
I0311 13:35:10.834691 944071 ssh_runner.go:195] Run: sudo runc --root /run/containerd/runc/k8s.io list -f json
I0311 13:35:10.858098 944071 cri.go:116] JSON = null
W0311 13:35:10.858202 944071 kubeadm.go:398] unpause failed: list paused: list returned 0 containers, but ps returned 9
I0311 13:35:10.858302 944071 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
W0311 13:35:10.869235 944071 kubeadm.go:404] apiserver tunnel failed: apiserver port not set
I0311 13:35:10.869307 944071 kubeadm.go:407] found existing configuration files, will attempt cluster restart
I0311 13:35:10.869327 944071 kubeadm.go:587] restartPrimaryControlPlane start ...
I0311 13:35:10.869410 944071 ssh_runner.go:195] Run: sudo test -d /data/minikube
I0311 13:35:10.878429 944071 kubeadm.go:129] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
stdout:
stderr:
I0311 13:35:10.879018 944071 kubeconfig.go:47] verify endpoint returned: get endpoint: "old-k8s-version-070145" does not appear in /home/jenkins/minikube-integration/18350-741028/kubeconfig
I0311 13:35:10.879181 944071 kubeconfig.go:62] /home/jenkins/minikube-integration/18350-741028/kubeconfig needs updating (will repair): [kubeconfig missing "old-k8s-version-070145" cluster setting kubeconfig missing "old-k8s-version-070145" context setting]
I0311 13:35:10.879545 944071 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18350-741028/kubeconfig: {Name:mkea9792df2a23b99e9686253371e8a16054b02d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0311 13:35:10.881278 944071 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
I0311 13:35:10.891099 944071 kubeadm.go:624] The running cluster does not require reconfiguration: 192.168.76.2
I0311 13:35:10.891181 944071 kubeadm.go:591] duration metric: took 21.828316ms to restartPrimaryControlPlane
I0311 13:35:10.891225 944071 kubeadm.go:393] duration metric: took 116.700726ms to StartCluster
I0311 13:35:10.891275 944071 settings.go:142] acquiring lock: {Name:mk647fd5a11531f437bba0a4615b0b34bf87ec0c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0311 13:35:10.891359 944071 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/18350-741028/kubeconfig
I0311 13:35:10.892120 944071 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18350-741028/kubeconfig: {Name:mkea9792df2a23b99e9686253371e8a16054b02d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0311 13:35:10.892399 944071 start.go:234] Will wait 6m0s for node &{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}
I0311 13:35:10.894773 944071 out.go:177] * Verifying Kubernetes components...
I0311 13:35:10.892821 944071 addons.go:502] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:true default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volumesnapshots:false yakd:false]
I0311 13:35:10.892930 944071 config.go:182] Loaded profile config "old-k8s-version-070145": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0
I0311 13:35:10.897097 944071 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0311 13:35:10.895024 944071 addons.go:69] Setting storage-provisioner=true in profile "old-k8s-version-070145"
I0311 13:35:10.897293 944071 addons.go:234] Setting addon storage-provisioner=true in "old-k8s-version-070145"
W0311 13:35:10.897330 944071 addons.go:243] addon storage-provisioner should already be in state true
I0311 13:35:10.897370 944071 host.go:66] Checking if "old-k8s-version-070145" exists ...
I0311 13:35:10.897943 944071 cli_runner.go:164] Run: docker container inspect old-k8s-version-070145 --format={{.State.Status}}
I0311 13:35:10.895030 944071 addons.go:69] Setting dashboard=true in profile "old-k8s-version-070145"
I0311 13:35:10.898226 944071 addons.go:234] Setting addon dashboard=true in "old-k8s-version-070145"
W0311 13:35:10.898262 944071 addons.go:243] addon dashboard should already be in state true
I0311 13:35:10.898302 944071 host.go:66] Checking if "old-k8s-version-070145" exists ...
I0311 13:35:10.898781 944071 cli_runner.go:164] Run: docker container inspect old-k8s-version-070145 --format={{.State.Status}}
I0311 13:35:10.895034 944071 addons.go:69] Setting default-storageclass=true in profile "old-k8s-version-070145"
I0311 13:35:10.899871 944071 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "old-k8s-version-070145"
I0311 13:35:10.900155 944071 cli_runner.go:164] Run: docker container inspect old-k8s-version-070145 --format={{.State.Status}}
I0311 13:35:10.895038 944071 addons.go:69] Setting metrics-server=true in profile "old-k8s-version-070145"
I0311 13:35:10.900678 944071 addons.go:234] Setting addon metrics-server=true in "old-k8s-version-070145"
W0311 13:35:10.900715 944071 addons.go:243] addon metrics-server should already be in state true
I0311 13:35:10.900796 944071 host.go:66] Checking if "old-k8s-version-070145" exists ...
I0311 13:35:10.901293 944071 cli_runner.go:164] Run: docker container inspect old-k8s-version-070145 --format={{.State.Status}}
I0311 13:35:10.984306 944071 addons.go:234] Setting addon default-storageclass=true in "old-k8s-version-070145"
W0311 13:35:10.984330 944071 addons.go:243] addon default-storageclass should already be in state true
I0311 13:35:10.984356 944071 host.go:66] Checking if "old-k8s-version-070145" exists ...
I0311 13:35:10.984872 944071 cli_runner.go:164] Run: docker container inspect old-k8s-version-070145 --format={{.State.Status}}
I0311 13:35:10.993682 944071 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0311 13:35:11.000394 944071 out.go:177] - Using image registry.k8s.io/echoserver:1.4
I0311 13:35:11.000424 944071 addons.go:426] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0311 13:35:11.002564 944071 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0311 13:35:11.004715 944071 out.go:177] - Using image fake.domain/registry.k8s.io/echoserver:1.4
I0311 13:35:11.002676 944071 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-070145
I0311 13:35:11.008968 944071 out.go:177] - Using image docker.io/kubernetesui/dashboard:v2.7.0
I0311 13:35:11.011402 944071 addons.go:426] installing /etc/kubernetes/addons/dashboard-ns.yaml
I0311 13:35:11.011433 944071 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-ns.yaml (759 bytes)
I0311 13:35:11.011510 944071 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-070145
I0311 13:35:11.009068 944071 addons.go:426] installing /etc/kubernetes/addons/metrics-apiservice.yaml
I0311 13:35:11.011745 944071 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
I0311 13:35:11.011788 944071 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-070145
I0311 13:35:11.060842 944071 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34038 SSHKeyPath:/home/jenkins/minikube-integration/18350-741028/.minikube/machines/old-k8s-version-070145/id_rsa Username:docker}
I0311 13:35:11.087983 944071 addons.go:426] installing /etc/kubernetes/addons/storageclass.yaml
I0311 13:35:11.088006 944071 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0311 13:35:11.088086 944071 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-070145
I0311 13:35:11.089863 944071 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34038 SSHKeyPath:/home/jenkins/minikube-integration/18350-741028/.minikube/machines/old-k8s-version-070145/id_rsa Username:docker}
I0311 13:35:11.108063 944071 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34038 SSHKeyPath:/home/jenkins/minikube-integration/18350-741028/.minikube/machines/old-k8s-version-070145/id_rsa Username:docker}
I0311 13:35:11.140033 944071 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34038 SSHKeyPath:/home/jenkins/minikube-integration/18350-741028/.minikube/machines/old-k8s-version-070145/id_rsa Username:docker}
I0311 13:35:11.185963 944071 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0311 13:35:11.258237 944071 node_ready.go:35] waiting up to 6m0s for node "old-k8s-version-070145" to be "Ready" ...
I0311 13:35:11.287929 944071 addons.go:426] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
I0311 13:35:11.288003 944071 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1825 bytes)
I0311 13:35:11.315470 944071 addons.go:426] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
I0311 13:35:11.315544 944071 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
I0311 13:35:11.330727 944071 addons.go:426] installing /etc/kubernetes/addons/dashboard-clusterrole.yaml
I0311 13:35:11.330831 944071 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-clusterrole.yaml (1001 bytes)
I0311 13:35:11.341940 944071 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0311 13:35:11.382112 944071 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0311 13:35:11.384236 944071 addons.go:426] installing /etc/kubernetes/addons/metrics-server-service.yaml
I0311 13:35:11.384314 944071 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
I0311 13:35:11.399520 944071 addons.go:426] installing /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml
I0311 13:35:11.399548 944071 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml (1018 bytes)
I0311 13:35:11.465775 944071 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0311 13:35:11.478317 944071 addons.go:426] installing /etc/kubernetes/addons/dashboard-configmap.yaml
I0311 13:35:11.478407 944071 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-configmap.yaml (837 bytes)
W0311 13:35:11.525705 944071 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0311 13:35:11.525794 944071 retry.go:31] will retry after 233.511653ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0311 13:35:11.548297 944071 addons.go:426] installing /etc/kubernetes/addons/dashboard-dp.yaml
I0311 13:35:11.548373 944071 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-dp.yaml (4201 bytes)
I0311 13:35:11.576394 944071 addons.go:426] installing /etc/kubernetes/addons/dashboard-role.yaml
I0311 13:35:11.576477 944071 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-role.yaml (1724 bytes)
W0311 13:35:11.577541 944071 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0311 13:35:11.577605 944071 retry.go:31] will retry after 184.278931ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0311 13:35:11.603047 944071 addons.go:426] installing /etc/kubernetes/addons/dashboard-rolebinding.yaml
I0311 13:35:11.603123 944071 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-rolebinding.yaml (1046 bytes)
I0311 13:35:11.626653 944071 addons.go:426] installing /etc/kubernetes/addons/dashboard-sa.yaml
I0311 13:35:11.626738 944071 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-sa.yaml (837 bytes)
W0311 13:35:11.645198 944071 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0311 13:35:11.645280 944071 retry.go:31] will retry after 211.040242ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0311 13:35:11.648505 944071 addons.go:426] installing /etc/kubernetes/addons/dashboard-secret.yaml
I0311 13:35:11.648542 944071 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-secret.yaml (1389 bytes)
I0311 13:35:11.672055 944071 addons.go:426] installing /etc/kubernetes/addons/dashboard-svc.yaml
I0311 13:35:11.672142 944071 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-svc.yaml (1294 bytes)
I0311 13:35:11.692423 944071 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0311 13:35:11.760172 944071 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I0311 13:35:11.762391 944071 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0311 13:35:11.796698 944071 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0311 13:35:11.796807 944071 retry.go:31] will retry after 238.370199ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0311 13:35:11.857098 944071 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0311 13:35:11.891063 944071 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0311 13:35:11.891103 944071 retry.go:31] will retry after 220.435217ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0311 13:35:11.891063 944071 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0311 13:35:11.891118 944071 retry.go:31] will retry after 287.102303ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0311 13:35:11.949849 944071 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0311 13:35:11.949913 944071 retry.go:31] will retry after 205.42742ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0311 13:35:12.036138 944071 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0311 13:35:12.112677 944071 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0311 13:35:12.126692 944071 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0311 13:35:12.126731 944071 retry.go:31] will retry after 417.251064ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0311 13:35:12.156001 944071 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0311 13:35:12.178782 944071 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0311 13:35:12.201184 944071 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0311 13:35:12.201229 944071 retry.go:31] will retry after 610.568049ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0311 13:35:12.317065 944071 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0311 13:35:12.317102 944071 retry.go:31] will retry after 713.360596ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0311 13:35:12.353470 944071 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0311 13:35:12.353505 944071 retry.go:31] will retry after 644.573124ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0311 13:35:12.544973 944071 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0311 13:35:12.659122 944071 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0311 13:35:12.659202 944071 retry.go:31] will retry after 516.415125ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0311 13:35:12.812885 944071 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0311 13:35:12.949799 944071 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0311 13:35:12.949886 944071 retry.go:31] will retry after 889.01404ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0311 13:35:12.999177 944071 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I0311 13:35:13.031070 944071 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0311 13:35:13.176549 944071 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0311 13:35:13.199154 944071 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0311 13:35:13.199240 944071 retry.go:31] will retry after 751.66925ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0311 13:35:13.246675 944071 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0311 13:35:13.246758 944071 retry.go:31] will retry after 934.336065ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0311 13:35:13.259233 944071 node_ready.go:53] error getting node "old-k8s-version-070145": Get "https://192.168.76.2:8443/api/v1/nodes/old-k8s-version-070145": dial tcp 192.168.76.2:8443: connect: connection refused
W0311 13:35:13.332854 944071 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0311 13:35:13.332891 944071 retry.go:31] will retry after 632.685793ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0311 13:35:13.839836 944071 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0311 13:35:13.948004 944071 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0311 13:35:13.948037 944071 retry.go:31] will retry after 1.393769037s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0311 13:35:13.951321 944071 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I0311 13:35:13.966593 944071 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0311 13:35:14.126903 944071 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0311 13:35:14.126941 944071 retry.go:31] will retry after 1.874900756s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0311 13:35:14.127000 944071 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0311 13:35:14.127023 944071 retry.go:31] will retry after 1.535348832s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0311 13:35:14.181281 944071 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0311 13:35:14.267238 944071 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0311 13:35:14.267311 944071 retry.go:31] will retry after 1.036888495s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0311 13:35:15.259795 944071 node_ready.go:53] error getting node "old-k8s-version-070145": Get "https://192.168.76.2:8443/api/v1/nodes/old-k8s-version-070145": dial tcp 192.168.76.2:8443: connect: connection refused
I0311 13:35:15.305045 944071 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0311 13:35:15.342687 944071 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0311 13:35:15.404832 944071 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0311 13:35:15.404876 944071 retry.go:31] will retry after 2.011184747s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0311 13:35:15.440224 944071 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0311 13:35:15.440308 944071 retry.go:31] will retry after 1.486725896s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0311 13:35:15.662604 944071 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0311 13:35:15.743145 944071 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0311 13:35:15.743179 944071 retry.go:31] will retry after 2.310990132s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0311 13:35:16.002863 944071 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0311 13:35:16.090914 944071 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0311 13:35:16.090953 944071 retry.go:31] will retry after 1.781655076s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0311 13:35:16.927853 944071 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0311 13:35:17.045226 944071 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0311 13:35:17.045263 944071 retry.go:31] will retry after 3.8356264s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0311 13:35:17.416681 944071 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0311 13:35:17.508866 944071 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0311 13:35:17.508897 944071 retry.go:31] will retry after 2.062902733s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0311 13:35:17.759666 944071 node_ready.go:53] error getting node "old-k8s-version-070145": Get "https://192.168.76.2:8443/api/v1/nodes/old-k8s-version-070145": dial tcp 192.168.76.2:8443: connect: connection refused
I0311 13:35:17.872881 944071 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0311 13:35:17.958345 944071 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0311 13:35:17.958383 944071 retry.go:31] will retry after 2.08763973s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0311 13:35:18.054747 944071 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0311 13:35:18.134014 944071 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0311 13:35:18.134052 944071 retry.go:31] will retry after 2.809791685s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0311 13:35:19.572536 944071 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0311 13:35:19.747756 944071 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0311 13:35:19.747787 944071 retry.go:31] will retry after 4.12512008s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0311 13:35:20.046962 944071 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0311 13:35:20.881717 944071 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I0311 13:35:20.944118 944071 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I0311 13:35:23.873395 944071 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0311 13:35:29.751634 944071 node_ready.go:49] node "old-k8s-version-070145" has status "Ready":"True"
I0311 13:35:29.751677 944071 node_ready.go:38] duration metric: took 18.493357218s for node "old-k8s-version-070145" to be "Ready" ...
I0311 13:35:29.751693 944071 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0311 13:35:29.893499 944071 pod_ready.go:78] waiting up to 6m0s for pod "coredns-74ff55c5b-4c948" in "kube-system" namespace to be "Ready" ...
I0311 13:35:29.934113 944071 pod_ready.go:92] pod "coredns-74ff55c5b-4c948" in "kube-system" namespace has status "Ready":"True"
I0311 13:35:29.934151 944071 pod_ready.go:81] duration metric: took 40.617984ms for pod "coredns-74ff55c5b-4c948" in "kube-system" namespace to be "Ready" ...
I0311 13:35:29.934164 944071 pod_ready.go:78] waiting up to 6m0s for pod "etcd-old-k8s-version-070145" in "kube-system" namespace to be "Ready" ...
I0311 13:35:29.984555 944071 pod_ready.go:92] pod "etcd-old-k8s-version-070145" in "kube-system" namespace has status "Ready":"True"
I0311 13:35:29.984577 944071 pod_ready.go:81] duration metric: took 50.405322ms for pod "etcd-old-k8s-version-070145" in "kube-system" namespace to be "Ready" ...
I0311 13:35:29.984592 944071 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-old-k8s-version-070145" in "kube-system" namespace to be "Ready" ...
I0311 13:35:31.634842 944071 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: (11.587811914s)
I0311 13:35:31.637689 944071 out.go:177] * Some dashboard features require the metrics-server addon. To enable all features please run:
minikube -p old-k8s-version-070145 addons enable metrics-server
I0311 13:35:31.635020 944071 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: (10.753271533s)
I0311 13:35:31.635074 944071 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: (10.690926353s)
I0311 13:35:31.645992 944071 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (7.772556582s)
I0311 13:35:31.646037 944071 addons.go:470] Verifying addon metrics-server=true in "old-k8s-version-070145"
I0311 13:35:31.653920 944071 out.go:177] * Enabled addons: dashboard, storage-provisioner, metrics-server, default-storageclass
I0311 13:35:31.657278 944071 addons.go:505] duration metric: took 20.764449626s for enable addons: enabled=[dashboard storage-provisioner metrics-server default-storageclass]
I0311 13:35:31.991613 944071 pod_ready.go:102] pod "kube-apiserver-old-k8s-version-070145" in "kube-system" namespace has status "Ready":"False"
I0311 13:35:33.992620 944071 pod_ready.go:102] pod "kube-apiserver-old-k8s-version-070145" in "kube-system" namespace has status "Ready":"False"
I0311 13:35:36.491261 944071 pod_ready.go:102] pod "kube-apiserver-old-k8s-version-070145" in "kube-system" namespace has status "Ready":"False"
I0311 13:35:38.491850 944071 pod_ready.go:102] pod "kube-apiserver-old-k8s-version-070145" in "kube-system" namespace has status "Ready":"False"
I0311 13:35:38.991767 944071 pod_ready.go:92] pod "kube-apiserver-old-k8s-version-070145" in "kube-system" namespace has status "Ready":"True"
I0311 13:35:38.991797 944071 pod_ready.go:81] duration metric: took 9.007197194s for pod "kube-apiserver-old-k8s-version-070145" in "kube-system" namespace to be "Ready" ...
I0311 13:35:38.991810 944071 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-old-k8s-version-070145" in "kube-system" namespace to be "Ready" ...
I0311 13:35:40.998200 944071 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-070145" in "kube-system" namespace has status "Ready":"False"
I0311 13:35:42.998586 944071 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-070145" in "kube-system" namespace has status "Ready":"False"
I0311 13:35:45.074369 944071 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-070145" in "kube-system" namespace has status "Ready":"False"
I0311 13:35:47.497983 944071 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-070145" in "kube-system" namespace has status "Ready":"False"
I0311 13:35:49.541193 944071 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-070145" in "kube-system" namespace has status "Ready":"False"
I0311 13:35:51.998979 944071 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-070145" in "kube-system" namespace has status "Ready":"False"
I0311 13:35:54.003284 944071 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-070145" in "kube-system" namespace has status "Ready":"False"
I0311 13:35:56.022666 944071 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-070145" in "kube-system" namespace has status "Ready":"False"
I0311 13:35:58.497885 944071 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-070145" in "kube-system" namespace has status "Ready":"False"
I0311 13:36:00.499423 944071 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-070145" in "kube-system" namespace has status "Ready":"False"
I0311 13:36:02.998710 944071 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-070145" in "kube-system" namespace has status "Ready":"False"
I0311 13:36:05.497863 944071 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-070145" in "kube-system" namespace has status "Ready":"False"
I0311 13:36:07.500077 944071 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-070145" in "kube-system" namespace has status "Ready":"False"
I0311 13:36:09.998999 944071 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-070145" in "kube-system" namespace has status "Ready":"False"
I0311 13:36:11.999519 944071 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-070145" in "kube-system" namespace has status "Ready":"False"
I0311 13:36:14.001369 944071 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-070145" in "kube-system" namespace has status "Ready":"False"
I0311 13:36:16.498681 944071 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-070145" in "kube-system" namespace has status "Ready":"False"
I0311 13:36:18.499694 944071 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-070145" in "kube-system" namespace has status "Ready":"False"
I0311 13:36:20.503187 944071 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-070145" in "kube-system" namespace has status "Ready":"False"
I0311 13:36:22.998514 944071 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-070145" in "kube-system" namespace has status "Ready":"False"
I0311 13:36:25.498020 944071 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-070145" in "kube-system" namespace has status "Ready":"False"
I0311 13:36:27.500939 944071 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-070145" in "kube-system" namespace has status "Ready":"False"
I0311 13:36:29.997634 944071 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-070145" in "kube-system" namespace has status "Ready":"False"
I0311 13:36:30.998256 944071 pod_ready.go:92] pod "kube-controller-manager-old-k8s-version-070145" in "kube-system" namespace has status "Ready":"True"
I0311 13:36:30.998289 944071 pod_ready.go:81] duration metric: took 52.006471128s for pod "kube-controller-manager-old-k8s-version-070145" in "kube-system" namespace to be "Ready" ...
I0311 13:36:30.998302 944071 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-6vcch" in "kube-system" namespace to be "Ready" ...
I0311 13:36:31.005232 944071 pod_ready.go:92] pod "kube-proxy-6vcch" in "kube-system" namespace has status "Ready":"True"
I0311 13:36:31.005256 944071 pod_ready.go:81] duration metric: took 6.945496ms for pod "kube-proxy-6vcch" in "kube-system" namespace to be "Ready" ...
I0311 13:36:31.005268 944071 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-old-k8s-version-070145" in "kube-system" namespace to be "Ready" ...
I0311 13:36:33.014131 944071 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-070145" in "kube-system" namespace has status "Ready":"False"
I0311 13:36:35.512411 944071 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-070145" in "kube-system" namespace has status "Ready":"False"
I0311 13:36:38.013190 944071 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-070145" in "kube-system" namespace has status "Ready":"False"
I0311 13:36:40.025830 944071 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-070145" in "kube-system" namespace has status "Ready":"False"
I0311 13:36:42.513659 944071 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-070145" in "kube-system" namespace has status "Ready":"False"
I0311 13:36:44.514711 944071 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-070145" in "kube-system" namespace has status "Ready":"False"
I0311 13:36:47.012132 944071 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-070145" in "kube-system" namespace has status "Ready":"False"
I0311 13:36:49.511968 944071 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-070145" in "kube-system" namespace has status "Ready":"False"
I0311 13:36:52.012324 944071 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-070145" in "kube-system" namespace has status "Ready":"False"
I0311 13:36:54.014329 944071 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-070145" in "kube-system" namespace has status "Ready":"False"
I0311 13:36:56.511989 944071 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-070145" in "kube-system" namespace has status "Ready":"False"
I0311 13:36:58.014747 944071 pod_ready.go:92] pod "kube-scheduler-old-k8s-version-070145" in "kube-system" namespace has status "Ready":"True"
I0311 13:36:58.014770 944071 pod_ready.go:81] duration metric: took 27.009494044s for pod "kube-scheduler-old-k8s-version-070145" in "kube-system" namespace to be "Ready" ...
I0311 13:36:58.014782 944071 pod_ready.go:78] waiting up to 6m0s for pod "metrics-server-9975d5f86-fjvd8" in "kube-system" namespace to be "Ready" ...
I0311 13:37:00.079971 944071 pod_ready.go:102] pod "metrics-server-9975d5f86-fjvd8" in "kube-system" namespace has status "Ready":"False"
I0311 13:37:02.521800 944071 pod_ready.go:102] pod "metrics-server-9975d5f86-fjvd8" in "kube-system" namespace has status "Ready":"False"
I0311 13:37:05.022195 944071 pod_ready.go:102] pod "metrics-server-9975d5f86-fjvd8" in "kube-system" namespace has status "Ready":"False"
I0311 13:37:07.521698 944071 pod_ready.go:102] pod "metrics-server-9975d5f86-fjvd8" in "kube-system" namespace has status "Ready":"False"
I0311 13:37:10.022779 944071 pod_ready.go:102] pod "metrics-server-9975d5f86-fjvd8" in "kube-system" namespace has status "Ready":"False"
I0311 13:37:12.526266 944071 pod_ready.go:102] pod "metrics-server-9975d5f86-fjvd8" in "kube-system" namespace has status "Ready":"False"
I0311 13:37:15.027548 944071 pod_ready.go:102] pod "metrics-server-9975d5f86-fjvd8" in "kube-system" namespace has status "Ready":"False"
I0311 13:37:17.522690 944071 pod_ready.go:102] pod "metrics-server-9975d5f86-fjvd8" in "kube-system" namespace has status "Ready":"False"
I0311 13:37:20.022872 944071 pod_ready.go:102] pod "metrics-server-9975d5f86-fjvd8" in "kube-system" namespace has status "Ready":"False"
I0311 13:37:22.521266 944071 pod_ready.go:102] pod "metrics-server-9975d5f86-fjvd8" in "kube-system" namespace has status "Ready":"False"
I0311 13:37:25.022746 944071 pod_ready.go:102] pod "metrics-server-9975d5f86-fjvd8" in "kube-system" namespace has status "Ready":"False"
I0311 13:37:27.520396 944071 pod_ready.go:102] pod "metrics-server-9975d5f86-fjvd8" in "kube-system" namespace has status "Ready":"False"
I0311 13:37:30.023004 944071 pod_ready.go:102] pod "metrics-server-9975d5f86-fjvd8" in "kube-system" namespace has status "Ready":"False"
I0311 13:37:32.522658 944071 pod_ready.go:102] pod "metrics-server-9975d5f86-fjvd8" in "kube-system" namespace has status "Ready":"False"
I0311 13:37:35.022062 944071 pod_ready.go:102] pod "metrics-server-9975d5f86-fjvd8" in "kube-system" namespace has status "Ready":"False"
I0311 13:37:37.025226 944071 pod_ready.go:102] pod "metrics-server-9975d5f86-fjvd8" in "kube-system" namespace has status "Ready":"False"
I0311 13:37:39.521295 944071 pod_ready.go:102] pod "metrics-server-9975d5f86-fjvd8" in "kube-system" namespace has status "Ready":"False"
I0311 13:37:41.521822 944071 pod_ready.go:102] pod "metrics-server-9975d5f86-fjvd8" in "kube-system" namespace has status "Ready":"False"
I0311 13:37:44.022424 944071 pod_ready.go:102] pod "metrics-server-9975d5f86-fjvd8" in "kube-system" namespace has status "Ready":"False"
I0311 13:37:46.521943 944071 pod_ready.go:102] pod "metrics-server-9975d5f86-fjvd8" in "kube-system" namespace has status "Ready":"False"
I0311 13:37:49.021913 944071 pod_ready.go:102] pod "metrics-server-9975d5f86-fjvd8" in "kube-system" namespace has status "Ready":"False"
I0311 13:37:51.022358 944071 pod_ready.go:102] pod "metrics-server-9975d5f86-fjvd8" in "kube-system" namespace has status "Ready":"False"
I0311 13:37:53.028148 944071 pod_ready.go:102] pod "metrics-server-9975d5f86-fjvd8" in "kube-system" namespace has status "Ready":"False"
I0311 13:37:55.520965 944071 pod_ready.go:102] pod "metrics-server-9975d5f86-fjvd8" in "kube-system" namespace has status "Ready":"False"
I0311 13:37:58.021680 944071 pod_ready.go:102] pod "metrics-server-9975d5f86-fjvd8" in "kube-system" namespace has status "Ready":"False"
I0311 13:38:00.113871 944071 pod_ready.go:102] pod "metrics-server-9975d5f86-fjvd8" in "kube-system" namespace has status "Ready":"False"
I0311 13:38:02.521058 944071 pod_ready.go:102] pod "metrics-server-9975d5f86-fjvd8" in "kube-system" namespace has status "Ready":"False"
I0311 13:38:05.022050 944071 pod_ready.go:102] pod "metrics-server-9975d5f86-fjvd8" in "kube-system" namespace has status "Ready":"False"
I0311 13:38:07.520924 944071 pod_ready.go:102] pod "metrics-server-9975d5f86-fjvd8" in "kube-system" namespace has status "Ready":"False"
I0311 13:38:09.521343 944071 pod_ready.go:102] pod "metrics-server-9975d5f86-fjvd8" in "kube-system" namespace has status "Ready":"False"
I0311 13:38:12.021506 944071 pod_ready.go:102] pod "metrics-server-9975d5f86-fjvd8" in "kube-system" namespace has status "Ready":"False"
I0311 13:38:14.521978 944071 pod_ready.go:102] pod "metrics-server-9975d5f86-fjvd8" in "kube-system" namespace has status "Ready":"False"
I0311 13:38:16.522381 944071 pod_ready.go:102] pod "metrics-server-9975d5f86-fjvd8" in "kube-system" namespace has status "Ready":"False"
I0311 13:38:19.020844 944071 pod_ready.go:102] pod "metrics-server-9975d5f86-fjvd8" in "kube-system" namespace has status "Ready":"False"
I0311 13:38:21.022499 944071 pod_ready.go:102] pod "metrics-server-9975d5f86-fjvd8" in "kube-system" namespace has status "Ready":"False"
I0311 13:38:23.026881 944071 pod_ready.go:102] pod "metrics-server-9975d5f86-fjvd8" in "kube-system" namespace has status "Ready":"False"
I0311 13:38:25.520562 944071 pod_ready.go:102] pod "metrics-server-9975d5f86-fjvd8" in "kube-system" namespace has status "Ready":"False"
I0311 13:38:27.521541 944071 pod_ready.go:102] pod "metrics-server-9975d5f86-fjvd8" in "kube-system" namespace has status "Ready":"False"
I0311 13:38:30.027373 944071 pod_ready.go:102] pod "metrics-server-9975d5f86-fjvd8" in "kube-system" namespace has status "Ready":"False"
I0311 13:38:32.520831 944071 pod_ready.go:102] pod "metrics-server-9975d5f86-fjvd8" in "kube-system" namespace has status "Ready":"False"
I0311 13:38:35.021894 944071 pod_ready.go:102] pod "metrics-server-9975d5f86-fjvd8" in "kube-system" namespace has status "Ready":"False"
I0311 13:38:37.023151 944071 pod_ready.go:102] pod "metrics-server-9975d5f86-fjvd8" in "kube-system" namespace has status "Ready":"False"
I0311 13:38:39.521017 944071 pod_ready.go:102] pod "metrics-server-9975d5f86-fjvd8" in "kube-system" namespace has status "Ready":"False"
I0311 13:38:41.521963 944071 pod_ready.go:102] pod "metrics-server-9975d5f86-fjvd8" in "kube-system" namespace has status "Ready":"False"
I0311 13:38:43.522808 944071 pod_ready.go:102] pod "metrics-server-9975d5f86-fjvd8" in "kube-system" namespace has status "Ready":"False"
I0311 13:38:46.022108 944071 pod_ready.go:102] pod "metrics-server-9975d5f86-fjvd8" in "kube-system" namespace has status "Ready":"False"
I0311 13:38:48.022806 944071 pod_ready.go:102] pod "metrics-server-9975d5f86-fjvd8" in "kube-system" namespace has status "Ready":"False"
I0311 13:38:50.032049 944071 pod_ready.go:102] pod "metrics-server-9975d5f86-fjvd8" in "kube-system" namespace has status "Ready":"False"
I0311 13:38:52.521328 944071 pod_ready.go:102] pod "metrics-server-9975d5f86-fjvd8" in "kube-system" namespace has status "Ready":"False"
I0311 13:38:54.521824 944071 pod_ready.go:102] pod "metrics-server-9975d5f86-fjvd8" in "kube-system" namespace has status "Ready":"False"
I0311 13:38:57.026587 944071 pod_ready.go:102] pod "metrics-server-9975d5f86-fjvd8" in "kube-system" namespace has status "Ready":"False"
I0311 13:38:59.521725 944071 pod_ready.go:102] pod "metrics-server-9975d5f86-fjvd8" in "kube-system" namespace has status "Ready":"False"
I0311 13:39:01.521871 944071 pod_ready.go:102] pod "metrics-server-9975d5f86-fjvd8" in "kube-system" namespace has status "Ready":"False"
I0311 13:39:04.020649 944071 pod_ready.go:102] pod "metrics-server-9975d5f86-fjvd8" in "kube-system" namespace has status "Ready":"False"
I0311 13:39:06.021872 944071 pod_ready.go:102] pod "metrics-server-9975d5f86-fjvd8" in "kube-system" namespace has status "Ready":"False"
I0311 13:39:08.521591 944071 pod_ready.go:102] pod "metrics-server-9975d5f86-fjvd8" in "kube-system" namespace has status "Ready":"False"
I0311 13:39:11.022004 944071 pod_ready.go:102] pod "metrics-server-9975d5f86-fjvd8" in "kube-system" namespace has status "Ready":"False"
I0311 13:39:13.521634 944071 pod_ready.go:102] pod "metrics-server-9975d5f86-fjvd8" in "kube-system" namespace has status "Ready":"False"
I0311 13:39:16.022480 944071 pod_ready.go:102] pod "metrics-server-9975d5f86-fjvd8" in "kube-system" namespace has status "Ready":"False"
I0311 13:39:18.024938 944071 pod_ready.go:102] pod "metrics-server-9975d5f86-fjvd8" in "kube-system" namespace has status "Ready":"False"
I0311 13:39:20.520794 944071 pod_ready.go:102] pod "metrics-server-9975d5f86-fjvd8" in "kube-system" namespace has status "Ready":"False"
I0311 13:39:22.521838 944071 pod_ready.go:102] pod "metrics-server-9975d5f86-fjvd8" in "kube-system" namespace has status "Ready":"False"
I0311 13:39:25.022412 944071 pod_ready.go:102] pod "metrics-server-9975d5f86-fjvd8" in "kube-system" namespace has status "Ready":"False"
I0311 13:39:27.521489 944071 pod_ready.go:102] pod "metrics-server-9975d5f86-fjvd8" in "kube-system" namespace has status "Ready":"False"
I0311 13:39:29.522573 944071 pod_ready.go:102] pod "metrics-server-9975d5f86-fjvd8" in "kube-system" namespace has status "Ready":"False"
I0311 13:39:32.022630 944071 pod_ready.go:102] pod "metrics-server-9975d5f86-fjvd8" in "kube-system" namespace has status "Ready":"False"
I0311 13:39:34.522230 944071 pod_ready.go:102] pod "metrics-server-9975d5f86-fjvd8" in "kube-system" namespace has status "Ready":"False"
I0311 13:39:37.026458 944071 pod_ready.go:102] pod "metrics-server-9975d5f86-fjvd8" in "kube-system" namespace has status "Ready":"False"
I0311 13:39:39.520721 944071 pod_ready.go:102] pod "metrics-server-9975d5f86-fjvd8" in "kube-system" namespace has status "Ready":"False"
I0311 13:39:41.521250 944071 pod_ready.go:102] pod "metrics-server-9975d5f86-fjvd8" in "kube-system" namespace has status "Ready":"False"
I0311 13:39:43.528601 944071 pod_ready.go:102] pod "metrics-server-9975d5f86-fjvd8" in "kube-system" namespace has status "Ready":"False"
I0311 13:39:46.021997 944071 pod_ready.go:102] pod "metrics-server-9975d5f86-fjvd8" in "kube-system" namespace has status "Ready":"False"
I0311 13:39:48.022166 944071 pod_ready.go:102] pod "metrics-server-9975d5f86-fjvd8" in "kube-system" namespace has status "Ready":"False"
I0311 13:39:50.022559 944071 pod_ready.go:102] pod "metrics-server-9975d5f86-fjvd8" in "kube-system" namespace has status "Ready":"False"
I0311 13:39:52.521663 944071 pod_ready.go:102] pod "metrics-server-9975d5f86-fjvd8" in "kube-system" namespace has status "Ready":"False"
I0311 13:39:54.522497 944071 pod_ready.go:102] pod "metrics-server-9975d5f86-fjvd8" in "kube-system" namespace has status "Ready":"False"
I0311 13:39:56.525794 944071 pod_ready.go:102] pod "metrics-server-9975d5f86-fjvd8" in "kube-system" namespace has status "Ready":"False"
I0311 13:39:59.020959 944071 pod_ready.go:102] pod "metrics-server-9975d5f86-fjvd8" in "kube-system" namespace has status "Ready":"False"
I0311 13:40:01.022004 944071 pod_ready.go:102] pod "metrics-server-9975d5f86-fjvd8" in "kube-system" namespace has status "Ready":"False"
I0311 13:40:03.027396 944071 pod_ready.go:102] pod "metrics-server-9975d5f86-fjvd8" in "kube-system" namespace has status "Ready":"False"
I0311 13:40:05.520987 944071 pod_ready.go:102] pod "metrics-server-9975d5f86-fjvd8" in "kube-system" namespace has status "Ready":"False"
I0311 13:40:07.521129 944071 pod_ready.go:102] pod "metrics-server-9975d5f86-fjvd8" in "kube-system" namespace has status "Ready":"False"
I0311 13:40:09.521623 944071 pod_ready.go:102] pod "metrics-server-9975d5f86-fjvd8" in "kube-system" namespace has status "Ready":"False"
I0311 13:40:12.025796 944071 pod_ready.go:102] pod "metrics-server-9975d5f86-fjvd8" in "kube-system" namespace has status "Ready":"False"
I0311 13:40:14.521394 944071 pod_ready.go:102] pod "metrics-server-9975d5f86-fjvd8" in "kube-system" namespace has status "Ready":"False"
I0311 13:40:16.521770 944071 pod_ready.go:102] pod "metrics-server-9975d5f86-fjvd8" in "kube-system" namespace has status "Ready":"False"
I0311 13:40:18.522436 944071 pod_ready.go:102] pod "metrics-server-9975d5f86-fjvd8" in "kube-system" namespace has status "Ready":"False"
I0311 13:40:21.023784 944071 pod_ready.go:102] pod "metrics-server-9975d5f86-fjvd8" in "kube-system" namespace has status "Ready":"False"
I0311 13:40:23.027065 944071 pod_ready.go:102] pod "metrics-server-9975d5f86-fjvd8" in "kube-system" namespace has status "Ready":"False"
I0311 13:40:25.523504 944071 pod_ready.go:102] pod "metrics-server-9975d5f86-fjvd8" in "kube-system" namespace has status "Ready":"False"
I0311 13:40:28.021381 944071 pod_ready.go:102] pod "metrics-server-9975d5f86-fjvd8" in "kube-system" namespace has status "Ready":"False"
I0311 13:40:30.024110 944071 pod_ready.go:102] pod "metrics-server-9975d5f86-fjvd8" in "kube-system" namespace has status "Ready":"False"
I0311 13:40:32.107226 944071 pod_ready.go:102] pod "metrics-server-9975d5f86-fjvd8" in "kube-system" namespace has status "Ready":"False"
I0311 13:40:34.521359 944071 pod_ready.go:102] pod "metrics-server-9975d5f86-fjvd8" in "kube-system" namespace has status "Ready":"False"
I0311 13:40:37.023356 944071 pod_ready.go:102] pod "metrics-server-9975d5f86-fjvd8" in "kube-system" namespace has status "Ready":"False"
I0311 13:40:39.522008 944071 pod_ready.go:102] pod "metrics-server-9975d5f86-fjvd8" in "kube-system" namespace has status "Ready":"False"
I0311 13:40:42.024191 944071 pod_ready.go:102] pod "metrics-server-9975d5f86-fjvd8" in "kube-system" namespace has status "Ready":"False"
I0311 13:40:44.522287 944071 pod_ready.go:102] pod "metrics-server-9975d5f86-fjvd8" in "kube-system" namespace has status "Ready":"False"
I0311 13:40:47.022156 944071 pod_ready.go:102] pod "metrics-server-9975d5f86-fjvd8" in "kube-system" namespace has status "Ready":"False"
I0311 13:40:49.520617 944071 pod_ready.go:102] pod "metrics-server-9975d5f86-fjvd8" in "kube-system" namespace has status "Ready":"False"
I0311 13:40:51.521039 944071 pod_ready.go:102] pod "metrics-server-9975d5f86-fjvd8" in "kube-system" namespace has status "Ready":"False"
I0311 13:40:53.521085 944071 pod_ready.go:102] pod "metrics-server-9975d5f86-fjvd8" in "kube-system" namespace has status "Ready":"False"
I0311 13:40:56.021763 944071 pod_ready.go:102] pod "metrics-server-9975d5f86-fjvd8" in "kube-system" namespace has status "Ready":"False"
I0311 13:40:58.021428 944071 pod_ready.go:81] duration metric: took 4m0.006632014s for pod "metrics-server-9975d5f86-fjvd8" in "kube-system" namespace to be "Ready" ...
E0311 13:40:58.021456 944071 pod_ready.go:66] WaitExtra: waitPodCondition: context deadline exceeded
I0311 13:40:58.021464 944071 pod_ready.go:38] duration metric: took 5m28.269759464s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0311 13:40:58.021479 944071 api_server.go:52] waiting for apiserver process to appear ...
I0311 13:40:58.021508 944071 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
I0311 13:40:58.021569 944071 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0311 13:40:58.079449 944071 cri.go:89] found id: "2db70787e2d49fdecd9bc02d04c1eb56827c3d542198aabfd91e6440e7bdedfb"
I0311 13:40:58.079474 944071 cri.go:89] found id: "1efd3d3c6b431a8f6d76e245d3ec7ab63c30f2b096c264acd026c38d4878a67f"
I0311 13:40:58.079479 944071 cri.go:89] found id: ""
I0311 13:40:58.079487 944071 logs.go:276] 2 containers: [2db70787e2d49fdecd9bc02d04c1eb56827c3d542198aabfd91e6440e7bdedfb 1efd3d3c6b431a8f6d76e245d3ec7ab63c30f2b096c264acd026c38d4878a67f]
I0311 13:40:58.079545 944071 ssh_runner.go:195] Run: which crictl
I0311 13:40:58.083484 944071 ssh_runner.go:195] Run: which crictl
I0311 13:40:58.087301 944071 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
I0311 13:40:58.087377 944071 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0311 13:40:58.132274 944071 cri.go:89] found id: "3d91f57195c2a3301694e12ef5429b5c4533a1555f186d0710618b7b852d2760"
I0311 13:40:58.132295 944071 cri.go:89] found id: "5ce8ca658a489eed2dbd049d4848b82cf2f879b98316ff0a5e0f9b0ff9f2962e"
I0311 13:40:58.132300 944071 cri.go:89] found id: ""
I0311 13:40:58.132309 944071 logs.go:276] 2 containers: [3d91f57195c2a3301694e12ef5429b5c4533a1555f186d0710618b7b852d2760 5ce8ca658a489eed2dbd049d4848b82cf2f879b98316ff0a5e0f9b0ff9f2962e]
I0311 13:40:58.132371 944071 ssh_runner.go:195] Run: which crictl
I0311 13:40:58.136329 944071 ssh_runner.go:195] Run: which crictl
I0311 13:40:58.139894 944071 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
I0311 13:40:58.139981 944071 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0311 13:40:58.183800 944071 cri.go:89] found id: "1b76f78246021579cf21e4531ff3eab7085e6d1e7d053d08b44e0d6140571ec1"
I0311 13:40:58.183839 944071 cri.go:89] found id: "6f6759a5fa53b61d59a4eb3efed14f78f772e070b07ebae287535c7bd97f6ac7"
I0311 13:40:58.183844 944071 cri.go:89] found id: ""
I0311 13:40:58.183857 944071 logs.go:276] 2 containers: [1b76f78246021579cf21e4531ff3eab7085e6d1e7d053d08b44e0d6140571ec1 6f6759a5fa53b61d59a4eb3efed14f78f772e070b07ebae287535c7bd97f6ac7]
I0311 13:40:58.183941 944071 ssh_runner.go:195] Run: which crictl
I0311 13:40:58.187937 944071 ssh_runner.go:195] Run: which crictl
I0311 13:40:58.191733 944071 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
I0311 13:40:58.191811 944071 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0311 13:40:58.248640 944071 cri.go:89] found id: "39152e7d8a96155b7cd9fa4c2075f12a084ad8469e78c5db3718c29114ccdec1"
I0311 13:40:58.248662 944071 cri.go:89] found id: "18ba14631e2229013a95152ecc7bd700ff0dc021cd44274d5c5657ffb75ed347"
I0311 13:40:58.248667 944071 cri.go:89] found id: ""
I0311 13:40:58.248674 944071 logs.go:276] 2 containers: [39152e7d8a96155b7cd9fa4c2075f12a084ad8469e78c5db3718c29114ccdec1 18ba14631e2229013a95152ecc7bd700ff0dc021cd44274d5c5657ffb75ed347]
I0311 13:40:58.248737 944071 ssh_runner.go:195] Run: which crictl
I0311 13:40:58.252691 944071 ssh_runner.go:195] Run: which crictl
I0311 13:40:58.256116 944071 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
I0311 13:40:58.256183 944071 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0311 13:40:58.302491 944071 cri.go:89] found id: "1046f75cb6d0bdb95e2b7da1e6dbd5108dd2cc257606b15059e8eec97867afb5"
I0311 13:40:58.302522 944071 cri.go:89] found id: "8334568a27c354d62138974eb15c381240354c69ff9cc3334aafb99945f69298"
I0311 13:40:58.302528 944071 cri.go:89] found id: ""
I0311 13:40:58.302536 944071 logs.go:276] 2 containers: [1046f75cb6d0bdb95e2b7da1e6dbd5108dd2cc257606b15059e8eec97867afb5 8334568a27c354d62138974eb15c381240354c69ff9cc3334aafb99945f69298]
I0311 13:40:58.302678 944071 ssh_runner.go:195] Run: which crictl
I0311 13:40:58.306935 944071 ssh_runner.go:195] Run: which crictl
I0311 13:40:58.310475 944071 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
I0311 13:40:58.310580 944071 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0311 13:40:58.373172 944071 cri.go:89] found id: "bc4f384ce5455f87e2277b85ac8603215e4769c7db6b809c8d6638746a8f0f79"
I0311 13:40:58.373201 944071 cri.go:89] found id: "2a8386dbbc357521701b6779041b13f7ac23bf6efa6e4648879ae34ab9456918"
I0311 13:40:58.373219 944071 cri.go:89] found id: ""
I0311 13:40:58.373249 944071 logs.go:276] 2 containers: [bc4f384ce5455f87e2277b85ac8603215e4769c7db6b809c8d6638746a8f0f79 2a8386dbbc357521701b6779041b13f7ac23bf6efa6e4648879ae34ab9456918]
I0311 13:40:58.373325 944071 ssh_runner.go:195] Run: which crictl
I0311 13:40:58.378954 944071 ssh_runner.go:195] Run: which crictl
I0311 13:40:58.383201 944071 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
I0311 13:40:58.383281 944071 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0311 13:40:58.426540 944071 cri.go:89] found id: "881db81636d17f287bdf2f1d72f8fbfef4724f8214d5f3b4d8d55fa6f7cce1c1"
I0311 13:40:58.426561 944071 cri.go:89] found id: "ee7a5ecb39413c27e23ab32527a89da9064b17f58353410a2e96d56978c5b575"
I0311 13:40:58.426565 944071 cri.go:89] found id: ""
I0311 13:40:58.426578 944071 logs.go:276] 2 containers: [881db81636d17f287bdf2f1d72f8fbfef4724f8214d5f3b4d8d55fa6f7cce1c1 ee7a5ecb39413c27e23ab32527a89da9064b17f58353410a2e96d56978c5b575]
I0311 13:40:58.426637 944071 ssh_runner.go:195] Run: which crictl
I0311 13:40:58.430233 944071 ssh_runner.go:195] Run: which crictl
I0311 13:40:58.433871 944071 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
I0311 13:40:58.433950 944071 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I0311 13:40:58.481178 944071 cri.go:89] found id: "bc98146e508c71c02a0b452cdb210d18cca3ee22c41165cc797f9e83833c8ad9"
I0311 13:40:58.481198 944071 cri.go:89] found id: ""
I0311 13:40:58.481206 944071 logs.go:276] 1 containers: [bc98146e508c71c02a0b452cdb210d18cca3ee22c41165cc797f9e83833c8ad9]
I0311 13:40:58.481265 944071 ssh_runner.go:195] Run: which crictl
I0311 13:40:58.485075 944071 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
I0311 13:40:58.485147 944071 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0311 13:40:58.524320 944071 cri.go:89] found id: "91683919c3a681de6a823dc15c85345c16650c12b9aa001e49a672a08b900503"
I0311 13:40:58.524341 944071 cri.go:89] found id: "96c1af2a12c5afb2a60e4b1487ac66e32236bd20e9cd7c3d75b01e38e1b0e6d2"
I0311 13:40:58.524345 944071 cri.go:89] found id: ""
I0311 13:40:58.524352 944071 logs.go:276] 2 containers: [91683919c3a681de6a823dc15c85345c16650c12b9aa001e49a672a08b900503 96c1af2a12c5afb2a60e4b1487ac66e32236bd20e9cd7c3d75b01e38e1b0e6d2]
I0311 13:40:58.524445 944071 ssh_runner.go:195] Run: which crictl
I0311 13:40:58.530121 944071 ssh_runner.go:195] Run: which crictl
I0311 13:40:58.534188 944071 logs.go:123] Gathering logs for etcd [5ce8ca658a489eed2dbd049d4848b82cf2f879b98316ff0a5e0f9b0ff9f2962e] ...
I0311 13:40:58.534225 944071 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 5ce8ca658a489eed2dbd049d4848b82cf2f879b98316ff0a5e0f9b0ff9f2962e"
I0311 13:40:58.605868 944071 logs.go:123] Gathering logs for coredns [1b76f78246021579cf21e4531ff3eab7085e6d1e7d053d08b44e0d6140571ec1] ...
I0311 13:40:58.605905 944071 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 1b76f78246021579cf21e4531ff3eab7085e6d1e7d053d08b44e0d6140571ec1"
I0311 13:40:58.653793 944071 logs.go:123] Gathering logs for kindnet [881db81636d17f287bdf2f1d72f8fbfef4724f8214d5f3b4d8d55fa6f7cce1c1] ...
I0311 13:40:58.653826 944071 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 881db81636d17f287bdf2f1d72f8fbfef4724f8214d5f3b4d8d55fa6f7cce1c1"
I0311 13:40:58.695746 944071 logs.go:123] Gathering logs for kubernetes-dashboard [bc98146e508c71c02a0b452cdb210d18cca3ee22c41165cc797f9e83833c8ad9] ...
I0311 13:40:58.695778 944071 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 bc98146e508c71c02a0b452cdb210d18cca3ee22c41165cc797f9e83833c8ad9"
I0311 13:40:58.743564 944071 logs.go:123] Gathering logs for storage-provisioner [96c1af2a12c5afb2a60e4b1487ac66e32236bd20e9cd7c3d75b01e38e1b0e6d2] ...
I0311 13:40:58.743594 944071 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 96c1af2a12c5afb2a60e4b1487ac66e32236bd20e9cd7c3d75b01e38e1b0e6d2"
I0311 13:40:58.783019 944071 logs.go:123] Gathering logs for kubelet ...
I0311 13:40:58.783048 944071 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0311 13:40:58.831302 944071 logs.go:138] Found kubelet problem: Mar 11 13:35:29 old-k8s-version-070145 kubelet[664]: E0311 13:35:29.459417 664 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:old-k8s-version-070145" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-070145' and this object
W0311 13:40:58.831534 944071 logs.go:138] Found kubelet problem: Mar 11 13:35:29 old-k8s-version-070145 kubelet[664]: E0311 13:35:29.459726 664 reflector.go:138] object-"kube-system"/"coredns-token-qkqt2": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "coredns-token-qkqt2" is forbidden: User "system:node:old-k8s-version-070145" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-070145' and this object
W0311 13:40:58.831739 944071 logs.go:138] Found kubelet problem: Mar 11 13:35:29 old-k8s-version-070145 kubelet[664]: E0311 13:35:29.459902 664 reflector.go:138] object-"kube-system"/"coredns": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:old-k8s-version-070145" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-070145' and this object
W0311 13:40:58.831955 944071 logs.go:138] Found kubelet problem: Mar 11 13:35:29 old-k8s-version-070145 kubelet[664]: E0311 13:35:29.460076 664 reflector.go:138] object-"kube-system"/"kube-proxy-token-gxdwg": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kube-proxy-token-gxdwg" is forbidden: User "system:node:old-k8s-version-070145" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-070145' and this object
W0311 13:40:58.832180 944071 logs.go:138] Found kubelet problem: Mar 11 13:35:29 old-k8s-version-070145 kubelet[664]: E0311 13:35:29.460251 664 reflector.go:138] object-"kube-system"/"kindnet-token-rnqx8": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kindnet-token-rnqx8" is forbidden: User "system:node:old-k8s-version-070145" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-070145' and this object
W0311 13:40:58.841316 944071 logs.go:138] Found kubelet problem: Mar 11 13:35:30 old-k8s-version-070145 kubelet[664]: E0311 13:35:30.669341 664 pod_workers.go:191] Error syncing pod 97a60e3d-c157-4827-82c5-590c454ae52c ("metrics-server-9975d5f86-fjvd8_kube-system(97a60e3d-c157-4827-82c5-590c454ae52c)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0311 13:40:58.841517 944071 logs.go:138] Found kubelet problem: Mar 11 13:35:31 old-k8s-version-070145 kubelet[664]: E0311 13:35:31.153659 664 pod_workers.go:191] Error syncing pod 97a60e3d-c157-4827-82c5-590c454ae52c ("metrics-server-9975d5f86-fjvd8_kube-system(97a60e3d-c157-4827-82c5-590c454ae52c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0311 13:40:58.844261 944071 logs.go:138] Found kubelet problem: Mar 11 13:35:44 old-k8s-version-070145 kubelet[664]: E0311 13:35:44.954825 664 pod_workers.go:191] Error syncing pod 97a60e3d-c157-4827-82c5-590c454ae52c ("metrics-server-9975d5f86-fjvd8_kube-system(97a60e3d-c157-4827-82c5-590c454ae52c)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0311 13:40:58.845967 944071 logs.go:138] Found kubelet problem: Mar 11 13:35:56 old-k8s-version-070145 kubelet[664]: E0311 13:35:56.925831 664 pod_workers.go:191] Error syncing pod 97a60e3d-c157-4827-82c5-590c454ae52c ("metrics-server-9975d5f86-fjvd8_kube-system(97a60e3d-c157-4827-82c5-590c454ae52c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0311 13:40:58.846758 944071 logs.go:138] Found kubelet problem: Mar 11 13:35:59 old-k8s-version-070145 kubelet[664]: E0311 13:35:59.291208 664 pod_workers.go:191] Error syncing pod cd398c70-ed6f-4abf-9b68-5612dc691d46 ("dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"
W0311 13:40:58.847221 944071 logs.go:138] Found kubelet problem: Mar 11 13:36:00 old-k8s-version-070145 kubelet[664]: E0311 13:36:00.325909 664 pod_workers.go:191] Error syncing pod cd398c70-ed6f-4abf-9b68-5612dc691d46 ("dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"
W0311 13:40:58.847657 944071 logs.go:138] Found kubelet problem: Mar 11 13:36:01 old-k8s-version-070145 kubelet[664]: E0311 13:36:01.328676 664 pod_workers.go:191] Error syncing pod 56c93912-57eb-4ab7-8853-172caa7e74d0 ("storage-provisioner_kube-system(56c93912-57eb-4ab7-8853-172caa7e74d0)"), skipping: failed to "StartContainer" for "storage-provisioner" with CrashLoopBackOff: "back-off 10s restarting failed container=storage-provisioner pod=storage-provisioner_kube-system(56c93912-57eb-4ab7-8853-172caa7e74d0)"
W0311 13:40:58.847990 944071 logs.go:138] Found kubelet problem: Mar 11 13:36:03 old-k8s-version-070145 kubelet[664]: E0311 13:36:03.832442 664 pod_workers.go:191] Error syncing pod cd398c70-ed6f-4abf-9b68-5612dc691d46 ("dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"
W0311 13:40:58.850435 944071 logs.go:138] Found kubelet problem: Mar 11 13:36:08 old-k8s-version-070145 kubelet[664]: E0311 13:36:08.925493 664 pod_workers.go:191] Error syncing pod 97a60e3d-c157-4827-82c5-590c454ae52c ("metrics-server-9975d5f86-fjvd8_kube-system(97a60e3d-c157-4827-82c5-590c454ae52c)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0311 13:40:58.851366 944071 logs.go:138] Found kubelet problem: Mar 11 13:36:14 old-k8s-version-070145 kubelet[664]: E0311 13:36:14.371867 664 pod_workers.go:191] Error syncing pod cd398c70-ed6f-4abf-9b68-5612dc691d46 ("dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"
W0311 13:40:58.851678 944071 logs.go:138] Found kubelet problem: Mar 11 13:36:22 old-k8s-version-070145 kubelet[664]: E0311 13:36:22.915611 664 pod_workers.go:191] Error syncing pod 97a60e3d-c157-4827-82c5-590c454ae52c ("metrics-server-9975d5f86-fjvd8_kube-system(97a60e3d-c157-4827-82c5-590c454ae52c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0311 13:40:58.852002 944071 logs.go:138] Found kubelet problem: Mar 11 13:36:23 old-k8s-version-070145 kubelet[664]: E0311 13:36:23.832156 664 pod_workers.go:191] Error syncing pod cd398c70-ed6f-4abf-9b68-5612dc691d46 ("dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"
W0311 13:40:58.852591 944071 logs.go:138] Found kubelet problem: Mar 11 13:36:35 old-k8s-version-070145 kubelet[664]: E0311 13:36:35.418432 664 pod_workers.go:191] Error syncing pod cd398c70-ed6f-4abf-9b68-5612dc691d46 ("dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"
W0311 13:40:58.852784 944071 logs.go:138] Found kubelet problem: Mar 11 13:36:35 old-k8s-version-070145 kubelet[664]: E0311 13:36:35.917817 664 pod_workers.go:191] Error syncing pod 97a60e3d-c157-4827-82c5-590c454ae52c ("metrics-server-9975d5f86-fjvd8_kube-system(97a60e3d-c157-4827-82c5-590c454ae52c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0311 13:40:58.853109 944071 logs.go:138] Found kubelet problem: Mar 11 13:36:43 old-k8s-version-070145 kubelet[664]: E0311 13:36:43.832567 664 pod_workers.go:191] Error syncing pod cd398c70-ed6f-4abf-9b68-5612dc691d46 ("dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"
W0311 13:40:58.855518 944071 logs.go:138] Found kubelet problem: Mar 11 13:36:49 old-k8s-version-070145 kubelet[664]: E0311 13:36:49.924277 664 pod_workers.go:191] Error syncing pod 97a60e3d-c157-4827-82c5-590c454ae52c ("metrics-server-9975d5f86-fjvd8_kube-system(97a60e3d-c157-4827-82c5-590c454ae52c)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0311 13:40:58.855845 944071 logs.go:138] Found kubelet problem: Mar 11 13:36:56 old-k8s-version-070145 kubelet[664]: E0311 13:36:56.917736 664 pod_workers.go:191] Error syncing pod cd398c70-ed6f-4abf-9b68-5612dc691d46 ("dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"
W0311 13:40:58.856029 944071 logs.go:138] Found kubelet problem: Mar 11 13:37:03 old-k8s-version-070145 kubelet[664]: E0311 13:37:03.915495 664 pod_workers.go:191] Error syncing pod 97a60e3d-c157-4827-82c5-590c454ae52c ("metrics-server-9975d5f86-fjvd8_kube-system(97a60e3d-c157-4827-82c5-590c454ae52c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0311 13:40:58.856351 944071 logs.go:138] Found kubelet problem: Mar 11 13:37:08 old-k8s-version-070145 kubelet[664]: E0311 13:37:08.918019 664 pod_workers.go:191] Error syncing pod cd398c70-ed6f-4abf-9b68-5612dc691d46 ("dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"
W0311 13:40:58.856536 944071 logs.go:138] Found kubelet problem: Mar 11 13:37:14 old-k8s-version-070145 kubelet[664]: E0311 13:37:14.917495 664 pod_workers.go:191] Error syncing pod 97a60e3d-c157-4827-82c5-590c454ae52c ("metrics-server-9975d5f86-fjvd8_kube-system(97a60e3d-c157-4827-82c5-590c454ae52c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0311 13:40:58.857152 944071 logs.go:138] Found kubelet problem: Mar 11 13:37:23 old-k8s-version-070145 kubelet[664]: E0311 13:37:23.531510 664 pod_workers.go:191] Error syncing pod cd398c70-ed6f-4abf-9b68-5612dc691d46 ("dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"
W0311 13:40:58.857484 944071 logs.go:138] Found kubelet problem: Mar 11 13:37:24 old-k8s-version-070145 kubelet[664]: E0311 13:37:24.534676 664 pod_workers.go:191] Error syncing pod cd398c70-ed6f-4abf-9b68-5612dc691d46 ("dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"
W0311 13:40:58.857666 944071 logs.go:138] Found kubelet problem: Mar 11 13:37:28 old-k8s-version-070145 kubelet[664]: E0311 13:37:28.918169 664 pod_workers.go:191] Error syncing pod 97a60e3d-c157-4827-82c5-590c454ae52c ("metrics-server-9975d5f86-fjvd8_kube-system(97a60e3d-c157-4827-82c5-590c454ae52c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0311 13:40:58.857994 944071 logs.go:138] Found kubelet problem: Mar 11 13:37:36 old-k8s-version-070145 kubelet[664]: E0311 13:37:36.918270 664 pod_workers.go:191] Error syncing pod cd398c70-ed6f-4abf-9b68-5612dc691d46 ("dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"
W0311 13:40:58.858179 944071 logs.go:138] Found kubelet problem: Mar 11 13:37:42 old-k8s-version-070145 kubelet[664]: E0311 13:37:42.915790 664 pod_workers.go:191] Error syncing pod 97a60e3d-c157-4827-82c5-590c454ae52c ("metrics-server-9975d5f86-fjvd8_kube-system(97a60e3d-c157-4827-82c5-590c454ae52c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0311 13:40:58.858502 944071 logs.go:138] Found kubelet problem: Mar 11 13:37:48 old-k8s-version-070145 kubelet[664]: E0311 13:37:48.916052 664 pod_workers.go:191] Error syncing pod cd398c70-ed6f-4abf-9b68-5612dc691d46 ("dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"
W0311 13:40:58.858685 944071 logs.go:138] Found kubelet problem: Mar 11 13:37:54 old-k8s-version-070145 kubelet[664]: E0311 13:37:54.916972 664 pod_workers.go:191] Error syncing pod 97a60e3d-c157-4827-82c5-590c454ae52c ("metrics-server-9975d5f86-fjvd8_kube-system(97a60e3d-c157-4827-82c5-590c454ae52c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0311 13:40:58.859049 944071 logs.go:138] Found kubelet problem: Mar 11 13:38:03 old-k8s-version-070145 kubelet[664]: E0311 13:38:03.915594 664 pod_workers.go:191] Error syncing pod cd398c70-ed6f-4abf-9b68-5612dc691d46 ("dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"
W0311 13:40:58.859240 944071 logs.go:138] Found kubelet problem: Mar 11 13:38:08 old-k8s-version-070145 kubelet[664]: E0311 13:38:08.915793 664 pod_workers.go:191] Error syncing pod 97a60e3d-c157-4827-82c5-590c454ae52c ("metrics-server-9975d5f86-fjvd8_kube-system(97a60e3d-c157-4827-82c5-590c454ae52c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0311 13:40:58.859598 944071 logs.go:138] Found kubelet problem: Mar 11 13:38:17 old-k8s-version-070145 kubelet[664]: E0311 13:38:17.915139 664 pod_workers.go:191] Error syncing pod cd398c70-ed6f-4abf-9b68-5612dc691d46 ("dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"
W0311 13:40:58.862035 944071 logs.go:138] Found kubelet problem: Mar 11 13:38:23 old-k8s-version-070145 kubelet[664]: E0311 13:38:23.923389 664 pod_workers.go:191] Error syncing pod 97a60e3d-c157-4827-82c5-590c454ae52c ("metrics-server-9975d5f86-fjvd8_kube-system(97a60e3d-c157-4827-82c5-590c454ae52c)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0311 13:40:58.862362 944071 logs.go:138] Found kubelet problem: Mar 11 13:38:29 old-k8s-version-070145 kubelet[664]: E0311 13:38:29.915142 664 pod_workers.go:191] Error syncing pod cd398c70-ed6f-4abf-9b68-5612dc691d46 ("dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"
W0311 13:40:58.862546 944071 logs.go:138] Found kubelet problem: Mar 11 13:38:34 old-k8s-version-070145 kubelet[664]: E0311 13:38:34.915655 664 pod_workers.go:191] Error syncing pod 97a60e3d-c157-4827-82c5-590c454ae52c ("metrics-server-9975d5f86-fjvd8_kube-system(97a60e3d-c157-4827-82c5-590c454ae52c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0311 13:40:58.862872 944071 logs.go:138] Found kubelet problem: Mar 11 13:38:41 old-k8s-version-070145 kubelet[664]: E0311 13:38:41.915198 664 pod_workers.go:191] Error syncing pod cd398c70-ed6f-4abf-9b68-5612dc691d46 ("dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"
W0311 13:40:58.863052 944071 logs.go:138] Found kubelet problem: Mar 11 13:38:45 old-k8s-version-070145 kubelet[664]: E0311 13:38:45.915534 664 pod_workers.go:191] Error syncing pod 97a60e3d-c157-4827-82c5-590c454ae52c ("metrics-server-9975d5f86-fjvd8_kube-system(97a60e3d-c157-4827-82c5-590c454ae52c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0311 13:40:58.863633 944071 logs.go:138] Found kubelet problem: Mar 11 13:38:54 old-k8s-version-070145 kubelet[664]: E0311 13:38:54.718973 664 pod_workers.go:191] Error syncing pod cd398c70-ed6f-4abf-9b68-5612dc691d46 ("dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"
W0311 13:40:58.863819 944071 logs.go:138] Found kubelet problem: Mar 11 13:38:58 old-k8s-version-070145 kubelet[664]: E0311 13:38:58.915749 664 pod_workers.go:191] Error syncing pod 97a60e3d-c157-4827-82c5-590c454ae52c ("metrics-server-9975d5f86-fjvd8_kube-system(97a60e3d-c157-4827-82c5-590c454ae52c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0311 13:40:58.864145 944071 logs.go:138] Found kubelet problem: Mar 11 13:39:03 old-k8s-version-070145 kubelet[664]: E0311 13:39:03.832416 664 pod_workers.go:191] Error syncing pod cd398c70-ed6f-4abf-9b68-5612dc691d46 ("dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"
W0311 13:40:58.864327 944071 logs.go:138] Found kubelet problem: Mar 11 13:39:09 old-k8s-version-070145 kubelet[664]: E0311 13:39:09.916058 664 pod_workers.go:191] Error syncing pod 97a60e3d-c157-4827-82c5-590c454ae52c ("metrics-server-9975d5f86-fjvd8_kube-system(97a60e3d-c157-4827-82c5-590c454ae52c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0311 13:40:58.864660 944071 logs.go:138] Found kubelet problem: Mar 11 13:39:17 old-k8s-version-070145 kubelet[664]: E0311 13:39:17.915142 664 pod_workers.go:191] Error syncing pod cd398c70-ed6f-4abf-9b68-5612dc691d46 ("dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"
W0311 13:40:58.864850 944071 logs.go:138] Found kubelet problem: Mar 11 13:39:24 old-k8s-version-070145 kubelet[664]: E0311 13:39:24.915425 664 pod_workers.go:191] Error syncing pod 97a60e3d-c157-4827-82c5-590c454ae52c ("metrics-server-9975d5f86-fjvd8_kube-system(97a60e3d-c157-4827-82c5-590c454ae52c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0311 13:40:58.865177 944071 logs.go:138] Found kubelet problem: Mar 11 13:39:31 old-k8s-version-070145 kubelet[664]: E0311 13:39:31.915158 664 pod_workers.go:191] Error syncing pod cd398c70-ed6f-4abf-9b68-5612dc691d46 ("dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"
W0311 13:40:58.865362 944071 logs.go:138] Found kubelet problem: Mar 11 13:39:35 old-k8s-version-070145 kubelet[664]: E0311 13:39:35.915581 664 pod_workers.go:191] Error syncing pod 97a60e3d-c157-4827-82c5-590c454ae52c ("metrics-server-9975d5f86-fjvd8_kube-system(97a60e3d-c157-4827-82c5-590c454ae52c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0311 13:40:58.865686 944071 logs.go:138] Found kubelet problem: Mar 11 13:39:42 old-k8s-version-070145 kubelet[664]: E0311 13:39:42.915728 664 pod_workers.go:191] Error syncing pod cd398c70-ed6f-4abf-9b68-5612dc691d46 ("dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"
W0311 13:40:58.865872 944071 logs.go:138] Found kubelet problem: Mar 11 13:39:48 old-k8s-version-070145 kubelet[664]: E0311 13:39:48.916029 664 pod_workers.go:191] Error syncing pod 97a60e3d-c157-4827-82c5-590c454ae52c ("metrics-server-9975d5f86-fjvd8_kube-system(97a60e3d-c157-4827-82c5-590c454ae52c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0311 13:40:58.866200 944071 logs.go:138] Found kubelet problem: Mar 11 13:39:56 old-k8s-version-070145 kubelet[664]: E0311 13:39:56.916329 664 pod_workers.go:191] Error syncing pod cd398c70-ed6f-4abf-9b68-5612dc691d46 ("dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"
W0311 13:40:58.866382 944071 logs.go:138] Found kubelet problem: Mar 11 13:39:59 old-k8s-version-070145 kubelet[664]: E0311 13:39:59.916223 664 pod_workers.go:191] Error syncing pod 97a60e3d-c157-4827-82c5-590c454ae52c ("metrics-server-9975d5f86-fjvd8_kube-system(97a60e3d-c157-4827-82c5-590c454ae52c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0311 13:40:58.866709 944071 logs.go:138] Found kubelet problem: Mar 11 13:40:11 old-k8s-version-070145 kubelet[664]: E0311 13:40:11.915247 664 pod_workers.go:191] Error syncing pod cd398c70-ed6f-4abf-9b68-5612dc691d46 ("dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"
W0311 13:40:58.866890 944071 logs.go:138] Found kubelet problem: Mar 11 13:40:11 old-k8s-version-070145 kubelet[664]: E0311 13:40:11.916186 664 pod_workers.go:191] Error syncing pod 97a60e3d-c157-4827-82c5-590c454ae52c ("metrics-server-9975d5f86-fjvd8_kube-system(97a60e3d-c157-4827-82c5-590c454ae52c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0311 13:40:58.867073 944071 logs.go:138] Found kubelet problem: Mar 11 13:40:22 old-k8s-version-070145 kubelet[664]: E0311 13:40:22.921762 664 pod_workers.go:191] Error syncing pod 97a60e3d-c157-4827-82c5-590c454ae52c ("metrics-server-9975d5f86-fjvd8_kube-system(97a60e3d-c157-4827-82c5-590c454ae52c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0311 13:40:58.867457 944071 logs.go:138] Found kubelet problem: Mar 11 13:40:26 old-k8s-version-070145 kubelet[664]: E0311 13:40:26.915380 664 pod_workers.go:191] Error syncing pod cd398c70-ed6f-4abf-9b68-5612dc691d46 ("dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"
W0311 13:40:58.867646 944071 logs.go:138] Found kubelet problem: Mar 11 13:40:36 old-k8s-version-070145 kubelet[664]: E0311 13:40:36.915484 664 pod_workers.go:191] Error syncing pod 97a60e3d-c157-4827-82c5-590c454ae52c ("metrics-server-9975d5f86-fjvd8_kube-system(97a60e3d-c157-4827-82c5-590c454ae52c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0311 13:40:58.867975 944071 logs.go:138] Found kubelet problem: Mar 11 13:40:39 old-k8s-version-070145 kubelet[664]: E0311 13:40:39.915140 664 pod_workers.go:191] Error syncing pod cd398c70-ed6f-4abf-9b68-5612dc691d46 ("dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"
W0311 13:40:58.868159 944071 logs.go:138] Found kubelet problem: Mar 11 13:40:50 old-k8s-version-070145 kubelet[664]: E0311 13:40:50.915444 664 pod_workers.go:191] Error syncing pod 97a60e3d-c157-4827-82c5-590c454ae52c ("metrics-server-9975d5f86-fjvd8_kube-system(97a60e3d-c157-4827-82c5-590c454ae52c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0311 13:40:58.868487 944071 logs.go:138] Found kubelet problem: Mar 11 13:40:53 old-k8s-version-070145 kubelet[664]: E0311 13:40:53.915252 664 pod_workers.go:191] Error syncing pod cd398c70-ed6f-4abf-9b68-5612dc691d46 ("dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"
I0311 13:40:58.868498 944071 logs.go:123] Gathering logs for kube-scheduler [18ba14631e2229013a95152ecc7bd700ff0dc021cd44274d5c5657ffb75ed347] ...
I0311 13:40:58.868512 944071 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 18ba14631e2229013a95152ecc7bd700ff0dc021cd44274d5c5657ffb75ed347"
I0311 13:40:58.914662 944071 logs.go:123] Gathering logs for etcd [3d91f57195c2a3301694e12ef5429b5c4533a1555f186d0710618b7b852d2760] ...
I0311 13:40:58.914696 944071 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 3d91f57195c2a3301694e12ef5429b5c4533a1555f186d0710618b7b852d2760"
I0311 13:40:58.961521 944071 logs.go:123] Gathering logs for kube-scheduler [39152e7d8a96155b7cd9fa4c2075f12a084ad8469e78c5db3718c29114ccdec1] ...
I0311 13:40:58.961608 944071 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 39152e7d8a96155b7cd9fa4c2075f12a084ad8469e78c5db3718c29114ccdec1"
I0311 13:40:59.005366 944071 logs.go:123] Gathering logs for kube-proxy [1046f75cb6d0bdb95e2b7da1e6dbd5108dd2cc257606b15059e8eec97867afb5] ...
I0311 13:40:59.005475 944071 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 1046f75cb6d0bdb95e2b7da1e6dbd5108dd2cc257606b15059e8eec97867afb5"
I0311 13:40:59.045829 944071 logs.go:123] Gathering logs for kube-proxy [8334568a27c354d62138974eb15c381240354c69ff9cc3334aafb99945f69298] ...
I0311 13:40:59.045859 944071 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 8334568a27c354d62138974eb15c381240354c69ff9cc3334aafb99945f69298"
I0311 13:40:59.085076 944071 logs.go:123] Gathering logs for kube-controller-manager [bc4f384ce5455f87e2277b85ac8603215e4769c7db6b809c8d6638746a8f0f79] ...
I0311 13:40:59.085105 944071 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 bc4f384ce5455f87e2277b85ac8603215e4769c7db6b809c8d6638746a8f0f79"
I0311 13:40:59.144503 944071 logs.go:123] Gathering logs for container status ...
I0311 13:40:59.144537 944071 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0311 13:40:59.218905 944071 logs.go:123] Gathering logs for storage-provisioner [91683919c3a681de6a823dc15c85345c16650c12b9aa001e49a672a08b900503] ...
I0311 13:40:59.218933 944071 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 91683919c3a681de6a823dc15c85345c16650c12b9aa001e49a672a08b900503"
I0311 13:40:59.263075 944071 logs.go:123] Gathering logs for dmesg ...
I0311 13:40:59.263103 944071 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0311 13:40:59.282074 944071 logs.go:123] Gathering logs for describe nodes ...
I0311 13:40:59.282102 944071 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0311 13:40:59.441208 944071 logs.go:123] Gathering logs for kube-apiserver [2db70787e2d49fdecd9bc02d04c1eb56827c3d542198aabfd91e6440e7bdedfb] ...
I0311 13:40:59.441237 944071 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 2db70787e2d49fdecd9bc02d04c1eb56827c3d542198aabfd91e6440e7bdedfb"
I0311 13:40:59.508829 944071 logs.go:123] Gathering logs for kube-apiserver [1efd3d3c6b431a8f6d76e245d3ec7ab63c30f2b096c264acd026c38d4878a67f] ...
I0311 13:40:59.508869 944071 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 1efd3d3c6b431a8f6d76e245d3ec7ab63c30f2b096c264acd026c38d4878a67f"
I0311 13:40:59.572255 944071 logs.go:123] Gathering logs for coredns [6f6759a5fa53b61d59a4eb3efed14f78f772e070b07ebae287535c7bd97f6ac7] ...
I0311 13:40:59.572294 944071 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 6f6759a5fa53b61d59a4eb3efed14f78f772e070b07ebae287535c7bd97f6ac7"
I0311 13:40:59.620790 944071 logs.go:123] Gathering logs for kube-controller-manager [2a8386dbbc357521701b6779041b13f7ac23bf6efa6e4648879ae34ab9456918] ...
I0311 13:40:59.620843 944071 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 2a8386dbbc357521701b6779041b13f7ac23bf6efa6e4648879ae34ab9456918"
I0311 13:40:59.698473 944071 logs.go:123] Gathering logs for kindnet [ee7a5ecb39413c27e23ab32527a89da9064b17f58353410a2e96d56978c5b575] ...
I0311 13:40:59.698506 944071 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 ee7a5ecb39413c27e23ab32527a89da9064b17f58353410a2e96d56978c5b575"
I0311 13:40:59.743547 944071 logs.go:123] Gathering logs for containerd ...
I0311 13:40:59.743574 944071 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
I0311 13:40:59.807738 944071 out.go:304] Setting ErrFile to fd 2...
I0311 13:40:59.807772 944071 out.go:338] TERM=,COLORTERM=, which probably does not support color
W0311 13:40:59.807839 944071 out.go:239] X Problems detected in kubelet:
X Problems detected in kubelet:
W0311 13:40:59.807853 944071 out.go:239] Mar 11 13:40:26 old-k8s-version-070145 kubelet[664]: E0311 13:40:26.915380 664 pod_workers.go:191] Error syncing pod cd398c70-ed6f-4abf-9b68-5612dc691d46 ("dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"
Mar 11 13:40:26 old-k8s-version-070145 kubelet[664]: E0311 13:40:26.915380 664 pod_workers.go:191] Error syncing pod cd398c70-ed6f-4abf-9b68-5612dc691d46 ("dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"
W0311 13:40:59.807868 944071 out.go:239] Mar 11 13:40:36 old-k8s-version-070145 kubelet[664]: E0311 13:40:36.915484 664 pod_workers.go:191] Error syncing pod 97a60e3d-c157-4827-82c5-590c454ae52c ("metrics-server-9975d5f86-fjvd8_kube-system(97a60e3d-c157-4827-82c5-590c454ae52c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Mar 11 13:40:36 old-k8s-version-070145 kubelet[664]: E0311 13:40:36.915484 664 pod_workers.go:191] Error syncing pod 97a60e3d-c157-4827-82c5-590c454ae52c ("metrics-server-9975d5f86-fjvd8_kube-system(97a60e3d-c157-4827-82c5-590c454ae52c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0311 13:40:59.807878 944071 out.go:239] Mar 11 13:40:39 old-k8s-version-070145 kubelet[664]: E0311 13:40:39.915140 664 pod_workers.go:191] Error syncing pod cd398c70-ed6f-4abf-9b68-5612dc691d46 ("dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"
Mar 11 13:40:39 old-k8s-version-070145 kubelet[664]: E0311 13:40:39.915140 664 pod_workers.go:191] Error syncing pod cd398c70-ed6f-4abf-9b68-5612dc691d46 ("dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"
W0311 13:40:59.807906 944071 out.go:239] Mar 11 13:40:50 old-k8s-version-070145 kubelet[664]: E0311 13:40:50.915444 664 pod_workers.go:191] Error syncing pod 97a60e3d-c157-4827-82c5-590c454ae52c ("metrics-server-9975d5f86-fjvd8_kube-system(97a60e3d-c157-4827-82c5-590c454ae52c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Mar 11 13:40:50 old-k8s-version-070145 kubelet[664]: E0311 13:40:50.915444 664 pod_workers.go:191] Error syncing pod 97a60e3d-c157-4827-82c5-590c454ae52c ("metrics-server-9975d5f86-fjvd8_kube-system(97a60e3d-c157-4827-82c5-590c454ae52c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0311 13:40:59.807914 944071 out.go:239] Mar 11 13:40:53 old-k8s-version-070145 kubelet[664]: E0311 13:40:53.915252 664 pod_workers.go:191] Error syncing pod cd398c70-ed6f-4abf-9b68-5612dc691d46 ("dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"
Mar 11 13:40:53 old-k8s-version-070145 kubelet[664]: E0311 13:40:53.915252 664 pod_workers.go:191] Error syncing pod cd398c70-ed6f-4abf-9b68-5612dc691d46 ("dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"
I0311 13:40:59.807928 944071 out.go:304] Setting ErrFile to fd 2...
I0311 13:40:59.807934 944071 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0311 13:41:09.809197 944071 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0311 13:41:09.823369 944071 api_server.go:72] duration metric: took 5m58.93090375s to wait for apiserver process to appear ...
I0311 13:41:09.823396 944071 api_server.go:88] waiting for apiserver healthz status ...
I0311 13:41:09.823436 944071 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
I0311 13:41:09.823498 944071 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0311 13:41:09.877840 944071 cri.go:89] found id: "2db70787e2d49fdecd9bc02d04c1eb56827c3d542198aabfd91e6440e7bdedfb"
I0311 13:41:09.877880 944071 cri.go:89] found id: "1efd3d3c6b431a8f6d76e245d3ec7ab63c30f2b096c264acd026c38d4878a67f"
I0311 13:41:09.877888 944071 cri.go:89] found id: ""
I0311 13:41:09.877895 944071 logs.go:276] 2 containers: [2db70787e2d49fdecd9bc02d04c1eb56827c3d542198aabfd91e6440e7bdedfb 1efd3d3c6b431a8f6d76e245d3ec7ab63c30f2b096c264acd026c38d4878a67f]
I0311 13:41:09.877950 944071 ssh_runner.go:195] Run: which crictl
I0311 13:41:09.881988 944071 ssh_runner.go:195] Run: which crictl
I0311 13:41:09.885782 944071 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
I0311 13:41:09.885874 944071 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0311 13:41:09.941083 944071 cri.go:89] found id: "3d91f57195c2a3301694e12ef5429b5c4533a1555f186d0710618b7b852d2760"
I0311 13:41:09.941106 944071 cri.go:89] found id: "5ce8ca658a489eed2dbd049d4848b82cf2f879b98316ff0a5e0f9b0ff9f2962e"
I0311 13:41:09.941112 944071 cri.go:89] found id: ""
I0311 13:41:09.941119 944071 logs.go:276] 2 containers: [3d91f57195c2a3301694e12ef5429b5c4533a1555f186d0710618b7b852d2760 5ce8ca658a489eed2dbd049d4848b82cf2f879b98316ff0a5e0f9b0ff9f2962e]
I0311 13:41:09.941174 944071 ssh_runner.go:195] Run: which crictl
I0311 13:41:09.946146 944071 ssh_runner.go:195] Run: which crictl
I0311 13:41:09.949966 944071 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
I0311 13:41:09.950040 944071 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0311 13:41:09.995065 944071 cri.go:89] found id: "1b76f78246021579cf21e4531ff3eab7085e6d1e7d053d08b44e0d6140571ec1"
I0311 13:41:09.995089 944071 cri.go:89] found id: "6f6759a5fa53b61d59a4eb3efed14f78f772e070b07ebae287535c7bd97f6ac7"
I0311 13:41:09.995095 944071 cri.go:89] found id: ""
I0311 13:41:09.995102 944071 logs.go:276] 2 containers: [1b76f78246021579cf21e4531ff3eab7085e6d1e7d053d08b44e0d6140571ec1 6f6759a5fa53b61d59a4eb3efed14f78f772e070b07ebae287535c7bd97f6ac7]
I0311 13:41:09.995157 944071 ssh_runner.go:195] Run: which crictl
I0311 13:41:10.001750 944071 ssh_runner.go:195] Run: which crictl
I0311 13:41:10.008139 944071 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
I0311 13:41:10.008251 944071 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0311 13:41:10.086211 944071 cri.go:89] found id: "39152e7d8a96155b7cd9fa4c2075f12a084ad8469e78c5db3718c29114ccdec1"
I0311 13:41:10.086243 944071 cri.go:89] found id: "18ba14631e2229013a95152ecc7bd700ff0dc021cd44274d5c5657ffb75ed347"
I0311 13:41:10.086249 944071 cri.go:89] found id: ""
I0311 13:41:10.086257 944071 logs.go:276] 2 containers: [39152e7d8a96155b7cd9fa4c2075f12a084ad8469e78c5db3718c29114ccdec1 18ba14631e2229013a95152ecc7bd700ff0dc021cd44274d5c5657ffb75ed347]
I0311 13:41:10.086316 944071 ssh_runner.go:195] Run: which crictl
I0311 13:41:10.092285 944071 ssh_runner.go:195] Run: which crictl
I0311 13:41:10.096429 944071 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
I0311 13:41:10.096511 944071 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0311 13:41:10.160818 944071 cri.go:89] found id: "1046f75cb6d0bdb95e2b7da1e6dbd5108dd2cc257606b15059e8eec97867afb5"
I0311 13:41:10.160838 944071 cri.go:89] found id: "8334568a27c354d62138974eb15c381240354c69ff9cc3334aafb99945f69298"
I0311 13:41:10.160842 944071 cri.go:89] found id: ""
I0311 13:41:10.160850 944071 logs.go:276] 2 containers: [1046f75cb6d0bdb95e2b7da1e6dbd5108dd2cc257606b15059e8eec97867afb5 8334568a27c354d62138974eb15c381240354c69ff9cc3334aafb99945f69298]
I0311 13:41:10.160905 944071 ssh_runner.go:195] Run: which crictl
I0311 13:41:10.167099 944071 ssh_runner.go:195] Run: which crictl
I0311 13:41:10.172922 944071 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
I0311 13:41:10.172999 944071 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0311 13:41:10.240216 944071 cri.go:89] found id: "bc4f384ce5455f87e2277b85ac8603215e4769c7db6b809c8d6638746a8f0f79"
I0311 13:41:10.240235 944071 cri.go:89] found id: "2a8386dbbc357521701b6779041b13f7ac23bf6efa6e4648879ae34ab9456918"
I0311 13:41:10.240239 944071 cri.go:89] found id: ""
I0311 13:41:10.240246 944071 logs.go:276] 2 containers: [bc4f384ce5455f87e2277b85ac8603215e4769c7db6b809c8d6638746a8f0f79 2a8386dbbc357521701b6779041b13f7ac23bf6efa6e4648879ae34ab9456918]
I0311 13:41:10.240304 944071 ssh_runner.go:195] Run: which crictl
I0311 13:41:10.248593 944071 ssh_runner.go:195] Run: which crictl
I0311 13:41:10.252452 944071 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
I0311 13:41:10.252524 944071 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0311 13:41:10.303927 944071 cri.go:89] found id: "881db81636d17f287bdf2f1d72f8fbfef4724f8214d5f3b4d8d55fa6f7cce1c1"
I0311 13:41:10.303951 944071 cri.go:89] found id: "ee7a5ecb39413c27e23ab32527a89da9064b17f58353410a2e96d56978c5b575"
I0311 13:41:10.303962 944071 cri.go:89] found id: ""
I0311 13:41:10.303970 944071 logs.go:276] 2 containers: [881db81636d17f287bdf2f1d72f8fbfef4724f8214d5f3b4d8d55fa6f7cce1c1 ee7a5ecb39413c27e23ab32527a89da9064b17f58353410a2e96d56978c5b575]
I0311 13:41:10.304022 944071 ssh_runner.go:195] Run: which crictl
I0311 13:41:10.310472 944071 ssh_runner.go:195] Run: which crictl
I0311 13:41:10.314370 944071 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
I0311 13:41:10.314439 944071 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I0311 13:41:10.384102 944071 cri.go:89] found id: "bc98146e508c71c02a0b452cdb210d18cca3ee22c41165cc797f9e83833c8ad9"
I0311 13:41:10.384123 944071 cri.go:89] found id: ""
I0311 13:41:10.384132 944071 logs.go:276] 1 containers: [bc98146e508c71c02a0b452cdb210d18cca3ee22c41165cc797f9e83833c8ad9]
I0311 13:41:10.384187 944071 ssh_runner.go:195] Run: which crictl
I0311 13:41:10.390472 944071 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
I0311 13:41:10.390545 944071 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0311 13:41:10.438709 944071 cri.go:89] found id: "91683919c3a681de6a823dc15c85345c16650c12b9aa001e49a672a08b900503"
I0311 13:41:10.438731 944071 cri.go:89] found id: "96c1af2a12c5afb2a60e4b1487ac66e32236bd20e9cd7c3d75b01e38e1b0e6d2"
I0311 13:41:10.438736 944071 cri.go:89] found id: ""
I0311 13:41:10.438743 944071 logs.go:276] 2 containers: [91683919c3a681de6a823dc15c85345c16650c12b9aa001e49a672a08b900503 96c1af2a12c5afb2a60e4b1487ac66e32236bd20e9cd7c3d75b01e38e1b0e6d2]
I0311 13:41:10.438815 944071 ssh_runner.go:195] Run: which crictl
I0311 13:41:10.442584 944071 ssh_runner.go:195] Run: which crictl
I0311 13:41:10.445932 944071 logs.go:123] Gathering logs for kubernetes-dashboard [bc98146e508c71c02a0b452cdb210d18cca3ee22c41165cc797f9e83833c8ad9] ...
I0311 13:41:10.445962 944071 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 bc98146e508c71c02a0b452cdb210d18cca3ee22c41165cc797f9e83833c8ad9"
I0311 13:41:10.516714 944071 logs.go:123] Gathering logs for storage-provisioner [91683919c3a681de6a823dc15c85345c16650c12b9aa001e49a672a08b900503] ...
I0311 13:41:10.516770 944071 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 91683919c3a681de6a823dc15c85345c16650c12b9aa001e49a672a08b900503"
I0311 13:41:10.587649 944071 logs.go:123] Gathering logs for container status ...
I0311 13:41:10.587675 944071 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0311 13:41:10.686391 944071 logs.go:123] Gathering logs for coredns [1b76f78246021579cf21e4531ff3eab7085e6d1e7d053d08b44e0d6140571ec1] ...
I0311 13:41:10.686423 944071 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 1b76f78246021579cf21e4531ff3eab7085e6d1e7d053d08b44e0d6140571ec1"
I0311 13:41:10.740465 944071 logs.go:123] Gathering logs for kube-scheduler [39152e7d8a96155b7cd9fa4c2075f12a084ad8469e78c5db3718c29114ccdec1] ...
I0311 13:41:10.740496 944071 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 39152e7d8a96155b7cd9fa4c2075f12a084ad8469e78c5db3718c29114ccdec1"
I0311 13:41:10.794246 944071 logs.go:123] Gathering logs for kube-controller-manager [2a8386dbbc357521701b6779041b13f7ac23bf6efa6e4648879ae34ab9456918] ...
I0311 13:41:10.794273 944071 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 2a8386dbbc357521701b6779041b13f7ac23bf6efa6e4648879ae34ab9456918"
I0311 13:41:10.868780 944071 logs.go:123] Gathering logs for kindnet [881db81636d17f287bdf2f1d72f8fbfef4724f8214d5f3b4d8d55fa6f7cce1c1] ...
I0311 13:41:10.868853 944071 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 881db81636d17f287bdf2f1d72f8fbfef4724f8214d5f3b4d8d55fa6f7cce1c1"
I0311 13:41:10.916588 944071 logs.go:123] Gathering logs for kube-scheduler [18ba14631e2229013a95152ecc7bd700ff0dc021cd44274d5c5657ffb75ed347] ...
I0311 13:41:10.916724 944071 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 18ba14631e2229013a95152ecc7bd700ff0dc021cd44274d5c5657ffb75ed347"
I0311 13:41:10.984043 944071 logs.go:123] Gathering logs for kube-proxy [8334568a27c354d62138974eb15c381240354c69ff9cc3334aafb99945f69298] ...
I0311 13:41:10.984216 944071 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 8334568a27c354d62138974eb15c381240354c69ff9cc3334aafb99945f69298"
I0311 13:41:11.051457 944071 logs.go:123] Gathering logs for kindnet [ee7a5ecb39413c27e23ab32527a89da9064b17f58353410a2e96d56978c5b575] ...
I0311 13:41:11.051531 944071 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 ee7a5ecb39413c27e23ab32527a89da9064b17f58353410a2e96d56978c5b575"
I0311 13:41:11.108664 944071 logs.go:123] Gathering logs for containerd ...
I0311 13:41:11.108778 944071 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
I0311 13:41:11.182036 944071 logs.go:123] Gathering logs for dmesg ...
I0311 13:41:11.182130 944071 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0311 13:41:11.205719 944071 logs.go:123] Gathering logs for kube-apiserver [1efd3d3c6b431a8f6d76e245d3ec7ab63c30f2b096c264acd026c38d4878a67f] ...
I0311 13:41:11.208834 944071 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 1efd3d3c6b431a8f6d76e245d3ec7ab63c30f2b096c264acd026c38d4878a67f"
I0311 13:41:11.288040 944071 logs.go:123] Gathering logs for etcd [3d91f57195c2a3301694e12ef5429b5c4533a1555f186d0710618b7b852d2760] ...
I0311 13:41:11.288078 944071 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 3d91f57195c2a3301694e12ef5429b5c4533a1555f186d0710618b7b852d2760"
I0311 13:41:11.360152 944071 logs.go:123] Gathering logs for etcd [5ce8ca658a489eed2dbd049d4848b82cf2f879b98316ff0a5e0f9b0ff9f2962e] ...
I0311 13:41:11.360180 944071 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 5ce8ca658a489eed2dbd049d4848b82cf2f879b98316ff0a5e0f9b0ff9f2962e"
I0311 13:41:11.443060 944071 logs.go:123] Gathering logs for storage-provisioner [96c1af2a12c5afb2a60e4b1487ac66e32236bd20e9cd7c3d75b01e38e1b0e6d2] ...
I0311 13:41:11.443180 944071 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 96c1af2a12c5afb2a60e4b1487ac66e32236bd20e9cd7c3d75b01e38e1b0e6d2"
I0311 13:41:11.536727 944071 logs.go:123] Gathering logs for kube-proxy [1046f75cb6d0bdb95e2b7da1e6dbd5108dd2cc257606b15059e8eec97867afb5] ...
I0311 13:41:11.536857 944071 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 1046f75cb6d0bdb95e2b7da1e6dbd5108dd2cc257606b15059e8eec97867afb5"
I0311 13:41:11.771851 944071 logs.go:123] Gathering logs for kube-controller-manager [bc4f384ce5455f87e2277b85ac8603215e4769c7db6b809c8d6638746a8f0f79] ...
I0311 13:41:11.771882 944071 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 bc4f384ce5455f87e2277b85ac8603215e4769c7db6b809c8d6638746a8f0f79"
I0311 13:41:11.936183 944071 logs.go:123] Gathering logs for kubelet ...
I0311 13:41:11.936224 944071 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0311 13:41:12.006020 944071 logs.go:138] Found kubelet problem: Mar 11 13:35:29 old-k8s-version-070145 kubelet[664]: E0311 13:35:29.459417 664 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:old-k8s-version-070145" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-070145' and this object
W0311 13:41:12.006319 944071 logs.go:138] Found kubelet problem: Mar 11 13:35:29 old-k8s-version-070145 kubelet[664]: E0311 13:35:29.459726 664 reflector.go:138] object-"kube-system"/"coredns-token-qkqt2": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "coredns-token-qkqt2" is forbidden: User "system:node:old-k8s-version-070145" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-070145' and this object
W0311 13:41:12.006551 944071 logs.go:138] Found kubelet problem: Mar 11 13:35:29 old-k8s-version-070145 kubelet[664]: E0311 13:35:29.459902 664 reflector.go:138] object-"kube-system"/"coredns": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:old-k8s-version-070145" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-070145' and this object
W0311 13:41:12.006796 944071 logs.go:138] Found kubelet problem: Mar 11 13:35:29 old-k8s-version-070145 kubelet[664]: E0311 13:35:29.460076 664 reflector.go:138] object-"kube-system"/"kube-proxy-token-gxdwg": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kube-proxy-token-gxdwg" is forbidden: User "system:node:old-k8s-version-070145" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-070145' and this object
W0311 13:41:12.007039 944071 logs.go:138] Found kubelet problem: Mar 11 13:35:29 old-k8s-version-070145 kubelet[664]: E0311 13:35:29.460251 664 reflector.go:138] object-"kube-system"/"kindnet-token-rnqx8": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kindnet-token-rnqx8" is forbidden: User "system:node:old-k8s-version-070145" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-070145' and this object
W0311 13:41:12.016281 944071 logs.go:138] Found kubelet problem: Mar 11 13:35:30 old-k8s-version-070145 kubelet[664]: E0311 13:35:30.669341 664 pod_workers.go:191] Error syncing pod 97a60e3d-c157-4827-82c5-590c454ae52c ("metrics-server-9975d5f86-fjvd8_kube-system(97a60e3d-c157-4827-82c5-590c454ae52c)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0311 13:41:12.017053 944071 logs.go:138] Found kubelet problem: Mar 11 13:35:31 old-k8s-version-070145 kubelet[664]: E0311 13:35:31.153659 664 pod_workers.go:191] Error syncing pod 97a60e3d-c157-4827-82c5-590c454ae52c ("metrics-server-9975d5f86-fjvd8_kube-system(97a60e3d-c157-4827-82c5-590c454ae52c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0311 13:41:12.019852 944071 logs.go:138] Found kubelet problem: Mar 11 13:35:44 old-k8s-version-070145 kubelet[664]: E0311 13:35:44.954825 664 pod_workers.go:191] Error syncing pod 97a60e3d-c157-4827-82c5-590c454ae52c ("metrics-server-9975d5f86-fjvd8_kube-system(97a60e3d-c157-4827-82c5-590c454ae52c)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0311 13:41:12.021550 944071 logs.go:138] Found kubelet problem: Mar 11 13:35:56 old-k8s-version-070145 kubelet[664]: E0311 13:35:56.925831 664 pod_workers.go:191] Error syncing pod 97a60e3d-c157-4827-82c5-590c454ae52c ("metrics-server-9975d5f86-fjvd8_kube-system(97a60e3d-c157-4827-82c5-590c454ae52c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0311 13:41:12.022347 944071 logs.go:138] Found kubelet problem: Mar 11 13:35:59 old-k8s-version-070145 kubelet[664]: E0311 13:35:59.291208 664 pod_workers.go:191] Error syncing pod cd398c70-ed6f-4abf-9b68-5612dc691d46 ("dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"
W0311 13:41:12.022809 944071 logs.go:138] Found kubelet problem: Mar 11 13:36:00 old-k8s-version-070145 kubelet[664]: E0311 13:36:00.325909 664 pod_workers.go:191] Error syncing pod cd398c70-ed6f-4abf-9b68-5612dc691d46 ("dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"
W0311 13:41:12.023990 944071 logs.go:138] Found kubelet problem: Mar 11 13:36:01 old-k8s-version-070145 kubelet[664]: E0311 13:36:01.328676 664 pod_workers.go:191] Error syncing pod 56c93912-57eb-4ab7-8853-172caa7e74d0 ("storage-provisioner_kube-system(56c93912-57eb-4ab7-8853-172caa7e74d0)"), skipping: failed to "StartContainer" for "storage-provisioner" with CrashLoopBackOff: "back-off 10s restarting failed container=storage-provisioner pod=storage-provisioner_kube-system(56c93912-57eb-4ab7-8853-172caa7e74d0)"
W0311 13:41:12.024343 944071 logs.go:138] Found kubelet problem: Mar 11 13:36:03 old-k8s-version-070145 kubelet[664]: E0311 13:36:03.832442 664 pod_workers.go:191] Error syncing pod cd398c70-ed6f-4abf-9b68-5612dc691d46 ("dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"
W0311 13:41:12.029660 944071 logs.go:138] Found kubelet problem: Mar 11 13:36:08 old-k8s-version-070145 kubelet[664]: E0311 13:36:08.925493 664 pod_workers.go:191] Error syncing pod 97a60e3d-c157-4827-82c5-590c454ae52c ("metrics-server-9975d5f86-fjvd8_kube-system(97a60e3d-c157-4827-82c5-590c454ae52c)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0311 13:41:12.031738 944071 logs.go:138] Found kubelet problem: Mar 11 13:36:14 old-k8s-version-070145 kubelet[664]: E0311 13:36:14.371867 664 pod_workers.go:191] Error syncing pod cd398c70-ed6f-4abf-9b68-5612dc691d46 ("dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"
W0311 13:41:12.032072 944071 logs.go:138] Found kubelet problem: Mar 11 13:36:22 old-k8s-version-070145 kubelet[664]: E0311 13:36:22.915611 664 pod_workers.go:191] Error syncing pod 97a60e3d-c157-4827-82c5-590c454ae52c ("metrics-server-9975d5f86-fjvd8_kube-system(97a60e3d-c157-4827-82c5-590c454ae52c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0311 13:41:12.032410 944071 logs.go:138] Found kubelet problem: Mar 11 13:36:23 old-k8s-version-070145 kubelet[664]: E0311 13:36:23.832156 664 pod_workers.go:191] Error syncing pod cd398c70-ed6f-4abf-9b68-5612dc691d46 ("dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"
W0311 13:41:12.037788 944071 logs.go:138] Found kubelet problem: Mar 11 13:36:35 old-k8s-version-070145 kubelet[664]: E0311 13:36:35.418432 664 pod_workers.go:191] Error syncing pod cd398c70-ed6f-4abf-9b68-5612dc691d46 ("dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"
W0311 13:41:12.038018 944071 logs.go:138] Found kubelet problem: Mar 11 13:36:35 old-k8s-version-070145 kubelet[664]: E0311 13:36:35.917817 664 pod_workers.go:191] Error syncing pod 97a60e3d-c157-4827-82c5-590c454ae52c ("metrics-server-9975d5f86-fjvd8_kube-system(97a60e3d-c157-4827-82c5-590c454ae52c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0311 13:41:12.038345 944071 logs.go:138] Found kubelet problem: Mar 11 13:36:43 old-k8s-version-070145 kubelet[664]: E0311 13:36:43.832567 664 pod_workers.go:191] Error syncing pod cd398c70-ed6f-4abf-9b68-5612dc691d46 ("dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"
W0311 13:41:12.043942 944071 logs.go:138] Found kubelet problem: Mar 11 13:36:49 old-k8s-version-070145 kubelet[664]: E0311 13:36:49.924277 664 pod_workers.go:191] Error syncing pod 97a60e3d-c157-4827-82c5-590c454ae52c ("metrics-server-9975d5f86-fjvd8_kube-system(97a60e3d-c157-4827-82c5-590c454ae52c)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0311 13:41:12.044297 944071 logs.go:138] Found kubelet problem: Mar 11 13:36:56 old-k8s-version-070145 kubelet[664]: E0311 13:36:56.917736 664 pod_workers.go:191] Error syncing pod cd398c70-ed6f-4abf-9b68-5612dc691d46 ("dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"
W0311 13:41:12.044499 944071 logs.go:138] Found kubelet problem: Mar 11 13:37:03 old-k8s-version-070145 kubelet[664]: E0311 13:37:03.915495 664 pod_workers.go:191] Error syncing pod 97a60e3d-c157-4827-82c5-590c454ae52c ("metrics-server-9975d5f86-fjvd8_kube-system(97a60e3d-c157-4827-82c5-590c454ae52c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0311 13:41:12.044968 944071 logs.go:138] Found kubelet problem: Mar 11 13:37:08 old-k8s-version-070145 kubelet[664]: E0311 13:37:08.918019 664 pod_workers.go:191] Error syncing pod cd398c70-ed6f-4abf-9b68-5612dc691d46 ("dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"
W0311 13:41:12.045159 944071 logs.go:138] Found kubelet problem: Mar 11 13:37:14 old-k8s-version-070145 kubelet[664]: E0311 13:37:14.917495 664 pod_workers.go:191] Error syncing pod 97a60e3d-c157-4827-82c5-590c454ae52c ("metrics-server-9975d5f86-fjvd8_kube-system(97a60e3d-c157-4827-82c5-590c454ae52c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0311 13:41:12.045841 944071 logs.go:138] Found kubelet problem: Mar 11 13:37:23 old-k8s-version-070145 kubelet[664]: E0311 13:37:23.531510 664 pod_workers.go:191] Error syncing pod cd398c70-ed6f-4abf-9b68-5612dc691d46 ("dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"
W0311 13:41:12.046261 944071 logs.go:138] Found kubelet problem: Mar 11 13:37:24 old-k8s-version-070145 kubelet[664]: E0311 13:37:24.534676 664 pod_workers.go:191] Error syncing pod cd398c70-ed6f-4abf-9b68-5612dc691d46 ("dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"
W0311 13:41:12.046476 944071 logs.go:138] Found kubelet problem: Mar 11 13:37:28 old-k8s-version-070145 kubelet[664]: E0311 13:37:28.918169 664 pod_workers.go:191] Error syncing pod 97a60e3d-c157-4827-82c5-590c454ae52c ("metrics-server-9975d5f86-fjvd8_kube-system(97a60e3d-c157-4827-82c5-590c454ae52c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0311 13:41:12.046851 944071 logs.go:138] Found kubelet problem: Mar 11 13:37:36 old-k8s-version-070145 kubelet[664]: E0311 13:37:36.918270 664 pod_workers.go:191] Error syncing pod cd398c70-ed6f-4abf-9b68-5612dc691d46 ("dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"
W0311 13:41:12.047070 944071 logs.go:138] Found kubelet problem: Mar 11 13:37:42 old-k8s-version-070145 kubelet[664]: E0311 13:37:42.915790 664 pod_workers.go:191] Error syncing pod 97a60e3d-c157-4827-82c5-590c454ae52c ("metrics-server-9975d5f86-fjvd8_kube-system(97a60e3d-c157-4827-82c5-590c454ae52c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0311 13:41:12.047441 944071 logs.go:138] Found kubelet problem: Mar 11 13:37:48 old-k8s-version-070145 kubelet[664]: E0311 13:37:48.916052 664 pod_workers.go:191] Error syncing pod cd398c70-ed6f-4abf-9b68-5612dc691d46 ("dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"
W0311 13:41:12.047653 944071 logs.go:138] Found kubelet problem: Mar 11 13:37:54 old-k8s-version-070145 kubelet[664]: E0311 13:37:54.916972 664 pod_workers.go:191] Error syncing pod 97a60e3d-c157-4827-82c5-590c454ae52c ("metrics-server-9975d5f86-fjvd8_kube-system(97a60e3d-c157-4827-82c5-590c454ae52c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0311 13:41:12.048023 944071 logs.go:138] Found kubelet problem: Mar 11 13:38:03 old-k8s-version-070145 kubelet[664]: E0311 13:38:03.915594 664 pod_workers.go:191] Error syncing pod cd398c70-ed6f-4abf-9b68-5612dc691d46 ("dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"
W0311 13:41:12.054889 944071 logs.go:138] Found kubelet problem: Mar 11 13:38:08 old-k8s-version-070145 kubelet[664]: E0311 13:38:08.915793 664 pod_workers.go:191] Error syncing pod 97a60e3d-c157-4827-82c5-590c454ae52c ("metrics-server-9975d5f86-fjvd8_kube-system(97a60e3d-c157-4827-82c5-590c454ae52c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0311 13:41:12.056930 944071 logs.go:138] Found kubelet problem: Mar 11 13:38:17 old-k8s-version-070145 kubelet[664]: E0311 13:38:17.915139 664 pod_workers.go:191] Error syncing pod cd398c70-ed6f-4abf-9b68-5612dc691d46 ("dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"
W0311 13:41:12.064675 944071 logs.go:138] Found kubelet problem: Mar 11 13:38:23 old-k8s-version-070145 kubelet[664]: E0311 13:38:23.923389 664 pod_workers.go:191] Error syncing pod 97a60e3d-c157-4827-82c5-590c454ae52c ("metrics-server-9975d5f86-fjvd8_kube-system(97a60e3d-c157-4827-82c5-590c454ae52c)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0311 13:41:12.067039 944071 logs.go:138] Found kubelet problem: Mar 11 13:38:29 old-k8s-version-070145 kubelet[664]: E0311 13:38:29.915142 664 pod_workers.go:191] Error syncing pod cd398c70-ed6f-4abf-9b68-5612dc691d46 ("dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"
W0311 13:41:12.072741 944071 logs.go:138] Found kubelet problem: Mar 11 13:38:34 old-k8s-version-070145 kubelet[664]: E0311 13:38:34.915655 664 pod_workers.go:191] Error syncing pod 97a60e3d-c157-4827-82c5-590c454ae52c ("metrics-server-9975d5f86-fjvd8_kube-system(97a60e3d-c157-4827-82c5-590c454ae52c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0311 13:41:12.073153 944071 logs.go:138] Found kubelet problem: Mar 11 13:38:41 old-k8s-version-070145 kubelet[664]: E0311 13:38:41.915198 664 pod_workers.go:191] Error syncing pod cd398c70-ed6f-4abf-9b68-5612dc691d46 ("dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"
W0311 13:41:12.073345 944071 logs.go:138] Found kubelet problem: Mar 11 13:38:45 old-k8s-version-070145 kubelet[664]: E0311 13:38:45.915534 664 pod_workers.go:191] Error syncing pod 97a60e3d-c157-4827-82c5-590c454ae52c ("metrics-server-9975d5f86-fjvd8_kube-system(97a60e3d-c157-4827-82c5-590c454ae52c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0311 13:41:12.073941 944071 logs.go:138] Found kubelet problem: Mar 11 13:38:54 old-k8s-version-070145 kubelet[664]: E0311 13:38:54.718973 664 pod_workers.go:191] Error syncing pod cd398c70-ed6f-4abf-9b68-5612dc691d46 ("dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"
W0311 13:41:12.074125 944071 logs.go:138] Found kubelet problem: Mar 11 13:38:58 old-k8s-version-070145 kubelet[664]: E0311 13:38:58.915749 664 pod_workers.go:191] Error syncing pod 97a60e3d-c157-4827-82c5-590c454ae52c ("metrics-server-9975d5f86-fjvd8_kube-system(97a60e3d-c157-4827-82c5-590c454ae52c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0311 13:41:12.074451 944071 logs.go:138] Found kubelet problem: Mar 11 13:39:03 old-k8s-version-070145 kubelet[664]: E0311 13:39:03.832416 664 pod_workers.go:191] Error syncing pod cd398c70-ed6f-4abf-9b68-5612dc691d46 ("dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"
W0311 13:41:12.074640 944071 logs.go:138] Found kubelet problem: Mar 11 13:39:09 old-k8s-version-070145 kubelet[664]: E0311 13:39:09.916058 664 pod_workers.go:191] Error syncing pod 97a60e3d-c157-4827-82c5-590c454ae52c ("metrics-server-9975d5f86-fjvd8_kube-system(97a60e3d-c157-4827-82c5-590c454ae52c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0311 13:41:12.074974 944071 logs.go:138] Found kubelet problem: Mar 11 13:39:17 old-k8s-version-070145 kubelet[664]: E0311 13:39:17.915142 664 pod_workers.go:191] Error syncing pod cd398c70-ed6f-4abf-9b68-5612dc691d46 ("dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"
W0311 13:41:12.075174 944071 logs.go:138] Found kubelet problem: Mar 11 13:39:24 old-k8s-version-070145 kubelet[664]: E0311 13:39:24.915425 664 pod_workers.go:191] Error syncing pod 97a60e3d-c157-4827-82c5-590c454ae52c ("metrics-server-9975d5f86-fjvd8_kube-system(97a60e3d-c157-4827-82c5-590c454ae52c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0311 13:41:12.075500 944071 logs.go:138] Found kubelet problem: Mar 11 13:39:31 old-k8s-version-070145 kubelet[664]: E0311 13:39:31.915158 664 pod_workers.go:191] Error syncing pod cd398c70-ed6f-4abf-9b68-5612dc691d46 ("dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"
W0311 13:41:12.075688 944071 logs.go:138] Found kubelet problem: Mar 11 13:39:35 old-k8s-version-070145 kubelet[664]: E0311 13:39:35.915581 664 pod_workers.go:191] Error syncing pod 97a60e3d-c157-4827-82c5-590c454ae52c ("metrics-server-9975d5f86-fjvd8_kube-system(97a60e3d-c157-4827-82c5-590c454ae52c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0311 13:41:12.076023 944071 logs.go:138] Found kubelet problem: Mar 11 13:39:42 old-k8s-version-070145 kubelet[664]: E0311 13:39:42.915728 664 pod_workers.go:191] Error syncing pod cd398c70-ed6f-4abf-9b68-5612dc691d46 ("dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"
W0311 13:41:12.076207 944071 logs.go:138] Found kubelet problem: Mar 11 13:39:48 old-k8s-version-070145 kubelet[664]: E0311 13:39:48.916029 664 pod_workers.go:191] Error syncing pod 97a60e3d-c157-4827-82c5-590c454ae52c ("metrics-server-9975d5f86-fjvd8_kube-system(97a60e3d-c157-4827-82c5-590c454ae52c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0311 13:41:12.076540 944071 logs.go:138] Found kubelet problem: Mar 11 13:39:56 old-k8s-version-070145 kubelet[664]: E0311 13:39:56.916329 664 pod_workers.go:191] Error syncing pod cd398c70-ed6f-4abf-9b68-5612dc691d46 ("dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"
W0311 13:41:12.076723 944071 logs.go:138] Found kubelet problem: Mar 11 13:39:59 old-k8s-version-070145 kubelet[664]: E0311 13:39:59.916223 664 pod_workers.go:191] Error syncing pod 97a60e3d-c157-4827-82c5-590c454ae52c ("metrics-server-9975d5f86-fjvd8_kube-system(97a60e3d-c157-4827-82c5-590c454ae52c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0311 13:41:12.083790 944071 logs.go:138] Found kubelet problem: Mar 11 13:40:11 old-k8s-version-070145 kubelet[664]: E0311 13:40:11.915247 664 pod_workers.go:191] Error syncing pod cd398c70-ed6f-4abf-9b68-5612dc691d46 ("dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"
W0311 13:41:12.084875 944071 logs.go:138] Found kubelet problem: Mar 11 13:40:11 old-k8s-version-070145 kubelet[664]: E0311 13:40:11.916186 664 pod_workers.go:191] Error syncing pod 97a60e3d-c157-4827-82c5-590c454ae52c ("metrics-server-9975d5f86-fjvd8_kube-system(97a60e3d-c157-4827-82c5-590c454ae52c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0311 13:41:12.085112 944071 logs.go:138] Found kubelet problem: Mar 11 13:40:22 old-k8s-version-070145 kubelet[664]: E0311 13:40:22.921762 664 pod_workers.go:191] Error syncing pod 97a60e3d-c157-4827-82c5-590c454ae52c ("metrics-server-9975d5f86-fjvd8_kube-system(97a60e3d-c157-4827-82c5-590c454ae52c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0311 13:41:12.085444 944071 logs.go:138] Found kubelet problem: Mar 11 13:40:26 old-k8s-version-070145 kubelet[664]: E0311 13:40:26.915380 664 pod_workers.go:191] Error syncing pod cd398c70-ed6f-4abf-9b68-5612dc691d46 ("dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"
W0311 13:41:12.085631 944071 logs.go:138] Found kubelet problem: Mar 11 13:40:36 old-k8s-version-070145 kubelet[664]: E0311 13:40:36.915484 664 pod_workers.go:191] Error syncing pod 97a60e3d-c157-4827-82c5-590c454ae52c ("metrics-server-9975d5f86-fjvd8_kube-system(97a60e3d-c157-4827-82c5-590c454ae52c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0311 13:41:12.085956 944071 logs.go:138] Found kubelet problem: Mar 11 13:40:39 old-k8s-version-070145 kubelet[664]: E0311 13:40:39.915140 664 pod_workers.go:191] Error syncing pod cd398c70-ed6f-4abf-9b68-5612dc691d46 ("dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"
W0311 13:41:12.089446 944071 logs.go:138] Found kubelet problem: Mar 11 13:40:50 old-k8s-version-070145 kubelet[664]: E0311 13:40:50.915444 664 pod_workers.go:191] Error syncing pod 97a60e3d-c157-4827-82c5-590c454ae52c ("metrics-server-9975d5f86-fjvd8_kube-system(97a60e3d-c157-4827-82c5-590c454ae52c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0311 13:41:12.089806 944071 logs.go:138] Found kubelet problem: Mar 11 13:40:53 old-k8s-version-070145 kubelet[664]: E0311 13:40:53.915252 664 pod_workers.go:191] Error syncing pod cd398c70-ed6f-4abf-9b68-5612dc691d46 ("dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"
W0311 13:41:12.092881 944071 logs.go:138] Found kubelet problem: Mar 11 13:41:04 old-k8s-version-070145 kubelet[664]: E0311 13:41:04.935691 664 pod_workers.go:191] Error syncing pod 97a60e3d-c157-4827-82c5-590c454ae52c ("metrics-server-9975d5f86-fjvd8_kube-system(97a60e3d-c157-4827-82c5-590c454ae52c)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0311 13:41:12.093226 944071 logs.go:138] Found kubelet problem: Mar 11 13:41:07 old-k8s-version-070145 kubelet[664]: E0311 13:41:07.915147 664 pod_workers.go:191] Error syncing pod cd398c70-ed6f-4abf-9b68-5612dc691d46 ("dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"
I0311 13:41:12.093234 944071 logs.go:123] Gathering logs for describe nodes ...
I0311 13:41:12.093248 944071 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0311 13:41:12.600012 944071 logs.go:123] Gathering logs for kube-apiserver [2db70787e2d49fdecd9bc02d04c1eb56827c3d542198aabfd91e6440e7bdedfb] ...
I0311 13:41:12.600048 944071 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 2db70787e2d49fdecd9bc02d04c1eb56827c3d542198aabfd91e6440e7bdedfb"
I0311 13:41:12.718027 944071 logs.go:123] Gathering logs for coredns [6f6759a5fa53b61d59a4eb3efed14f78f772e070b07ebae287535c7bd97f6ac7] ...
I0311 13:41:12.718060 944071 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 6f6759a5fa53b61d59a4eb3efed14f78f772e070b07ebae287535c7bd97f6ac7"
I0311 13:41:12.792099 944071 out.go:304] Setting ErrFile to fd 2...
I0311 13:41:12.792123 944071 out.go:338] TERM=,COLORTERM=, which probably does not support color
W0311 13:41:12.792182 944071 out.go:239] X Problems detected in kubelet:
X Problems detected in kubelet:
W0311 13:41:12.792192 944071 out.go:239] Mar 11 13:40:39 old-k8s-version-070145 kubelet[664]: E0311 13:40:39.915140 664 pod_workers.go:191] Error syncing pod cd398c70-ed6f-4abf-9b68-5612dc691d46 ("dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"
Mar 11 13:40:39 old-k8s-version-070145 kubelet[664]: E0311 13:40:39.915140 664 pod_workers.go:191] Error syncing pod cd398c70-ed6f-4abf-9b68-5612dc691d46 ("dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"
W0311 13:41:12.792198 944071 out.go:239] Mar 11 13:40:50 old-k8s-version-070145 kubelet[664]: E0311 13:40:50.915444 664 pod_workers.go:191] Error syncing pod 97a60e3d-c157-4827-82c5-590c454ae52c ("metrics-server-9975d5f86-fjvd8_kube-system(97a60e3d-c157-4827-82c5-590c454ae52c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Mar 11 13:40:50 old-k8s-version-070145 kubelet[664]: E0311 13:40:50.915444 664 pod_workers.go:191] Error syncing pod 97a60e3d-c157-4827-82c5-590c454ae52c ("metrics-server-9975d5f86-fjvd8_kube-system(97a60e3d-c157-4827-82c5-590c454ae52c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0311 13:41:12.792302 944071 out.go:239] Mar 11 13:40:53 old-k8s-version-070145 kubelet[664]: E0311 13:40:53.915252 664 pod_workers.go:191] Error syncing pod cd398c70-ed6f-4abf-9b68-5612dc691d46 ("dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"
Mar 11 13:40:53 old-k8s-version-070145 kubelet[664]: E0311 13:40:53.915252 664 pod_workers.go:191] Error syncing pod cd398c70-ed6f-4abf-9b68-5612dc691d46 ("dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"
W0311 13:41:12.792311 944071 out.go:239] Mar 11 13:41:04 old-k8s-version-070145 kubelet[664]: E0311 13:41:04.935691 664 pod_workers.go:191] Error syncing pod 97a60e3d-c157-4827-82c5-590c454ae52c ("metrics-server-9975d5f86-fjvd8_kube-system(97a60e3d-c157-4827-82c5-590c454ae52c)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
Mar 11 13:41:04 old-k8s-version-070145 kubelet[664]: E0311 13:41:04.935691 664 pod_workers.go:191] Error syncing pod 97a60e3d-c157-4827-82c5-590c454ae52c ("metrics-server-9975d5f86-fjvd8_kube-system(97a60e3d-c157-4827-82c5-590c454ae52c)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0311 13:41:12.792319 944071 out.go:239] Mar 11 13:41:07 old-k8s-version-070145 kubelet[664]: E0311 13:41:07.915147 664 pod_workers.go:191] Error syncing pod cd398c70-ed6f-4abf-9b68-5612dc691d46 ("dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"
Mar 11 13:41:07 old-k8s-version-070145 kubelet[664]: E0311 13:41:07.915147 664 pod_workers.go:191] Error syncing pod cd398c70-ed6f-4abf-9b68-5612dc691d46 ("dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"
I0311 13:41:12.792326 944071 out.go:304] Setting ErrFile to fd 2...
I0311 13:41:12.792340 944071 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0311 13:41:22.793384 944071 api_server.go:253] Checking apiserver healthz at https://192.168.76.2:8443/healthz ...
I0311 13:41:22.808295 944071 api_server.go:279] https://192.168.76.2:8443/healthz returned 200:
ok
I0311 13:41:22.811005 944071 out.go:177]
W0311 13:41:22.812825 944071 out.go:239] X Exiting due to K8S_UNHEALTHY_CONTROL_PLANE: wait 6m0s for node: wait for healthy API server: controlPlane never updated to v1.20.0
X Exiting due to K8S_UNHEALTHY_CONTROL_PLANE: wait 6m0s for node: wait for healthy API server: controlPlane never updated to v1.20.0
W0311 13:41:22.812862 944071 out.go:239] * Suggestion: Control Plane could not update, try minikube delete --all --purge
* Suggestion: Control Plane could not update, try minikube delete --all --purge
W0311 13:41:22.812880 944071 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/11417
* Related issue: https://github.com/kubernetes/minikube/issues/11417
W0311 13:41:22.812886 944071 out.go:239] *
*
W0311 13:41:22.814440 944071 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0311 13:41:22.816345 944071 out.go:177]
** /stderr **
start_stop_delete_test.go:259: failed to start minikube post-stop. args "out/minikube-linux-arm64 start -p old-k8s-version-070145 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=containerd --kubernetes-version=v1.20.0": exit status 102
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: docker inspect <======
helpers_test.go:231: (dbg) Run: docker inspect old-k8s-version-070145
helpers_test.go:235: (dbg) docker inspect old-k8s-version-070145:
-- stdout --
[
{
"Id": "c2b58f15dac72da98fcdbecdafc5c14b1959ab1722ad895570c1793b350db4d3",
"Created": "2024-03-11T13:31:48.457635198Z",
"Path": "/usr/local/bin/entrypoint",
"Args": [
"/sbin/init"
],
"State": {
"Status": "running",
"Running": true,
"Paused": false,
"Restarting": false,
"OOMKilled": false,
"Dead": false,
"Pid": 944284,
"ExitCode": 0,
"Error": "",
"StartedAt": "2024-03-11T13:35:02.769978988Z",
"FinishedAt": "2024-03-11T13:35:01.517476887Z"
},
"Image": "sha256:4a9b65157dd7fb2ddb7cb7afe975b3dc288e9877c60d13613a69dd41a70e2e4e",
"ResolvConfPath": "/var/lib/docker/containers/c2b58f15dac72da98fcdbecdafc5c14b1959ab1722ad895570c1793b350db4d3/resolv.conf",
"HostnamePath": "/var/lib/docker/containers/c2b58f15dac72da98fcdbecdafc5c14b1959ab1722ad895570c1793b350db4d3/hostname",
"HostsPath": "/var/lib/docker/containers/c2b58f15dac72da98fcdbecdafc5c14b1959ab1722ad895570c1793b350db4d3/hosts",
"LogPath": "/var/lib/docker/containers/c2b58f15dac72da98fcdbecdafc5c14b1959ab1722ad895570c1793b350db4d3/c2b58f15dac72da98fcdbecdafc5c14b1959ab1722ad895570c1793b350db4d3-json.log",
"Name": "/old-k8s-version-070145",
"RestartCount": 0,
"Driver": "overlay2",
"Platform": "linux",
"MountLabel": "",
"ProcessLabel": "",
"AppArmorProfile": "unconfined",
"ExecIDs": null,
"HostConfig": {
"Binds": [
"/lib/modules:/lib/modules:ro",
"old-k8s-version-070145:/var"
],
"ContainerIDFile": "",
"LogConfig": {
"Type": "json-file",
"Config": {}
},
"NetworkMode": "old-k8s-version-070145",
"PortBindings": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
]
},
"RestartPolicy": {
"Name": "no",
"MaximumRetryCount": 0
},
"AutoRemove": false,
"VolumeDriver": "",
"VolumesFrom": null,
"ConsoleSize": [
0,
0
],
"CapAdd": null,
"CapDrop": null,
"CgroupnsMode": "host",
"Dns": [],
"DnsOptions": [],
"DnsSearch": [],
"ExtraHosts": null,
"GroupAdd": null,
"IpcMode": "private",
"Cgroup": "",
"Links": null,
"OomScoreAdj": 0,
"PidMode": "",
"Privileged": true,
"PublishAllPorts": false,
"ReadonlyRootfs": false,
"SecurityOpt": [
"seccomp=unconfined",
"apparmor=unconfined",
"label=disable"
],
"Tmpfs": {
"/run": "",
"/tmp": ""
},
"UTSMode": "",
"UsernsMode": "",
"ShmSize": 67108864,
"Runtime": "runc",
"Isolation": "",
"CpuShares": 0,
"Memory": 2306867200,
"NanoCpus": 2000000000,
"CgroupParent": "",
"BlkioWeight": 0,
"BlkioWeightDevice": [],
"BlkioDeviceReadBps": [],
"BlkioDeviceWriteBps": [],
"BlkioDeviceReadIOps": [],
"BlkioDeviceWriteIOps": [],
"CpuPeriod": 0,
"CpuQuota": 0,
"CpuRealtimePeriod": 0,
"CpuRealtimeRuntime": 0,
"CpusetCpus": "",
"CpusetMems": "",
"Devices": [],
"DeviceCgroupRules": null,
"DeviceRequests": null,
"MemoryReservation": 0,
"MemorySwap": 4613734400,
"MemorySwappiness": null,
"OomKillDisable": false,
"PidsLimit": null,
"Ulimits": [],
"CpuCount": 0,
"CpuPercent": 0,
"IOMaximumIOps": 0,
"IOMaximumBandwidth": 0,
"MaskedPaths": null,
"ReadonlyPaths": null
},
"GraphDriver": {
"Data": {
"LowerDir": "/var/lib/docker/overlay2/44820a06763716b579fa2e82a7d86f92c4b59f0db07d68827bb731dc1cb14469-init/diff:/var/lib/docker/overlay2/361ff7146c1f8f9f5c07c69a78aa76c291e59293e7654dd235648b6a877bb54d/diff",
"MergedDir": "/var/lib/docker/overlay2/44820a06763716b579fa2e82a7d86f92c4b59f0db07d68827bb731dc1cb14469/merged",
"UpperDir": "/var/lib/docker/overlay2/44820a06763716b579fa2e82a7d86f92c4b59f0db07d68827bb731dc1cb14469/diff",
"WorkDir": "/var/lib/docker/overlay2/44820a06763716b579fa2e82a7d86f92c4b59f0db07d68827bb731dc1cb14469/work"
},
"Name": "overlay2"
},
"Mounts": [
{
"Type": "bind",
"Source": "/lib/modules",
"Destination": "/lib/modules",
"Mode": "ro",
"RW": false,
"Propagation": "rprivate"
},
{
"Type": "volume",
"Name": "old-k8s-version-070145",
"Source": "/var/lib/docker/volumes/old-k8s-version-070145/_data",
"Destination": "/var",
"Driver": "local",
"Mode": "z",
"RW": true,
"Propagation": ""
}
],
"Config": {
"Hostname": "old-k8s-version-070145",
"Domainname": "",
"User": "",
"AttachStdin": false,
"AttachStdout": false,
"AttachStderr": false,
"ExposedPorts": {
"22/tcp": {},
"2376/tcp": {},
"32443/tcp": {},
"5000/tcp": {},
"8443/tcp": {}
},
"Tty": true,
"OpenStdin": false,
"StdinOnce": false,
"Env": [
"container=docker",
"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
],
"Cmd": null,
"Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08",
"Volumes": null,
"WorkingDir": "/",
"Entrypoint": [
"/usr/local/bin/entrypoint",
"/sbin/init"
],
"OnBuild": null,
"Labels": {
"created_by.minikube.sigs.k8s.io": "true",
"mode.minikube.sigs.k8s.io": "old-k8s-version-070145",
"name.minikube.sigs.k8s.io": "old-k8s-version-070145",
"role.minikube.sigs.k8s.io": ""
},
"StopSignal": "SIGRTMIN+3"
},
"NetworkSettings": {
"Bridge": "",
"SandboxID": "169942820b5672ed9c7c7f40efcb95f7b7a68fb2ec1852cbf28d9a291580c306",
"SandboxKey": "/var/run/docker/netns/169942820b56",
"Ports": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "34038"
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "34037"
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "34034"
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "34036"
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "34035"
}
]
},
"HairpinMode": false,
"LinkLocalIPv6Address": "",
"LinkLocalIPv6PrefixLen": 0,
"SecondaryIPAddresses": null,
"SecondaryIPv6Addresses": null,
"EndpointID": "",
"Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"IPAddress": "",
"IPPrefixLen": 0,
"IPv6Gateway": "",
"MacAddress": "",
"Networks": {
"old-k8s-version-070145": {
"IPAMConfig": {
"IPv4Address": "192.168.76.2"
},
"Links": null,
"Aliases": [
"c2b58f15dac7",
"old-k8s-version-070145"
],
"MacAddress": "02:42:c0:a8:4c:02",
"NetworkID": "930f8d5ae0b9630ca65148854dfdf42bccc33d0bc60375b23b7bbfb10f5b87f5",
"EndpointID": "ec927d4701e3362cbb250a35168c104c0cb7dc1dc7ba515ae9d8e9322fd72be5",
"Gateway": "192.168.76.1",
"IPAddress": "192.168.76.2",
"IPPrefixLen": 24,
"IPv6Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"DriverOpts": null,
"DNSNames": [
"old-k8s-version-070145",
"c2b58f15dac7"
]
}
}
}
}
]
-- /stdout --
helpers_test.go:239: (dbg) Run: out/minikube-linux-arm64 status --format={{.Host}} -p old-k8s-version-070145 -n old-k8s-version-070145
helpers_test.go:244: <<< TestStartStop/group/old-k8s-version/serial/SecondStart FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: minikube logs <======
helpers_test.go:247: (dbg) Run: out/minikube-linux-arm64 -p old-k8s-version-070145 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-arm64 -p old-k8s-version-070145 logs -n 25: (2.744536438s)
helpers_test.go:252: TestStartStop/group/old-k8s-version/serial/SecondStart logs:
-- stdout --
==> Audit <==
|---------|--------------------------------------------------------|--------------------------|---------|---------|---------------------|---------------------|
| Command | Args | Profile | User | Version | Start Time | End Time |
|---------|--------------------------------------------------------|--------------------------|---------|---------|---------------------|---------------------|
| start | -p cert-expiration-442518 | cert-expiration-442518 | jenkins | v1.32.0 | 11 Mar 24 13:30 UTC | 11 Mar 24 13:31 UTC |
| | --memory=2048 | | | | | |
| | --cert-expiration=3m | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| ssh | force-systemd-env-445766 | force-systemd-env-445766 | jenkins | v1.32.0 | 11 Mar 24 13:31 UTC | 11 Mar 24 13:31 UTC |
| | ssh cat | | | | | |
| | /etc/containerd/config.toml | | | | | |
| delete | -p force-systemd-env-445766 | force-systemd-env-445766 | jenkins | v1.32.0 | 11 Mar 24 13:31 UTC | 11 Mar 24 13:31 UTC |
| start | -p cert-options-508405 | cert-options-508405 | jenkins | v1.32.0 | 11 Mar 24 13:31 UTC | 11 Mar 24 13:31 UTC |
| | --memory=2048 | | | | | |
| | --apiserver-ips=127.0.0.1 | | | | | |
| | --apiserver-ips=192.168.15.15 | | | | | |
| | --apiserver-names=localhost | | | | | |
| | --apiserver-names=www.google.com | | | | | |
| | --apiserver-port=8555 | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| ssh | cert-options-508405 ssh | cert-options-508405 | jenkins | v1.32.0 | 11 Mar 24 13:31 UTC | 11 Mar 24 13:31 UTC |
| | openssl x509 -text -noout -in | | | | | |
| | /var/lib/minikube/certs/apiserver.crt | | | | | |
| ssh | -p cert-options-508405 -- sudo | cert-options-508405 | jenkins | v1.32.0 | 11 Mar 24 13:31 UTC | 11 Mar 24 13:31 UTC |
| | cat /etc/kubernetes/admin.conf | | | | | |
| delete | -p cert-options-508405 | cert-options-508405 | jenkins | v1.32.0 | 11 Mar 24 13:31 UTC | 11 Mar 24 13:31 UTC |
| start | -p old-k8s-version-070145 | old-k8s-version-070145 | jenkins | v1.32.0 | 11 Mar 24 13:31 UTC | 11 Mar 24 13:34 UTC |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --kvm-network=default | | | | | |
| | --kvm-qemu-uri=qemu:///system | | | | | |
| | --disable-driver-mounts | | | | | |
| | --keep-context=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --kubernetes-version=v1.20.0 | | | | | |
| start | -p cert-expiration-442518 | cert-expiration-442518 | jenkins | v1.32.0 | 11 Mar 24 13:34 UTC | 11 Mar 24 13:34 UTC |
| | --memory=2048 | | | | | |
| | --cert-expiration=8760h | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| delete | -p cert-expiration-442518 | cert-expiration-442518 | jenkins | v1.32.0 | 11 Mar 24 13:34 UTC | 11 Mar 24 13:34 UTC |
| start | -p no-preload-740029 | no-preload-740029 | jenkins | v1.32.0 | 11 Mar 24 13:34 UTC | 11 Mar 24 13:35 UTC |
| | --memory=2200 --alsologtostderr | | | | | |
| | --wait=true --preload=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --kubernetes-version=v1.29.0-rc.2 | | | | | |
| addons | enable metrics-server -p old-k8s-version-070145 | old-k8s-version-070145 | jenkins | v1.32.0 | 11 Mar 24 13:34 UTC | 11 Mar 24 13:34 UTC |
| | --images=MetricsServer=registry.k8s.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| stop | -p old-k8s-version-070145 | old-k8s-version-070145 | jenkins | v1.32.0 | 11 Mar 24 13:34 UTC | 11 Mar 24 13:35 UTC |
| | --alsologtostderr -v=3 | | | | | |
| addons | enable dashboard -p old-k8s-version-070145 | old-k8s-version-070145 | jenkins | v1.32.0 | 11 Mar 24 13:35 UTC | 11 Mar 24 13:35 UTC |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| start | -p old-k8s-version-070145 | old-k8s-version-070145 | jenkins | v1.32.0 | 11 Mar 24 13:35 UTC | |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --kvm-network=default | | | | | |
| | --kvm-qemu-uri=qemu:///system | | | | | |
| | --disable-driver-mounts | | | | | |
| | --keep-context=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --kubernetes-version=v1.20.0 | | | | | |
| addons | enable metrics-server -p no-preload-740029 | no-preload-740029 | jenkins | v1.32.0 | 11 Mar 24 13:35 UTC | 11 Mar 24 13:35 UTC |
| | --images=MetricsServer=registry.k8s.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| stop | -p no-preload-740029 | no-preload-740029 | jenkins | v1.32.0 | 11 Mar 24 13:35 UTC | 11 Mar 24 13:36 UTC |
| | --alsologtostderr -v=3 | | | | | |
| addons | enable dashboard -p no-preload-740029 | no-preload-740029 | jenkins | v1.32.0 | 11 Mar 24 13:36 UTC | 11 Mar 24 13:36 UTC |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| start | -p no-preload-740029 | no-preload-740029 | jenkins | v1.32.0 | 11 Mar 24 13:36 UTC | 11 Mar 24 13:40 UTC |
| | --memory=2200 --alsologtostderr | | | | | |
| | --wait=true --preload=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --kubernetes-version=v1.29.0-rc.2 | | | | | |
| image | no-preload-740029 image list | no-preload-740029 | jenkins | v1.32.0 | 11 Mar 24 13:41 UTC | 11 Mar 24 13:41 UTC |
| | --format=json | | | | | |
| pause | -p no-preload-740029 | no-preload-740029 | jenkins | v1.32.0 | 11 Mar 24 13:41 UTC | 11 Mar 24 13:41 UTC |
| | --alsologtostderr -v=1 | | | | | |
| unpause | -p no-preload-740029 | no-preload-740029 | jenkins | v1.32.0 | 11 Mar 24 13:41 UTC | 11 Mar 24 13:41 UTC |
| | --alsologtostderr -v=1 | | | | | |
| delete | -p no-preload-740029 | no-preload-740029 | jenkins | v1.32.0 | 11 Mar 24 13:41 UTC | 11 Mar 24 13:41 UTC |
| delete | -p no-preload-740029 | no-preload-740029 | jenkins | v1.32.0 | 11 Mar 24 13:41 UTC | 11 Mar 24 13:41 UTC |
| start | -p embed-certs-810824 | embed-certs-810824 | jenkins | v1.32.0 | 11 Mar 24 13:41 UTC | |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --embed-certs --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --kubernetes-version=v1.28.4 | | | | | |
|---------|--------------------------------------------------------|--------------------------|---------|---------|---------------------|---------------------|
==> Last Start <==
Log file created at: 2024/03/11 13:41:16
Running on machine: ip-172-31-31-251
Binary: Built with gc go1.22.0 for linux/arm64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I0311 13:41:16.166837 954940 out.go:291] Setting OutFile to fd 1 ...
I0311 13:41:16.167067 954940 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0311 13:41:16.167077 954940 out.go:304] Setting ErrFile to fd 2...
I0311 13:41:16.167082 954940 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0311 13:41:16.167309 954940 root.go:338] Updating PATH: /home/jenkins/minikube-integration/18350-741028/.minikube/bin
I0311 13:41:16.167746 954940 out.go:298] Setting JSON to false
I0311 13:41:16.168736 954940 start.go:129] hostinfo: {"hostname":"ip-172-31-31-251","uptime":19421,"bootTime":1710145056,"procs":215,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1055-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"982e3628-3742-4b3e-bb63-ac1b07660ec7"}
I0311 13:41:16.168861 954940 start.go:139] virtualization:
I0311 13:41:16.171462 954940 out.go:177] * [embed-certs-810824] minikube v1.32.0 on Ubuntu 20.04 (arm64)
I0311 13:41:16.173936 954940 out.go:177] - MINIKUBE_LOCATION=18350
I0311 13:41:16.175702 954940 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0311 13:41:16.174049 954940 notify.go:220] Checking for updates...
I0311 13:41:16.179283 954940 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/18350-741028/kubeconfig
I0311 13:41:16.181601 954940 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/18350-741028/.minikube
I0311 13:41:16.183539 954940 out.go:177] - MINIKUBE_BIN=out/minikube-linux-arm64
I0311 13:41:16.185616 954940 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0311 13:41:16.188720 954940 config.go:182] Loaded profile config "old-k8s-version-070145": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0
I0311 13:41:16.188857 954940 driver.go:392] Setting default libvirt URI to qemu:///system
I0311 13:41:16.210093 954940 docker.go:122] docker version: linux-25.0.4:Docker Engine - Community
I0311 13:41:16.210203 954940 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0311 13:41:16.276978 954940 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:32 OomKillDisable:true NGoroutines:56 SystemTime:2024-03-11 13:41:16.267194749 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1055-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215035904 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:25.0.4 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:ae07eda36dd25f8a1b98dfbf587313b99c0190bb Expected:ae07eda36dd25f8a1b98dfbf587313b99c0190bb} RuncCommit:{ID:v1.1.12-0-g51d5e94 Expected:v1.1.12-0-g51d5e94} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.13.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.24.7]] Warnings:<nil>}}
I0311 13:41:16.277090 954940 docker.go:295] overlay module found
I0311 13:41:16.279091 954940 out.go:177] * Using the docker driver based on user configuration
I0311 13:41:16.280999 954940 start.go:297] selected driver: docker
I0311 13:41:16.281018 954940 start.go:901] validating driver "docker" against <nil>
I0311 13:41:16.281052 954940 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0311 13:41:16.281685 954940 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0311 13:41:16.336205 954940 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:32 OomKillDisable:true NGoroutines:56 SystemTime:2024-03-11 13:41:16.326031327 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1055-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215035904 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:25.0.4 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:ae07eda36dd25f8a1b98dfbf587313b99c0190bb Expected:ae07eda36dd25f8a1b98dfbf587313b99c0190bb} RuncCommit:{ID:v1.1.12-0-g51d5e94 Expected:v1.1.12-0-g51d5e94} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.13.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.24.7]] Warnings:<nil>}}
I0311 13:41:16.336369 954940 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0311 13:41:16.336594 954940 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0311 13:41:16.338455 954940 out.go:177] * Using Docker driver with root privileges
I0311 13:41:16.340259 954940 cni.go:84] Creating CNI manager for ""
I0311 13:41:16.340280 954940 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0311 13:41:16.340291 954940 start_flags.go:319] Found "CNI" CNI - setting NetworkPlugin=cni
I0311 13:41:16.340402 954940 start.go:340] cluster config:
{Name:embed-certs-810824 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:embed-certs-810824 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Contain
erRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: Stati
cIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0311 13:41:16.342525 954940 out.go:177] * Starting "embed-certs-810824" primary control-plane node in "embed-certs-810824" cluster
I0311 13:41:16.344148 954940 cache.go:121] Beginning downloading kic base image for docker with containerd
I0311 13:41:16.346155 954940 out.go:177] * Pulling base image v0.0.42-1708944392-18244 ...
I0311 13:41:16.347874 954940 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime containerd
I0311 13:41:16.347924 954940 preload.go:147] Found local preload: /home/jenkins/minikube-integration/18350-741028/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-containerd-overlay2-arm64.tar.lz4
I0311 13:41:16.347947 954940 cache.go:56] Caching tarball of preloaded images
I0311 13:41:16.348037 954940 preload.go:173] Found /home/jenkins/minikube-integration/18350-741028/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-containerd-overlay2-arm64.tar.lz4 in cache, skipping download
I0311 13:41:16.348052 954940 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on containerd
I0311 13:41:16.348160 954940 profile.go:142] Saving config to /home/jenkins/minikube-integration/18350-741028/.minikube/profiles/embed-certs-810824/config.json ...
I0311 13:41:16.348190 954940 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18350-741028/.minikube/profiles/embed-certs-810824/config.json: {Name:mk327b6c081f5c215f8a51c34b97fbf9957e350c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0311 13:41:16.348288 954940 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 in local docker daemon
I0311 13:41:16.365523 954940 image.go:83] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 in local docker daemon, skipping pull
I0311 13:41:16.365551 954940 cache.go:144] gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 exists in daemon, skipping load
I0311 13:41:16.365566 954940 cache.go:194] Successfully downloaded all kic artifacts
I0311 13:41:16.365594 954940 start.go:360] acquireMachinesLock for embed-certs-810824: {Name:mk5e2e2ff648c4dd68f8367eedc78d81e84033d6 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0311 13:41:16.366195 954940 start.go:364] duration metric: took 575.946µs to acquireMachinesLock for "embed-certs-810824"
I0311 13:41:16.366230 954940 start.go:93] Provisioning new machine with config: &{Name:embed-certs-810824 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:embed-certs-810824 Namespace:default APIServerHAVIP: APIServe
rName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableM
etrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:containerd ControlPlane:true Worker:true}
I0311 13:41:16.366333 954940 start.go:125] createHost starting for "" (driver="docker")
I0311 13:41:12.600012 944071 logs.go:123] Gathering logs for kube-apiserver [2db70787e2d49fdecd9bc02d04c1eb56827c3d542198aabfd91e6440e7bdedfb] ...
I0311 13:41:12.600048 944071 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 2db70787e2d49fdecd9bc02d04c1eb56827c3d542198aabfd91e6440e7bdedfb"
I0311 13:41:12.718027 944071 logs.go:123] Gathering logs for coredns [6f6759a5fa53b61d59a4eb3efed14f78f772e070b07ebae287535c7bd97f6ac7] ...
I0311 13:41:12.718060 944071 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 6f6759a5fa53b61d59a4eb3efed14f78f772e070b07ebae287535c7bd97f6ac7"
I0311 13:41:12.792099 944071 out.go:304] Setting ErrFile to fd 2...
I0311 13:41:12.792123 944071 out.go:338] TERM=,COLORTERM=, which probably does not support color
W0311 13:41:12.792182 944071 out.go:239] X Problems detected in kubelet:
W0311 13:41:12.792192 944071 out.go:239] Mar 11 13:40:39 old-k8s-version-070145 kubelet[664]: E0311 13:40:39.915140 664 pod_workers.go:191] Error syncing pod cd398c70-ed6f-4abf-9b68-5612dc691d46 ("dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"
W0311 13:41:12.792198 944071 out.go:239] Mar 11 13:40:50 old-k8s-version-070145 kubelet[664]: E0311 13:40:50.915444 664 pod_workers.go:191] Error syncing pod 97a60e3d-c157-4827-82c5-590c454ae52c ("metrics-server-9975d5f86-fjvd8_kube-system(97a60e3d-c157-4827-82c5-590c454ae52c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0311 13:41:12.792302 944071 out.go:239] Mar 11 13:40:53 old-k8s-version-070145 kubelet[664]: E0311 13:40:53.915252 664 pod_workers.go:191] Error syncing pod cd398c70-ed6f-4abf-9b68-5612dc691d46 ("dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"
W0311 13:41:12.792311 944071 out.go:239] Mar 11 13:41:04 old-k8s-version-070145 kubelet[664]: E0311 13:41:04.935691 664 pod_workers.go:191] Error syncing pod 97a60e3d-c157-4827-82c5-590c454ae52c ("metrics-server-9975d5f86-fjvd8_kube-system(97a60e3d-c157-4827-82c5-590c454ae52c)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0311 13:41:12.792319 944071 out.go:239] Mar 11 13:41:07 old-k8s-version-070145 kubelet[664]: E0311 13:41:07.915147 664 pod_workers.go:191] Error syncing pod cd398c70-ed6f-4abf-9b68-5612dc691d46 ("dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"
I0311 13:41:12.792326 944071 out.go:304] Setting ErrFile to fd 2...
I0311 13:41:12.792340 944071 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0311 13:41:16.368944 954940 out.go:204] * Creating docker container (CPUs=2, Memory=2200MB) ...
I0311 13:41:16.369196 954940 start.go:159] libmachine.API.Create for "embed-certs-810824" (driver="docker")
I0311 13:41:16.369245 954940 client.go:168] LocalClient.Create starting
I0311 13:41:16.369333 954940 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/18350-741028/.minikube/certs/ca.pem
I0311 13:41:16.369373 954940 main.go:141] libmachine: Decoding PEM data...
I0311 13:41:16.369389 954940 main.go:141] libmachine: Parsing certificate...
I0311 13:41:16.369452 954940 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/18350-741028/.minikube/certs/cert.pem
I0311 13:41:16.369476 954940 main.go:141] libmachine: Decoding PEM data...
I0311 13:41:16.369489 954940 main.go:141] libmachine: Parsing certificate...
I0311 13:41:16.369866 954940 cli_runner.go:164] Run: docker network inspect embed-certs-810824 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
W0311 13:41:16.384897 954940 cli_runner.go:211] docker network inspect embed-certs-810824 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
I0311 13:41:16.384994 954940 network_create.go:281] running [docker network inspect embed-certs-810824] to gather additional debugging logs...
I0311 13:41:16.385021 954940 cli_runner.go:164] Run: docker network inspect embed-certs-810824
W0311 13:41:16.400001 954940 cli_runner.go:211] docker network inspect embed-certs-810824 returned with exit code 1
I0311 13:41:16.400057 954940 network_create.go:284] error running [docker network inspect embed-certs-810824]: docker network inspect embed-certs-810824: exit status 1
stdout:
[]
stderr:
Error response from daemon: network embed-certs-810824 not found
I0311 13:41:16.400071 954940 network_create.go:286] output of [docker network inspect embed-certs-810824]: -- stdout --
[]
-- /stdout --
** stderr **
Error response from daemon: network embed-certs-810824 not found
** /stderr **
I0311 13:41:16.400167 954940 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0311 13:41:16.417362 954940 network.go:211] skipping subnet 192.168.49.0/24 that is taken: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName:br-7a016e0cbfe3 IfaceIPv4:192.168.49.1 IfaceMTU:1500 IfaceMAC:02:42:23:1a:bb:a6} reservation:<nil>}
I0311 13:41:16.417804 954940 network.go:211] skipping subnet 192.168.58.0/24 that is taken: &{IP:192.168.58.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.58.0/24 Gateway:192.168.58.1 ClientMin:192.168.58.2 ClientMax:192.168.58.254 Broadcast:192.168.58.255 IsPrivate:true Interface:{IfaceName:br-86d71c327011 IfaceIPv4:192.168.58.1 IfaceMTU:1500 IfaceMAC:02:42:a7:43:00:21} reservation:<nil>}
I0311 13:41:16.418231 954940 network.go:211] skipping subnet 192.168.67.0/24 that is taken: &{IP:192.168.67.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.67.0/24 Gateway:192.168.67.1 ClientMin:192.168.67.2 ClientMax:192.168.67.254 Broadcast:192.168.67.255 IsPrivate:true Interface:{IfaceName:br-29847169e5e9 IfaceIPv4:192.168.67.1 IfaceMTU:1500 IfaceMAC:02:42:19:81:84:86} reservation:<nil>}
I0311 13:41:16.418581 954940 network.go:211] skipping subnet 192.168.76.0/24 that is taken: &{IP:192.168.76.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.76.0/24 Gateway:192.168.76.1 ClientMin:192.168.76.2 ClientMax:192.168.76.254 Broadcast:192.168.76.255 IsPrivate:true Interface:{IfaceName:br-930f8d5ae0b9 IfaceIPv4:192.168.76.1 IfaceMTU:1500 IfaceMAC:02:42:f9:97:db:d1} reservation:<nil>}
I0311 13:41:16.419218 954940 network.go:206] using free private subnet 192.168.85.0/24: &{IP:192.168.85.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.85.0/24 Gateway:192.168.85.1 ClientMin:192.168.85.2 ClientMax:192.168.85.254 Broadcast:192.168.85.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0x40025911d0}
I0311 13:41:16.419259 954940 network_create.go:124] attempt to create docker network embed-certs-810824 192.168.85.0/24 with gateway 192.168.85.1 and MTU of 1500 ...
I0311 13:41:16.419355 954940 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.85.0/24 --gateway=192.168.85.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=embed-certs-810824 embed-certs-810824
I0311 13:41:16.482882 954940 network_create.go:108] docker network embed-certs-810824 192.168.85.0/24 created
I0311 13:41:16.482918 954940 kic.go:121] calculated static IP "192.168.85.2" for the "embed-certs-810824" container
I0311 13:41:16.483021 954940 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
I0311 13:41:16.503458 954940 cli_runner.go:164] Run: docker volume create embed-certs-810824 --label name.minikube.sigs.k8s.io=embed-certs-810824 --label created_by.minikube.sigs.k8s.io=true
I0311 13:41:16.523793 954940 oci.go:103] Successfully created a docker volume embed-certs-810824
I0311 13:41:16.523877 954940 cli_runner.go:164] Run: docker run --rm --name embed-certs-810824-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=embed-certs-810824 --entrypoint /usr/bin/test -v embed-certs-810824:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 -d /var/lib
I0311 13:41:17.179764 954940 oci.go:107] Successfully prepared a docker volume embed-certs-810824
I0311 13:41:17.179831 954940 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime containerd
I0311 13:41:17.179855 954940 kic.go:194] Starting extracting preloaded images to volume ...
I0311 13:41:17.179945 954940 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/18350-741028/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-containerd-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v embed-certs-810824:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 -I lz4 -xf /preloaded.tar -C /extractDir
I0311 13:41:22.793384 944071 api_server.go:253] Checking apiserver healthz at https://192.168.76.2:8443/healthz ...
I0311 13:41:22.808295 944071 api_server.go:279] https://192.168.76.2:8443/healthz returned 200:
ok
I0311 13:41:22.811005 944071 out.go:177]
W0311 13:41:22.812825 944071 out.go:239] X Exiting due to K8S_UNHEALTHY_CONTROL_PLANE: wait 6m0s for node: wait for healthy API server: controlPlane never updated to v1.20.0
W0311 13:41:22.812862 944071 out.go:239] * Suggestion: Control Plane could not update, try minikube delete --all --purge
W0311 13:41:22.812880 944071 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/11417
W0311 13:41:22.812886 944071 out.go:239] *
W0311 13:41:22.814440 944071 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0311 13:41:22.816345 944071 out.go:177]
==> container status <==
CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID POD
6159094736fcf 523cad1a4df73 2 minutes ago Exited dashboard-metrics-scraper 5 418e6754ee6be dashboard-metrics-scraper-8d5bb5db8-trflx
91683919c3a68 ba04bb24b9575 5 minutes ago Running storage-provisioner 3 cef72cd2d1288 storage-provisioner
bc98146e508c7 20b332c9a70d8 5 minutes ago Running kubernetes-dashboard 0 1aa8f11770948 kubernetes-dashboard-cd95d586-zhrbn
1b76f78246021 db91994f4ee8f 5 minutes ago Running coredns 1 27e58de389838 coredns-74ff55c5b-4c948
881db81636d17 4740c1948d3fc 5 minutes ago Running kindnet-cni 1 68bcc03722002 kindnet-2ptss
1046f75cb6d0b 25a5233254979 5 minutes ago Running kube-proxy 1 30e2ed4a67120 kube-proxy-6vcch
bc6ec28f9d79f 1611cd07b61d5 5 minutes ago Running busybox 1 61b6101c93a3f busybox
96c1af2a12c5a ba04bb24b9575 5 minutes ago Exited storage-provisioner 2 cef72cd2d1288 storage-provisioner
3d91f57195c2a 05b738aa1bc63 6 minutes ago Running etcd 1 3c3270ff5d797 etcd-old-k8s-version-070145
39152e7d8a961 e7605f88f17d6 6 minutes ago Running kube-scheduler 1 d14d0e4d93067 kube-scheduler-old-k8s-version-070145
2db70787e2d49 2c08bbbc02d3a 6 minutes ago Running kube-apiserver 1 bc8f6d2a0c32f kube-apiserver-old-k8s-version-070145
bc4f384ce5455 1df8a2b116bd1 6 minutes ago Running kube-controller-manager 1 856ddb14e3fb8 kube-controller-manager-old-k8s-version-070145
72f46a3f79d14 1611cd07b61d5 6 minutes ago Exited busybox 0 6f70a280df3bf busybox
6f6759a5fa53b db91994f4ee8f 8 minutes ago Exited coredns 0 b33bb4bc7d5e7 coredns-74ff55c5b-4c948
8334568a27c35 25a5233254979 8 minutes ago Exited kube-proxy 0 4d40a7380b157 kube-proxy-6vcch
ee7a5ecb39413 4740c1948d3fc 8 minutes ago Exited kindnet-cni 0 ec13f86f7071c kindnet-2ptss
2a8386dbbc357 1df8a2b116bd1 9 minutes ago Exited kube-controller-manager 0 b48d10c3cb039 kube-controller-manager-old-k8s-version-070145
18ba14631e222 e7605f88f17d6 9 minutes ago Exited kube-scheduler 0 21ad0d8daae22 kube-scheduler-old-k8s-version-070145
5ce8ca658a489 05b738aa1bc63 9 minutes ago Exited etcd 0 f1073c3d966d5 etcd-old-k8s-version-070145
1efd3d3c6b431 2c08bbbc02d3a 9 minutes ago Exited kube-apiserver 0 f2da1085267d3 kube-apiserver-old-k8s-version-070145
==> containerd <==
Mar 11 13:37:22 old-k8s-version-070145 containerd[569]: time="2024-03-11T13:37:22.941929473Z" level=info msg="CreateContainer within sandbox \"418e6754ee6beffa95e01505a0a1d90b5225ce2ba9bff9d700f08a15f2da3f7d\" for &ContainerMetadata{Name:dashboard-metrics-scraper,Attempt:4,} returns container id \"c775ba6e2d78ed50442f20a29d4c6c2aec402b4eda7b85fb4f56831df4a52bfc\""
Mar 11 13:37:22 old-k8s-version-070145 containerd[569]: time="2024-03-11T13:37:22.942983421Z" level=info msg="StartContainer for \"c775ba6e2d78ed50442f20a29d4c6c2aec402b4eda7b85fb4f56831df4a52bfc\""
Mar 11 13:37:23 old-k8s-version-070145 containerd[569]: time="2024-03-11T13:37:23.010849570Z" level=info msg="StartContainer for \"c775ba6e2d78ed50442f20a29d4c6c2aec402b4eda7b85fb4f56831df4a52bfc\" returns successfully"
Mar 11 13:37:23 old-k8s-version-070145 containerd[569]: time="2024-03-11T13:37:23.071068116Z" level=info msg="shim disconnected" id=c775ba6e2d78ed50442f20a29d4c6c2aec402b4eda7b85fb4f56831df4a52bfc
Mar 11 13:37:23 old-k8s-version-070145 containerd[569]: time="2024-03-11T13:37:23.071368667Z" level=warning msg="cleaning up after shim disconnected" id=c775ba6e2d78ed50442f20a29d4c6c2aec402b4eda7b85fb4f56831df4a52bfc namespace=k8s.io
Mar 11 13:37:23 old-k8s-version-070145 containerd[569]: time="2024-03-11T13:37:23.071493884Z" level=info msg="cleaning up dead shim"
Mar 11 13:37:23 old-k8s-version-070145 containerd[569]: time="2024-03-11T13:37:23.081135095Z" level=warning msg="cleanup warnings time=\"2024-03-11T13:37:23Z\" level=info msg=\"starting signal loop\" namespace=k8s.io pid=2953 runtime=io.containerd.runc.v2\n"
Mar 11 13:37:23 old-k8s-version-070145 containerd[569]: time="2024-03-11T13:37:23.534618059Z" level=info msg="RemoveContainer for \"a3d779f141731561ccfb72b7b43ef91de46a3a518a70907b68ae2c8963d66834\""
Mar 11 13:37:23 old-k8s-version-070145 containerd[569]: time="2024-03-11T13:37:23.546337308Z" level=info msg="RemoveContainer for \"a3d779f141731561ccfb72b7b43ef91de46a3a518a70907b68ae2c8963d66834\" returns successfully"
Mar 11 13:38:23 old-k8s-version-070145 containerd[569]: time="2024-03-11T13:38:23.916032692Z" level=info msg="PullImage \"fake.domain/registry.k8s.io/echoserver:1.4\""
Mar 11 13:38:23 old-k8s-version-070145 containerd[569]: time="2024-03-11T13:38:23.921325906Z" level=info msg="trying next host" error="failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host" host=fake.domain
Mar 11 13:38:23 old-k8s-version-070145 containerd[569]: time="2024-03-11T13:38:23.922873561Z" level=error msg="PullImage \"fake.domain/registry.k8s.io/echoserver:1.4\" failed" error="failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
Mar 11 13:38:53 old-k8s-version-070145 containerd[569]: time="2024-03-11T13:38:53.917166188Z" level=info msg="CreateContainer within sandbox \"418e6754ee6beffa95e01505a0a1d90b5225ce2ba9bff9d700f08a15f2da3f7d\" for container &ContainerMetadata{Name:dashboard-metrics-scraper,Attempt:5,}"
Mar 11 13:38:53 old-k8s-version-070145 containerd[569]: time="2024-03-11T13:38:53.932993130Z" level=info msg="CreateContainer within sandbox \"418e6754ee6beffa95e01505a0a1d90b5225ce2ba9bff9d700f08a15f2da3f7d\" for &ContainerMetadata{Name:dashboard-metrics-scraper,Attempt:5,} returns container id \"6159094736fcfb1fe1c55f422706a16266ba9ff346982d996c31508dc0cca2c7\""
Mar 11 13:38:53 old-k8s-version-070145 containerd[569]: time="2024-03-11T13:38:53.933678589Z" level=info msg="StartContainer for \"6159094736fcfb1fe1c55f422706a16266ba9ff346982d996c31508dc0cca2c7\""
Mar 11 13:38:54 old-k8s-version-070145 containerd[569]: time="2024-03-11T13:38:54.003504990Z" level=info msg="StartContainer for \"6159094736fcfb1fe1c55f422706a16266ba9ff346982d996c31508dc0cca2c7\" returns successfully"
Mar 11 13:38:54 old-k8s-version-070145 containerd[569]: time="2024-03-11T13:38:54.035640512Z" level=info msg="shim disconnected" id=6159094736fcfb1fe1c55f422706a16266ba9ff346982d996c31508dc0cca2c7
Mar 11 13:38:54 old-k8s-version-070145 containerd[569]: time="2024-03-11T13:38:54.035705398Z" level=warning msg="cleaning up after shim disconnected" id=6159094736fcfb1fe1c55f422706a16266ba9ff346982d996c31508dc0cca2c7 namespace=k8s.io
Mar 11 13:38:54 old-k8s-version-070145 containerd[569]: time="2024-03-11T13:38:54.035717032Z" level=info msg="cleaning up dead shim"
Mar 11 13:38:54 old-k8s-version-070145 containerd[569]: time="2024-03-11T13:38:54.052673779Z" level=warning msg="cleanup warnings time=\"2024-03-11T13:38:54Z\" level=info msg=\"starting signal loop\" namespace=k8s.io pid=3208 runtime=io.containerd.runc.v2\ntime=\"2024-03-11T13:38:54Z\" level=warning msg=\"failed to remove runc container\" error=\"runc did not terminate successfully: exit status 255: \" runtime=io.containerd.runc.v2\n"
Mar 11 13:38:54 old-k8s-version-070145 containerd[569]: time="2024-03-11T13:38:54.719955443Z" level=info msg="RemoveContainer for \"c775ba6e2d78ed50442f20a29d4c6c2aec402b4eda7b85fb4f56831df4a52bfc\""
Mar 11 13:38:54 old-k8s-version-070145 containerd[569]: time="2024-03-11T13:38:54.727474550Z" level=info msg="RemoveContainer for \"c775ba6e2d78ed50442f20a29d4c6c2aec402b4eda7b85fb4f56831df4a52bfc\" returns successfully"
Mar 11 13:41:04 old-k8s-version-070145 containerd[569]: time="2024-03-11T13:41:04.916282219Z" level=info msg="PullImage \"fake.domain/registry.k8s.io/echoserver:1.4\""
Mar 11 13:41:04 old-k8s-version-070145 containerd[569]: time="2024-03-11T13:41:04.933034141Z" level=info msg="trying next host" error="failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host" host=fake.domain
Mar 11 13:41:04 old-k8s-version-070145 containerd[569]: time="2024-03-11T13:41:04.934688954Z" level=error msg="PullImage \"fake.domain/registry.k8s.io/echoserver:1.4\" failed" error="failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
==> coredns [1b76f78246021579cf21e4531ff3eab7085e6d1e7d053d08b44e0d6140571ec1] <==
.:53
[INFO] plugin/reload: Running configuration MD5 = b494d968e357ba1b925cee838fbd78ed
CoreDNS-1.7.0
linux/arm64, go1.14.4, f59c03d
[INFO] 127.0.0.1:60428 - 49663 "HINFO IN 8284826612343937346.2595708993875510566. udp 57 false 512" NXDOMAIN qr,rd,ra 57 0.013097117s
==> coredns [6f6759a5fa53b61d59a4eb3efed14f78f772e070b07ebae287535c7bd97f6ac7] <==
.:53
[INFO] plugin/reload: Running configuration MD5 = b494d968e357ba1b925cee838fbd78ed
CoreDNS-1.7.0
linux/arm64, go1.14.4, f59c03d
[INFO] 127.0.0.1:43949 - 28500 "HINFO IN 1335326925369388077.7612004195877892919. udp 57 false 512" NXDOMAIN qr,rd,ra 57 0.022431119s
==> describe nodes <==
Name: old-k8s-version-070145
Roles: control-plane,master
Labels: beta.kubernetes.io/arch=arm64
beta.kubernetes.io/os=linux
kubernetes.io/arch=arm64
kubernetes.io/hostname=old-k8s-version-070145
kubernetes.io/os=linux
minikube.k8s.io/commit=1f02234404c3608d31811fa9c1f2f7d976b3e563
minikube.k8s.io/name=old-k8s-version-070145
minikube.k8s.io/primary=true
minikube.k8s.io/updated_at=2024_03_11T13_32_26_0700
minikube.k8s.io/version=v1.32.0
node-role.kubernetes.io/control-plane=
node-role.kubernetes.io/master=
Annotations: kubeadm.alpha.kubernetes.io/cri-socket: /run/containerd/containerd.sock
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Mon, 11 Mar 2024 13:32:23 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: old-k8s-version-070145
AcquireTime: <unset>
RenewTime: Mon, 11 Mar 2024 13:41:22 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Mon, 11 Mar 2024 13:41:22 +0000 Mon, 11 Mar 2024 13:32:17 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Mon, 11 Mar 2024 13:41:22 +0000 Mon, 11 Mar 2024 13:32:17 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Mon, 11 Mar 2024 13:41:22 +0000 Mon, 11 Mar 2024 13:32:17 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Mon, 11 Mar 2024 13:41:22 +0000 Mon, 11 Mar 2024 13:32:41 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.76.2
Hostname: old-k8s-version-070145
Capacity:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022496Ki
pods: 110
Allocatable:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022496Ki
pods: 110
System Info:
Machine ID: b40dd697a6a04c12a5c813bffb5e562b
System UUID: 6a772993-19db-4a68-88ee-31a8447783c9
Boot ID: 26506771-5b0e-4b52-8e79-b1a5a7798867
Kernel Version: 5.15.0-1055-aws
OS Image: Ubuntu 22.04.3 LTS
Operating System: linux
Architecture: arm64
Container Runtime Version: containerd://1.6.28
Kubelet Version: v1.20.0
Kube-Proxy Version: v1.20.0
PodCIDR: 10.244.0.0/24
PodCIDRs: 10.244.0.0/24
Non-terminated Pods: (12 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits AGE
--------- ---- ------------ ---------- --------------- ------------- ---
default busybox 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 6m47s
kube-system coredns-74ff55c5b-4c948 100m (5%!)(MISSING) 0 (0%!)(MISSING) 70Mi (0%!)(MISSING) 170Mi (2%!)(MISSING) 8m44s
kube-system etcd-old-k8s-version-070145 100m (5%!)(MISSING) 0 (0%!)(MISSING) 100Mi (1%!)(MISSING) 0 (0%!)(MISSING) 8m51s
kube-system kindnet-2ptss 100m (5%!)(MISSING) 100m (5%!)(MISSING) 50Mi (0%!)(MISSING) 50Mi (0%!)(MISSING) 8m44s
kube-system kube-apiserver-old-k8s-version-070145 250m (12%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 8m50s
kube-system kube-controller-manager-old-k8s-version-070145 200m (10%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 8m50s
kube-system kube-proxy-6vcch 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 8m44s
kube-system kube-scheduler-old-k8s-version-070145 100m (5%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 8m50s
kube-system metrics-server-9975d5f86-fjvd8 100m (5%!)(MISSING) 0 (0%!)(MISSING) 200Mi (2%!)(MISSING) 0 (0%!)(MISSING) 6m36s
kube-system storage-provisioner 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 8m43s
kubernetes-dashboard dashboard-metrics-scraper-8d5bb5db8-trflx 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 5m38s
kubernetes-dashboard kubernetes-dashboard-cd95d586-zhrbn 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 5m38s
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 950m (47%!)(MISSING) 100m (5%!)(MISSING)
memory 420Mi (5%!)(MISSING) 220Mi (2%!)(MISSING)
ephemeral-storage 100Mi (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-1Gi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-2Mi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-32Mi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-64Ki 0 (0%!)(MISSING) 0 (0%!)(MISSING)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Starting 9m10s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 9m10s (x2 over 9m10s) kubelet Node old-k8s-version-070145 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 9m10s (x2 over 9m10s) kubelet Node old-k8s-version-070145 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 9m10s (x2 over 9m10s) kubelet Node old-k8s-version-070145 status is now: NodeHasSufficientPID
Normal NodeAllocatableEnforced 9m10s kubelet Updated Node Allocatable limit across pods
Normal Starting 8m51s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 8m51s kubelet Node old-k8s-version-070145 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 8m51s kubelet Node old-k8s-version-070145 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 8m51s kubelet Node old-k8s-version-070145 status is now: NodeHasSufficientPID
Normal NodeAllocatableEnforced 8m51s kubelet Updated Node Allocatable limit across pods
Normal NodeReady 8m44s kubelet Node old-k8s-version-070145 status is now: NodeReady
Normal Starting 8m42s kube-proxy Starting kube-proxy.
Normal Starting 6m7s kubelet Starting kubelet.
Normal NodeAllocatableEnforced 6m7s kubelet Updated Node Allocatable limit across pods
Normal NodeHasSufficientMemory 6m6s (x8 over 6m7s) kubelet Node old-k8s-version-070145 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 6m6s (x8 over 6m7s) kubelet Node old-k8s-version-070145 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 6m6s (x7 over 6m7s) kubelet Node old-k8s-version-070145 status is now: NodeHasSufficientPID
Normal Starting 5m54s kube-proxy Starting kube-proxy.
==> dmesg <==
[ +0.001227] FS-Cache: O-key=[8] '5c3e5c0100000000'
[ +0.000741] FS-Cache: N-cookie c=00000042 [p=00000039 fl=2 nc=0 na=1]
[ +0.000979] FS-Cache: N-cookie d=00000000174c94b3{9p.inode} n=00000000769f7abe
[ +0.001119] FS-Cache: N-key=[8] '5c3e5c0100000000'
[ +0.002760] FS-Cache: Duplicate cookie detected
[ +0.000795] FS-Cache: O-cookie c=0000003c [p=00000039 fl=226 nc=0 na=1]
[ +0.001147] FS-Cache: O-cookie d=00000000174c94b3{9p.inode} n=000000006cb1d8c4
[ +0.001125] FS-Cache: O-key=[8] '5c3e5c0100000000'
[ +0.000746] FS-Cache: N-cookie c=00000043 [p=00000039 fl=2 nc=0 na=1]
[ +0.000987] FS-Cache: N-cookie d=00000000174c94b3{9p.inode} n=00000000849aab82
[ +0.001155] FS-Cache: N-key=[8] '5c3e5c0100000000'
[ +2.618490] FS-Cache: Duplicate cookie detected
[ +0.000786] FS-Cache: O-cookie c=0000003a [p=00000039 fl=226 nc=0 na=1]
[ +0.001189] FS-Cache: O-cookie d=00000000174c94b3{9p.inode} n=0000000051073a19
[ +0.001122] FS-Cache: O-key=[8] '5b3e5c0100000000'
[ +0.000741] FS-Cache: N-cookie c=00000045 [p=00000039 fl=2 nc=0 na=1]
[ +0.001577] FS-Cache: N-cookie d=00000000174c94b3{9p.inode} n=00000000769f7abe
[ +0.001521] FS-Cache: N-key=[8] '5b3e5c0100000000'
[ +0.435282] FS-Cache: Duplicate cookie detected
[ +0.000826] FS-Cache: O-cookie c=0000003f [p=00000039 fl=226 nc=0 na=1]
[ +0.000994] FS-Cache: O-cookie d=00000000174c94b3{9p.inode} n=000000002de20fa9
[ +0.001111] FS-Cache: O-key=[8] '613e5c0100000000'
[ +0.000833] FS-Cache: N-cookie c=00000046 [p=00000039 fl=2 nc=0 na=1]
[ +0.000996] FS-Cache: N-cookie d=00000000174c94b3{9p.inode} n=00000000bc2d205d
[ +0.001142] FS-Cache: N-key=[8] '613e5c0100000000'
==> etcd [3d91f57195c2a3301694e12ef5429b5c4533a1555f186d0710618b7b852d2760] <==
2024-03-11 13:37:16.983742 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-11 13:37:26.983655 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-11 13:37:36.983968 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-11 13:37:46.983728 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-11 13:37:56.983877 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-11 13:38:06.983881 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-11 13:38:16.984058 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-11 13:38:26.983793 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-11 13:38:36.983690 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-11 13:38:46.983976 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-11 13:38:56.983844 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-11 13:39:06.983901 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-11 13:39:16.983745 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-11 13:39:26.983683 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-11 13:39:36.983739 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-11 13:39:46.983891 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-11 13:39:56.983884 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-11 13:40:06.983839 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-11 13:40:16.983996 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-11 13:40:26.983868 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-11 13:40:36.983882 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-11 13:40:46.983758 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-11 13:40:56.984346 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-11 13:41:06.983725 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-11 13:41:16.983802 I | etcdserver/api/etcdhttp: /health OK (status code 200)
==> etcd [5ce8ca658a489eed2dbd049d4848b82cf2f879b98316ff0a5e0f9b0ff9f2962e] <==
raft2024/03/11 13:32:17 INFO: ea7e25599daad906 received MsgVoteResp from ea7e25599daad906 at term 2
raft2024/03/11 13:32:17 INFO: ea7e25599daad906 became leader at term 2
raft2024/03/11 13:32:17 INFO: raft.node: ea7e25599daad906 elected leader ea7e25599daad906 at term 2
2024-03-11 13:32:17.247787 I | etcdserver: setting up the initial cluster version to 3.4
2024-03-11 13:32:17.249201 N | etcdserver/membership: set the initial cluster version to 3.4
2024-03-11 13:32:17.249398 I | etcdserver/api: enabled capabilities for version 3.4
2024-03-11 13:32:17.249491 I | etcdserver: published {Name:old-k8s-version-070145 ClientURLs:[https://192.168.76.2:2379]} to cluster 6f20f2c4b2fb5f8a
2024-03-11 13:32:17.249732 I | embed: ready to serve client requests
2024-03-11 13:32:17.251329 I | embed: serving client requests on 192.168.76.2:2379
2024-03-11 13:32:17.260345 I | embed: ready to serve client requests
2024-03-11 13:32:17.287385 I | embed: serving client requests on 127.0.0.1:2379
2024-03-11 13:32:43.231642 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-11 13:32:44.184218 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-11 13:32:54.184519 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-11 13:33:04.184494 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-11 13:33:14.184490 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-11 13:33:24.184382 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-11 13:33:34.184497 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-11 13:33:44.184320 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-11 13:33:54.184477 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-11 13:34:04.184558 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-11 13:34:14.184378 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-11 13:34:24.184529 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-11 13:34:34.186790 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-03-11 13:34:44.184388 I | etcdserver/api/etcdhttp: /health OK (status code 200)
==> kernel <==
13:41:25 up 5:23, 0 users, load average: 2.00, 1.91, 2.46
Linux old-k8s-version-070145 5.15.0-1055-aws #60~20.04.1-Ubuntu SMP Thu Feb 22 15:54:21 UTC 2024 aarch64 aarch64 aarch64 GNU/Linux
PRETTY_NAME="Ubuntu 22.04.3 LTS"
==> kindnet [881db81636d17f287bdf2f1d72f8fbfef4724f8214d5f3b4d8d55fa6f7cce1c1] <==
I0311 13:39:22.893476 1 main.go:227] handling current node
I0311 13:39:32.902793 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0311 13:39:32.902821 1 main.go:227] handling current node
I0311 13:39:42.926400 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0311 13:39:42.926428 1 main.go:227] handling current node
I0311 13:39:52.939205 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0311 13:39:52.939231 1 main.go:227] handling current node
I0311 13:40:02.954392 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0311 13:40:02.954419 1 main.go:227] handling current node
I0311 13:40:12.970713 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0311 13:40:12.970748 1 main.go:227] handling current node
I0311 13:40:22.983897 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0311 13:40:22.983924 1 main.go:227] handling current node
I0311 13:40:32.991352 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0311 13:40:32.991381 1 main.go:227] handling current node
I0311 13:40:43.006855 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0311 13:40:43.006886 1 main.go:227] handling current node
I0311 13:40:53.011446 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0311 13:40:53.011478 1 main.go:227] handling current node
I0311 13:41:03.027174 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0311 13:41:03.027206 1 main.go:227] handling current node
I0311 13:41:13.049688 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0311 13:41:13.049722 1 main.go:227] handling current node
I0311 13:41:23.063613 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0311 13:41:23.063647 1 main.go:227] handling current node
==> kindnet [ee7a5ecb39413c27e23ab32527a89da9064b17f58353410a2e96d56978c5b575] <==
podIP = 192.168.76.2
I0311 13:32:42.825398 1 main.go:116] setting mtu 1500 for CNI
I0311 13:32:42.825412 1 main.go:146] kindnetd IP family: "ipv4"
I0311 13:32:42.825423 1 main.go:150] noMask IPv4 subnets: [10.244.0.0/16]
I0311 13:33:13.055404 1 main.go:191] Failed to get nodes, retrying after error: Get "https://10.96.0.1:443/api/v1/nodes": dial tcp 10.96.0.1:443: i/o timeout
I0311 13:33:13.073993 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0311 13:33:13.074029 1 main.go:227] handling current node
I0311 13:33:23.080995 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0311 13:33:23.081026 1 main.go:227] handling current node
I0311 13:33:33.102602 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0311 13:33:33.102634 1 main.go:227] handling current node
I0311 13:33:43.115591 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0311 13:33:43.115620 1 main.go:227] handling current node
I0311 13:33:53.138067 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0311 13:33:53.138734 1 main.go:227] handling current node
I0311 13:34:03.162051 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0311 13:34:03.162081 1 main.go:227] handling current node
I0311 13:34:13.174839 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0311 13:34:13.174868 1 main.go:227] handling current node
I0311 13:34:23.200967 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0311 13:34:23.201143 1 main.go:227] handling current node
I0311 13:34:33.226722 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0311 13:34:33.230075 1 main.go:227] handling current node
I0311 13:34:43.255513 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0311 13:34:43.256178 1 main.go:227] handling current node
==> kube-apiserver [1efd3d3c6b431a8f6d76e245d3ec7ab63c30f2b096c264acd026c38d4878a67f] <==
I0311 13:32:23.945539 1 storage_scheduling.go:132] created PriorityClass system-cluster-critical with value 2000000000
I0311 13:32:23.945754 1 storage_scheduling.go:148] all system priority classes are created successfully or already exist.
I0311 13:32:24.499852 1 controller.go:606] quota admission added evaluator for: roles.rbac.authorization.k8s.io
I0311 13:32:24.545447 1 controller.go:606] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io
W0311 13:32:24.645226 1 lease.go:233] Resetting endpoints for master service "kubernetes" to [192.168.76.2]
I0311 13:32:24.646583 1 controller.go:606] quota admission added evaluator for: endpoints
I0311 13:32:24.651479 1 controller.go:606] quota admission added evaluator for: endpointslices.discovery.k8s.io
I0311 13:32:25.564247 1 controller.go:606] quota admission added evaluator for: serviceaccounts
I0311 13:32:26.091911 1 controller.go:606] quota admission added evaluator for: deployments.apps
I0311 13:32:26.140099 1 controller.go:606] quota admission added evaluator for: daemonsets.apps
I0311 13:32:34.658358 1 controller.go:606] quota admission added evaluator for: leases.coordination.k8s.io
I0311 13:32:41.591248 1 controller.go:606] quota admission added evaluator for: replicasets.apps
I0311 13:32:41.790591 1 controller.go:606] quota admission added evaluator for: controllerrevisions.apps
I0311 13:32:58.614128 1 client.go:360] parsed scheme: "passthrough"
I0311 13:32:58.614357 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0311 13:32:58.614373 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0311 13:33:37.722849 1 client.go:360] parsed scheme: "passthrough"
I0311 13:33:37.722891 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0311 13:33:37.722900 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0311 13:34:11.883006 1 client.go:360] parsed scheme: "passthrough"
I0311 13:34:11.883077 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0311 13:34:11.883087 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0311 13:34:45.236117 1 client.go:360] parsed scheme: "passthrough"
I0311 13:34:45.236173 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0311 13:34:45.236183 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
==> kube-apiserver [2db70787e2d49fdecd9bc02d04c1eb56827c3d542198aabfd91e6440e7bdedfb] <==
I0311 13:37:36.554226 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0311 13:37:36.554263 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0311 13:38:21.089424 1 client.go:360] parsed scheme: "passthrough"
I0311 13:38:21.089880 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0311 13:38:21.089914 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
W0311 13:38:32.391011 1 handler_proxy.go:102] no RequestInfo found in the context
E0311 13:38:32.391252 1 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I0311 13:38:32.391268 1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
I0311 13:39:05.003258 1 client.go:360] parsed scheme: "passthrough"
I0311 13:39:05.003339 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0311 13:39:05.003350 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0311 13:39:48.998420 1 client.go:360] parsed scheme: "passthrough"
I0311 13:39:48.998548 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0311 13:39:48.998560 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0311 13:40:27.948415 1 client.go:360] parsed scheme: "passthrough"
I0311 13:40:27.948461 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0311 13:40:27.948470 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
W0311 13:40:30.577419 1 handler_proxy.go:102] no RequestInfo found in the context
E0311 13:40:30.577615 1 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I0311 13:40:30.577633 1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
I0311 13:41:12.177408 1 client.go:360] parsed scheme: "passthrough"
I0311 13:41:12.177455 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0311 13:41:12.177463 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
==> kube-controller-manager [2a8386dbbc357521701b6779041b13f7ac23bf6efa6e4648879ae34ab9456918] <==
I0311 13:32:41.648133 1 event.go:291] "Event occurred" object="old-k8s-version-070145" kind="Node" apiVersion="v1" type="Normal" reason="RegisteredNode" message="Node old-k8s-version-070145 event: Registered Node old-k8s-version-070145 in Controller"
I0311 13:32:41.656855 1 shared_informer.go:247] Caches are synced for TTL
I0311 13:32:41.675110 1 shared_informer.go:247] Caches are synced for node
I0311 13:32:41.675406 1 range_allocator.go:172] Starting range CIDR allocator
I0311 13:32:41.676289 1 shared_informer.go:240] Waiting for caches to sync for cidrallocator
I0311 13:32:41.676400 1 shared_informer.go:247] Caches are synced for cidrallocator
I0311 13:32:41.685684 1 shared_informer.go:247] Caches are synced for persistent volume
I0311 13:32:41.694171 1 shared_informer.go:247] Caches are synced for daemon sets
I0311 13:32:41.725796 1 shared_informer.go:247] Caches are synced for attach detach
I0311 13:32:41.727629 1 shared_informer.go:247] Caches are synced for GC
I0311 13:32:41.734237 1 event.go:291] "Event occurred" object="kube-system/coredns-74ff55c5b" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-74ff55c5b-4c948"
I0311 13:32:41.779938 1 range_allocator.go:373] Set node old-k8s-version-070145 PodCIDR to [10.244.0.0/24]
I0311 13:32:41.848401 1 shared_informer.go:247] Caches are synced for resource quota
I0311 13:32:41.869328 1 shared_informer.go:247] Caches are synced for resource quota
I0311 13:32:41.932010 1 shared_informer.go:240] Waiting for caches to sync for garbage collector
I0311 13:32:41.978157 1 event.go:291] "Event occurred" object="kube-system/kube-proxy" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kube-proxy-6vcch"
I0311 13:32:42.004134 1 event.go:291] "Event occurred" object="kube-system/kindnet" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kindnet-2ptss"
E0311 13:32:42.061061 1 daemon_controller.go:320] kube-system/kindnet failed with : error storing status for daemon set &v1.DaemonSet{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"kindnet", GenerateName:"", Namespace:"kube-system", SelfLink:"", UID:"c3e1eb0c-f6b8-4108-9bdc-a3583c9763dc", ResourceVersion:"280", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63845760746, loc:(*time.Location)(0x632eb80)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"app":"kindnet", "k8s-app":"kindnet", "tier":"node"}, Annotations:map[string]string{"deprecated.daemonset.template.generation":"1", "kubectl.kubernetes.io/last-applied-configuration":"{\"apiVersion\":\"apps/v1\",\"kind\":\"DaemonSet\",\"metadata\":{\"annotations\":{},\"labels\":{\"app\":\"kindnet\",\"k8s-app\":\"kindnet\",\"tier\":\"node\"},\"name\":\"kindnet\",\"namespace\":\"kube-system\"},\"spec\":{\"selector\":{\"matchLabels\":{\"app\":\"k
indnet\"}},\"template\":{\"metadata\":{\"labels\":{\"app\":\"kindnet\",\"k8s-app\":\"kindnet\",\"tier\":\"node\"}},\"spec\":{\"containers\":[{\"env\":[{\"name\":\"HOST_IP\",\"valueFrom\":{\"fieldRef\":{\"fieldPath\":\"status.hostIP\"}}},{\"name\":\"POD_IP\",\"valueFrom\":{\"fieldRef\":{\"fieldPath\":\"status.podIP\"}}},{\"name\":\"POD_SUBNET\",\"value\":\"10.244.0.0/16\"}],\"image\":\"docker.io/kindest/kindnetd:v20240202-8f1494ea\",\"name\":\"kindnet-cni\",\"resources\":{\"limits\":{\"cpu\":\"100m\",\"memory\":\"50Mi\"},\"requests\":{\"cpu\":\"100m\",\"memory\":\"50Mi\"}},\"securityContext\":{\"capabilities\":{\"add\":[\"NET_RAW\",\"NET_ADMIN\"]},\"privileged\":false},\"volumeMounts\":[{\"mountPath\":\"/etc/cni/net.d\",\"name\":\"cni-cfg\"},{\"mountPath\":\"/run/xtables.lock\",\"name\":\"xtables-lock\",\"readOnly\":false},{\"mountPath\":\"/lib/modules\",\"name\":\"lib-modules\",\"readOnly\":true}]}],\"hostNetwork\":true,\"serviceAccountName\":\"kindnet\",\"tolerations\":[{\"effect\":\"NoSchedule\",\"operator\
":\"Exists\"}],\"volumes\":[{\"hostPath\":{\"path\":\"/etc/cni/net.d\",\"type\":\"DirectoryOrCreate\"},\"name\":\"cni-cfg\"},{\"hostPath\":{\"path\":\"/run/xtables.lock\",\"type\":\"FileOrCreate\"},\"name\":\"xtables-lock\"},{\"hostPath\":{\"path\":\"/lib/modules\"},\"name\":\"lib-modules\"}]}}}}\n"}, OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry{v1.ManagedFieldsEntry{Manager:"kubectl-client-side-apply", Operation:"Update", APIVersion:"apps/v1", Time:(*v1.Time)(0x40017a6f40), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0x40017a6f60)}}}, Spec:v1.DaemonSetSpec{Selector:(*v1.LabelSelector)(0x40017a6f80), Template:v1.PodTemplateSpec{ObjectMeta:v1.ObjectMeta{Name:"", GenerateName:"", Namespace:"", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string
{"app":"kindnet", "k8s-app":"kindnet", "tier":"node"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v1.PodSpec{Volumes:[]v1.Volume{v1.Volume{Name:"cni-cfg", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0x40017a6fa0), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil),
FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}, v1.Volume{Name:"xtables-lock", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0x40017a6fc0), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.Glust
erfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}, v1.Volume{Name:"lib-modules", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0x40017a6fe0), EmptyDi
r:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil),
PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}}, InitContainers:[]v1.Container(nil), Containers:[]v1.Container{v1.Container{Name:"kindnet-cni", Image:"docker.io/kindest/kindnetd:v20240202-8f1494ea", Command:[]string(nil), Args:[]string(nil), WorkingDir:"", Ports:[]v1.ContainerPort(nil), EnvFrom:[]v1.EnvFromSource(nil), Env:[]v1.EnvVar{v1.EnvVar{Name:"HOST_IP", Value:"", ValueFrom:(*v1.EnvVarSource)(0x40017a7000)}, v1.EnvVar{Name:"POD_IP", Value:"", ValueFrom:(*v1.EnvVarSource)(0x40017a7040)}, v1.EnvVar{Name:"POD_SUBNET", Value:"10.244.0.0/16", ValueFrom:(*v1.EnvVarSource)(nil)}}, Resources:v1.ResourceRequirements{Limits:v1.ResourceList{"cpu":resource.Quantity{i:resource.int64Amount{value:100, scale:-3}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"100m", Format:"DecimalSI"}, "memory":resource.Quantity{i:resource.int64Amount{value:52428800, scale:
0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"50Mi", Format:"BinarySI"}}, Requests:v1.ResourceList{"cpu":resource.Quantity{i:resource.int64Amount{value:100, scale:-3}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"100m", Format:"DecimalSI"}, "memory":resource.Quantity{i:resource.int64Amount{value:52428800, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"50Mi", Format:"BinarySI"}}}, VolumeMounts:[]v1.VolumeMount{v1.VolumeMount{Name:"cni-cfg", ReadOnly:false, MountPath:"/etc/cni/net.d", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"xtables-lock", ReadOnly:false, MountPath:"/run/xtables.lock", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"lib-modules", ReadOnly:true, MountPath:"/lib/modules", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}}, VolumeDevices:[]v1.VolumeDevice(nil), LivenessProbe:(*v1.Probe)(nil), ReadinessProbe:(*v1.Probe)(nil), StartupProbe:
(*v1.Probe)(nil), Lifecycle:(*v1.Lifecycle)(nil), TerminationMessagePath:"/dev/termination-log", TerminationMessagePolicy:"File", ImagePullPolicy:"IfNotPresent", SecurityContext:(*v1.SecurityContext)(0x400161e9c0), Stdin:false, StdinOnce:false, TTY:false}}, EphemeralContainers:[]v1.EphemeralContainer(nil), RestartPolicy:"Always", TerminationGracePeriodSeconds:(*int64)(0x400104cd58), ActiveDeadlineSeconds:(*int64)(nil), DNSPolicy:"ClusterFirst", NodeSelector:map[string]string(nil), ServiceAccountName:"kindnet", DeprecatedServiceAccount:"kindnet", AutomountServiceAccountToken:(*bool)(nil), NodeName:"", HostNetwork:true, HostPID:false, HostIPC:false, ShareProcessNamespace:(*bool)(nil), SecurityContext:(*v1.PodSecurityContext)(0x40001c15e0), ImagePullSecrets:[]v1.LocalObjectReference(nil), Hostname:"", Subdomain:"", Affinity:(*v1.Affinity)(nil), SchedulerName:"default-scheduler", Tolerations:[]v1.Toleration{v1.Toleration{Key:"", Operator:"Exists", Value:"", Effect:"NoSchedule", TolerationSeconds:(*int64)(nil)}},
HostAliases:[]v1.HostAlias(nil), PriorityClassName:"", Priority:(*int32)(nil), DNSConfig:(*v1.PodDNSConfig)(nil), ReadinessGates:[]v1.PodReadinessGate(nil), RuntimeClassName:(*string)(nil), EnableServiceLinks:(*bool)(nil), PreemptionPolicy:(*v1.PreemptionPolicy)(nil), Overhead:v1.ResourceList(nil), TopologySpreadConstraints:[]v1.TopologySpreadConstraint(nil), SetHostnameAsFQDN:(*bool)(nil)}}, UpdateStrategy:v1.DaemonSetUpdateStrategy{Type:"RollingUpdate", RollingUpdate:(*v1.RollingUpdateDaemonSet)(0x400000ff68)}, MinReadySeconds:0, RevisionHistoryLimit:(*int32)(0x400104cda0)}, Status:v1.DaemonSetStatus{CurrentNumberScheduled:0, NumberMisscheduled:0, DesiredNumberScheduled:0, NumberReady:0, ObservedGeneration:0, UpdatedNumberScheduled:0, NumberAvailable:0, NumberUnavailable:0, CollisionCount:(*int32)(nil), Conditions:[]v1.DaemonSetCondition(nil)}}: Operation cannot be fulfilled on daemonsets.apps "kindnet": the object has been modified; please apply your changes to the latest version and try again
I0311 13:32:42.132240 1 shared_informer.go:247] Caches are synced for garbage collector
I0311 13:32:42.224352 1 shared_informer.go:247] Caches are synced for garbage collector
I0311 13:32:42.224380 1 garbagecollector.go:151] Garbage collector: all resource monitors have synced. Proceeding to collect garbage
I0311 13:32:43.131317 1 event.go:291] "Event occurred" object="kube-system/coredns" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled down replica set coredns-74ff55c5b to 1"
I0311 13:32:43.169411 1 event.go:291] "Event occurred" object="kube-system/coredns-74ff55c5b" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulDelete" message="Deleted pod: coredns-74ff55c5b-7t849"
I0311 13:32:46.644257 1 node_lifecycle_controller.go:1222] Controller detected that some Nodes are Ready. Exiting master disruption mode.
I0311 13:34:48.725027 1 event.go:291] "Event occurred" object="kube-system/metrics-server" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set metrics-server-9975d5f86 to 1"
==> kube-controller-manager [bc4f384ce5455f87e2277b85ac8603215e4769c7db6b809c8d6638746a8f0f79] <==
E0311 13:37:19.570676 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0311 13:37:27.127948 1 request.go:655] Throttling request took 1.048374088s, request: GET:https://192.168.76.2:8443/apis/apiextensions.k8s.io/v1beta1?timeout=32s
W0311 13:37:27.979487 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0311 13:37:50.072607 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0311 13:37:59.630172 1 request.go:655] Throttling request took 1.048113255s, request: GET:https://192.168.76.2:8443/apis/networking.k8s.io/v1beta1?timeout=32s
W0311 13:38:00.563639 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0311 13:38:20.574448 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0311 13:38:32.214042 1 request.go:655] Throttling request took 1.048195008s, request: GET:https://192.168.76.2:8443/apis/extensions/v1beta1?timeout=32s
W0311 13:38:33.065707 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0311 13:38:51.076373 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0311 13:39:04.716264 1 request.go:655] Throttling request took 1.048300433s, request: GET:https://192.168.76.2:8443/apis/coordination.k8s.io/v1beta1?timeout=32s
W0311 13:39:05.567766 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0311 13:39:21.578342 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0311 13:39:37.218310 1 request.go:655] Throttling request took 1.047354569s, request: GET:https://192.168.76.2:8443/apis/authorization.k8s.io/v1?timeout=32s
W0311 13:39:38.070094 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0311 13:39:52.080452 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0311 13:40:09.720500 1 request.go:655] Throttling request took 1.048352601s, request: GET:https://192.168.76.2:8443/apis/extensions/v1beta1?timeout=32s
W0311 13:40:10.571917 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0311 13:40:22.590446 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0311 13:40:42.222393 1 request.go:655] Throttling request took 1.048457112s, request: GET:https://192.168.76.2:8443/apis/admissionregistration.k8s.io/v1beta1?timeout=32s
W0311 13:40:43.073672 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0311 13:40:53.092380 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0311 13:41:14.724131 1 request.go:655] Throttling request took 1.048426497s, request: GET:https://192.168.76.2:8443/apis/extensions/v1beta1?timeout=32s
W0311 13:41:15.575605 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0311 13:41:23.594450 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
==> kube-proxy [1046f75cb6d0bdb95e2b7da1e6dbd5108dd2cc257606b15059e8eec97867afb5] <==
I0311 13:35:31.829261 1 node.go:172] Successfully retrieved node IP: 192.168.76.2
I0311 13:35:31.829331 1 server_others.go:142] kube-proxy node IP is an IPv4 address (192.168.76.2), assume IPv4 operation
W0311 13:35:31.855423 1 server_others.go:578] Unknown proxy mode "", assuming iptables proxy
I0311 13:35:31.855698 1 server_others.go:185] Using iptables Proxier.
I0311 13:35:31.859649 1 server.go:650] Version: v1.20.0
I0311 13:35:31.863477 1 config.go:315] Starting service config controller
I0311 13:35:31.863492 1 shared_informer.go:240] Waiting for caches to sync for service config
I0311 13:35:31.863542 1 config.go:224] Starting endpoint slice config controller
I0311 13:35:31.863546 1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config
I0311 13:35:31.963673 1 shared_informer.go:247] Caches are synced for endpoint slice config
I0311 13:35:31.963673 1 shared_informer.go:247] Caches are synced for service config
==> kube-proxy [8334568a27c354d62138974eb15c381240354c69ff9cc3334aafb99945f69298] <==
I0311 13:32:43.372315 1 node.go:172] Successfully retrieved node IP: 192.168.76.2
I0311 13:32:43.372625 1 server_others.go:142] kube-proxy node IP is an IPv4 address (192.168.76.2), assume IPv4 operation
W0311 13:32:43.402743 1 server_others.go:578] Unknown proxy mode "", assuming iptables proxy
I0311 13:32:43.403073 1 server_others.go:185] Using iptables Proxier.
I0311 13:32:43.403641 1 server.go:650] Version: v1.20.0
I0311 13:32:43.404403 1 config.go:315] Starting service config controller
I0311 13:32:43.404468 1 shared_informer.go:240] Waiting for caches to sync for service config
I0311 13:32:43.404550 1 config.go:224] Starting endpoint slice config controller
I0311 13:32:43.404600 1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config
I0311 13:32:43.504673 1 shared_informer.go:247] Caches are synced for endpoint slice config
I0311 13:32:43.504770 1 shared_informer.go:247] Caches are synced for service config
==> kube-scheduler [18ba14631e2229013a95152ecc7bd700ff0dc021cd44274d5c5657ffb75ed347] <==
I0311 13:32:23.134682 1 configmap_cafile_content.go:202] Starting client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0311 13:32:23.134695 1 shared_informer.go:240] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0311 13:32:23.134710 1 tlsconfig.go:240] Starting DynamicServingCertificateController
E0311 13:32:23.145146 1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
E0311 13:32:23.169508 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1beta1.PodDisruptionBudget: failed to list *v1beta1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
E0311 13:32:23.169600 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
E0311 13:32:23.169710 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
E0311 13:32:23.169779 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
E0311 13:32:23.169833 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
E0311 13:32:23.169958 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
E0311 13:32:23.170071 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
E0311 13:32:23.170189 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
E0311 13:32:23.170277 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
E0311 13:32:23.170359 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
E0311 13:32:23.170446 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
E0311 13:32:24.030237 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
E0311 13:32:24.091929 1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
E0311 13:32:24.092538 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1beta1.PodDisruptionBudget: failed to list *v1beta1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
E0311 13:32:24.104979 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
E0311 13:32:24.112028 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
E0311 13:32:24.127421 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
E0311 13:32:24.228128 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
E0311 13:32:24.269986 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
E0311 13:32:24.283661 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
I0311 13:32:26.434837 1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
==> kube-scheduler [39152e7d8a96155b7cd9fa4c2075f12a084ad8469e78c5db3718c29114ccdec1] <==
I0311 13:35:22.780150 1 serving.go:331] Generated self-signed cert in-memory
W0311 13:35:29.339874 1 requestheader_controller.go:193] Unable to get configmap/extension-apiserver-authentication in kube-system. Usually fixed by 'kubectl create rolebinding -n kube-system ROLEBINDING_NAME --role=extension-apiserver-authentication-reader --serviceaccount=YOUR_NS:YOUR_SA'
W0311 13:35:29.340125 1 authentication.go:332] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"
W0311 13:35:29.340228 1 authentication.go:333] Continuing without authentication configuration. This may treat all requests as anonymous.
W0311 13:35:29.340305 1 authentication.go:334] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false
I0311 13:35:29.470863 1 secure_serving.go:197] Serving securely on 127.0.0.1:10259
I0311 13:35:29.471185 1 configmap_cafile_content.go:202] Starting client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0311 13:35:29.471309 1 shared_informer.go:240] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0311 13:35:29.471330 1 tlsconfig.go:240] Starting DynamicServingCertificateController
I0311 13:35:29.571353 1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
==> kubelet <==
Mar 11 13:39:48 old-k8s-version-070145 kubelet[664]: E0311 13:39:48.916029 664 pod_workers.go:191] Error syncing pod 97a60e3d-c157-4827-82c5-590c454ae52c ("metrics-server-9975d5f86-fjvd8_kube-system(97a60e3d-c157-4827-82c5-590c454ae52c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Mar 11 13:39:56 old-k8s-version-070145 kubelet[664]: I0311 13:39:56.915981 664 scope.go:95] [topologymanager] RemoveContainer - Container ID: 6159094736fcfb1fe1c55f422706a16266ba9ff346982d996c31508dc0cca2c7
Mar 11 13:39:56 old-k8s-version-070145 kubelet[664]: E0311 13:39:56.916329 664 pod_workers.go:191] Error syncing pod cd398c70-ed6f-4abf-9b68-5612dc691d46 ("dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"
Mar 11 13:39:59 old-k8s-version-070145 kubelet[664]: E0311 13:39:59.916223 664 pod_workers.go:191] Error syncing pod 97a60e3d-c157-4827-82c5-590c454ae52c ("metrics-server-9975d5f86-fjvd8_kube-system(97a60e3d-c157-4827-82c5-590c454ae52c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Mar 11 13:40:11 old-k8s-version-070145 kubelet[664]: I0311 13:40:11.914903 664 scope.go:95] [topologymanager] RemoveContainer - Container ID: 6159094736fcfb1fe1c55f422706a16266ba9ff346982d996c31508dc0cca2c7
Mar 11 13:40:11 old-k8s-version-070145 kubelet[664]: E0311 13:40:11.915247 664 pod_workers.go:191] Error syncing pod cd398c70-ed6f-4abf-9b68-5612dc691d46 ("dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"
Mar 11 13:40:11 old-k8s-version-070145 kubelet[664]: E0311 13:40:11.916186 664 pod_workers.go:191] Error syncing pod 97a60e3d-c157-4827-82c5-590c454ae52c ("metrics-server-9975d5f86-fjvd8_kube-system(97a60e3d-c157-4827-82c5-590c454ae52c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Mar 11 13:40:22 old-k8s-version-070145 kubelet[664]: E0311 13:40:22.921762 664 pod_workers.go:191] Error syncing pod 97a60e3d-c157-4827-82c5-590c454ae52c ("metrics-server-9975d5f86-fjvd8_kube-system(97a60e3d-c157-4827-82c5-590c454ae52c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Mar 11 13:40:26 old-k8s-version-070145 kubelet[664]: I0311 13:40:26.914944 664 scope.go:95] [topologymanager] RemoveContainer - Container ID: 6159094736fcfb1fe1c55f422706a16266ba9ff346982d996c31508dc0cca2c7
Mar 11 13:40:26 old-k8s-version-070145 kubelet[664]: E0311 13:40:26.915380 664 pod_workers.go:191] Error syncing pod cd398c70-ed6f-4abf-9b68-5612dc691d46 ("dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"
Mar 11 13:40:36 old-k8s-version-070145 kubelet[664]: E0311 13:40:36.915484 664 pod_workers.go:191] Error syncing pod 97a60e3d-c157-4827-82c5-590c454ae52c ("metrics-server-9975d5f86-fjvd8_kube-system(97a60e3d-c157-4827-82c5-590c454ae52c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Mar 11 13:40:39 old-k8s-version-070145 kubelet[664]: I0311 13:40:39.914791 664 scope.go:95] [topologymanager] RemoveContainer - Container ID: 6159094736fcfb1fe1c55f422706a16266ba9ff346982d996c31508dc0cca2c7
Mar 11 13:40:39 old-k8s-version-070145 kubelet[664]: E0311 13:40:39.915140 664 pod_workers.go:191] Error syncing pod cd398c70-ed6f-4abf-9b68-5612dc691d46 ("dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"
Mar 11 13:40:50 old-k8s-version-070145 kubelet[664]: E0311 13:40:50.915444 664 pod_workers.go:191] Error syncing pod 97a60e3d-c157-4827-82c5-590c454ae52c ("metrics-server-9975d5f86-fjvd8_kube-system(97a60e3d-c157-4827-82c5-590c454ae52c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Mar 11 13:40:53 old-k8s-version-070145 kubelet[664]: I0311 13:40:53.914833 664 scope.go:95] [topologymanager] RemoveContainer - Container ID: 6159094736fcfb1fe1c55f422706a16266ba9ff346982d996c31508dc0cca2c7
Mar 11 13:40:53 old-k8s-version-070145 kubelet[664]: E0311 13:40:53.915252 664 pod_workers.go:191] Error syncing pod cd398c70-ed6f-4abf-9b68-5612dc691d46 ("dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"
Mar 11 13:41:04 old-k8s-version-070145 kubelet[664]: E0311 13:41:04.934973 664 remote_image.go:113] PullImage "fake.domain/registry.k8s.io/echoserver:1.4" from image service failed: rpc error: code = Unknown desc = failed to pull and unpack image "fake.domain/registry.k8s.io/echoserver:1.4": failed to resolve reference "fake.domain/registry.k8s.io/echoserver:1.4": failed to do request: Head "https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host
Mar 11 13:41:04 old-k8s-version-070145 kubelet[664]: E0311 13:41:04.935405 664 kuberuntime_image.go:51] Pull image "fake.domain/registry.k8s.io/echoserver:1.4" failed: rpc error: code = Unknown desc = failed to pull and unpack image "fake.domain/registry.k8s.io/echoserver:1.4": failed to resolve reference "fake.domain/registry.k8s.io/echoserver:1.4": failed to do request: Head "https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host
Mar 11 13:41:04 old-k8s-version-070145 kubelet[664]: E0311 13:41:04.935646 664 kuberuntime_manager.go:829] container &Container{Name:metrics-server,Image:fake.domain/registry.k8s.io/echoserver:1.4,Command:[],Args:[--cert-dir=/tmp --secure-port=4443 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --kubelet-use-node-status-port --metric-resolution=60s --kubelet-insecure-tls],WorkingDir:,Ports:[]ContainerPort{ContainerPort{Name:https,HostPort:0,ContainerPort:4443,Protocol:TCP,HostIP:,},},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{cpu: {{100 -3} {<nil>} 100m DecimalSI},memory: {{209715200 0} {<nil>} BinarySI},},},VolumeMounts:[]VolumeMount{VolumeMount{Name:tmp-dir,ReadOnly:false,MountPath:/tmp,SubPath:,MountPropagation:nil,SubPathExpr:,},VolumeMount{Name:metrics-server-token-f2vrw,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:&Probe{Handler:Handler{Exec
:nil,HTTPGet:&HTTPGetAction{Path:/livez,Port:{1 0 https},Host:,Scheme:HTTPS,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,},InitialDelaySeconds:0,TimeoutSeconds:1,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,},ReadinessProbe:&Probe{Handler:Handler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/readyz,Port:{1 0 https},Host:,Scheme:HTTPS,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,},InitialDelaySeconds:0,TimeoutSeconds:1,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:*1000,RunAsNonRoot:*true,ReadOnlyRootFilesystem:*true,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,} start failed in pod metrics-server-9975d5f86-fjvd8_kube-system(97a60e3
d-c157-4827-82c5-590c454ae52c): ErrImagePull: rpc error: code = Unknown desc = failed to pull and unpack image "fake.domain/registry.k8s.io/echoserver:1.4": failed to resolve reference "fake.domain/registry.k8s.io/echoserver:1.4": failed to do request: Head "https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host
Mar 11 13:41:04 old-k8s-version-070145 kubelet[664]: E0311 13:41:04.935691 664 pod_workers.go:191] Error syncing pod 97a60e3d-c157-4827-82c5-590c454ae52c ("metrics-server-9975d5f86-fjvd8_kube-system(97a60e3d-c157-4827-82c5-590c454ae52c)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
Mar 11 13:41:07 old-k8s-version-070145 kubelet[664]: I0311 13:41:07.914808 664 scope.go:95] [topologymanager] RemoveContainer - Container ID: 6159094736fcfb1fe1c55f422706a16266ba9ff346982d996c31508dc0cca2c7
Mar 11 13:41:07 old-k8s-version-070145 kubelet[664]: E0311 13:41:07.915147 664 pod_workers.go:191] Error syncing pod cd398c70-ed6f-4abf-9b68-5612dc691d46 ("dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"
Mar 11 13:41:16 old-k8s-version-070145 kubelet[664]: E0311 13:41:16.917268 664 pod_workers.go:191] Error syncing pod 97a60e3d-c157-4827-82c5-590c454ae52c ("metrics-server-9975d5f86-fjvd8_kube-system(97a60e3d-c157-4827-82c5-590c454ae52c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Mar 11 13:41:19 old-k8s-version-070145 kubelet[664]: I0311 13:41:19.914771 664 scope.go:95] [topologymanager] RemoveContainer - Container ID: 6159094736fcfb1fe1c55f422706a16266ba9ff346982d996c31508dc0cca2c7
Mar 11 13:41:19 old-k8s-version-070145 kubelet[664]: E0311 13:41:19.915149 664 pod_workers.go:191] Error syncing pod cd398c70-ed6f-4abf-9b68-5612dc691d46 ("dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-trflx_kubernetes-dashboard(cd398c70-ed6f-4abf-9b68-5612dc691d46)"
==> kubernetes-dashboard [bc98146e508c71c02a0b452cdb210d18cca3ee22c41165cc797f9e83833c8ad9] <==
2024/03/11 13:35:52 Using namespace: kubernetes-dashboard
2024/03/11 13:35:52 Using in-cluster config to connect to apiserver
2024/03/11 13:35:52 Using secret token for csrf signing
2024/03/11 13:35:52 Initializing csrf token from kubernetes-dashboard-csrf secret
2024/03/11 13:35:52 Empty token. Generating and storing in a secret kubernetes-dashboard-csrf
2024/03/11 13:35:52 Successful initial request to the apiserver, version: v1.20.0
2024/03/11 13:35:52 Generating JWE encryption key
2024/03/11 13:35:52 New synchronizer has been registered: kubernetes-dashboard-key-holder-kubernetes-dashboard. Starting
2024/03/11 13:35:52 Starting secret synchronizer for kubernetes-dashboard-key-holder in namespace kubernetes-dashboard
2024/03/11 13:35:52 Initializing JWE encryption key from synchronized object
2024/03/11 13:35:52 Creating in-cluster Sidecar client
2024/03/11 13:35:52 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/03/11 13:35:52 Serving insecurely on HTTP port: 9090
2024/03/11 13:36:22 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/03/11 13:36:52 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/03/11 13:37:22 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/03/11 13:37:52 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/03/11 13:38:22 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/03/11 13:38:52 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/03/11 13:39:22 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/03/11 13:39:52 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/03/11 13:40:22 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/03/11 13:40:52 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/03/11 13:41:23 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/03/11 13:35:52 Starting overwatch
==> storage-provisioner [91683919c3a681de6a823dc15c85345c16650c12b9aa001e49a672a08b900503] <==
I0311 13:36:16.149871 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
I0311 13:36:16.170065 1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
I0311 13:36:16.170123 1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
I0311 13:36:33.657069 1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
I0311 13:36:33.657626 1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"b9be581c-2ea0-4e83-8265-182464cee089", APIVersion:"v1", ResourceVersion:"835", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' old-k8s-version-070145_560b4b64-5f42-4a6b-b516-b143d43b16ba became leader
I0311 13:36:33.658813 1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_old-k8s-version-070145_560b4b64-5f42-4a6b-b516-b143d43b16ba!
I0311 13:36:33.760093 1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_old-k8s-version-070145_560b4b64-5f42-4a6b-b516-b143d43b16ba!
==> storage-provisioner [96c1af2a12c5afb2a60e4b1487ac66e32236bd20e9cd7c3d75b01e38e1b0e6d2] <==
I0311 13:35:31.086836 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
F0311 13:36:01.094454 1 main.go:39] error getting server version: Get "https://10.96.0.1:443/version?timeout=32s": dial tcp 10.96.0.1:443: i/o timeout
-- /stdout --
helpers_test.go:254: (dbg) Run: out/minikube-linux-arm64 status --format={{.APIServer}} -p old-k8s-version-070145 -n old-k8s-version-070145
helpers_test.go:261: (dbg) Run: kubectl --context old-k8s-version-070145 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:272: non-running pods: metrics-server-9975d5f86-fjvd8
helpers_test.go:274: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: describe non-running pods <======
helpers_test.go:277: (dbg) Run: kubectl --context old-k8s-version-070145 describe pod metrics-server-9975d5f86-fjvd8
helpers_test.go:277: (dbg) Non-zero exit: kubectl --context old-k8s-version-070145 describe pod metrics-server-9975d5f86-fjvd8: exit status 1 (131.179283ms)
** stderr **
Error from server (NotFound): pods "metrics-server-9975d5f86-fjvd8" not found
** /stderr **
helpers_test.go:279: kubectl --context old-k8s-version-070145 describe pod metrics-server-9975d5f86-fjvd8: exit status 1
--- FAIL: TestStartStop/group/old-k8s-version/serial/SecondStart (385.27s)