=== RUN TestStartStop/group/old-k8s-version/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run: out/minikube-linux-arm64 start -p old-k8s-version-199824 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=containerd --kubernetes-version=v1.20.0
start_stop_delete_test.go:256: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p old-k8s-version-199824 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=containerd --kubernetes-version=v1.20.0: exit status 102 (6m18.564677937s)
-- stdout --
* [old-k8s-version-199824] minikube v1.33.1 on Ubuntu 20.04 (arm64)
- MINIKUBE_LOCATION=19302
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/19302-1169903/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/19302-1169903/.minikube
- MINIKUBE_BIN=out/minikube-linux-arm64
- MINIKUBE_FORCE_SYSTEMD=
* Kubernetes 1.30.3 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.30.3
* Using the docker driver based on existing profile
* Starting "old-k8s-version-199824" primary control-plane node in "old-k8s-version-199824" cluster
* Pulling base image v0.0.44-1721324606-19298 ...
* Restarting existing docker container for "old-k8s-version-199824" ...
* Preparing Kubernetes v1.20.0 on containerd 1.7.19 ...
* Verifying Kubernetes components...
- Using image gcr.io/k8s-minikube/storage-provisioner:v5
- Using image registry.k8s.io/echoserver:1.4
- Using image docker.io/kubernetesui/dashboard:v2.7.0
- Using image fake.domain/registry.k8s.io/echoserver:1.4
* Some dashboard features require the metrics-server addon. To enable all features please run:
minikube -p old-k8s-version-199824 addons enable metrics-server
* Enabled addons: storage-provisioner, default-storageclass, metrics-server, dashboard
-- /stdout --
** stderr **
I0719 05:13:41.960503 1384211 out.go:291] Setting OutFile to fd 1 ...
I0719 05:13:41.960726 1384211 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0719 05:13:41.960754 1384211 out.go:304] Setting ErrFile to fd 2...
I0719 05:13:41.960773 1384211 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0719 05:13:41.961037 1384211 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19302-1169903/.minikube/bin
I0719 05:13:41.961424 1384211 out.go:298] Setting JSON to false
I0719 05:13:41.962476 1384211 start.go:129] hostinfo: {"hostname":"ip-172-31-31-251","uptime":24966,"bootTime":1721341056,"procs":200,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1064-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"982e3628-3742-4b3e-bb63-ac1b07660ec7"}
I0719 05:13:41.962573 1384211 start.go:139] virtualization:
I0719 05:13:41.965112 1384211 out.go:177] * [old-k8s-version-199824] minikube v1.33.1 on Ubuntu 20.04 (arm64)
I0719 05:13:41.968403 1384211 out.go:177] - MINIKUBE_LOCATION=19302
I0719 05:13:41.970630 1384211 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0719 05:13:41.973211 1384211 notify.go:220] Checking for updates...
I0719 05:13:41.976399 1384211 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/19302-1169903/kubeconfig
I0719 05:13:41.978483 1384211 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/19302-1169903/.minikube
I0719 05:13:41.980733 1384211 out.go:177] - MINIKUBE_BIN=out/minikube-linux-arm64
I0719 05:13:41.982621 1384211 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0719 05:13:41.984897 1384211 config.go:182] Loaded profile config "old-k8s-version-199824": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0
I0719 05:13:41.987514 1384211 out.go:177] * Kubernetes 1.30.3 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.30.3
I0719 05:13:41.989926 1384211 driver.go:392] Setting default libvirt URI to qemu:///system
I0719 05:13:42.023381 1384211 docker.go:123] docker version: linux-27.0.3:Docker Engine - Community
I0719 05:13:42.023519 1384211 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0719 05:13:42.087887 1384211 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:40 OomKillDisable:true NGoroutines:51 SystemTime:2024-07-19 05:13:42.076253231 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1064-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214896640 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:27.0.3 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41 Expected:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.15.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.28.1]] Warnings:<nil>}}
I0719 05:13:42.088118 1384211 docker.go:307] overlay module found
I0719 05:13:42.092634 1384211 out.go:177] * Using the docker driver based on existing profile
I0719 05:13:42.095417 1384211 start.go:297] selected driver: docker
I0719 05:13:42.095449 1384211 start.go:901] validating driver "docker" against &{Name:old-k8s-version-199824 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-199824 Namespace:default APIServerHAVIP: AP
IServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:fa
lse MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0719 05:13:42.095601 1384211 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0719 05:13:42.096353 1384211 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0719 05:13:42.179512 1384211 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:40 OomKillDisable:true NGoroutines:51 SystemTime:2024-07-19 05:13:42.168884856 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1064-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214896640 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:27.0.3 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41 Expected:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.15.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.28.1]] Warnings:<nil>}}
I0719 05:13:42.179938 1384211 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0719 05:13:42.179973 1384211 cni.go:84] Creating CNI manager for ""
I0719 05:13:42.179986 1384211 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0719 05:13:42.180038 1384211 start.go:340] cluster config:
{Name:old-k8s-version-199824 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-199824 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local
ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:do
cker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0719 05:13:42.186897 1384211 out.go:177] * Starting "old-k8s-version-199824" primary control-plane node in "old-k8s-version-199824" cluster
I0719 05:13:42.189737 1384211 cache.go:121] Beginning downloading kic base image for docker with containerd
I0719 05:13:42.194277 1384211 out.go:177] * Pulling base image v0.0.44-1721324606-19298 ...
I0719 05:13:42.198095 1384211 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime containerd
I0719 05:13:42.198165 1384211 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19302-1169903/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-containerd-overlay2-arm64.tar.lz4
I0719 05:13:42.198178 1384211 cache.go:56] Caching tarball of preloaded images
I0719 05:13:42.198274 1384211 preload.go:172] Found /home/jenkins/minikube-integration/19302-1169903/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-containerd-overlay2-arm64.tar.lz4 in cache, skipping download
I0719 05:13:42.198285 1384211 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on containerd
I0719 05:13:42.198353 1384211 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f in local docker daemon
I0719 05:13:42.198414 1384211 profile.go:143] Saving config to /home/jenkins/minikube-integration/19302-1169903/.minikube/profiles/old-k8s-version-199824/config.json ...
W0719 05:13:42.225668 1384211 image.go:95] image gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f is of wrong architecture
I0719 05:13:42.225692 1384211 cache.go:149] Downloading gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f to local cache
I0719 05:13:42.225821 1384211 image.go:63] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f in local cache directory
I0719 05:13:42.225857 1384211 image.go:66] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f in local cache directory, skipping pull
I0719 05:13:42.225863 1384211 image.go:135] gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f exists in cache, skipping pull
I0719 05:13:42.225879 1384211 cache.go:152] successfully saved gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f as a tarball
I0719 05:13:42.225895 1384211 cache.go:162] Loading gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f from local cache
I0719 05:13:42.355591 1384211 cache.go:164] successfully loaded and using gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f from cached tarball
I0719 05:13:42.355633 1384211 cache.go:194] Successfully downloaded all kic artifacts
I0719 05:13:42.355678 1384211 start.go:360] acquireMachinesLock for old-k8s-version-199824: {Name:mkf5a8051bd9f3bb856740530901b89e26de5b15 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0719 05:13:42.355764 1384211 start.go:364] duration metric: took 59.782µs to acquireMachinesLock for "old-k8s-version-199824"
I0719 05:13:42.355790 1384211 start.go:96] Skipping create...Using existing machine configuration
I0719 05:13:42.355799 1384211 fix.go:54] fixHost starting:
I0719 05:13:42.356083 1384211 cli_runner.go:164] Run: docker container inspect old-k8s-version-199824 --format={{.State.Status}}
I0719 05:13:42.372650 1384211 fix.go:112] recreateIfNeeded on old-k8s-version-199824: state=Stopped err=<nil>
W0719 05:13:42.372683 1384211 fix.go:138] unexpected machine state, will restart: <nil>
I0719 05:13:42.375090 1384211 out.go:177] * Restarting existing docker container for "old-k8s-version-199824" ...
I0719 05:13:42.377057 1384211 cli_runner.go:164] Run: docker start old-k8s-version-199824
I0719 05:13:42.702706 1384211 cli_runner.go:164] Run: docker container inspect old-k8s-version-199824 --format={{.State.Status}}
I0719 05:13:42.723923 1384211 kic.go:430] container "old-k8s-version-199824" state is running.
I0719 05:13:42.724476 1384211 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-199824
I0719 05:13:42.749586 1384211 profile.go:143] Saving config to /home/jenkins/minikube-integration/19302-1169903/.minikube/profiles/old-k8s-version-199824/config.json ...
I0719 05:13:42.749812 1384211 machine.go:94] provisionDockerMachine start ...
I0719 05:13:42.749879 1384211 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-199824
I0719 05:13:42.770773 1384211 main.go:141] libmachine: Using SSH client type: native
I0719 05:13:42.771097 1384211 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2cd0] 0x3e5530 <nil> [] 0s} 127.0.0.1 34547 <nil> <nil>}
I0719 05:13:42.771110 1384211 main.go:141] libmachine: About to run SSH command:
hostname
I0719 05:13:42.772242 1384211 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:40560->127.0.0.1:34547: read: connection reset by peer
I0719 05:13:45.906789 1384211 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-199824
I0719 05:13:45.906823 1384211 ubuntu.go:169] provisioning hostname "old-k8s-version-199824"
I0719 05:13:45.906902 1384211 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-199824
I0719 05:13:45.928644 1384211 main.go:141] libmachine: Using SSH client type: native
I0719 05:13:45.928901 1384211 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2cd0] 0x3e5530 <nil> [] 0s} 127.0.0.1 34547 <nil> <nil>}
I0719 05:13:45.928918 1384211 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-199824 && echo "old-k8s-version-199824" | sudo tee /etc/hostname
I0719 05:13:46.067700 1384211 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-199824
I0719 05:13:46.067781 1384211 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-199824
I0719 05:13:46.085205 1384211 main.go:141] libmachine: Using SSH client type: native
I0719 05:13:46.085471 1384211 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2cd0] 0x3e5530 <nil> [] 0s} 127.0.0.1 34547 <nil> <nil>}
I0719 05:13:46.085489 1384211 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-199824' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-199824/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-199824' | sudo tee -a /etc/hosts;
fi
fi
I0719 05:13:46.207289 1384211 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0719 05:13:46.207329 1384211 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/19302-1169903/.minikube CaCertPath:/home/jenkins/minikube-integration/19302-1169903/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19302-1169903/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19302-1169903/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19302-1169903/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19302-1169903/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19302-1169903/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19302-1169903/.minikube}
I0719 05:13:46.207368 1384211 ubuntu.go:177] setting up certificates
I0719 05:13:46.207382 1384211 provision.go:84] configureAuth start
I0719 05:13:46.207469 1384211 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-199824
I0719 05:13:46.223696 1384211 provision.go:143] copyHostCerts
I0719 05:13:46.223771 1384211 exec_runner.go:144] found /home/jenkins/minikube-integration/19302-1169903/.minikube/key.pem, removing ...
I0719 05:13:46.223790 1384211 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19302-1169903/.minikube/key.pem
I0719 05:13:46.223866 1384211 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19302-1169903/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19302-1169903/.minikube/key.pem (1679 bytes)
I0719 05:13:46.223973 1384211 exec_runner.go:144] found /home/jenkins/minikube-integration/19302-1169903/.minikube/ca.pem, removing ...
I0719 05:13:46.223987 1384211 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19302-1169903/.minikube/ca.pem
I0719 05:13:46.224017 1384211 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19302-1169903/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19302-1169903/.minikube/ca.pem (1078 bytes)
I0719 05:13:46.224075 1384211 exec_runner.go:144] found /home/jenkins/minikube-integration/19302-1169903/.minikube/cert.pem, removing ...
I0719 05:13:46.224084 1384211 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19302-1169903/.minikube/cert.pem
I0719 05:13:46.224109 1384211 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19302-1169903/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19302-1169903/.minikube/cert.pem (1123 bytes)
I0719 05:13:46.224162 1384211 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19302-1169903/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19302-1169903/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19302-1169903/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-199824 san=[127.0.0.1 192.168.85.2 localhost minikube old-k8s-version-199824]
I0719 05:13:46.591482 1384211 provision.go:177] copyRemoteCerts
I0719 05:13:46.591549 1384211 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0719 05:13:46.591589 1384211 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-199824
I0719 05:13:46.607918 1384211 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34547 SSHKeyPath:/home/jenkins/minikube-integration/19302-1169903/.minikube/machines/old-k8s-version-199824/id_rsa Username:docker}
I0719 05:13:46.699969 1384211 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19302-1169903/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0719 05:13:46.724369 1384211 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19302-1169903/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0719 05:13:46.750629 1384211 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19302-1169903/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0719 05:13:46.774865 1384211 provision.go:87] duration metric: took 567.464996ms to configureAuth
I0719 05:13:46.774905 1384211 ubuntu.go:193] setting minikube options for container-runtime
I0719 05:13:46.775091 1384211 config.go:182] Loaded profile config "old-k8s-version-199824": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0
I0719 05:13:46.775104 1384211 machine.go:97] duration metric: took 4.02528324s to provisionDockerMachine
I0719 05:13:46.775113 1384211 start.go:293] postStartSetup for "old-k8s-version-199824" (driver="docker")
I0719 05:13:46.775123 1384211 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0719 05:13:46.775234 1384211 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0719 05:13:46.775286 1384211 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-199824
I0719 05:13:46.794941 1384211 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34547 SSHKeyPath:/home/jenkins/minikube-integration/19302-1169903/.minikube/machines/old-k8s-version-199824/id_rsa Username:docker}
I0719 05:13:46.884223 1384211 ssh_runner.go:195] Run: cat /etc/os-release
I0719 05:13:46.887624 1384211 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0719 05:13:46.887665 1384211 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0719 05:13:46.887676 1384211 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0719 05:13:46.887683 1384211 info.go:137] Remote host: Ubuntu 22.04.4 LTS
I0719 05:13:46.887694 1384211 filesync.go:126] Scanning /home/jenkins/minikube-integration/19302-1169903/.minikube/addons for local assets ...
I0719 05:13:46.887748 1384211 filesync.go:126] Scanning /home/jenkins/minikube-integration/19302-1169903/.minikube/files for local assets ...
I0719 05:13:46.887831 1384211 filesync.go:149] local asset: /home/jenkins/minikube-integration/19302-1169903/.minikube/files/etc/ssl/certs/11752862.pem -> 11752862.pem in /etc/ssl/certs
I0719 05:13:46.887937 1384211 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0719 05:13:46.896400 1384211 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19302-1169903/.minikube/files/etc/ssl/certs/11752862.pem --> /etc/ssl/certs/11752862.pem (1708 bytes)
I0719 05:13:46.920310 1384211 start.go:296] duration metric: took 145.18121ms for postStartSetup
I0719 05:13:46.920409 1384211 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0719 05:13:46.920468 1384211 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-199824
I0719 05:13:46.938393 1384211 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34547 SSHKeyPath:/home/jenkins/minikube-integration/19302-1169903/.minikube/machines/old-k8s-version-199824/id_rsa Username:docker}
I0719 05:13:47.030002 1384211 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I0719 05:13:47.034756 1384211 fix.go:56] duration metric: took 4.678950345s for fixHost
I0719 05:13:47.034781 1384211 start.go:83] releasing machines lock for "old-k8s-version-199824", held for 4.679003818s
I0719 05:13:47.034850 1384211 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-199824
I0719 05:13:47.050934 1384211 ssh_runner.go:195] Run: cat /version.json
I0719 05:13:47.050987 1384211 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-199824
I0719 05:13:47.051014 1384211 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0719 05:13:47.051071 1384211 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-199824
I0719 05:13:47.069931 1384211 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34547 SSHKeyPath:/home/jenkins/minikube-integration/19302-1169903/.minikube/machines/old-k8s-version-199824/id_rsa Username:docker}
I0719 05:13:47.069986 1384211 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34547 SSHKeyPath:/home/jenkins/minikube-integration/19302-1169903/.minikube/machines/old-k8s-version-199824/id_rsa Username:docker}
I0719 05:13:47.316994 1384211 ssh_runner.go:195] Run: systemctl --version
I0719 05:13:47.321440 1384211 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I0719 05:13:47.325807 1384211 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
I0719 05:13:47.344939 1384211 cni.go:230] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
I0719 05:13:47.345045 1384211 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0719 05:13:47.353940 1384211 cni.go:259] no active bridge cni configs found in "/etc/cni/net.d" - nothing to disable
I0719 05:13:47.353968 1384211 start.go:495] detecting cgroup driver to use...
I0719 05:13:47.354001 1384211 detect.go:187] detected "cgroupfs" cgroup driver on host os
I0719 05:13:47.354048 1384211 ssh_runner.go:195] Run: sudo systemctl stop -f crio
I0719 05:13:47.367798 1384211 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I0719 05:13:47.379676 1384211 docker.go:217] disabling cri-docker service (if available) ...
I0719 05:13:47.379754 1384211 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0719 05:13:47.393237 1384211 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0719 05:13:47.405129 1384211 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0719 05:13:47.496808 1384211 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0719 05:13:47.584466 1384211 docker.go:233] disabling docker service ...
I0719 05:13:47.584556 1384211 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0719 05:13:47.598493 1384211 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0719 05:13:47.610861 1384211 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0719 05:13:47.700138 1384211 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0719 05:13:47.806866 1384211 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0719 05:13:47.820383 1384211 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock
" | sudo tee /etc/crictl.yaml"
I0719 05:13:47.842137 1384211 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.2"|' /etc/containerd/config.toml"
I0719 05:13:47.854555 1384211 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
I0719 05:13:47.865113 1384211 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...
I0719 05:13:47.865195 1384211 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
I0719 05:13:47.875844 1384211 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0719 05:13:47.886517 1384211 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
I0719 05:13:47.897204 1384211 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0719 05:13:47.908049 1384211 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0719 05:13:47.921202 1384211 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
I0719 05:13:47.932084 1384211 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0719 05:13:47.947969 1384211 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0719 05:13:47.960809 1384211 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0719 05:13:48.087731 1384211 ssh_runner.go:195] Run: sudo systemctl restart containerd
I0719 05:13:48.333733 1384211 start.go:542] Will wait 60s for socket path /run/containerd/containerd.sock
I0719 05:13:48.333804 1384211 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
I0719 05:13:48.338394 1384211 start.go:563] Will wait 60s for crictl version
I0719 05:13:48.338461 1384211 ssh_runner.go:195] Run: which crictl
I0719 05:13:48.343729 1384211 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0719 05:13:48.410254 1384211 start.go:579] Version: 0.1.0
RuntimeName: containerd
RuntimeVersion: 1.7.19
RuntimeApiVersion: v1
I0719 05:13:48.410324 1384211 ssh_runner.go:195] Run: containerd --version
I0719 05:13:48.437644 1384211 ssh_runner.go:195] Run: containerd --version
I0719 05:13:48.468241 1384211 out.go:177] * Preparing Kubernetes v1.20.0 on containerd 1.7.19 ...
I0719 05:13:48.472003 1384211 cli_runner.go:164] Run: docker network inspect old-k8s-version-199824 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0719 05:13:48.488865 1384211 ssh_runner.go:195] Run: grep 192.168.85.1 host.minikube.internal$ /etc/hosts
I0719 05:13:48.493326 1384211 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.85.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0719 05:13:48.506498 1384211 kubeadm.go:883] updating cluster {Name:old-k8s-version-199824 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-199824 Namespace:default APIServerHAVIP: APIServerName:minik
ubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/
home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0719 05:13:48.506618 1384211 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime containerd
I0719 05:13:48.506678 1384211 ssh_runner.go:195] Run: sudo crictl images --output json
I0719 05:13:48.566036 1384211 containerd.go:627] all images are preloaded for containerd runtime.
I0719 05:13:48.566057 1384211 containerd.go:534] Images already preloaded, skipping extraction
I0719 05:13:48.566114 1384211 ssh_runner.go:195] Run: sudo crictl images --output json
I0719 05:13:48.631780 1384211 containerd.go:627] all images are preloaded for containerd runtime.
I0719 05:13:48.631841 1384211 cache_images.go:84] Images are preloaded, skipping loading
I0719 05:13:48.631879 1384211 kubeadm.go:934] updating node { 192.168.85.2 8443 v1.20.0 containerd true true} ...
I0719 05:13:48.632031 1384211 kubeadm.go:946] kubelet [Unit]
Wants=containerd.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///run/containerd/containerd.sock --hostname-override=old-k8s-version-199824 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.85.2
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-199824 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0719 05:13:48.632126 1384211 ssh_runner.go:195] Run: sudo crictl info
I0719 05:13:48.690668 1384211 cni.go:84] Creating CNI manager for ""
I0719 05:13:48.690696 1384211 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0719 05:13:48.690707 1384211 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0719 05:13:48.690727 1384211 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.85.2 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-199824 NodeName:old-k8s-version-199824 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.85.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.85.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt
StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0719 05:13:48.690858 1384211 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.85.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /run/containerd/containerd.sock
name: "old-k8s-version-199824"
kubeletExtraArgs:
node-ip: 192.168.85.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.85.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0719 05:13:48.690928 1384211 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0719 05:13:48.700456 1384211 binaries.go:44] Found k8s binaries, skipping transfer
I0719 05:13:48.700569 1384211 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0719 05:13:48.710334 1384211 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (442 bytes)
I0719 05:13:48.728799 1384211 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0719 05:13:48.747632 1384211 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2125 bytes)
I0719 05:13:48.766772 1384211 ssh_runner.go:195] Run: grep 192.168.85.2 control-plane.minikube.internal$ /etc/hosts
I0719 05:13:48.770794 1384211 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.85.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0719 05:13:48.781667 1384211 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0719 05:13:48.896643 1384211 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0719 05:13:48.913961 1384211 certs.go:68] Setting up /home/jenkins/minikube-integration/19302-1169903/.minikube/profiles/old-k8s-version-199824 for IP: 192.168.85.2
I0719 05:13:48.913987 1384211 certs.go:194] generating shared ca certs ...
I0719 05:13:48.914002 1384211 certs.go:226] acquiring lock for ca certs: {Name:mkb94216b4baf781e984c9b79eeab87cfce4eb07 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0719 05:13:48.914190 1384211 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19302-1169903/.minikube/ca.key
I0719 05:13:48.914242 1384211 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19302-1169903/.minikube/proxy-client-ca.key
I0719 05:13:48.914261 1384211 certs.go:256] generating profile certs ...
I0719 05:13:48.914369 1384211 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/19302-1169903/.minikube/profiles/old-k8s-version-199824/client.key
I0719 05:13:48.914453 1384211 certs.go:359] skipping valid signed profile cert regeneration for "minikube": /home/jenkins/minikube-integration/19302-1169903/.minikube/profiles/old-k8s-version-199824/apiserver.key.61b2c4c4
I0719 05:13:48.914506 1384211 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/19302-1169903/.minikube/profiles/old-k8s-version-199824/proxy-client.key
I0719 05:13:48.914659 1384211 certs.go:484] found cert: /home/jenkins/minikube-integration/19302-1169903/.minikube/certs/1175286.pem (1338 bytes)
W0719 05:13:48.914693 1384211 certs.go:480] ignoring /home/jenkins/minikube-integration/19302-1169903/.minikube/certs/1175286_empty.pem, impossibly tiny 0 bytes
I0719 05:13:48.914704 1384211 certs.go:484] found cert: /home/jenkins/minikube-integration/19302-1169903/.minikube/certs/ca-key.pem (1679 bytes)
I0719 05:13:48.914740 1384211 certs.go:484] found cert: /home/jenkins/minikube-integration/19302-1169903/.minikube/certs/ca.pem (1078 bytes)
I0719 05:13:48.914789 1384211 certs.go:484] found cert: /home/jenkins/minikube-integration/19302-1169903/.minikube/certs/cert.pem (1123 bytes)
I0719 05:13:48.914819 1384211 certs.go:484] found cert: /home/jenkins/minikube-integration/19302-1169903/.minikube/certs/key.pem (1679 bytes)
I0719 05:13:48.921153 1384211 certs.go:484] found cert: /home/jenkins/minikube-integration/19302-1169903/.minikube/files/etc/ssl/certs/11752862.pem (1708 bytes)
I0719 05:13:48.922068 1384211 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19302-1169903/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0719 05:13:48.966215 1384211 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19302-1169903/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I0719 05:13:49.030195 1384211 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19302-1169903/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0719 05:13:49.071546 1384211 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19302-1169903/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0719 05:13:49.130092 1384211 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19302-1169903/.minikube/profiles/old-k8s-version-199824/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0719 05:13:49.170944 1384211 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19302-1169903/.minikube/profiles/old-k8s-version-199824/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0719 05:13:49.243983 1384211 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19302-1169903/.minikube/profiles/old-k8s-version-199824/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0719 05:13:49.296851 1384211 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19302-1169903/.minikube/profiles/old-k8s-version-199824/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0719 05:13:49.348919 1384211 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19302-1169903/.minikube/files/etc/ssl/certs/11752862.pem --> /usr/share/ca-certificates/11752862.pem (1708 bytes)
I0719 05:13:49.383129 1384211 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19302-1169903/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0719 05:13:49.407835 1384211 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19302-1169903/.minikube/certs/1175286.pem --> /usr/share/ca-certificates/1175286.pem (1338 bytes)
I0719 05:13:49.462277 1384211 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0719 05:13:49.486802 1384211 ssh_runner.go:195] Run: openssl version
I0719 05:13:49.500451 1384211 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/11752862.pem && ln -fs /usr/share/ca-certificates/11752862.pem /etc/ssl/certs/11752862.pem"
I0719 05:13:49.516063 1384211 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/11752862.pem
I0719 05:13:49.520360 1384211 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Jul 19 04:32 /usr/share/ca-certificates/11752862.pem
I0719 05:13:49.520424 1384211 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/11752862.pem
I0719 05:13:49.534615 1384211 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/11752862.pem /etc/ssl/certs/3ec20f2e.0"
I0719 05:13:49.554574 1384211 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0719 05:13:49.568294 1384211 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0719 05:13:49.573045 1384211 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Jul 19 04:24 /usr/share/ca-certificates/minikubeCA.pem
I0719 05:13:49.573107 1384211 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0719 05:13:49.582893 1384211 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0719 05:13:49.594553 1384211 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/1175286.pem && ln -fs /usr/share/ca-certificates/1175286.pem /etc/ssl/certs/1175286.pem"
I0719 05:13:49.604852 1384211 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/1175286.pem
I0719 05:13:49.617019 1384211 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Jul 19 04:32 /usr/share/ca-certificates/1175286.pem
I0719 05:13:49.617081 1384211 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/1175286.pem
I0719 05:13:49.634382 1384211 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/1175286.pem /etc/ssl/certs/51391683.0"
I0719 05:13:49.646552 1384211 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0719 05:13:49.650848 1384211 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
I0719 05:13:49.658351 1384211 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
I0719 05:13:49.665843 1384211 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
I0719 05:13:49.676590 1384211 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
I0719 05:13:49.685611 1384211 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
I0719 05:13:49.703383 1384211 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
I0719 05:13:49.717216 1384211 kubeadm.go:392] StartCluster: {Name:old-k8s-version-199824 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-199824 Namespace:default APIServerHAVIP: APIServerName:minikube
CA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/hom
e/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0719 05:13:49.717309 1384211 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}
I0719 05:13:49.717375 1384211 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0719 05:13:49.801977 1384211 cri.go:89] found id: "ec60727167db8439a76a65e4aba2ea5d113e867f686695daf0f9f2df3a9b984b"
I0719 05:13:49.802001 1384211 cri.go:89] found id: "e0ea78faa765147f1c1a9e8517bc48fd17bcb16534bcab7e02bcfe8728d4dec6"
I0719 05:13:49.802006 1384211 cri.go:89] found id: "e71234bf3aa04aebb949cd71de920bc330e0e7bc52dda21233bf1bcf5445df5a"
I0719 05:13:49.802010 1384211 cri.go:89] found id: "78aa39803d3d37bc510fe812e66f0fd6c8b18fa73ee068c031077da23ecacce0"
I0719 05:13:49.802013 1384211 cri.go:89] found id: "31d2288b65a8bfddfa998e3247ebb91dfa488cdde250694c21541c28d32b661b"
I0719 05:13:49.802017 1384211 cri.go:89] found id: "fb25f9a0346cc4e0812cc4849a6418ef42d67be0c75dedeec160273a75983a4a"
I0719 05:13:49.802020 1384211 cri.go:89] found id: "31f8a36bff2a9b66f7c2a5a8fdc3fe9b14f1b569fae35aa6b7bec34dca8ef7a7"
I0719 05:13:49.802024 1384211 cri.go:89] found id: "8ea851149d390f197f798dbb1e77c9ae51eb21cceef7c8955c58d5d653fec285"
I0719 05:13:49.802027 1384211 cri.go:89] found id: ""
I0719 05:13:49.802078 1384211 ssh_runner.go:195] Run: sudo runc --root /run/containerd/runc/k8s.io list -f json
I0719 05:13:49.818471 1384211 cri.go:116] JSON = null
W0719 05:13:49.818519 1384211 kubeadm.go:399] unpause failed: list paused: list returned 0 containers, but ps returned 8
I0719 05:13:49.818590 1384211 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0719 05:13:49.837985 1384211 kubeadm.go:408] found existing configuration files, will attempt cluster restart
I0719 05:13:49.838014 1384211 kubeadm.go:593] restartPrimaryControlPlane start ...
I0719 05:13:49.838065 1384211 ssh_runner.go:195] Run: sudo test -d /data/minikube
I0719 05:13:49.850559 1384211 kubeadm.go:130] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
stdout:
stderr:
I0719 05:13:49.851276 1384211 kubeconfig.go:47] verify endpoint returned: get endpoint: "old-k8s-version-199824" does not appear in /home/jenkins/minikube-integration/19302-1169903/kubeconfig
I0719 05:13:49.851561 1384211 kubeconfig.go:62] /home/jenkins/minikube-integration/19302-1169903/kubeconfig needs updating (will repair): [kubeconfig missing "old-k8s-version-199824" cluster setting kubeconfig missing "old-k8s-version-199824" context setting]
I0719 05:13:49.852070 1384211 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19302-1169903/kubeconfig: {Name:mkc20ac26e86e3155beb9b46782ccc5a9f7a2b0a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0719 05:13:49.853450 1384211 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
I0719 05:13:49.865722 1384211 kubeadm.go:630] The running cluster does not require reconfiguration: 192.168.85.2
I0719 05:13:49.865757 1384211 kubeadm.go:597] duration metric: took 27.736398ms to restartPrimaryControlPlane
I0719 05:13:49.865770 1384211 kubeadm.go:394] duration metric: took 148.571722ms to StartCluster
I0719 05:13:49.865785 1384211 settings.go:142] acquiring lock: {Name:mk3315ab8b868aa7f5d94c6da5998345b76d5aca Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0719 05:13:49.865841 1384211 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/19302-1169903/kubeconfig
I0719 05:13:49.866752 1384211 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19302-1169903/kubeconfig: {Name:mkc20ac26e86e3155beb9b46782ccc5a9f7a2b0a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0719 05:13:49.866946 1384211 start.go:235] Will wait 6m0s for node &{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}
I0719 05:13:49.867279 1384211 config.go:182] Loaded profile config "old-k8s-version-199824": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0
I0719 05:13:49.867321 1384211 addons.go:507] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:true default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]
I0719 05:13:49.867386 1384211 addons.go:69] Setting storage-provisioner=true in profile "old-k8s-version-199824"
I0719 05:13:49.867409 1384211 addons.go:234] Setting addon storage-provisioner=true in "old-k8s-version-199824"
W0719 05:13:49.867415 1384211 addons.go:243] addon storage-provisioner should already be in state true
I0719 05:13:49.867431 1384211 addons.go:69] Setting default-storageclass=true in profile "old-k8s-version-199824"
I0719 05:13:49.867440 1384211 addons.go:69] Setting metrics-server=true in profile "old-k8s-version-199824"
I0719 05:13:49.867455 1384211 addons.go:234] Setting addon metrics-server=true in "old-k8s-version-199824"
W0719 05:13:49.867460 1384211 addons.go:243] addon metrics-server should already be in state true
I0719 05:13:49.867467 1384211 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "old-k8s-version-199824"
I0719 05:13:49.867474 1384211 host.go:66] Checking if "old-k8s-version-199824" exists ...
I0719 05:13:49.867741 1384211 cli_runner.go:164] Run: docker container inspect old-k8s-version-199824 --format={{.State.Status}}
I0719 05:13:49.868028 1384211 cli_runner.go:164] Run: docker container inspect old-k8s-version-199824 --format={{.State.Status}}
I0719 05:13:49.867436 1384211 host.go:66] Checking if "old-k8s-version-199824" exists ...
I0719 05:13:49.868559 1384211 cli_runner.go:164] Run: docker container inspect old-k8s-version-199824 --format={{.State.Status}}
I0719 05:13:49.868927 1384211 addons.go:69] Setting dashboard=true in profile "old-k8s-version-199824"
I0719 05:13:49.868956 1384211 addons.go:234] Setting addon dashboard=true in "old-k8s-version-199824"
W0719 05:13:49.868963 1384211 addons.go:243] addon dashboard should already be in state true
I0719 05:13:49.868995 1384211 host.go:66] Checking if "old-k8s-version-199824" exists ...
I0719 05:13:49.869386 1384211 cli_runner.go:164] Run: docker container inspect old-k8s-version-199824 --format={{.State.Status}}
I0719 05:13:49.872059 1384211 out.go:177] * Verifying Kubernetes components...
I0719 05:13:49.876381 1384211 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0719 05:13:49.904091 1384211 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0719 05:13:49.906597 1384211 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0719 05:13:49.906617 1384211 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0719 05:13:49.906681 1384211 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-199824
I0719 05:13:49.911634 1384211 out.go:177] - Using image registry.k8s.io/echoserver:1.4
I0719 05:13:49.913429 1384211 out.go:177] - Using image docker.io/kubernetesui/dashboard:v2.7.0
I0719 05:13:49.918558 1384211 addons.go:431] installing /etc/kubernetes/addons/dashboard-ns.yaml
I0719 05:13:49.918580 1384211 ssh_runner.go:362] scp dashboard/dashboard-ns.yaml --> /etc/kubernetes/addons/dashboard-ns.yaml (759 bytes)
I0719 05:13:49.918648 1384211 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-199824
I0719 05:13:49.928894 1384211 addons.go:234] Setting addon default-storageclass=true in "old-k8s-version-199824"
W0719 05:13:49.928913 1384211 addons.go:243] addon default-storageclass should already be in state true
I0719 05:13:49.928940 1384211 host.go:66] Checking if "old-k8s-version-199824" exists ...
I0719 05:13:49.930143 1384211 cli_runner.go:164] Run: docker container inspect old-k8s-version-199824 --format={{.State.Status}}
I0719 05:13:49.931320 1384211 out.go:177] - Using image fake.domain/registry.k8s.io/echoserver:1.4
I0719 05:13:49.933456 1384211 addons.go:431] installing /etc/kubernetes/addons/metrics-apiservice.yaml
I0719 05:13:49.933474 1384211 ssh_runner.go:362] scp metrics-server/metrics-apiservice.yaml --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
I0719 05:13:49.933532 1384211 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-199824
I0719 05:13:50.008570 1384211 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34547 SSHKeyPath:/home/jenkins/minikube-integration/19302-1169903/.minikube/machines/old-k8s-version-199824/id_rsa Username:docker}
I0719 05:13:50.010023 1384211 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34547 SSHKeyPath:/home/jenkins/minikube-integration/19302-1169903/.minikube/machines/old-k8s-version-199824/id_rsa Username:docker}
I0719 05:13:50.016288 1384211 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34547 SSHKeyPath:/home/jenkins/minikube-integration/19302-1169903/.minikube/machines/old-k8s-version-199824/id_rsa Username:docker}
I0719 05:13:50.031513 1384211 addons.go:431] installing /etc/kubernetes/addons/storageclass.yaml
I0719 05:13:50.031556 1384211 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0719 05:13:50.031632 1384211 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-199824
I0719 05:13:50.063611 1384211 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34547 SSHKeyPath:/home/jenkins/minikube-integration/19302-1169903/.minikube/machines/old-k8s-version-199824/id_rsa Username:docker}
I0719 05:13:50.124084 1384211 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0719 05:13:50.213692 1384211 node_ready.go:35] waiting up to 6m0s for node "old-k8s-version-199824" to be "Ready" ...
I0719 05:13:50.265635 1384211 addons.go:431] installing /etc/kubernetes/addons/dashboard-clusterrole.yaml
I0719 05:13:50.265656 1384211 ssh_runner.go:362] scp dashboard/dashboard-clusterrole.yaml --> /etc/kubernetes/addons/dashboard-clusterrole.yaml (1001 bytes)
I0719 05:13:50.297112 1384211 addons.go:431] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
I0719 05:13:50.297176 1384211 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1825 bytes)
I0719 05:13:50.330696 1384211 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0719 05:13:50.349163 1384211 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0719 05:13:50.352086 1384211 addons.go:431] installing /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml
I0719 05:13:50.352146 1384211 ssh_runner.go:362] scp dashboard/dashboard-clusterrolebinding.yaml --> /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml (1018 bytes)
I0719 05:13:50.369898 1384211 addons.go:431] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
I0719 05:13:50.369961 1384211 ssh_runner.go:362] scp metrics-server/metrics-server-rbac.yaml --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
I0719 05:13:50.440739 1384211 addons.go:431] installing /etc/kubernetes/addons/dashboard-configmap.yaml
I0719 05:13:50.440810 1384211 ssh_runner.go:362] scp dashboard/dashboard-configmap.yaml --> /etc/kubernetes/addons/dashboard-configmap.yaml (837 bytes)
I0719 05:13:50.493453 1384211 addons.go:431] installing /etc/kubernetes/addons/metrics-server-service.yaml
I0719 05:13:50.493526 1384211 ssh_runner.go:362] scp metrics-server/metrics-server-service.yaml --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
I0719 05:13:50.516727 1384211 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0719 05:13:50.539382 1384211 addons.go:431] installing /etc/kubernetes/addons/dashboard-dp.yaml
I0719 05:13:50.539472 1384211 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-dp.yaml (4201 bytes)
I0719 05:13:50.613111 1384211 addons.go:431] installing /etc/kubernetes/addons/dashboard-role.yaml
I0719 05:13:50.613183 1384211 ssh_runner.go:362] scp dashboard/dashboard-role.yaml --> /etc/kubernetes/addons/dashboard-role.yaml (1724 bytes)
W0719 05:13:50.643063 1384211 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0719 05:13:50.643185 1384211 retry.go:31] will retry after 200.401031ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0719 05:13:50.647811 1384211 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0719 05:13:50.647879 1384211 retry.go:31] will retry after 137.499043ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0719 05:13:50.658366 1384211 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0719 05:13:50.658446 1384211 retry.go:31] will retry after 212.501893ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0719 05:13:50.660312 1384211 addons.go:431] installing /etc/kubernetes/addons/dashboard-rolebinding.yaml
I0719 05:13:50.660377 1384211 ssh_runner.go:362] scp dashboard/dashboard-rolebinding.yaml --> /etc/kubernetes/addons/dashboard-rolebinding.yaml (1046 bytes)
I0719 05:13:50.678080 1384211 addons.go:431] installing /etc/kubernetes/addons/dashboard-sa.yaml
I0719 05:13:50.678152 1384211 ssh_runner.go:362] scp dashboard/dashboard-sa.yaml --> /etc/kubernetes/addons/dashboard-sa.yaml (837 bytes)
I0719 05:13:50.695735 1384211 addons.go:431] installing /etc/kubernetes/addons/dashboard-secret.yaml
I0719 05:13:50.695760 1384211 ssh_runner.go:362] scp dashboard/dashboard-secret.yaml --> /etc/kubernetes/addons/dashboard-secret.yaml (1389 bytes)
I0719 05:13:50.713282 1384211 addons.go:431] installing /etc/kubernetes/addons/dashboard-svc.yaml
I0719 05:13:50.713350 1384211 ssh_runner.go:362] scp dashboard/dashboard-svc.yaml --> /etc/kubernetes/addons/dashboard-svc.yaml (1294 bytes)
I0719 05:13:50.731724 1384211 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0719 05:13:50.785825 1384211 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0719 05:13:50.805260 1384211 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0719 05:13:50.805294 1384211 retry.go:31] will retry after 345.227691ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0719 05:13:50.844922 1384211 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I0719 05:13:50.872146 1384211 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0719 05:13:50.876640 1384211 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0719 05:13:50.876672 1384211 retry.go:31] will retry after 274.054243ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0719 05:13:51.116696 1384211 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0719 05:13:51.116727 1384211 retry.go:31] will retry after 308.833838ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0719 05:13:51.150992 1384211 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I0719 05:13:51.151140 1384211 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0719 05:13:51.163835 1384211 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0719 05:13:51.163867 1384211 retry.go:31] will retry after 351.97607ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0719 05:13:51.425796 1384211 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0719 05:13:51.464902 1384211 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0719 05:13:51.464930 1384211 retry.go:31] will retry after 269.289432ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0719 05:13:51.490123 1384211 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0719 05:13:51.490153 1384211 retry.go:31] will retry after 763.63151ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0719 05:13:51.516426 1384211 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0719 05:13:51.527566 1384211 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0719 05:13:51.527602 1384211 retry.go:31] will retry after 471.641496ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0719 05:13:51.647305 1384211 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0719 05:13:51.647335 1384211 retry.go:31] will retry after 351.324855ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0719 05:13:51.735269 1384211 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0719 05:13:51.804751 1384211 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0719 05:13:51.804781 1384211 retry.go:31] will retry after 469.727376ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0719 05:13:51.999613 1384211 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0719 05:13:51.999775 1384211 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0719 05:13:52.110973 1384211 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0719 05:13:52.111008 1384211 retry.go:31] will retry after 1.122786148s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0719 05:13:52.111056 1384211 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0719 05:13:52.111062 1384211 retry.go:31] will retry after 806.878803ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0719 05:13:52.214616 1384211 node_ready.go:53] error getting node "old-k8s-version-199824": Get "https://192.168.85.2:8443/api/v1/nodes/old-k8s-version-199824": dial tcp 192.168.85.2:8443: connect: connection refused
I0719 05:13:52.254800 1384211 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I0719 05:13:52.275295 1384211 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0719 05:13:52.348136 1384211 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0719 05:13:52.348169 1384211 retry.go:31] will retry after 1.229475365s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0719 05:13:52.367742 1384211 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0719 05:13:52.367824 1384211 retry.go:31] will retry after 904.789258ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0719 05:13:52.918698 1384211 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0719 05:13:52.990303 1384211 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0719 05:13:52.990332 1384211 retry.go:31] will retry after 1.67616912s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0719 05:13:53.234483 1384211 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0719 05:13:53.273027 1384211 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0719 05:13:53.324480 1384211 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0719 05:13:53.324565 1384211 retry.go:31] will retry after 1.108159064s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0719 05:13:53.360359 1384211 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0719 05:13:53.360390 1384211 retry.go:31] will retry after 1.438202741s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0719 05:13:53.578766 1384211 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0719 05:13:53.657659 1384211 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0719 05:13:53.657693 1384211 retry.go:31] will retry after 1.810465648s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0719 05:13:54.215192 1384211 node_ready.go:53] error getting node "old-k8s-version-199824": Get "https://192.168.85.2:8443/api/v1/nodes/old-k8s-version-199824": dial tcp 192.168.85.2:8443: connect: connection refused
I0719 05:13:54.433615 1384211 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0719 05:13:54.506191 1384211 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0719 05:13:54.506223 1384211 retry.go:31] will retry after 2.140323132s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0719 05:13:54.667617 1384211 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0719 05:13:54.735525 1384211 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0719 05:13:54.735568 1384211 retry.go:31] will retry after 1.338910638s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0719 05:13:54.799855 1384211 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0719 05:13:54.873475 1384211 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0719 05:13:54.873511 1384211 retry.go:31] will retry after 1.770158844s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0719 05:13:55.468436 1384211 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0719 05:13:55.541377 1384211 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0719 05:13:55.541409 1384211 retry.go:31] will retry after 1.430918891s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0719 05:13:56.074780 1384211 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0719 05:13:56.144391 1384211 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0719 05:13:56.144425 1384211 retry.go:31] will retry after 2.436288346s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0719 05:13:56.644488 1384211 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0719 05:13:56.646831 1384211 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0719 05:13:56.714445 1384211 node_ready.go:53] error getting node "old-k8s-version-199824": Get "https://192.168.85.2:8443/api/v1/nodes/old-k8s-version-199824": dial tcp 192.168.85.2:8443: connect: connection refused
W0719 05:13:56.731226 1384211 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0719 05:13:56.731256 1384211 retry.go:31] will retry after 3.674958642s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0719 05:13:56.743440 1384211 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0719 05:13:56.743471 1384211 retry.go:31] will retry after 4.252370178s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0719 05:13:56.972968 1384211 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0719 05:13:57.046644 1384211 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0719 05:13:57.046681 1384211 retry.go:31] will retry after 2.657015967s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0719 05:13:58.581033 1384211 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I0719 05:13:59.704178 1384211 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I0719 05:14:00.406659 1384211 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0719 05:14:00.996707 1384211 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0719 05:14:06.912335 1384211 node_ready.go:49] node "old-k8s-version-199824" has status "Ready":"True"
I0719 05:14:06.912360 1384211 node_ready.go:38] duration metric: took 16.698632123s for node "old-k8s-version-199824" to be "Ready" ...
I0719 05:14:06.912372 1384211 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0719 05:14:07.182248 1384211 pod_ready.go:78] waiting up to 6m0s for pod "coredns-74ff55c5b-ddsjt" in "kube-system" namespace to be "Ready" ...
I0719 05:14:07.319982 1384211 pod_ready.go:92] pod "coredns-74ff55c5b-ddsjt" in "kube-system" namespace has status "Ready":"True"
I0719 05:14:07.320006 1384211 pod_ready.go:81] duration metric: took 137.650562ms for pod "coredns-74ff55c5b-ddsjt" in "kube-system" namespace to be "Ready" ...
I0719 05:14:07.320019 1384211 pod_ready.go:78] waiting up to 6m0s for pod "etcd-old-k8s-version-199824" in "kube-system" namespace to be "Ready" ...
I0719 05:14:08.512838 1384211 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: (9.931767738s)
I0719 05:14:08.523009 1384211 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: (8.818792143s)
I0719 05:14:09.262497 1384211 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: (8.85578891s)
I0719 05:14:09.262681 1384211 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (8.265948575s)
I0719 05:14:09.262720 1384211 addons.go:475] Verifying addon metrics-server=true in "old-k8s-version-199824"
I0719 05:14:09.265666 1384211 out.go:177] * Some dashboard features require the metrics-server addon. To enable all features please run:
minikube -p old-k8s-version-199824 addons enable metrics-server
I0719 05:14:09.267764 1384211 out.go:177] * Enabled addons: storage-provisioner, default-storageclass, metrics-server, dashboard
I0719 05:14:09.269793 1384211 addons.go:510] duration metric: took 19.402447789s for enable addons: enabled=[storage-provisioner default-storageclass metrics-server dashboard]
I0719 05:14:09.349808 1384211 pod_ready.go:102] pod "etcd-old-k8s-version-199824" in "kube-system" namespace has status "Ready":"False"
I0719 05:14:11.825976 1384211 pod_ready.go:102] pod "etcd-old-k8s-version-199824" in "kube-system" namespace has status "Ready":"False"
I0719 05:14:13.826500 1384211 pod_ready.go:102] pod "etcd-old-k8s-version-199824" in "kube-system" namespace has status "Ready":"False"
I0719 05:14:15.826779 1384211 pod_ready.go:102] pod "etcd-old-k8s-version-199824" in "kube-system" namespace has status "Ready":"False"
I0719 05:14:18.327458 1384211 pod_ready.go:102] pod "etcd-old-k8s-version-199824" in "kube-system" namespace has status "Ready":"False"
I0719 05:14:20.828834 1384211 pod_ready.go:102] pod "etcd-old-k8s-version-199824" in "kube-system" namespace has status "Ready":"False"
I0719 05:14:23.327503 1384211 pod_ready.go:102] pod "etcd-old-k8s-version-199824" in "kube-system" namespace has status "Ready":"False"
I0719 05:14:25.826065 1384211 pod_ready.go:102] pod "etcd-old-k8s-version-199824" in "kube-system" namespace has status "Ready":"False"
I0719 05:14:27.826317 1384211 pod_ready.go:102] pod "etcd-old-k8s-version-199824" in "kube-system" namespace has status "Ready":"False"
I0719 05:14:29.827881 1384211 pod_ready.go:102] pod "etcd-old-k8s-version-199824" in "kube-system" namespace has status "Ready":"False"
I0719 05:14:32.330659 1384211 pod_ready.go:102] pod "etcd-old-k8s-version-199824" in "kube-system" namespace has status "Ready":"False"
I0719 05:14:34.331504 1384211 pod_ready.go:102] pod "etcd-old-k8s-version-199824" in "kube-system" namespace has status "Ready":"False"
I0719 05:14:36.827284 1384211 pod_ready.go:102] pod "etcd-old-k8s-version-199824" in "kube-system" namespace has status "Ready":"False"
I0719 05:14:39.326063 1384211 pod_ready.go:102] pod "etcd-old-k8s-version-199824" in "kube-system" namespace has status "Ready":"False"
I0719 05:14:41.326891 1384211 pod_ready.go:102] pod "etcd-old-k8s-version-199824" in "kube-system" namespace has status "Ready":"False"
I0719 05:14:43.826662 1384211 pod_ready.go:102] pod "etcd-old-k8s-version-199824" in "kube-system" namespace has status "Ready":"False"
I0719 05:14:45.827203 1384211 pod_ready.go:102] pod "etcd-old-k8s-version-199824" in "kube-system" namespace has status "Ready":"False"
I0719 05:14:48.326928 1384211 pod_ready.go:102] pod "etcd-old-k8s-version-199824" in "kube-system" namespace has status "Ready":"False"
I0719 05:14:50.826367 1384211 pod_ready.go:102] pod "etcd-old-k8s-version-199824" in "kube-system" namespace has status "Ready":"False"
I0719 05:14:52.827986 1384211 pod_ready.go:102] pod "etcd-old-k8s-version-199824" in "kube-system" namespace has status "Ready":"False"
I0719 05:14:55.326447 1384211 pod_ready.go:102] pod "etcd-old-k8s-version-199824" in "kube-system" namespace has status "Ready":"False"
I0719 05:14:57.326514 1384211 pod_ready.go:102] pod "etcd-old-k8s-version-199824" in "kube-system" namespace has status "Ready":"False"
I0719 05:14:59.327598 1384211 pod_ready.go:102] pod "etcd-old-k8s-version-199824" in "kube-system" namespace has status "Ready":"False"
I0719 05:15:01.829403 1384211 pod_ready.go:102] pod "etcd-old-k8s-version-199824" in "kube-system" namespace has status "Ready":"False"
I0719 05:15:04.326326 1384211 pod_ready.go:102] pod "etcd-old-k8s-version-199824" in "kube-system" namespace has status "Ready":"False"
I0719 05:15:06.826386 1384211 pod_ready.go:102] pod "etcd-old-k8s-version-199824" in "kube-system" namespace has status "Ready":"False"
I0719 05:15:09.329027 1384211 pod_ready.go:102] pod "etcd-old-k8s-version-199824" in "kube-system" namespace has status "Ready":"False"
I0719 05:15:11.829340 1384211 pod_ready.go:102] pod "etcd-old-k8s-version-199824" in "kube-system" namespace has status "Ready":"False"
I0719 05:15:14.326672 1384211 pod_ready.go:102] pod "etcd-old-k8s-version-199824" in "kube-system" namespace has status "Ready":"False"
I0719 05:15:16.825567 1384211 pod_ready.go:102] pod "etcd-old-k8s-version-199824" in "kube-system" namespace has status "Ready":"False"
I0719 05:15:18.826401 1384211 pod_ready.go:102] pod "etcd-old-k8s-version-199824" in "kube-system" namespace has status "Ready":"False"
I0719 05:15:20.826500 1384211 pod_ready.go:102] pod "etcd-old-k8s-version-199824" in "kube-system" namespace has status "Ready":"False"
I0719 05:15:22.831606 1384211 pod_ready.go:102] pod "etcd-old-k8s-version-199824" in "kube-system" namespace has status "Ready":"False"
I0719 05:15:25.326587 1384211 pod_ready.go:102] pod "etcd-old-k8s-version-199824" in "kube-system" namespace has status "Ready":"False"
I0719 05:15:27.826497 1384211 pod_ready.go:102] pod "etcd-old-k8s-version-199824" in "kube-system" namespace has status "Ready":"False"
I0719 05:15:30.326648 1384211 pod_ready.go:102] pod "etcd-old-k8s-version-199824" in "kube-system" namespace has status "Ready":"False"
I0719 05:15:32.833349 1384211 pod_ready.go:102] pod "etcd-old-k8s-version-199824" in "kube-system" namespace has status "Ready":"False"
I0719 05:15:34.837613 1384211 pod_ready.go:102] pod "etcd-old-k8s-version-199824" in "kube-system" namespace has status "Ready":"False"
I0719 05:15:35.825764 1384211 pod_ready.go:92] pod "etcd-old-k8s-version-199824" in "kube-system" namespace has status "Ready":"True"
I0719 05:15:35.825791 1384211 pod_ready.go:81] duration metric: took 1m28.505763996s for pod "etcd-old-k8s-version-199824" in "kube-system" namespace to be "Ready" ...
I0719 05:15:35.825807 1384211 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-old-k8s-version-199824" in "kube-system" namespace to be "Ready" ...
I0719 05:15:35.831042 1384211 pod_ready.go:92] pod "kube-apiserver-old-k8s-version-199824" in "kube-system" namespace has status "Ready":"True"
I0719 05:15:35.831072 1384211 pod_ready.go:81] duration metric: took 5.255097ms for pod "kube-apiserver-old-k8s-version-199824" in "kube-system" namespace to be "Ready" ...
I0719 05:15:35.831083 1384211 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-old-k8s-version-199824" in "kube-system" namespace to be "Ready" ...
I0719 05:15:36.838506 1384211 pod_ready.go:92] pod "kube-controller-manager-old-k8s-version-199824" in "kube-system" namespace has status "Ready":"True"
I0719 05:15:36.838534 1384211 pod_ready.go:81] duration metric: took 1.007442377s for pod "kube-controller-manager-old-k8s-version-199824" in "kube-system" namespace to be "Ready" ...
I0719 05:15:36.838546 1384211 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-f8hp8" in "kube-system" namespace to be "Ready" ...
I0719 05:15:36.843764 1384211 pod_ready.go:92] pod "kube-proxy-f8hp8" in "kube-system" namespace has status "Ready":"True"
I0719 05:15:36.843791 1384211 pod_ready.go:81] duration metric: took 5.237242ms for pod "kube-proxy-f8hp8" in "kube-system" namespace to be "Ready" ...
I0719 05:15:36.843803 1384211 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-old-k8s-version-199824" in "kube-system" namespace to be "Ready" ...
I0719 05:15:36.848650 1384211 pod_ready.go:92] pod "kube-scheduler-old-k8s-version-199824" in "kube-system" namespace has status "Ready":"True"
I0719 05:15:36.848679 1384211 pod_ready.go:81] duration metric: took 4.867677ms for pod "kube-scheduler-old-k8s-version-199824" in "kube-system" namespace to be "Ready" ...
I0719 05:15:36.848691 1384211 pod_ready.go:78] waiting up to 6m0s for pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace to be "Ready" ...
I0719 05:15:38.857218 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:15:41.355741 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:15:43.854660 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:15:45.854904 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:15:47.855943 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:15:50.355073 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:15:52.856462 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:15:55.355210 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:15:57.376856 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:15:59.854370 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:16:01.855021 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:16:04.359213 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:16:06.854913 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:16:09.356221 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:16:11.853727 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:16:13.861582 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:16:16.354664 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:16:18.354992 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:16:20.356570 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:16:22.854304 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:16:25.355839 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:16:27.854674 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:16:30.360512 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:16:32.854125 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:16:35.354291 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:16:37.356404 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:16:39.854884 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:16:41.855138 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:16:44.354688 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:16:46.355407 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:16:48.854064 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:16:50.854858 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:16:52.855010 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:16:55.354467 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:16:57.354935 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:16:59.357251 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:17:01.357481 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:17:03.855997 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:17:06.355744 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:17:08.358418 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:17:10.854231 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:17:12.855739 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:17:15.355491 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:17:17.366717 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:17:19.855026 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:17:22.354542 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:17:24.354960 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:17:26.360452 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:17:28.854571 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:17:31.355690 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:17:33.854686 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:17:36.354510 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:17:38.354813 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:17:40.355297 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:17:42.356472 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:17:44.854447 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:17:46.854576 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:17:49.355398 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:17:51.854349 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:17:53.854670 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:17:56.355123 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:17:58.355641 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:18:00.357066 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:18:02.854868 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:18:05.354892 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:18:07.854427 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:18:09.855129 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:18:12.354993 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:18:14.854576 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:18:17.355842 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:18:19.858287 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:18:22.354814 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:18:24.354942 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:18:26.355448 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:18:28.854713 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:18:31.355483 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:18:33.355683 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:18:35.854525 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:18:37.855220 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:18:40.355440 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:18:42.356853 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:18:44.357025 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:18:46.858390 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:18:49.355540 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:18:51.854421 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:18:54.355585 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:18:56.355885 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:18:58.855306 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:19:01.355062 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:19:03.359863 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:19:05.858455 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:19:08.355915 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:19:10.356074 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:19:12.356170 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:19:14.356729 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:19:16.854892 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:19:18.860196 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:19:20.861207 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:19:23.354593 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:19:25.354857 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:19:27.355704 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:19:29.391475 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:19:31.857140 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:19:34.355859 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:19:36.854028 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:19:36.854063 1384211 pod_ready.go:81] duration metric: took 4m0.00536304s for pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace to be "Ready" ...
E0719 05:19:36.854074 1384211 pod_ready.go:66] WaitExtra: waitPodCondition: context deadline exceeded
I0719 05:19:36.854082 1384211 pod_ready.go:38] duration metric: took 5m29.94169991s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0719 05:19:36.854095 1384211 api_server.go:52] waiting for apiserver process to appear ...
I0719 05:19:36.854125 1384211 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
I0719 05:19:36.854190 1384211 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0719 05:19:36.899539 1384211 cri.go:89] found id: "c4ee96f9f14987ba197d6ebeaedfca8a9835c03bcb4438e7948d99e01feb867f"
I0719 05:19:36.899560 1384211 cri.go:89] found id: "fb25f9a0346cc4e0812cc4849a6418ef42d67be0c75dedeec160273a75983a4a"
I0719 05:19:36.899566 1384211 cri.go:89] found id: ""
I0719 05:19:36.899573 1384211 logs.go:276] 2 containers: [c4ee96f9f14987ba197d6ebeaedfca8a9835c03bcb4438e7948d99e01feb867f fb25f9a0346cc4e0812cc4849a6418ef42d67be0c75dedeec160273a75983a4a]
I0719 05:19:36.899626 1384211 ssh_runner.go:195] Run: which crictl
I0719 05:19:36.903027 1384211 ssh_runner.go:195] Run: which crictl
I0719 05:19:36.906445 1384211 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
I0719 05:19:36.906518 1384211 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0719 05:19:36.946760 1384211 cri.go:89] found id: "456d0a34e10d1dde1a968ac307103c4ef6a4ffb93263871b27ba3a3200910ef6"
I0719 05:19:36.946783 1384211 cri.go:89] found id: "8ea851149d390f197f798dbb1e77c9ae51eb21cceef7c8955c58d5d653fec285"
I0719 05:19:36.946788 1384211 cri.go:89] found id: ""
I0719 05:19:36.946804 1384211 logs.go:276] 2 containers: [456d0a34e10d1dde1a968ac307103c4ef6a4ffb93263871b27ba3a3200910ef6 8ea851149d390f197f798dbb1e77c9ae51eb21cceef7c8955c58d5d653fec285]
I0719 05:19:36.946861 1384211 ssh_runner.go:195] Run: which crictl
I0719 05:19:36.950479 1384211 ssh_runner.go:195] Run: which crictl
I0719 05:19:36.954580 1384211 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
I0719 05:19:36.954697 1384211 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0719 05:19:37.020711 1384211 cri.go:89] found id: "c8b2082866621ae6fed2b885d44d13d0c6212ad3f4f27e55cd3d4c0ec819d697"
I0719 05:19:37.020738 1384211 cri.go:89] found id: "ec60727167db8439a76a65e4aba2ea5d113e867f686695daf0f9f2df3a9b984b"
I0719 05:19:37.020743 1384211 cri.go:89] found id: ""
I0719 05:19:37.020752 1384211 logs.go:276] 2 containers: [c8b2082866621ae6fed2b885d44d13d0c6212ad3f4f27e55cd3d4c0ec819d697 ec60727167db8439a76a65e4aba2ea5d113e867f686695daf0f9f2df3a9b984b]
I0719 05:19:37.020819 1384211 ssh_runner.go:195] Run: which crictl
I0719 05:19:37.026447 1384211 ssh_runner.go:195] Run: which crictl
I0719 05:19:37.031605 1384211 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
I0719 05:19:37.031700 1384211 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0719 05:19:37.075602 1384211 cri.go:89] found id: "62d56ad6f80d807a731bb4564ef55663b3b92ab83af2ba7115b207aaa62578ad"
I0719 05:19:37.075626 1384211 cri.go:89] found id: "31d2288b65a8bfddfa998e3247ebb91dfa488cdde250694c21541c28d32b661b"
I0719 05:19:37.075631 1384211 cri.go:89] found id: ""
I0719 05:19:37.075638 1384211 logs.go:276] 2 containers: [62d56ad6f80d807a731bb4564ef55663b3b92ab83af2ba7115b207aaa62578ad 31d2288b65a8bfddfa998e3247ebb91dfa488cdde250694c21541c28d32b661b]
I0719 05:19:37.075694 1384211 ssh_runner.go:195] Run: which crictl
I0719 05:19:37.079226 1384211 ssh_runner.go:195] Run: which crictl
I0719 05:19:37.082643 1384211 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
I0719 05:19:37.082715 1384211 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0719 05:19:37.119815 1384211 cri.go:89] found id: "ab6deb917db3a00322591b799b4f7c940babddc66581aa3657231d21bd68a000"
I0719 05:19:37.119838 1384211 cri.go:89] found id: "78aa39803d3d37bc510fe812e66f0fd6c8b18fa73ee068c031077da23ecacce0"
I0719 05:19:37.119843 1384211 cri.go:89] found id: ""
I0719 05:19:37.119850 1384211 logs.go:276] 2 containers: [ab6deb917db3a00322591b799b4f7c940babddc66581aa3657231d21bd68a000 78aa39803d3d37bc510fe812e66f0fd6c8b18fa73ee068c031077da23ecacce0]
I0719 05:19:37.119908 1384211 ssh_runner.go:195] Run: which crictl
I0719 05:19:37.123564 1384211 ssh_runner.go:195] Run: which crictl
I0719 05:19:37.127242 1384211 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
I0719 05:19:37.127372 1384211 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0719 05:19:37.165573 1384211 cri.go:89] found id: "8b74c8c28985fd1c8cd16fff081f8a3c79c626ff33e7b7705c27d8646b2344de"
I0719 05:19:37.165592 1384211 cri.go:89] found id: "31f8a36bff2a9b66f7c2a5a8fdc3fe9b14f1b569fae35aa6b7bec34dca8ef7a7"
I0719 05:19:37.165597 1384211 cri.go:89] found id: ""
I0719 05:19:37.165603 1384211 logs.go:276] 2 containers: [8b74c8c28985fd1c8cd16fff081f8a3c79c626ff33e7b7705c27d8646b2344de 31f8a36bff2a9b66f7c2a5a8fdc3fe9b14f1b569fae35aa6b7bec34dca8ef7a7]
I0719 05:19:37.165685 1384211 ssh_runner.go:195] Run: which crictl
I0719 05:19:37.169311 1384211 ssh_runner.go:195] Run: which crictl
I0719 05:19:37.173006 1384211 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
I0719 05:19:37.173080 1384211 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0719 05:19:37.223535 1384211 cri.go:89] found id: "10539463ca76eca3ef896527ce525ab179fe6b4182358afaa9eeeeb0f58f069c"
I0719 05:19:37.223557 1384211 cri.go:89] found id: "e0ea78faa765147f1c1a9e8517bc48fd17bcb16534bcab7e02bcfe8728d4dec6"
I0719 05:19:37.223561 1384211 cri.go:89] found id: ""
I0719 05:19:37.223568 1384211 logs.go:276] 2 containers: [10539463ca76eca3ef896527ce525ab179fe6b4182358afaa9eeeeb0f58f069c e0ea78faa765147f1c1a9e8517bc48fd17bcb16534bcab7e02bcfe8728d4dec6]
I0719 05:19:37.223624 1384211 ssh_runner.go:195] Run: which crictl
I0719 05:19:37.227189 1384211 ssh_runner.go:195] Run: which crictl
I0719 05:19:37.230509 1384211 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
I0719 05:19:37.230578 1384211 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I0719 05:19:37.271449 1384211 cri.go:89] found id: "6472a666aa3686f6d4a248b14ad6c12bd855ee07f9769fb002846093117bdb3c"
I0719 05:19:37.271478 1384211 cri.go:89] found id: ""
I0719 05:19:37.271486 1384211 logs.go:276] 1 containers: [6472a666aa3686f6d4a248b14ad6c12bd855ee07f9769fb002846093117bdb3c]
I0719 05:19:37.271545 1384211 ssh_runner.go:195] Run: which crictl
I0719 05:19:37.275022 1384211 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
I0719 05:19:37.275111 1384211 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0719 05:19:37.312257 1384211 cri.go:89] found id: "9fea07ce92177cea6b541d5da457322ab3fe68c5111c73979657fea3daea5d22"
I0719 05:19:37.312282 1384211 cri.go:89] found id: "5f5f26e535c99452b4f124fa647bbe2bde0544bddf60e1a422933a407836ef89"
I0719 05:19:37.312287 1384211 cri.go:89] found id: ""
I0719 05:19:37.312295 1384211 logs.go:276] 2 containers: [9fea07ce92177cea6b541d5da457322ab3fe68c5111c73979657fea3daea5d22 5f5f26e535c99452b4f124fa647bbe2bde0544bddf60e1a422933a407836ef89]
I0719 05:19:37.312362 1384211 ssh_runner.go:195] Run: which crictl
I0719 05:19:37.315991 1384211 ssh_runner.go:195] Run: which crictl
I0719 05:19:37.319403 1384211 logs.go:123] Gathering logs for dmesg ...
I0719 05:19:37.319431 1384211 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0719 05:19:37.339582 1384211 logs.go:123] Gathering logs for kube-apiserver [c4ee96f9f14987ba197d6ebeaedfca8a9835c03bcb4438e7948d99e01feb867f] ...
I0719 05:19:37.339613 1384211 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 c4ee96f9f14987ba197d6ebeaedfca8a9835c03bcb4438e7948d99e01feb867f"
I0719 05:19:37.399981 1384211 logs.go:123] Gathering logs for kube-scheduler [31d2288b65a8bfddfa998e3247ebb91dfa488cdde250694c21541c28d32b661b] ...
I0719 05:19:37.400015 1384211 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 31d2288b65a8bfddfa998e3247ebb91dfa488cdde250694c21541c28d32b661b"
I0719 05:19:37.444251 1384211 logs.go:123] Gathering logs for kindnet [10539463ca76eca3ef896527ce525ab179fe6b4182358afaa9eeeeb0f58f069c] ...
I0719 05:19:37.444285 1384211 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 10539463ca76eca3ef896527ce525ab179fe6b4182358afaa9eeeeb0f58f069c"
I0719 05:19:37.499929 1384211 logs.go:123] Gathering logs for kubernetes-dashboard [6472a666aa3686f6d4a248b14ad6c12bd855ee07f9769fb002846093117bdb3c] ...
I0719 05:19:37.499962 1384211 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 6472a666aa3686f6d4a248b14ad6c12bd855ee07f9769fb002846093117bdb3c"
I0719 05:19:37.538114 1384211 logs.go:123] Gathering logs for container status ...
I0719 05:19:37.538142 1384211 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0719 05:19:37.587552 1384211 logs.go:123] Gathering logs for storage-provisioner [5f5f26e535c99452b4f124fa647bbe2bde0544bddf60e1a422933a407836ef89] ...
I0719 05:19:37.587627 1384211 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 5f5f26e535c99452b4f124fa647bbe2bde0544bddf60e1a422933a407836ef89"
I0719 05:19:37.626284 1384211 logs.go:123] Gathering logs for kubelet ...
I0719 05:19:37.626316 1384211 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0719 05:19:37.681581 1384211 logs.go:138] Found kubelet problem: Jul 19 05:14:06 old-k8s-version-199824 kubelet[663]: E0719 05:14:06.879898 663 reflector.go:138] object-"kube-system"/"kube-proxy-token-486sl": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kube-proxy-token-486sl" is forbidden: User "system:node:old-k8s-version-199824" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-199824' and this object
W0719 05:19:37.681810 1384211 logs.go:138] Found kubelet problem: Jul 19 05:14:06 old-k8s-version-199824 kubelet[663]: E0719 05:14:06.880125 663 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:old-k8s-version-199824" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-199824' and this object
W0719 05:19:37.682026 1384211 logs.go:138] Found kubelet problem: Jul 19 05:14:06 old-k8s-version-199824 kubelet[663]: E0719 05:14:06.880466 663 reflector.go:138] object-"kube-system"/"coredns-token-zhr5r": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "coredns-token-zhr5r" is forbidden: User "system:node:old-k8s-version-199824" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-199824' and this object
W0719 05:19:37.682228 1384211 logs.go:138] Found kubelet problem: Jul 19 05:14:06 old-k8s-version-199824 kubelet[663]: E0719 05:14:06.880696 663 reflector.go:138] object-"kube-system"/"coredns": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:old-k8s-version-199824" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-199824' and this object
W0719 05:19:37.682457 1384211 logs.go:138] Found kubelet problem: Jul 19 05:14:06 old-k8s-version-199824 kubelet[663]: E0719 05:14:06.880989 663 reflector.go:138] object-"kube-system"/"storage-provisioner-token-tkjk9": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "storage-provisioner-token-tkjk9" is forbidden: User "system:node:old-k8s-version-199824" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-199824' and this object
W0719 05:19:37.682685 1384211 logs.go:138] Found kubelet problem: Jul 19 05:14:06 old-k8s-version-199824 kubelet[663]: E0719 05:14:06.881007 663 reflector.go:138] object-"kube-system"/"kindnet-token-lncwz": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kindnet-token-lncwz" is forbidden: User "system:node:old-k8s-version-199824" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-199824' and this object
W0719 05:19:37.688812 1384211 logs.go:138] Found kubelet problem: Jul 19 05:14:08 old-k8s-version-199824 kubelet[663]: E0719 05:14:08.050691 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0719 05:19:37.692895 1384211 logs.go:138] Found kubelet problem: Jul 19 05:14:08 old-k8s-version-199824 kubelet[663]: E0719 05:14:08.778488 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0719 05:19:37.695984 1384211 logs.go:138] Found kubelet problem: Jul 19 05:14:19 old-k8s-version-199824 kubelet[663]: E0719 05:14:19.553286 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0719 05:19:37.696321 1384211 logs.go:138] Found kubelet problem: Jul 19 05:14:26 old-k8s-version-199824 kubelet[663]: E0719 05:14:26.755718 663 reflector.go:138] object-"kubernetes-dashboard"/"kubernetes-dashboard-token-xs5nw": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kubernetes-dashboard-token-xs5nw" is forbidden: User "system:node:old-k8s-version-199824" cannot list resource "secrets" in API group "" in the namespace "kubernetes-dashboard": no relationship found between node 'old-k8s-version-199824' and this object
W0719 05:19:37.697933 1384211 logs.go:138] Found kubelet problem: Jul 19 05:14:34 old-k8s-version-199824 kubelet[663]: E0719 05:14:34.547673 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0719 05:19:37.698729 1384211 logs.go:138] Found kubelet problem: Jul 19 05:14:38 old-k8s-version-199824 kubelet[663]: E0719 05:14:38.956338 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
W0719 05:19:37.699253 1384211 logs.go:138] Found kubelet problem: Jul 19 05:14:39 old-k8s-version-199824 kubelet[663]: E0719 05:14:39.959828 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
W0719 05:19:37.699702 1384211 logs.go:138] Found kubelet problem: Jul 19 05:14:40 old-k8s-version-199824 kubelet[663]: E0719 05:14:40.964790 663 pod_workers.go:191] Error syncing pod 066eb7e2-3639-4912-a7c5-7a3bc8cfd104 ("storage-provisioner_kube-system(066eb7e2-3639-4912-a7c5-7a3bc8cfd104)"), skipping: failed to "StartContainer" for "storage-provisioner" with CrashLoopBackOff: "back-off 10s restarting failed container=storage-provisioner pod=storage-provisioner_kube-system(066eb7e2-3639-4912-a7c5-7a3bc8cfd104)"
W0719 05:19:37.700038 1384211 logs.go:138] Found kubelet problem: Jul 19 05:14:44 old-k8s-version-199824 kubelet[663]: E0719 05:14:44.803493 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
W0719 05:19:37.702515 1384211 logs.go:138] Found kubelet problem: Jul 19 05:14:45 old-k8s-version-199824 kubelet[663]: E0719 05:14:45.553693 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0719 05:19:37.703618 1384211 logs.go:138] Found kubelet problem: Jul 19 05:14:57 old-k8s-version-199824 kubelet[663]: E0719 05:14:57.011919 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
W0719 05:19:37.703812 1384211 logs.go:138] Found kubelet problem: Jul 19 05:14:57 old-k8s-version-199824 kubelet[663]: E0719 05:14:57.545646 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0719 05:19:37.704142 1384211 logs.go:138] Found kubelet problem: Jul 19 05:15:04 old-k8s-version-199824 kubelet[663]: E0719 05:15:04.804038 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
W0719 05:19:37.704328 1384211 logs.go:138] Found kubelet problem: Jul 19 05:15:09 old-k8s-version-199824 kubelet[663]: E0719 05:15:09.545053 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0719 05:19:37.704659 1384211 logs.go:138] Found kubelet problem: Jul 19 05:15:16 old-k8s-version-199824 kubelet[663]: E0719 05:15:16.546724 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
W0719 05:19:37.704846 1384211 logs.go:138] Found kubelet problem: Jul 19 05:15:24 old-k8s-version-199824 kubelet[663]: E0719 05:15:24.544833 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0719 05:19:37.705436 1384211 logs.go:138] Found kubelet problem: Jul 19 05:15:28 old-k8s-version-199824 kubelet[663]: E0719 05:15:28.099362 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
W0719 05:19:37.705773 1384211 logs.go:138] Found kubelet problem: Jul 19 05:15:34 old-k8s-version-199824 kubelet[663]: E0719 05:15:34.803496 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
W0719 05:19:37.708246 1384211 logs.go:138] Found kubelet problem: Jul 19 05:15:37 old-k8s-version-199824 kubelet[663]: E0719 05:15:37.554467 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0719 05:19:37.708576 1384211 logs.go:138] Found kubelet problem: Jul 19 05:15:48 old-k8s-version-199824 kubelet[663]: E0719 05:15:48.544496 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
W0719 05:19:37.708764 1384211 logs.go:138] Found kubelet problem: Jul 19 05:15:51 old-k8s-version-199824 kubelet[663]: E0719 05:15:51.545269 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0719 05:19:37.709092 1384211 logs.go:138] Found kubelet problem: Jul 19 05:16:01 old-k8s-version-199824 kubelet[663]: E0719 05:16:01.544502 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
W0719 05:19:37.709277 1384211 logs.go:138] Found kubelet problem: Jul 19 05:16:04 old-k8s-version-199824 kubelet[663]: E0719 05:16:04.544940 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0719 05:19:37.709868 1384211 logs.go:138] Found kubelet problem: Jul 19 05:16:13 old-k8s-version-199824 kubelet[663]: E0719 05:16:13.212164 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
W0719 05:19:37.710212 1384211 logs.go:138] Found kubelet problem: Jul 19 05:16:14 old-k8s-version-199824 kubelet[663]: E0719 05:16:14.803581 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
W0719 05:19:37.710399 1384211 logs.go:138] Found kubelet problem: Jul 19 05:16:15 old-k8s-version-199824 kubelet[663]: E0719 05:16:15.548045 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0719 05:19:37.710760 1384211 logs.go:138] Found kubelet problem: Jul 19 05:16:25 old-k8s-version-199824 kubelet[663]: E0719 05:16:25.545039 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
W0719 05:19:37.710950 1384211 logs.go:138] Found kubelet problem: Jul 19 05:16:26 old-k8s-version-199824 kubelet[663]: E0719 05:16:26.544814 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0719 05:19:37.711136 1384211 logs.go:138] Found kubelet problem: Jul 19 05:16:37 old-k8s-version-199824 kubelet[663]: E0719 05:16:37.545101 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0719 05:19:37.711502 1384211 logs.go:138] Found kubelet problem: Jul 19 05:16:38 old-k8s-version-199824 kubelet[663]: E0719 05:16:38.544489 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
W0719 05:19:37.711689 1384211 logs.go:138] Found kubelet problem: Jul 19 05:16:51 old-k8s-version-199824 kubelet[663]: E0719 05:16:51.546833 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0719 05:19:37.712024 1384211 logs.go:138] Found kubelet problem: Jul 19 05:16:52 old-k8s-version-199824 kubelet[663]: E0719 05:16:52.544432 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
W0719 05:19:37.714778 1384211 logs.go:138] Found kubelet problem: Jul 19 05:17:06 old-k8s-version-199824 kubelet[663]: E0719 05:17:06.557289 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0719 05:19:37.715125 1384211 logs.go:138] Found kubelet problem: Jul 19 05:17:07 old-k8s-version-199824 kubelet[663]: E0719 05:17:07.544941 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
W0719 05:19:37.715329 1384211 logs.go:138] Found kubelet problem: Jul 19 05:17:18 old-k8s-version-199824 kubelet[663]: E0719 05:17:18.544856 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0719 05:19:37.715660 1384211 logs.go:138] Found kubelet problem: Jul 19 05:17:19 old-k8s-version-199824 kubelet[663]: E0719 05:17:19.548049 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
W0719 05:19:37.715853 1384211 logs.go:138] Found kubelet problem: Jul 19 05:17:30 old-k8s-version-199824 kubelet[663]: E0719 05:17:30.544793 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0719 05:19:37.716444 1384211 logs.go:138] Found kubelet problem: Jul 19 05:17:34 old-k8s-version-199824 kubelet[663]: E0719 05:17:34.434708 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
W0719 05:19:37.716773 1384211 logs.go:138] Found kubelet problem: Jul 19 05:17:35 old-k8s-version-199824 kubelet[663]: E0719 05:17:35.438099 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
W0719 05:19:37.716963 1384211 logs.go:138] Found kubelet problem: Jul 19 05:17:44 old-k8s-version-199824 kubelet[663]: E0719 05:17:44.544860 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0719 05:19:37.717305 1384211 logs.go:138] Found kubelet problem: Jul 19 05:17:47 old-k8s-version-199824 kubelet[663]: E0719 05:17:47.548823 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
W0719 05:19:37.717493 1384211 logs.go:138] Found kubelet problem: Jul 19 05:17:58 old-k8s-version-199824 kubelet[663]: E0719 05:17:58.544841 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0719 05:19:37.717826 1384211 logs.go:138] Found kubelet problem: Jul 19 05:18:01 old-k8s-version-199824 kubelet[663]: E0719 05:18:01.545059 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
W0719 05:19:37.718013 1384211 logs.go:138] Found kubelet problem: Jul 19 05:18:10 old-k8s-version-199824 kubelet[663]: E0719 05:18:10.544965 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0719 05:19:37.718341 1384211 logs.go:138] Found kubelet problem: Jul 19 05:18:15 old-k8s-version-199824 kubelet[663]: E0719 05:18:15.545036 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
W0719 05:19:37.718530 1384211 logs.go:138] Found kubelet problem: Jul 19 05:18:23 old-k8s-version-199824 kubelet[663]: E0719 05:18:23.547544 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0719 05:19:37.718860 1384211 logs.go:138] Found kubelet problem: Jul 19 05:18:26 old-k8s-version-199824 kubelet[663]: E0719 05:18:26.545720 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
W0719 05:19:37.719200 1384211 logs.go:138] Found kubelet problem: Jul 19 05:18:38 old-k8s-version-199824 kubelet[663]: E0719 05:18:38.544881 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
W0719 05:19:37.719385 1384211 logs.go:138] Found kubelet problem: Jul 19 05:18:38 old-k8s-version-199824 kubelet[663]: E0719 05:18:38.545132 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0719 05:19:37.719720 1384211 logs.go:138] Found kubelet problem: Jul 19 05:18:50 old-k8s-version-199824 kubelet[663]: E0719 05:18:50.544554 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
W0719 05:19:37.719904 1384211 logs.go:138] Found kubelet problem: Jul 19 05:18:50 old-k8s-version-199824 kubelet[663]: E0719 05:18:50.545182 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0719 05:19:37.720093 1384211 logs.go:138] Found kubelet problem: Jul 19 05:19:01 old-k8s-version-199824 kubelet[663]: E0719 05:19:01.545861 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0719 05:19:37.720422 1384211 logs.go:138] Found kubelet problem: Jul 19 05:19:03 old-k8s-version-199824 kubelet[663]: E0719 05:19:03.544954 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
W0719 05:19:37.720609 1384211 logs.go:138] Found kubelet problem: Jul 19 05:19:13 old-k8s-version-199824 kubelet[663]: E0719 05:19:13.553562 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0719 05:19:37.720938 1384211 logs.go:138] Found kubelet problem: Jul 19 05:19:14 old-k8s-version-199824 kubelet[663]: E0719 05:19:14.544624 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
W0719 05:19:37.721269 1384211 logs.go:138] Found kubelet problem: Jul 19 05:19:25 old-k8s-version-199824 kubelet[663]: E0719 05:19:25.548824 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
W0719 05:19:37.721455 1384211 logs.go:138] Found kubelet problem: Jul 19 05:19:26 old-k8s-version-199824 kubelet[663]: E0719 05:19:26.544794 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
I0719 05:19:37.721465 1384211 logs.go:123] Gathering logs for etcd [456d0a34e10d1dde1a968ac307103c4ef6a4ffb93263871b27ba3a3200910ef6] ...
I0719 05:19:37.721479 1384211 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 456d0a34e10d1dde1a968ac307103c4ef6a4ffb93263871b27ba3a3200910ef6"
I0719 05:19:37.765178 1384211 logs.go:123] Gathering logs for etcd [8ea851149d390f197f798dbb1e77c9ae51eb21cceef7c8955c58d5d653fec285] ...
I0719 05:19:37.765265 1384211 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 8ea851149d390f197f798dbb1e77c9ae51eb21cceef7c8955c58d5d653fec285"
I0719 05:19:37.826417 1384211 logs.go:123] Gathering logs for kube-proxy [ab6deb917db3a00322591b799b4f7c940babddc66581aa3657231d21bd68a000] ...
I0719 05:19:37.826447 1384211 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 ab6deb917db3a00322591b799b4f7c940babddc66581aa3657231d21bd68a000"
I0719 05:19:37.867680 1384211 logs.go:123] Gathering logs for kube-proxy [78aa39803d3d37bc510fe812e66f0fd6c8b18fa73ee068c031077da23ecacce0] ...
I0719 05:19:37.867707 1384211 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 78aa39803d3d37bc510fe812e66f0fd6c8b18fa73ee068c031077da23ecacce0"
I0719 05:19:37.917105 1384211 logs.go:123] Gathering logs for kube-controller-manager [31f8a36bff2a9b66f7c2a5a8fdc3fe9b14f1b569fae35aa6b7bec34dca8ef7a7] ...
I0719 05:19:37.917134 1384211 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 31f8a36bff2a9b66f7c2a5a8fdc3fe9b14f1b569fae35aa6b7bec34dca8ef7a7"
I0719 05:19:37.974080 1384211 logs.go:123] Gathering logs for kube-apiserver [fb25f9a0346cc4e0812cc4849a6418ef42d67be0c75dedeec160273a75983a4a] ...
I0719 05:19:37.974113 1384211 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 fb25f9a0346cc4e0812cc4849a6418ef42d67be0c75dedeec160273a75983a4a"
I0719 05:19:38.034472 1384211 logs.go:123] Gathering logs for coredns [c8b2082866621ae6fed2b885d44d13d0c6212ad3f4f27e55cd3d4c0ec819d697] ...
I0719 05:19:38.034508 1384211 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 c8b2082866621ae6fed2b885d44d13d0c6212ad3f4f27e55cd3d4c0ec819d697"
I0719 05:19:38.079877 1384211 logs.go:123] Gathering logs for kube-controller-manager [8b74c8c28985fd1c8cd16fff081f8a3c79c626ff33e7b7705c27d8646b2344de] ...
I0719 05:19:38.079908 1384211 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 8b74c8c28985fd1c8cd16fff081f8a3c79c626ff33e7b7705c27d8646b2344de"
I0719 05:19:38.153761 1384211 logs.go:123] Gathering logs for kindnet [e0ea78faa765147f1c1a9e8517bc48fd17bcb16534bcab7e02bcfe8728d4dec6] ...
I0719 05:19:38.153832 1384211 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e0ea78faa765147f1c1a9e8517bc48fd17bcb16534bcab7e02bcfe8728d4dec6"
I0719 05:19:38.205148 1384211 logs.go:123] Gathering logs for containerd ...
I0719 05:19:38.205180 1384211 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
I0719 05:19:38.269612 1384211 logs.go:123] Gathering logs for describe nodes ...
I0719 05:19:38.269684 1384211 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0719 05:19:38.454438 1384211 logs.go:123] Gathering logs for coredns [ec60727167db8439a76a65e4aba2ea5d113e867f686695daf0f9f2df3a9b984b] ...
I0719 05:19:38.454526 1384211 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 ec60727167db8439a76a65e4aba2ea5d113e867f686695daf0f9f2df3a9b984b"
I0719 05:19:38.495308 1384211 logs.go:123] Gathering logs for kube-scheduler [62d56ad6f80d807a731bb4564ef55663b3b92ab83af2ba7115b207aaa62578ad] ...
I0719 05:19:38.495343 1384211 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 62d56ad6f80d807a731bb4564ef55663b3b92ab83af2ba7115b207aaa62578ad"
I0719 05:19:38.534496 1384211 logs.go:123] Gathering logs for storage-provisioner [9fea07ce92177cea6b541d5da457322ab3fe68c5111c73979657fea3daea5d22] ...
I0719 05:19:38.534526 1384211 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 9fea07ce92177cea6b541d5da457322ab3fe68c5111c73979657fea3daea5d22"
I0719 05:19:38.589753 1384211 out.go:304] Setting ErrFile to fd 2...
I0719 05:19:38.589778 1384211 out.go:338] TERM=,COLORTERM=, which probably does not support color
W0719 05:19:38.589845 1384211 out.go:239] X Problems detected in kubelet:
X Problems detected in kubelet:
W0719 05:19:38.589861 1384211 out.go:239] Jul 19 05:19:03 old-k8s-version-199824 kubelet[663]: E0719 05:19:03.544954 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
Jul 19 05:19:03 old-k8s-version-199824 kubelet[663]: E0719 05:19:03.544954 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
W0719 05:19:38.589869 1384211 out.go:239] Jul 19 05:19:13 old-k8s-version-199824 kubelet[663]: E0719 05:19:13.553562 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jul 19 05:19:13 old-k8s-version-199824 kubelet[663]: E0719 05:19:13.553562 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0719 05:19:38.589895 1384211 out.go:239] Jul 19 05:19:14 old-k8s-version-199824 kubelet[663]: E0719 05:19:14.544624 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
Jul 19 05:19:14 old-k8s-version-199824 kubelet[663]: E0719 05:19:14.544624 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
W0719 05:19:38.589912 1384211 out.go:239] Jul 19 05:19:25 old-k8s-version-199824 kubelet[663]: E0719 05:19:25.548824 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
Jul 19 05:19:25 old-k8s-version-199824 kubelet[663]: E0719 05:19:25.548824 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
W0719 05:19:38.589935 1384211 out.go:239] Jul 19 05:19:26 old-k8s-version-199824 kubelet[663]: E0719 05:19:26.544794 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jul 19 05:19:26 old-k8s-version-199824 kubelet[663]: E0719 05:19:26.544794 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
I0719 05:19:38.589960 1384211 out.go:304] Setting ErrFile to fd 2...
I0719 05:19:38.589967 1384211 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0719 05:19:48.591494 1384211 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0719 05:19:48.604654 1384211 api_server.go:72] duration metric: took 5m58.737673761s to wait for apiserver process to appear ...
I0719 05:19:48.604680 1384211 api_server.go:88] waiting for apiserver healthz status ...
I0719 05:19:48.604715 1384211 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
I0719 05:19:48.604781 1384211 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0719 05:19:48.645246 1384211 cri.go:89] found id: "c4ee96f9f14987ba197d6ebeaedfca8a9835c03bcb4438e7948d99e01feb867f"
I0719 05:19:48.645276 1384211 cri.go:89] found id: "fb25f9a0346cc4e0812cc4849a6418ef42d67be0c75dedeec160273a75983a4a"
I0719 05:19:48.645282 1384211 cri.go:89] found id: ""
I0719 05:19:48.645289 1384211 logs.go:276] 2 containers: [c4ee96f9f14987ba197d6ebeaedfca8a9835c03bcb4438e7948d99e01feb867f fb25f9a0346cc4e0812cc4849a6418ef42d67be0c75dedeec160273a75983a4a]
I0719 05:19:48.645347 1384211 ssh_runner.go:195] Run: which crictl
I0719 05:19:48.649122 1384211 ssh_runner.go:195] Run: which crictl
I0719 05:19:48.652840 1384211 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
I0719 05:19:48.652913 1384211 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0719 05:19:48.692109 1384211 cri.go:89] found id: "456d0a34e10d1dde1a968ac307103c4ef6a4ffb93263871b27ba3a3200910ef6"
I0719 05:19:48.692129 1384211 cri.go:89] found id: "8ea851149d390f197f798dbb1e77c9ae51eb21cceef7c8955c58d5d653fec285"
I0719 05:19:48.692134 1384211 cri.go:89] found id: ""
I0719 05:19:48.692141 1384211 logs.go:276] 2 containers: [456d0a34e10d1dde1a968ac307103c4ef6a4ffb93263871b27ba3a3200910ef6 8ea851149d390f197f798dbb1e77c9ae51eb21cceef7c8955c58d5d653fec285]
I0719 05:19:48.692198 1384211 ssh_runner.go:195] Run: which crictl
I0719 05:19:48.696099 1384211 ssh_runner.go:195] Run: which crictl
I0719 05:19:48.699785 1384211 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
I0719 05:19:48.699884 1384211 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0719 05:19:48.739478 1384211 cri.go:89] found id: "c8b2082866621ae6fed2b885d44d13d0c6212ad3f4f27e55cd3d4c0ec819d697"
I0719 05:19:48.739502 1384211 cri.go:89] found id: "ec60727167db8439a76a65e4aba2ea5d113e867f686695daf0f9f2df3a9b984b"
I0719 05:19:48.739507 1384211 cri.go:89] found id: ""
I0719 05:19:48.739524 1384211 logs.go:276] 2 containers: [c8b2082866621ae6fed2b885d44d13d0c6212ad3f4f27e55cd3d4c0ec819d697 ec60727167db8439a76a65e4aba2ea5d113e867f686695daf0f9f2df3a9b984b]
I0719 05:19:48.739585 1384211 ssh_runner.go:195] Run: which crictl
I0719 05:19:48.743141 1384211 ssh_runner.go:195] Run: which crictl
I0719 05:19:48.746877 1384211 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
I0719 05:19:48.746966 1384211 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0719 05:19:48.792713 1384211 cri.go:89] found id: "62d56ad6f80d807a731bb4564ef55663b3b92ab83af2ba7115b207aaa62578ad"
I0719 05:19:48.792737 1384211 cri.go:89] found id: "31d2288b65a8bfddfa998e3247ebb91dfa488cdde250694c21541c28d32b661b"
I0719 05:19:48.792743 1384211 cri.go:89] found id: ""
I0719 05:19:48.792751 1384211 logs.go:276] 2 containers: [62d56ad6f80d807a731bb4564ef55663b3b92ab83af2ba7115b207aaa62578ad 31d2288b65a8bfddfa998e3247ebb91dfa488cdde250694c21541c28d32b661b]
I0719 05:19:48.792819 1384211 ssh_runner.go:195] Run: which crictl
I0719 05:19:48.796337 1384211 ssh_runner.go:195] Run: which crictl
I0719 05:19:48.799848 1384211 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
I0719 05:19:48.799917 1384211 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0719 05:19:48.840832 1384211 cri.go:89] found id: "ab6deb917db3a00322591b799b4f7c940babddc66581aa3657231d21bd68a000"
I0719 05:19:48.840894 1384211 cri.go:89] found id: "78aa39803d3d37bc510fe812e66f0fd6c8b18fa73ee068c031077da23ecacce0"
I0719 05:19:48.840914 1384211 cri.go:89] found id: ""
I0719 05:19:48.840939 1384211 logs.go:276] 2 containers: [ab6deb917db3a00322591b799b4f7c940babddc66581aa3657231d21bd68a000 78aa39803d3d37bc510fe812e66f0fd6c8b18fa73ee068c031077da23ecacce0]
I0719 05:19:48.841012 1384211 ssh_runner.go:195] Run: which crictl
I0719 05:19:48.845655 1384211 ssh_runner.go:195] Run: which crictl
I0719 05:19:48.849428 1384211 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
I0719 05:19:48.849521 1384211 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0719 05:19:48.895343 1384211 cri.go:89] found id: "8b74c8c28985fd1c8cd16fff081f8a3c79c626ff33e7b7705c27d8646b2344de"
I0719 05:19:48.895365 1384211 cri.go:89] found id: "31f8a36bff2a9b66f7c2a5a8fdc3fe9b14f1b569fae35aa6b7bec34dca8ef7a7"
I0719 05:19:48.895370 1384211 cri.go:89] found id: ""
I0719 05:19:48.895385 1384211 logs.go:276] 2 containers: [8b74c8c28985fd1c8cd16fff081f8a3c79c626ff33e7b7705c27d8646b2344de 31f8a36bff2a9b66f7c2a5a8fdc3fe9b14f1b569fae35aa6b7bec34dca8ef7a7]
I0719 05:19:48.895448 1384211 ssh_runner.go:195] Run: which crictl
I0719 05:19:48.899241 1384211 ssh_runner.go:195] Run: which crictl
I0719 05:19:48.902654 1384211 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
I0719 05:19:48.902725 1384211 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0719 05:19:48.940093 1384211 cri.go:89] found id: "10539463ca76eca3ef896527ce525ab179fe6b4182358afaa9eeeeb0f58f069c"
I0719 05:19:48.940158 1384211 cri.go:89] found id: "e0ea78faa765147f1c1a9e8517bc48fd17bcb16534bcab7e02bcfe8728d4dec6"
I0719 05:19:48.940169 1384211 cri.go:89] found id: ""
I0719 05:19:48.940177 1384211 logs.go:276] 2 containers: [10539463ca76eca3ef896527ce525ab179fe6b4182358afaa9eeeeb0f58f069c e0ea78faa765147f1c1a9e8517bc48fd17bcb16534bcab7e02bcfe8728d4dec6]
I0719 05:19:48.940262 1384211 ssh_runner.go:195] Run: which crictl
I0719 05:19:48.944026 1384211 ssh_runner.go:195] Run: which crictl
I0719 05:19:48.947549 1384211 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
I0719 05:19:48.947674 1384211 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0719 05:19:48.989665 1384211 cri.go:89] found id: "9fea07ce92177cea6b541d5da457322ab3fe68c5111c73979657fea3daea5d22"
I0719 05:19:48.989691 1384211 cri.go:89] found id: "5f5f26e535c99452b4f124fa647bbe2bde0544bddf60e1a422933a407836ef89"
I0719 05:19:48.989696 1384211 cri.go:89] found id: ""
I0719 05:19:48.989703 1384211 logs.go:276] 2 containers: [9fea07ce92177cea6b541d5da457322ab3fe68c5111c73979657fea3daea5d22 5f5f26e535c99452b4f124fa647bbe2bde0544bddf60e1a422933a407836ef89]
I0719 05:19:48.989781 1384211 ssh_runner.go:195] Run: which crictl
I0719 05:19:48.994050 1384211 ssh_runner.go:195] Run: which crictl
I0719 05:19:48.997789 1384211 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
I0719 05:19:48.997895 1384211 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I0719 05:19:49.039568 1384211 cri.go:89] found id: "6472a666aa3686f6d4a248b14ad6c12bd855ee07f9769fb002846093117bdb3c"
I0719 05:19:49.039592 1384211 cri.go:89] found id: ""
I0719 05:19:49.039600 1384211 logs.go:276] 1 containers: [6472a666aa3686f6d4a248b14ad6c12bd855ee07f9769fb002846093117bdb3c]
I0719 05:19:49.039655 1384211 ssh_runner.go:195] Run: which crictl
I0719 05:19:49.043660 1384211 logs.go:123] Gathering logs for dmesg ...
I0719 05:19:49.043682 1384211 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0719 05:19:49.062713 1384211 logs.go:123] Gathering logs for describe nodes ...
I0719 05:19:49.062740 1384211 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0719 05:19:49.209258 1384211 logs.go:123] Gathering logs for coredns [c8b2082866621ae6fed2b885d44d13d0c6212ad3f4f27e55cd3d4c0ec819d697] ...
I0719 05:19:49.209288 1384211 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 c8b2082866621ae6fed2b885d44d13d0c6212ad3f4f27e55cd3d4c0ec819d697"
I0719 05:19:49.257893 1384211 logs.go:123] Gathering logs for kindnet [e0ea78faa765147f1c1a9e8517bc48fd17bcb16534bcab7e02bcfe8728d4dec6] ...
I0719 05:19:49.257928 1384211 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e0ea78faa765147f1c1a9e8517bc48fd17bcb16534bcab7e02bcfe8728d4dec6"
I0719 05:19:49.309457 1384211 logs.go:123] Gathering logs for containerd ...
I0719 05:19:49.309493 1384211 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
I0719 05:19:49.373482 1384211 logs.go:123] Gathering logs for kube-apiserver [c4ee96f9f14987ba197d6ebeaedfca8a9835c03bcb4438e7948d99e01feb867f] ...
I0719 05:19:49.373517 1384211 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 c4ee96f9f14987ba197d6ebeaedfca8a9835c03bcb4438e7948d99e01feb867f"
I0719 05:19:49.434446 1384211 logs.go:123] Gathering logs for kube-scheduler [31d2288b65a8bfddfa998e3247ebb91dfa488cdde250694c21541c28d32b661b] ...
I0719 05:19:49.434495 1384211 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 31d2288b65a8bfddfa998e3247ebb91dfa488cdde250694c21541c28d32b661b"
I0719 05:19:49.517653 1384211 logs.go:123] Gathering logs for kindnet [10539463ca76eca3ef896527ce525ab179fe6b4182358afaa9eeeeb0f58f069c] ...
I0719 05:19:49.517749 1384211 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 10539463ca76eca3ef896527ce525ab179fe6b4182358afaa9eeeeb0f58f069c"
I0719 05:19:49.621759 1384211 logs.go:123] Gathering logs for kubernetes-dashboard [6472a666aa3686f6d4a248b14ad6c12bd855ee07f9769fb002846093117bdb3c] ...
I0719 05:19:49.621842 1384211 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 6472a666aa3686f6d4a248b14ad6c12bd855ee07f9769fb002846093117bdb3c"
I0719 05:19:49.664546 1384211 logs.go:123] Gathering logs for container status ...
I0719 05:19:49.664619 1384211 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0719 05:19:49.725263 1384211 logs.go:123] Gathering logs for kube-apiserver [fb25f9a0346cc4e0812cc4849a6418ef42d67be0c75dedeec160273a75983a4a] ...
I0719 05:19:49.725290 1384211 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 fb25f9a0346cc4e0812cc4849a6418ef42d67be0c75dedeec160273a75983a4a"
I0719 05:19:49.796726 1384211 logs.go:123] Gathering logs for etcd [8ea851149d390f197f798dbb1e77c9ae51eb21cceef7c8955c58d5d653fec285] ...
I0719 05:19:49.796759 1384211 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 8ea851149d390f197f798dbb1e77c9ae51eb21cceef7c8955c58d5d653fec285"
I0719 05:19:49.847376 1384211 logs.go:123] Gathering logs for kube-proxy [78aa39803d3d37bc510fe812e66f0fd6c8b18fa73ee068c031077da23ecacce0] ...
I0719 05:19:49.847414 1384211 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 78aa39803d3d37bc510fe812e66f0fd6c8b18fa73ee068c031077da23ecacce0"
I0719 05:19:49.893049 1384211 logs.go:123] Gathering logs for kube-controller-manager [31f8a36bff2a9b66f7c2a5a8fdc3fe9b14f1b569fae35aa6b7bec34dca8ef7a7] ...
I0719 05:19:49.893082 1384211 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 31f8a36bff2a9b66f7c2a5a8fdc3fe9b14f1b569fae35aa6b7bec34dca8ef7a7"
I0719 05:19:49.948334 1384211 logs.go:123] Gathering logs for storage-provisioner [5f5f26e535c99452b4f124fa647bbe2bde0544bddf60e1a422933a407836ef89] ...
I0719 05:19:49.948382 1384211 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 5f5f26e535c99452b4f124fa647bbe2bde0544bddf60e1a422933a407836ef89"
I0719 05:19:49.993378 1384211 logs.go:123] Gathering logs for kubelet ...
I0719 05:19:49.993405 1384211 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0719 05:19:50.053768 1384211 logs.go:138] Found kubelet problem: Jul 19 05:14:06 old-k8s-version-199824 kubelet[663]: E0719 05:14:06.879898 663 reflector.go:138] object-"kube-system"/"kube-proxy-token-486sl": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kube-proxy-token-486sl" is forbidden: User "system:node:old-k8s-version-199824" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-199824' and this object
W0719 05:19:50.053997 1384211 logs.go:138] Found kubelet problem: Jul 19 05:14:06 old-k8s-version-199824 kubelet[663]: E0719 05:14:06.880125 663 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:old-k8s-version-199824" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-199824' and this object
W0719 05:19:50.054214 1384211 logs.go:138] Found kubelet problem: Jul 19 05:14:06 old-k8s-version-199824 kubelet[663]: E0719 05:14:06.880466 663 reflector.go:138] object-"kube-system"/"coredns-token-zhr5r": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "coredns-token-zhr5r" is forbidden: User "system:node:old-k8s-version-199824" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-199824' and this object
W0719 05:19:50.054417 1384211 logs.go:138] Found kubelet problem: Jul 19 05:14:06 old-k8s-version-199824 kubelet[663]: E0719 05:14:06.880696 663 reflector.go:138] object-"kube-system"/"coredns": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:old-k8s-version-199824" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-199824' and this object
W0719 05:19:50.054647 1384211 logs.go:138] Found kubelet problem: Jul 19 05:14:06 old-k8s-version-199824 kubelet[663]: E0719 05:14:06.880989 663 reflector.go:138] object-"kube-system"/"storage-provisioner-token-tkjk9": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "storage-provisioner-token-tkjk9" is forbidden: User "system:node:old-k8s-version-199824" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-199824' and this object
W0719 05:19:50.054862 1384211 logs.go:138] Found kubelet problem: Jul 19 05:14:06 old-k8s-version-199824 kubelet[663]: E0719 05:14:06.881007 663 reflector.go:138] object-"kube-system"/"kindnet-token-lncwz": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kindnet-token-lncwz" is forbidden: User "system:node:old-k8s-version-199824" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-199824' and this object
W0719 05:19:50.061021 1384211 logs.go:138] Found kubelet problem: Jul 19 05:14:08 old-k8s-version-199824 kubelet[663]: E0719 05:14:08.050691 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0719 05:19:50.064579 1384211 logs.go:138] Found kubelet problem: Jul 19 05:14:08 old-k8s-version-199824 kubelet[663]: E0719 05:14:08.778488 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0719 05:19:50.067607 1384211 logs.go:138] Found kubelet problem: Jul 19 05:14:19 old-k8s-version-199824 kubelet[663]: E0719 05:14:19.553286 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0719 05:19:50.067945 1384211 logs.go:138] Found kubelet problem: Jul 19 05:14:26 old-k8s-version-199824 kubelet[663]: E0719 05:14:26.755718 663 reflector.go:138] object-"kubernetes-dashboard"/"kubernetes-dashboard-token-xs5nw": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kubernetes-dashboard-token-xs5nw" is forbidden: User "system:node:old-k8s-version-199824" cannot list resource "secrets" in API group "" in the namespace "kubernetes-dashboard": no relationship found between node 'old-k8s-version-199824' and this object
W0719 05:19:50.069540 1384211 logs.go:138] Found kubelet problem: Jul 19 05:14:34 old-k8s-version-199824 kubelet[663]: E0719 05:14:34.547673 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0719 05:19:50.070344 1384211 logs.go:138] Found kubelet problem: Jul 19 05:14:38 old-k8s-version-199824 kubelet[663]: E0719 05:14:38.956338 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
W0719 05:19:50.070806 1384211 logs.go:138] Found kubelet problem: Jul 19 05:14:39 old-k8s-version-199824 kubelet[663]: E0719 05:14:39.959828 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
W0719 05:19:50.071298 1384211 logs.go:138] Found kubelet problem: Jul 19 05:14:40 old-k8s-version-199824 kubelet[663]: E0719 05:14:40.964790 663 pod_workers.go:191] Error syncing pod 066eb7e2-3639-4912-a7c5-7a3bc8cfd104 ("storage-provisioner_kube-system(066eb7e2-3639-4912-a7c5-7a3bc8cfd104)"), skipping: failed to "StartContainer" for "storage-provisioner" with CrashLoopBackOff: "back-off 10s restarting failed container=storage-provisioner pod=storage-provisioner_kube-system(066eb7e2-3639-4912-a7c5-7a3bc8cfd104)"
W0719 05:19:50.071634 1384211 logs.go:138] Found kubelet problem: Jul 19 05:14:44 old-k8s-version-199824 kubelet[663]: E0719 05:14:44.803493 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
W0719 05:19:50.074089 1384211 logs.go:138] Found kubelet problem: Jul 19 05:14:45 old-k8s-version-199824 kubelet[663]: E0719 05:14:45.553693 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0719 05:19:50.075166 1384211 logs.go:138] Found kubelet problem: Jul 19 05:14:57 old-k8s-version-199824 kubelet[663]: E0719 05:14:57.011919 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
W0719 05:19:50.075379 1384211 logs.go:138] Found kubelet problem: Jul 19 05:14:57 old-k8s-version-199824 kubelet[663]: E0719 05:14:57.545646 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0719 05:19:50.075711 1384211 logs.go:138] Found kubelet problem: Jul 19 05:15:04 old-k8s-version-199824 kubelet[663]: E0719 05:15:04.804038 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
W0719 05:19:50.075901 1384211 logs.go:138] Found kubelet problem: Jul 19 05:15:09 old-k8s-version-199824 kubelet[663]: E0719 05:15:09.545053 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0719 05:19:50.076233 1384211 logs.go:138] Found kubelet problem: Jul 19 05:15:16 old-k8s-version-199824 kubelet[663]: E0719 05:15:16.546724 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
W0719 05:19:50.076419 1384211 logs.go:138] Found kubelet problem: Jul 19 05:15:24 old-k8s-version-199824 kubelet[663]: E0719 05:15:24.544833 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0719 05:19:50.077010 1384211 logs.go:138] Found kubelet problem: Jul 19 05:15:28 old-k8s-version-199824 kubelet[663]: E0719 05:15:28.099362 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
W0719 05:19:50.077343 1384211 logs.go:138] Found kubelet problem: Jul 19 05:15:34 old-k8s-version-199824 kubelet[663]: E0719 05:15:34.803496 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
W0719 05:19:50.079810 1384211 logs.go:138] Found kubelet problem: Jul 19 05:15:37 old-k8s-version-199824 kubelet[663]: E0719 05:15:37.554467 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0719 05:19:50.080143 1384211 logs.go:138] Found kubelet problem: Jul 19 05:15:48 old-k8s-version-199824 kubelet[663]: E0719 05:15:48.544496 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
W0719 05:19:50.080329 1384211 logs.go:138] Found kubelet problem: Jul 19 05:15:51 old-k8s-version-199824 kubelet[663]: E0719 05:15:51.545269 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0719 05:19:50.080658 1384211 logs.go:138] Found kubelet problem: Jul 19 05:16:01 old-k8s-version-199824 kubelet[663]: E0719 05:16:01.544502 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
W0719 05:19:50.080901 1384211 logs.go:138] Found kubelet problem: Jul 19 05:16:04 old-k8s-version-199824 kubelet[663]: E0719 05:16:04.544940 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0719 05:19:50.081498 1384211 logs.go:138] Found kubelet problem: Jul 19 05:16:13 old-k8s-version-199824 kubelet[663]: E0719 05:16:13.212164 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
W0719 05:19:50.081834 1384211 logs.go:138] Found kubelet problem: Jul 19 05:16:14 old-k8s-version-199824 kubelet[663]: E0719 05:16:14.803581 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
W0719 05:19:50.082018 1384211 logs.go:138] Found kubelet problem: Jul 19 05:16:15 old-k8s-version-199824 kubelet[663]: E0719 05:16:15.548045 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0719 05:19:50.082598 1384211 logs.go:138] Found kubelet problem: Jul 19 05:16:25 old-k8s-version-199824 kubelet[663]: E0719 05:16:25.545039 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
W0719 05:19:50.082798 1384211 logs.go:138] Found kubelet problem: Jul 19 05:16:26 old-k8s-version-199824 kubelet[663]: E0719 05:16:26.544814 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0719 05:19:50.082981 1384211 logs.go:138] Found kubelet problem: Jul 19 05:16:37 old-k8s-version-199824 kubelet[663]: E0719 05:16:37.545101 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0719 05:19:50.083415 1384211 logs.go:138] Found kubelet problem: Jul 19 05:16:38 old-k8s-version-199824 kubelet[663]: E0719 05:16:38.544489 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
W0719 05:19:50.083607 1384211 logs.go:138] Found kubelet problem: Jul 19 05:16:51 old-k8s-version-199824 kubelet[663]: E0719 05:16:51.546833 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0719 05:19:50.083949 1384211 logs.go:138] Found kubelet problem: Jul 19 05:16:52 old-k8s-version-199824 kubelet[663]: E0719 05:16:52.544432 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
W0719 05:19:50.086423 1384211 logs.go:138] Found kubelet problem: Jul 19 05:17:06 old-k8s-version-199824 kubelet[663]: E0719 05:17:06.557289 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0719 05:19:50.086751 1384211 logs.go:138] Found kubelet problem: Jul 19 05:17:07 old-k8s-version-199824 kubelet[663]: E0719 05:17:07.544941 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
W0719 05:19:50.086937 1384211 logs.go:138] Found kubelet problem: Jul 19 05:17:18 old-k8s-version-199824 kubelet[663]: E0719 05:17:18.544856 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0719 05:19:50.087276 1384211 logs.go:138] Found kubelet problem: Jul 19 05:17:19 old-k8s-version-199824 kubelet[663]: E0719 05:17:19.548049 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
W0719 05:19:50.087461 1384211 logs.go:138] Found kubelet problem: Jul 19 05:17:30 old-k8s-version-199824 kubelet[663]: E0719 05:17:30.544793 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0719 05:19:50.088067 1384211 logs.go:138] Found kubelet problem: Jul 19 05:17:34 old-k8s-version-199824 kubelet[663]: E0719 05:17:34.434708 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
W0719 05:19:50.088400 1384211 logs.go:138] Found kubelet problem: Jul 19 05:17:35 old-k8s-version-199824 kubelet[663]: E0719 05:17:35.438099 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
W0719 05:19:50.088585 1384211 logs.go:138] Found kubelet problem: Jul 19 05:17:44 old-k8s-version-199824 kubelet[663]: E0719 05:17:44.544860 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0719 05:19:50.088916 1384211 logs.go:138] Found kubelet problem: Jul 19 05:17:47 old-k8s-version-199824 kubelet[663]: E0719 05:17:47.548823 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
W0719 05:19:50.089101 1384211 logs.go:138] Found kubelet problem: Jul 19 05:17:58 old-k8s-version-199824 kubelet[663]: E0719 05:17:58.544841 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0719 05:19:50.089432 1384211 logs.go:138] Found kubelet problem: Jul 19 05:18:01 old-k8s-version-199824 kubelet[663]: E0719 05:18:01.545059 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
W0719 05:19:50.089618 1384211 logs.go:138] Found kubelet problem: Jul 19 05:18:10 old-k8s-version-199824 kubelet[663]: E0719 05:18:10.544965 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0719 05:19:50.089949 1384211 logs.go:138] Found kubelet problem: Jul 19 05:18:15 old-k8s-version-199824 kubelet[663]: E0719 05:18:15.545036 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
W0719 05:19:50.090135 1384211 logs.go:138] Found kubelet problem: Jul 19 05:18:23 old-k8s-version-199824 kubelet[663]: E0719 05:18:23.547544 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0719 05:19:50.090470 1384211 logs.go:138] Found kubelet problem: Jul 19 05:18:26 old-k8s-version-199824 kubelet[663]: E0719 05:18:26.545720 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
W0719 05:19:50.090803 1384211 logs.go:138] Found kubelet problem: Jul 19 05:18:38 old-k8s-version-199824 kubelet[663]: E0719 05:18:38.544881 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
W0719 05:19:50.090988 1384211 logs.go:138] Found kubelet problem: Jul 19 05:18:38 old-k8s-version-199824 kubelet[663]: E0719 05:18:38.545132 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0719 05:19:50.091357 1384211 logs.go:138] Found kubelet problem: Jul 19 05:18:50 old-k8s-version-199824 kubelet[663]: E0719 05:18:50.544554 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
W0719 05:19:50.091543 1384211 logs.go:138] Found kubelet problem: Jul 19 05:18:50 old-k8s-version-199824 kubelet[663]: E0719 05:18:50.545182 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0719 05:19:50.091735 1384211 logs.go:138] Found kubelet problem: Jul 19 05:19:01 old-k8s-version-199824 kubelet[663]: E0719 05:19:01.545861 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0719 05:19:50.092066 1384211 logs.go:138] Found kubelet problem: Jul 19 05:19:03 old-k8s-version-199824 kubelet[663]: E0719 05:19:03.544954 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
W0719 05:19:50.092251 1384211 logs.go:138] Found kubelet problem: Jul 19 05:19:13 old-k8s-version-199824 kubelet[663]: E0719 05:19:13.553562 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0719 05:19:50.092582 1384211 logs.go:138] Found kubelet problem: Jul 19 05:19:14 old-k8s-version-199824 kubelet[663]: E0719 05:19:14.544624 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
W0719 05:19:50.092913 1384211 logs.go:138] Found kubelet problem: Jul 19 05:19:25 old-k8s-version-199824 kubelet[663]: E0719 05:19:25.548824 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
W0719 05:19:50.093099 1384211 logs.go:138] Found kubelet problem: Jul 19 05:19:26 old-k8s-version-199824 kubelet[663]: E0719 05:19:26.544794 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0719 05:19:50.093284 1384211 logs.go:138] Found kubelet problem: Jul 19 05:19:38 old-k8s-version-199824 kubelet[663]: E0719 05:19:38.545560 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0719 05:19:50.093612 1384211 logs.go:138] Found kubelet problem: Jul 19 05:19:39 old-k8s-version-199824 kubelet[663]: E0719 05:19:39.544604 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
I0719 05:19:50.093624 1384211 logs.go:123] Gathering logs for etcd [456d0a34e10d1dde1a968ac307103c4ef6a4ffb93263871b27ba3a3200910ef6] ...
I0719 05:19:50.093640 1384211 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 456d0a34e10d1dde1a968ac307103c4ef6a4ffb93263871b27ba3a3200910ef6"
I0719 05:19:50.155702 1384211 logs.go:123] Gathering logs for coredns [ec60727167db8439a76a65e4aba2ea5d113e867f686695daf0f9f2df3a9b984b] ...
I0719 05:19:50.155740 1384211 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 ec60727167db8439a76a65e4aba2ea5d113e867f686695daf0f9f2df3a9b984b"
I0719 05:19:50.199105 1384211 logs.go:123] Gathering logs for kube-scheduler [62d56ad6f80d807a731bb4564ef55663b3b92ab83af2ba7115b207aaa62578ad] ...
I0719 05:19:50.199223 1384211 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 62d56ad6f80d807a731bb4564ef55663b3b92ab83af2ba7115b207aaa62578ad"
I0719 05:19:50.243024 1384211 logs.go:123] Gathering logs for kube-proxy [ab6deb917db3a00322591b799b4f7c940babddc66581aa3657231d21bd68a000] ...
I0719 05:19:50.243051 1384211 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 ab6deb917db3a00322591b799b4f7c940babddc66581aa3657231d21bd68a000"
I0719 05:19:50.284030 1384211 logs.go:123] Gathering logs for kube-controller-manager [8b74c8c28985fd1c8cd16fff081f8a3c79c626ff33e7b7705c27d8646b2344de] ...
I0719 05:19:50.284058 1384211 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 8b74c8c28985fd1c8cd16fff081f8a3c79c626ff33e7b7705c27d8646b2344de"
I0719 05:19:50.355314 1384211 logs.go:123] Gathering logs for storage-provisioner [9fea07ce92177cea6b541d5da457322ab3fe68c5111c73979657fea3daea5d22] ...
I0719 05:19:50.355351 1384211 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 9fea07ce92177cea6b541d5da457322ab3fe68c5111c73979657fea3daea5d22"
I0719 05:19:50.396188 1384211 out.go:304] Setting ErrFile to fd 2...
I0719 05:19:50.396213 1384211 out.go:338] TERM=,COLORTERM=, which probably does not support color
W0719 05:19:50.396258 1384211 out.go:239] X Problems detected in kubelet:
X Problems detected in kubelet:
W0719 05:19:50.396273 1384211 out.go:239] Jul 19 05:19:14 old-k8s-version-199824 kubelet[663]: E0719 05:19:14.544624 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
Jul 19 05:19:14 old-k8s-version-199824 kubelet[663]: E0719 05:19:14.544624 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
W0719 05:19:50.396280 1384211 out.go:239] Jul 19 05:19:25 old-k8s-version-199824 kubelet[663]: E0719 05:19:25.548824 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
Jul 19 05:19:25 old-k8s-version-199824 kubelet[663]: E0719 05:19:25.548824 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
W0719 05:19:50.396292 1384211 out.go:239] Jul 19 05:19:26 old-k8s-version-199824 kubelet[663]: E0719 05:19:26.544794 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jul 19 05:19:26 old-k8s-version-199824 kubelet[663]: E0719 05:19:26.544794 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0719 05:19:50.396300 1384211 out.go:239] Jul 19 05:19:38 old-k8s-version-199824 kubelet[663]: E0719 05:19:38.545560 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jul 19 05:19:38 old-k8s-version-199824 kubelet[663]: E0719 05:19:38.545560 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0719 05:19:50.396306 1384211 out.go:239] Jul 19 05:19:39 old-k8s-version-199824 kubelet[663]: E0719 05:19:39.544604 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
Jul 19 05:19:39 old-k8s-version-199824 kubelet[663]: E0719 05:19:39.544604 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
I0719 05:19:50.396316 1384211 out.go:304] Setting ErrFile to fd 2...
I0719 05:19:50.396321 1384211 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0719 05:20:00.397174 1384211 api_server.go:253] Checking apiserver healthz at https://192.168.85.2:8443/healthz ...
I0719 05:20:00.421029 1384211 api_server.go:279] https://192.168.85.2:8443/healthz returned 200:
ok
I0719 05:20:00.424548 1384211 out.go:177]
W0719 05:20:00.428654 1384211 out.go:239] X Exiting due to K8S_UNHEALTHY_CONTROL_PLANE: wait 6m0s for node: wait for healthy API server: controlPlane never updated to v1.20.0
X Exiting due to K8S_UNHEALTHY_CONTROL_PLANE: wait 6m0s for node: wait for healthy API server: controlPlane never updated to v1.20.0
W0719 05:20:00.428751 1384211 out.go:239] * Suggestion: Control Plane could not update, try minikube delete --all --purge
* Suggestion: Control Plane could not update, try minikube delete --all --purge
W0719 05:20:00.428803 1384211 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/11417
* Related issue: https://github.com/kubernetes/minikube/issues/11417
W0719 05:20:00.428813 1384211 out.go:239] *
*
W0719 05:20:00.429909 1384211 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0719 05:20:00.451930 1384211 out.go:177]
** /stderr **
start_stop_delete_test.go:259: failed to start minikube post-stop. args "out/minikube-linux-arm64 start -p old-k8s-version-199824 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=containerd --kubernetes-version=v1.20.0": exit status 102
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: docker inspect <======
helpers_test.go:231: (dbg) Run: docker inspect old-k8s-version-199824
helpers_test.go:235: (dbg) docker inspect old-k8s-version-199824:
-- stdout --
[
{
"Id": "dde52599f67bbb167b451cb941aadf63b49946cca99e5d8a496082741daf0398",
"Created": "2024-07-19T05:10:31.199322476Z",
"Path": "/usr/local/bin/entrypoint",
"Args": [
"/sbin/init"
],
"State": {
"Status": "running",
"Running": true,
"Paused": false,
"Restarting": false,
"OOMKilled": false,
"Dead": false,
"Pid": 1384419,
"ExitCode": 0,
"Error": "",
"StartedAt": "2024-07-19T05:13:42.497874035Z",
"FinishedAt": "2024-07-19T05:13:41.435282141Z"
},
"Image": "sha256:e2c91a2178aa1acdb3eade350c62303b0cf135b362b91c6aa21cd060c2dbfcac",
"ResolvConfPath": "/var/lib/docker/containers/dde52599f67bbb167b451cb941aadf63b49946cca99e5d8a496082741daf0398/resolv.conf",
"HostnamePath": "/var/lib/docker/containers/dde52599f67bbb167b451cb941aadf63b49946cca99e5d8a496082741daf0398/hostname",
"HostsPath": "/var/lib/docker/containers/dde52599f67bbb167b451cb941aadf63b49946cca99e5d8a496082741daf0398/hosts",
"LogPath": "/var/lib/docker/containers/dde52599f67bbb167b451cb941aadf63b49946cca99e5d8a496082741daf0398/dde52599f67bbb167b451cb941aadf63b49946cca99e5d8a496082741daf0398-json.log",
"Name": "/old-k8s-version-199824",
"RestartCount": 0,
"Driver": "overlay2",
"Platform": "linux",
"MountLabel": "",
"ProcessLabel": "",
"AppArmorProfile": "unconfined",
"ExecIDs": null,
"HostConfig": {
"Binds": [
"/lib/modules:/lib/modules:ro",
"old-k8s-version-199824:/var"
],
"ContainerIDFile": "",
"LogConfig": {
"Type": "json-file",
"Config": {}
},
"NetworkMode": "old-k8s-version-199824",
"PortBindings": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
]
},
"RestartPolicy": {
"Name": "no",
"MaximumRetryCount": 0
},
"AutoRemove": false,
"VolumeDriver": "",
"VolumesFrom": null,
"ConsoleSize": [
0,
0
],
"CapAdd": null,
"CapDrop": null,
"CgroupnsMode": "host",
"Dns": [],
"DnsOptions": [],
"DnsSearch": [],
"ExtraHosts": null,
"GroupAdd": null,
"IpcMode": "private",
"Cgroup": "",
"Links": null,
"OomScoreAdj": 0,
"PidMode": "",
"Privileged": true,
"PublishAllPorts": false,
"ReadonlyRootfs": false,
"SecurityOpt": [
"seccomp=unconfined",
"apparmor=unconfined",
"label=disable"
],
"Tmpfs": {
"/run": "",
"/tmp": ""
},
"UTSMode": "",
"UsernsMode": "",
"ShmSize": 67108864,
"Runtime": "runc",
"Isolation": "",
"CpuShares": 0,
"Memory": 2306867200,
"NanoCpus": 2000000000,
"CgroupParent": "",
"BlkioWeight": 0,
"BlkioWeightDevice": [],
"BlkioDeviceReadBps": [],
"BlkioDeviceWriteBps": [],
"BlkioDeviceReadIOps": [],
"BlkioDeviceWriteIOps": [],
"CpuPeriod": 0,
"CpuQuota": 0,
"CpuRealtimePeriod": 0,
"CpuRealtimeRuntime": 0,
"CpusetCpus": "",
"CpusetMems": "",
"Devices": [],
"DeviceCgroupRules": null,
"DeviceRequests": null,
"MemoryReservation": 0,
"MemorySwap": 4613734400,
"MemorySwappiness": null,
"OomKillDisable": false,
"PidsLimit": null,
"Ulimits": [],
"CpuCount": 0,
"CpuPercent": 0,
"IOMaximumIOps": 0,
"IOMaximumBandwidth": 0,
"MaskedPaths": null,
"ReadonlyPaths": null
},
"GraphDriver": {
"Data": {
"LowerDir": "/var/lib/docker/overlay2/6ab1a31820ae674c0c3eb71b558ee210296a02a73948df22c744060d7dbdb26b-init/diff:/var/lib/docker/overlay2/2e609ea860f5f6cdf3bd6d0c793f678ce717d2ec8cf34dff616a52a0dc3892ff/diff",
"MergedDir": "/var/lib/docker/overlay2/6ab1a31820ae674c0c3eb71b558ee210296a02a73948df22c744060d7dbdb26b/merged",
"UpperDir": "/var/lib/docker/overlay2/6ab1a31820ae674c0c3eb71b558ee210296a02a73948df22c744060d7dbdb26b/diff",
"WorkDir": "/var/lib/docker/overlay2/6ab1a31820ae674c0c3eb71b558ee210296a02a73948df22c744060d7dbdb26b/work"
},
"Name": "overlay2"
},
"Mounts": [
{
"Type": "bind",
"Source": "/lib/modules",
"Destination": "/lib/modules",
"Mode": "ro",
"RW": false,
"Propagation": "rprivate"
},
{
"Type": "volume",
"Name": "old-k8s-version-199824",
"Source": "/var/lib/docker/volumes/old-k8s-version-199824/_data",
"Destination": "/var",
"Driver": "local",
"Mode": "z",
"RW": true,
"Propagation": ""
}
],
"Config": {
"Hostname": "old-k8s-version-199824",
"Domainname": "",
"User": "",
"AttachStdin": false,
"AttachStdout": false,
"AttachStderr": false,
"ExposedPorts": {
"22/tcp": {},
"2376/tcp": {},
"32443/tcp": {},
"5000/tcp": {},
"8443/tcp": {}
},
"Tty": true,
"OpenStdin": false,
"StdinOnce": false,
"Env": [
"container=docker",
"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
],
"Cmd": null,
"Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f",
"Volumes": null,
"WorkingDir": "/",
"Entrypoint": [
"/usr/local/bin/entrypoint",
"/sbin/init"
],
"OnBuild": null,
"Labels": {
"created_by.minikube.sigs.k8s.io": "true",
"mode.minikube.sigs.k8s.io": "old-k8s-version-199824",
"name.minikube.sigs.k8s.io": "old-k8s-version-199824",
"role.minikube.sigs.k8s.io": ""
},
"StopSignal": "SIGRTMIN+3"
},
"NetworkSettings": {
"Bridge": "",
"SandboxID": "a63e6bf8ff3489726c7b07d6b35a657fb459ac673f74be90c60218556584b752",
"SandboxKey": "/var/run/docker/netns/a63e6bf8ff34",
"Ports": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "34547"
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "34548"
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "34551"
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "34549"
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "34550"
}
]
},
"HairpinMode": false,
"LinkLocalIPv6Address": "",
"LinkLocalIPv6PrefixLen": 0,
"SecondaryIPAddresses": null,
"SecondaryIPv6Addresses": null,
"EndpointID": "",
"Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"IPAddress": "",
"IPPrefixLen": 0,
"IPv6Gateway": "",
"MacAddress": "",
"Networks": {
"old-k8s-version-199824": {
"IPAMConfig": {
"IPv4Address": "192.168.85.2"
},
"Links": null,
"Aliases": null,
"MacAddress": "02:42:c0:a8:55:02",
"DriverOpts": null,
"NetworkID": "e5f60714d43c7ac8d68519f526e8d641ed0a7e0d5589aea6d011dec6f337440d",
"EndpointID": "ad8f28300d270bf978934dcb07b7cc6ca02c038e527050f1353a2aaa990db72d",
"Gateway": "192.168.85.1",
"IPAddress": "192.168.85.2",
"IPPrefixLen": 24,
"IPv6Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"DNSNames": [
"old-k8s-version-199824",
"dde52599f67b"
]
}
}
}
}
]
-- /stdout --
helpers_test.go:239: (dbg) Run: out/minikube-linux-arm64 status --format={{.Host}} -p old-k8s-version-199824 -n old-k8s-version-199824
helpers_test.go:244: <<< TestStartStop/group/old-k8s-version/serial/SecondStart FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: minikube logs <======
helpers_test.go:247: (dbg) Run: out/minikube-linux-arm64 -p old-k8s-version-199824 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-arm64 -p old-k8s-version-199824 logs -n 25: (1.942483946s)
helpers_test.go:252: TestStartStop/group/old-k8s-version/serial/SecondStart logs:
-- stdout --
==> Audit <==
|---------|--------------------------------------------------------|---------------------------|---------|---------|---------------------|---------------------|
| Command | Args | Profile | User | Version | Start Time | End Time |
|---------|--------------------------------------------------------|---------------------------|---------|---------|---------------------|---------------------|
| delete | -p force-systemd-flag-811848 | force-systemd-flag-811848 | jenkins | v1.33.1 | 19 Jul 24 05:09 UTC | 19 Jul 24 05:09 UTC |
| start | -p cert-options-941202 | cert-options-941202 | jenkins | v1.33.1 | 19 Jul 24 05:09 UTC | 19 Jul 24 05:10 UTC |
| | --memory=2048 | | | | | |
| | --apiserver-ips=127.0.0.1 | | | | | |
| | --apiserver-ips=192.168.15.15 | | | | | |
| | --apiserver-names=localhost | | | | | |
| | --apiserver-names=www.google.com | | | | | |
| | --apiserver-port=8555 | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| ssh | cert-options-941202 ssh | cert-options-941202 | jenkins | v1.33.1 | 19 Jul 24 05:10 UTC | 19 Jul 24 05:10 UTC |
| | openssl x509 -text -noout -in | | | | | |
| | /var/lib/minikube/certs/apiserver.crt | | | | | |
| ssh | -p cert-options-941202 -- sudo | cert-options-941202 | jenkins | v1.33.1 | 19 Jul 24 05:10 UTC | 19 Jul 24 05:10 UTC |
| | cat /etc/kubernetes/admin.conf | | | | | |
| delete | -p cert-options-941202 | cert-options-941202 | jenkins | v1.33.1 | 19 Jul 24 05:10 UTC | 19 Jul 24 05:10 UTC |
| start | -p old-k8s-version-199824 | old-k8s-version-199824 | jenkins | v1.33.1 | 19 Jul 24 05:10 UTC | 19 Jul 24 05:13 UTC |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --kvm-network=default | | | | | |
| | --kvm-qemu-uri=qemu:///system | | | | | |
| | --disable-driver-mounts | | | | | |
| | --keep-context=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --kubernetes-version=v1.20.0 | | | | | |
| start | -p cert-expiration-906267 | cert-expiration-906267 | jenkins | v1.33.1 | 19 Jul 24 05:12 UTC | 19 Jul 24 05:12 UTC |
| | --memory=2048 | | | | | |
| | --cert-expiration=8760h | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| delete | -p cert-expiration-906267 | cert-expiration-906267 | jenkins | v1.33.1 | 19 Jul 24 05:12 UTC | 19 Jul 24 05:12 UTC |
| start | -p no-preload-724981 --memory=2200 | no-preload-724981 | jenkins | v1.33.1 | 19 Jul 24 05:12 UTC | 19 Jul 24 05:13 UTC |
| | --alsologtostderr --wait=true | | | | | |
| | --preload=false --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --kubernetes-version=v1.31.0-beta.0 | | | | | |
| addons | enable metrics-server -p old-k8s-version-199824 | old-k8s-version-199824 | jenkins | v1.33.1 | 19 Jul 24 05:13 UTC | 19 Jul 24 05:13 UTC |
| | --images=MetricsServer=registry.k8s.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| stop | -p old-k8s-version-199824 | old-k8s-version-199824 | jenkins | v1.33.1 | 19 Jul 24 05:13 UTC | 19 Jul 24 05:13 UTC |
| | --alsologtostderr -v=3 | | | | | |
| addons | enable dashboard -p old-k8s-version-199824 | old-k8s-version-199824 | jenkins | v1.33.1 | 19 Jul 24 05:13 UTC | 19 Jul 24 05:13 UTC |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| start | -p old-k8s-version-199824 | old-k8s-version-199824 | jenkins | v1.33.1 | 19 Jul 24 05:13 UTC | |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --kvm-network=default | | | | | |
| | --kvm-qemu-uri=qemu:///system | | | | | |
| | --disable-driver-mounts | | | | | |
| | --keep-context=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --kubernetes-version=v1.20.0 | | | | | |
| addons | enable metrics-server -p no-preload-724981 | no-preload-724981 | jenkins | v1.33.1 | 19 Jul 24 05:13 UTC | 19 Jul 24 05:13 UTC |
| | --images=MetricsServer=registry.k8s.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| stop | -p no-preload-724981 | no-preload-724981 | jenkins | v1.33.1 | 19 Jul 24 05:13 UTC | 19 Jul 24 05:14 UTC |
| | --alsologtostderr -v=3 | | | | | |
| addons | enable dashboard -p no-preload-724981 | no-preload-724981 | jenkins | v1.33.1 | 19 Jul 24 05:14 UTC | 19 Jul 24 05:14 UTC |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| start | -p no-preload-724981 --memory=2200 | no-preload-724981 | jenkins | v1.33.1 | 19 Jul 24 05:14 UTC | 19 Jul 24 05:18 UTC |
| | --alsologtostderr --wait=true | | | | | |
| | --preload=false --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --kubernetes-version=v1.31.0-beta.0 | | | | | |
| image | no-preload-724981 image list | no-preload-724981 | jenkins | v1.33.1 | 19 Jul 24 05:18 UTC | 19 Jul 24 05:18 UTC |
| | --format=json | | | | | |
| pause | -p no-preload-724981 | no-preload-724981 | jenkins | v1.33.1 | 19 Jul 24 05:18 UTC | 19 Jul 24 05:18 UTC |
| | --alsologtostderr -v=1 | | | | | |
| unpause | -p no-preload-724981 | no-preload-724981 | jenkins | v1.33.1 | 19 Jul 24 05:18 UTC | 19 Jul 24 05:18 UTC |
| | --alsologtostderr -v=1 | | | | | |
| delete | -p no-preload-724981 | no-preload-724981 | jenkins | v1.33.1 | 19 Jul 24 05:18 UTC | 19 Jul 24 05:18 UTC |
| delete | -p no-preload-724981 | no-preload-724981 | jenkins | v1.33.1 | 19 Jul 24 05:18 UTC | 19 Jul 24 05:18 UTC |
| start | -p embed-certs-371220 | embed-certs-371220 | jenkins | v1.33.1 | 19 Jul 24 05:18 UTC | 19 Jul 24 05:19 UTC |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --embed-certs --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --kubernetes-version=v1.30.3 | | | | | |
| addons | enable metrics-server -p embed-certs-371220 | embed-certs-371220 | jenkins | v1.33.1 | 19 Jul 24 05:19 UTC | 19 Jul 24 05:19 UTC |
| | --images=MetricsServer=registry.k8s.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| stop | -p embed-certs-371220 | embed-certs-371220 | jenkins | v1.33.1 | 19 Jul 24 05:19 UTC | |
| | --alsologtostderr -v=3 | | | | | |
|---------|--------------------------------------------------------|---------------------------|---------|---------|---------------------|---------------------|
==> Last Start <==
Log file created at: 2024/07/19 05:18:47
Running on machine: ip-172-31-31-251
Binary: Built with gc go1.22.5 for linux/arm64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I0719 05:18:47.592014 1393455 out.go:291] Setting OutFile to fd 1 ...
I0719 05:18:47.592242 1393455 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0719 05:18:47.592271 1393455 out.go:304] Setting ErrFile to fd 2...
I0719 05:18:47.592291 1393455 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0719 05:18:47.592567 1393455 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19302-1169903/.minikube/bin
I0719 05:18:47.593059 1393455 out.go:298] Setting JSON to false
I0719 05:18:47.594379 1393455 start.go:129] hostinfo: {"hostname":"ip-172-31-31-251","uptime":25272,"bootTime":1721341056,"procs":231,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1064-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"982e3628-3742-4b3e-bb63-ac1b07660ec7"}
I0719 05:18:47.594482 1393455 start.go:139] virtualization:
I0719 05:18:47.598278 1393455 out.go:177] * [embed-certs-371220] minikube v1.33.1 on Ubuntu 20.04 (arm64)
I0719 05:18:47.599993 1393455 out.go:177] - MINIKUBE_LOCATION=19302
I0719 05:18:47.600076 1393455 notify.go:220] Checking for updates...
I0719 05:18:47.603554 1393455 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0719 05:18:47.606121 1393455 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/19302-1169903/kubeconfig
I0719 05:18:47.607742 1393455 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/19302-1169903/.minikube
I0719 05:18:47.609672 1393455 out.go:177] - MINIKUBE_BIN=out/minikube-linux-arm64
I0719 05:18:47.612350 1393455 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0719 05:18:47.614919 1393455 config.go:182] Loaded profile config "old-k8s-version-199824": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0
I0719 05:18:47.615059 1393455 driver.go:392] Setting default libvirt URI to qemu:///system
I0719 05:18:47.637265 1393455 docker.go:123] docker version: linux-27.0.3:Docker Engine - Community
I0719 05:18:47.637380 1393455 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0719 05:18:47.697856 1393455 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:35 OomKillDisable:true NGoroutines:53 SystemTime:2024-07-19 05:18:47.688371439 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1064-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214896640 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:27.0.3 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41 Expected:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.15.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.28.1]] Warnings:<nil>}}
I0719 05:18:47.697972 1393455 docker.go:307] overlay module found
I0719 05:18:47.700367 1393455 out.go:177] * Using the docker driver based on user configuration
I0719 05:18:47.702201 1393455 start.go:297] selected driver: docker
I0719 05:18:47.702219 1393455 start.go:901] validating driver "docker" against <nil>
I0719 05:18:47.702234 1393455 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0719 05:18:47.702875 1393455 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0719 05:18:47.757409 1393455 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:35 OomKillDisable:true NGoroutines:53 SystemTime:2024-07-19 05:18:47.74791182 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1064-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aarc
h64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214896640 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:27.0.3 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41 Expected:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerError
s:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.15.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.28.1]] Warnings:<nil>}}
I0719 05:18:47.757596 1393455 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0719 05:18:47.757836 1393455 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0719 05:18:47.760183 1393455 out.go:177] * Using Docker driver with root privileges
I0719 05:18:47.761987 1393455 cni.go:84] Creating CNI manager for ""
I0719 05:18:47.762008 1393455 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0719 05:18:47.762020 1393455 start_flags.go:319] Found "CNI" CNI - setting NetworkPlugin=cni
I0719 05:18:47.762136 1393455 start.go:340] cluster config:
{Name:embed-certs-371220 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.3 ClusterName:embed-certs-371220 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Contain
erRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: Stati
cIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0719 05:18:47.764157 1393455 out.go:177] * Starting "embed-certs-371220" primary control-plane node in "embed-certs-371220" cluster
I0719 05:18:47.766016 1393455 cache.go:121] Beginning downloading kic base image for docker with containerd
I0719 05:18:47.768566 1393455 out.go:177] * Pulling base image v0.0.44-1721324606-19298 ...
I0719 05:18:47.770332 1393455 preload.go:131] Checking if preload exists for k8s version v1.30.3 and runtime containerd
I0719 05:18:47.770379 1393455 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19302-1169903/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.3-containerd-overlay2-arm64.tar.lz4
I0719 05:18:47.770387 1393455 cache.go:56] Caching tarball of preloaded images
I0719 05:18:47.770513 1393455 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f in local docker daemon
I0719 05:18:47.770685 1393455 preload.go:172] Found /home/jenkins/minikube-integration/19302-1169903/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.3-containerd-overlay2-arm64.tar.lz4 in cache, skipping download
I0719 05:18:47.770706 1393455 cache.go:59] Finished verifying existence of preloaded tar for v1.30.3 on containerd
I0719 05:18:47.770844 1393455 profile.go:143] Saving config to /home/jenkins/minikube-integration/19302-1169903/.minikube/profiles/embed-certs-371220/config.json ...
I0719 05:18:47.770878 1393455 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19302-1169903/.minikube/profiles/embed-certs-371220/config.json: {Name:mk10487a4078a05e00515171d64babc73afe5ca0 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
W0719 05:18:47.794782 1393455 image.go:95] image gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f is of wrong architecture
I0719 05:18:47.794804 1393455 cache.go:149] Downloading gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f to local cache
I0719 05:18:47.794881 1393455 image.go:63] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f in local cache directory
I0719 05:18:47.794899 1393455 image.go:66] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f in local cache directory, skipping pull
I0719 05:18:47.794904 1393455 image.go:135] gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f exists in cache, skipping pull
I0719 05:18:47.794912 1393455 cache.go:152] successfully saved gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f as a tarball
I0719 05:18:47.794917 1393455 cache.go:162] Loading gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f from local cache
I0719 05:18:47.922838 1393455 cache.go:164] successfully loaded and using gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f from cached tarball
I0719 05:18:47.922880 1393455 cache.go:194] Successfully downloaded all kic artifacts
I0719 05:18:47.922932 1393455 start.go:360] acquireMachinesLock for embed-certs-371220: {Name:mk6f520a87af2531173a188cca095ecfde41d13d Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0719 05:18:47.923053 1393455 start.go:364] duration metric: took 97.058µs to acquireMachinesLock for "embed-certs-371220"
I0719 05:18:47.923085 1393455 start.go:93] Provisioning new machine with config: &{Name:embed-certs-371220 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.3 ClusterName:embed-certs-371220 Namespace:default APIServerHAVIP: APIServe
rName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableM
etrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:containerd ControlPlane:true Worker:true}
I0719 05:18:47.923206 1393455 start.go:125] createHost starting for "" (driver="docker")
I0719 05:18:49.355540 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:18:51.854421 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:18:47.925737 1393455 out.go:204] * Creating docker container (CPUs=2, Memory=2200MB) ...
I0719 05:18:47.926005 1393455 start.go:159] libmachine.API.Create for "embed-certs-371220" (driver="docker")
I0719 05:18:47.926049 1393455 client.go:168] LocalClient.Create starting
I0719 05:18:47.926129 1393455 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19302-1169903/.minikube/certs/ca.pem
I0719 05:18:47.926166 1393455 main.go:141] libmachine: Decoding PEM data...
I0719 05:18:47.926184 1393455 main.go:141] libmachine: Parsing certificate...
I0719 05:18:47.926241 1393455 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19302-1169903/.minikube/certs/cert.pem
I0719 05:18:47.926275 1393455 main.go:141] libmachine: Decoding PEM data...
I0719 05:18:47.926295 1393455 main.go:141] libmachine: Parsing certificate...
I0719 05:18:47.926671 1393455 cli_runner.go:164] Run: docker network inspect embed-certs-371220 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
W0719 05:18:47.941812 1393455 cli_runner.go:211] docker network inspect embed-certs-371220 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
I0719 05:18:47.941897 1393455 network_create.go:284] running [docker network inspect embed-certs-371220] to gather additional debugging logs...
I0719 05:18:47.941919 1393455 cli_runner.go:164] Run: docker network inspect embed-certs-371220
W0719 05:18:47.957389 1393455 cli_runner.go:211] docker network inspect embed-certs-371220 returned with exit code 1
I0719 05:18:47.957421 1393455 network_create.go:287] error running [docker network inspect embed-certs-371220]: docker network inspect embed-certs-371220: exit status 1
stdout:
[]
stderr:
Error response from daemon: network embed-certs-371220 not found
I0719 05:18:47.957440 1393455 network_create.go:289] output of [docker network inspect embed-certs-371220]: -- stdout --
[]
-- /stdout --
** stderr **
Error response from daemon: network embed-certs-371220 not found
** /stderr **
I0719 05:18:47.957543 1393455 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0719 05:18:47.973232 1393455 network.go:211] skipping subnet 192.168.49.0/24 that is taken: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName:br-fd6e8fae9218 IfaceIPv4:192.168.49.1 IfaceMTU:1500 IfaceMAC:02:42:ad:9e:75:e0} reservation:<nil>}
I0719 05:18:47.973683 1393455 network.go:211] skipping subnet 192.168.58.0/24 that is taken: &{IP:192.168.58.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.58.0/24 Gateway:192.168.58.1 ClientMin:192.168.58.2 ClientMax:192.168.58.254 Broadcast:192.168.58.255 IsPrivate:true Interface:{IfaceName:br-3bcbb58e7bea IfaceIPv4:192.168.58.1 IfaceMTU:1500 IfaceMAC:02:42:a0:bc:f8:33} reservation:<nil>}
I0719 05:18:47.974183 1393455 network.go:211] skipping subnet 192.168.67.0/24 that is taken: &{IP:192.168.67.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.67.0/24 Gateway:192.168.67.1 ClientMin:192.168.67.2 ClientMax:192.168.67.254 Broadcast:192.168.67.255 IsPrivate:true Interface:{IfaceName:br-84d8f8799f2a IfaceIPv4:192.168.67.1 IfaceMTU:1500 IfaceMAC:02:42:f7:e9:8e:9c} reservation:<nil>}
I0719 05:18:47.974741 1393455 network.go:206] using free private subnet 192.168.76.0/24: &{IP:192.168.76.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.76.0/24 Gateway:192.168.76.1 ClientMin:192.168.76.2 ClientMax:192.168.76.254 Broadcast:192.168.76.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0x400187cba0}
I0719 05:18:47.974765 1393455 network_create.go:124] attempt to create docker network embed-certs-371220 192.168.76.0/24 with gateway 192.168.76.1 and MTU of 1500 ...
I0719 05:18:47.974828 1393455 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.76.0/24 --gateway=192.168.76.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=embed-certs-371220 embed-certs-371220
I0719 05:18:48.055974 1393455 network_create.go:108] docker network embed-certs-371220 192.168.76.0/24 created
I0719 05:18:48.056009 1393455 kic.go:121] calculated static IP "192.168.76.2" for the "embed-certs-371220" container
I0719 05:18:48.056116 1393455 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
I0719 05:18:48.073244 1393455 cli_runner.go:164] Run: docker volume create embed-certs-371220 --label name.minikube.sigs.k8s.io=embed-certs-371220 --label created_by.minikube.sigs.k8s.io=true
I0719 05:18:48.091471 1393455 oci.go:103] Successfully created a docker volume embed-certs-371220
I0719 05:18:48.091570 1393455 cli_runner.go:164] Run: docker run --rm --name embed-certs-371220-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=embed-certs-371220 --entrypoint /usr/bin/test -v embed-certs-371220:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f -d /var/lib
I0719 05:18:48.736708 1393455 oci.go:107] Successfully prepared a docker volume embed-certs-371220
I0719 05:18:48.736761 1393455 preload.go:131] Checking if preload exists for k8s version v1.30.3 and runtime containerd
I0719 05:18:48.736783 1393455 kic.go:194] Starting extracting preloaded images to volume ...
I0719 05:18:48.736875 1393455 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/19302-1169903/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.3-containerd-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v embed-certs-371220:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f -I lz4 -xf /preloaded.tar -C /extractDir
I0719 05:18:54.355585 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:18:56.355885 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:18:54.421326 1393455 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/19302-1169903/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.3-containerd-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v embed-certs-371220:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f -I lz4 -xf /preloaded.tar -C /extractDir: (5.684412108s)
I0719 05:18:54.421362 1393455 kic.go:203] duration metric: took 5.684574741s to extract preloaded images to volume ...
W0719 05:18:54.421496 1393455 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
I0719 05:18:54.421610 1393455 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
I0719 05:18:54.476542 1393455 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname embed-certs-371220 --name embed-certs-371220 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=embed-certs-371220 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=embed-certs-371220 --network embed-certs-371220 --ip 192.168.76.2 --volume embed-certs-371220:/var --security-opt apparmor=unconfined --memory=2200mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f
I0719 05:18:54.846409 1393455 cli_runner.go:164] Run: docker container inspect embed-certs-371220 --format={{.State.Running}}
I0719 05:18:54.869566 1393455 cli_runner.go:164] Run: docker container inspect embed-certs-371220 --format={{.State.Status}}
I0719 05:18:54.886370 1393455 cli_runner.go:164] Run: docker exec embed-certs-371220 stat /var/lib/dpkg/alternatives/iptables
I0719 05:18:54.943097 1393455 oci.go:144] the created container "embed-certs-371220" has a running status.
I0719 05:18:54.943126 1393455 kic.go:225] Creating ssh key for kic: /home/jenkins/minikube-integration/19302-1169903/.minikube/machines/embed-certs-371220/id_rsa...
I0719 05:18:55.754362 1393455 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/19302-1169903/.minikube/machines/embed-certs-371220/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
I0719 05:18:55.776945 1393455 cli_runner.go:164] Run: docker container inspect embed-certs-371220 --format={{.State.Status}}
I0719 05:18:55.807047 1393455 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
I0719 05:18:55.807070 1393455 kic_runner.go:114] Args: [docker exec --privileged embed-certs-371220 chown docker:docker /home/docker/.ssh/authorized_keys]
I0719 05:18:55.882205 1393455 cli_runner.go:164] Run: docker container inspect embed-certs-371220 --format={{.State.Status}}
I0719 05:18:55.905858 1393455 machine.go:94] provisionDockerMachine start ...
I0719 05:18:55.905980 1393455 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-371220
I0719 05:18:55.937247 1393455 main.go:141] libmachine: Using SSH client type: native
I0719 05:18:55.937516 1393455 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2cd0] 0x3e5530 <nil> [] 0s} 127.0.0.1 34557 <nil> <nil>}
I0719 05:18:55.937525 1393455 main.go:141] libmachine: About to run SSH command:
hostname
I0719 05:18:56.075230 1393455 main.go:141] libmachine: SSH cmd err, output: <nil>: embed-certs-371220
I0719 05:18:56.075295 1393455 ubuntu.go:169] provisioning hostname "embed-certs-371220"
I0719 05:18:56.075397 1393455 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-371220
I0719 05:18:56.096302 1393455 main.go:141] libmachine: Using SSH client type: native
I0719 05:18:56.096570 1393455 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2cd0] 0x3e5530 <nil> [] 0s} 127.0.0.1 34557 <nil> <nil>}
I0719 05:18:56.096582 1393455 main.go:141] libmachine: About to run SSH command:
sudo hostname embed-certs-371220 && echo "embed-certs-371220" | sudo tee /etc/hostname
I0719 05:18:56.239954 1393455 main.go:141] libmachine: SSH cmd err, output: <nil>: embed-certs-371220
I0719 05:18:56.240032 1393455 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-371220
I0719 05:18:56.257365 1393455 main.go:141] libmachine: Using SSH client type: native
I0719 05:18:56.257609 1393455 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2cd0] 0x3e5530 <nil> [] 0s} 127.0.0.1 34557 <nil> <nil>}
I0719 05:18:56.257627 1393455 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sembed-certs-371220' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 embed-certs-371220/g' /etc/hosts;
else
echo '127.0.1.1 embed-certs-371220' | sudo tee -a /etc/hosts;
fi
fi
I0719 05:18:56.379358 1393455 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0719 05:18:56.379384 1393455 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/19302-1169903/.minikube CaCertPath:/home/jenkins/minikube-integration/19302-1169903/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19302-1169903/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19302-1169903/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19302-1169903/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19302-1169903/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19302-1169903/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19302-1169903/.minikube}
I0719 05:18:56.379403 1393455 ubuntu.go:177] setting up certificates
I0719 05:18:56.379414 1393455 provision.go:84] configureAuth start
I0719 05:18:56.379482 1393455 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-371220
I0719 05:18:56.396809 1393455 provision.go:143] copyHostCerts
I0719 05:18:56.396875 1393455 exec_runner.go:144] found /home/jenkins/minikube-integration/19302-1169903/.minikube/cert.pem, removing ...
I0719 05:18:56.396887 1393455 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19302-1169903/.minikube/cert.pem
I0719 05:18:56.396965 1393455 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19302-1169903/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19302-1169903/.minikube/cert.pem (1123 bytes)
I0719 05:18:56.397082 1393455 exec_runner.go:144] found /home/jenkins/minikube-integration/19302-1169903/.minikube/key.pem, removing ...
I0719 05:18:56.397095 1393455 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19302-1169903/.minikube/key.pem
I0719 05:18:56.397128 1393455 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19302-1169903/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19302-1169903/.minikube/key.pem (1679 bytes)
I0719 05:18:56.397198 1393455 exec_runner.go:144] found /home/jenkins/minikube-integration/19302-1169903/.minikube/ca.pem, removing ...
I0719 05:18:56.397208 1393455 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19302-1169903/.minikube/ca.pem
I0719 05:18:56.397235 1393455 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19302-1169903/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19302-1169903/.minikube/ca.pem (1078 bytes)
I0719 05:18:56.397302 1393455 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19302-1169903/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19302-1169903/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19302-1169903/.minikube/certs/ca-key.pem org=jenkins.embed-certs-371220 san=[127.0.0.1 192.168.76.2 embed-certs-371220 localhost minikube]
I0719 05:18:56.684292 1393455 provision.go:177] copyRemoteCerts
I0719 05:18:56.684363 1393455 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0719 05:18:56.684407 1393455 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-371220
I0719 05:18:56.702640 1393455 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34557 SSHKeyPath:/home/jenkins/minikube-integration/19302-1169903/.minikube/machines/embed-certs-371220/id_rsa Username:docker}
I0719 05:18:56.796889 1393455 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19302-1169903/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0719 05:18:56.822918 1393455 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19302-1169903/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0719 05:18:56.849857 1393455 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19302-1169903/.minikube/machines/server.pem --> /etc/docker/server.pem (1224 bytes)
I0719 05:18:56.875418 1393455 provision.go:87] duration metric: took 495.988532ms to configureAuth
I0719 05:18:56.875446 1393455 ubuntu.go:193] setting minikube options for container-runtime
I0719 05:18:56.875667 1393455 config.go:182] Loaded profile config "embed-certs-371220": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.30.3
I0719 05:18:56.875687 1393455 machine.go:97] duration metric: took 969.811428ms to provisionDockerMachine
I0719 05:18:56.875694 1393455 client.go:171] duration metric: took 8.94963323s to LocalClient.Create
I0719 05:18:56.875714 1393455 start.go:167] duration metric: took 8.949710292s to libmachine.API.Create "embed-certs-371220"
I0719 05:18:56.875727 1393455 start.go:293] postStartSetup for "embed-certs-371220" (driver="docker")
I0719 05:18:56.875737 1393455 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0719 05:18:56.875790 1393455 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0719 05:18:56.875837 1393455 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-371220
I0719 05:18:56.893575 1393455 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34557 SSHKeyPath:/home/jenkins/minikube-integration/19302-1169903/.minikube/machines/embed-certs-371220/id_rsa Username:docker}
I0719 05:18:56.984495 1393455 ssh_runner.go:195] Run: cat /etc/os-release
I0719 05:18:56.987956 1393455 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0719 05:18:56.987991 1393455 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0719 05:18:56.988003 1393455 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0719 05:18:56.988011 1393455 info.go:137] Remote host: Ubuntu 22.04.4 LTS
I0719 05:18:56.988024 1393455 filesync.go:126] Scanning /home/jenkins/minikube-integration/19302-1169903/.minikube/addons for local assets ...
I0719 05:18:56.988084 1393455 filesync.go:126] Scanning /home/jenkins/minikube-integration/19302-1169903/.minikube/files for local assets ...
I0719 05:18:56.988172 1393455 filesync.go:149] local asset: /home/jenkins/minikube-integration/19302-1169903/.minikube/files/etc/ssl/certs/11752862.pem -> 11752862.pem in /etc/ssl/certs
I0719 05:18:56.988282 1393455 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0719 05:18:56.997940 1393455 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19302-1169903/.minikube/files/etc/ssl/certs/11752862.pem --> /etc/ssl/certs/11752862.pem (1708 bytes)
I0719 05:18:57.026678 1393455 start.go:296] duration metric: took 150.934301ms for postStartSetup
I0719 05:18:57.027118 1393455 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-371220
I0719 05:18:57.044712 1393455 profile.go:143] Saving config to /home/jenkins/minikube-integration/19302-1169903/.minikube/profiles/embed-certs-371220/config.json ...
I0719 05:18:57.045023 1393455 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0719 05:18:57.045078 1393455 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-371220
I0719 05:18:57.061567 1393455 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34557 SSHKeyPath:/home/jenkins/minikube-integration/19302-1169903/.minikube/machines/embed-certs-371220/id_rsa Username:docker}
I0719 05:18:57.152024 1393455 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I0719 05:18:57.156462 1393455 start.go:128] duration metric: took 9.233240601s to createHost
I0719 05:18:57.156494 1393455 start.go:83] releasing machines lock for "embed-certs-371220", held for 9.23342364s
I0719 05:18:57.156563 1393455 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-371220
I0719 05:18:57.173199 1393455 ssh_runner.go:195] Run: cat /version.json
I0719 05:18:57.173266 1393455 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-371220
I0719 05:18:57.173511 1393455 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0719 05:18:57.173567 1393455 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-371220
I0719 05:18:57.191960 1393455 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34557 SSHKeyPath:/home/jenkins/minikube-integration/19302-1169903/.minikube/machines/embed-certs-371220/id_rsa Username:docker}
I0719 05:18:57.192744 1393455 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34557 SSHKeyPath:/home/jenkins/minikube-integration/19302-1169903/.minikube/machines/embed-certs-371220/id_rsa Username:docker}
I0719 05:18:57.406878 1393455 ssh_runner.go:195] Run: systemctl --version
I0719 05:18:57.411433 1393455 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I0719 05:18:57.415666 1393455 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
I0719 05:18:57.443991 1393455 cni.go:230] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
I0719 05:18:57.444073 1393455 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0719 05:18:57.473027 1393455 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist, /etc/cni/net.d/100-crio-bridge.conf] bridge cni config(s)
I0719 05:18:57.473050 1393455 start.go:495] detecting cgroup driver to use...
I0719 05:18:57.473101 1393455 detect.go:187] detected "cgroupfs" cgroup driver on host os
I0719 05:18:57.473166 1393455 ssh_runner.go:195] Run: sudo systemctl stop -f crio
I0719 05:18:57.486012 1393455 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I0719 05:18:57.498284 1393455 docker.go:217] disabling cri-docker service (if available) ...
I0719 05:18:57.498346 1393455 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0719 05:18:57.513270 1393455 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0719 05:18:57.529518 1393455 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0719 05:18:57.647903 1393455 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0719 05:18:57.747330 1393455 docker.go:233] disabling docker service ...
I0719 05:18:57.747427 1393455 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0719 05:18:57.783329 1393455 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0719 05:18:57.795975 1393455 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0719 05:18:57.920921 1393455 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0719 05:18:58.016769 1393455 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0719 05:18:58.030952 1393455 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///run/containerd/containerd.sock
" | sudo tee /etc/crictl.yaml"
I0719 05:18:58.052223 1393455 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.9"|' /etc/containerd/config.toml"
I0719 05:18:58.067256 1393455 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
I0719 05:18:58.080624 1393455 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...
I0719 05:18:58.080806 1393455 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
I0719 05:18:58.093573 1393455 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0719 05:18:58.104644 1393455 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
I0719 05:18:58.116385 1393455 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0719 05:18:58.127511 1393455 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0719 05:18:58.137865 1393455 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
I0719 05:18:58.149065 1393455 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *enable_unprivileged_ports = .*/d' /etc/containerd/config.toml"
I0719 05:18:58.160143 1393455 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)\[plugins."io.containerd.grpc.v1.cri"\]|&\n\1 enable_unprivileged_ports = true|' /etc/containerd/config.toml"
I0719 05:18:58.171779 1393455 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0719 05:18:58.180678 1393455 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0719 05:18:58.190082 1393455 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0719 05:18:58.282680 1393455 ssh_runner.go:195] Run: sudo systemctl restart containerd
I0719 05:18:58.427875 1393455 start.go:542] Will wait 60s for socket path /run/containerd/containerd.sock
I0719 05:18:58.427959 1393455 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
I0719 05:18:58.431979 1393455 start.go:563] Will wait 60s for crictl version
I0719 05:18:58.432047 1393455 ssh_runner.go:195] Run: which crictl
I0719 05:18:58.435501 1393455 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0719 05:18:58.493574 1393455 start.go:579] Version: 0.1.0
RuntimeName: containerd
RuntimeVersion: 1.7.19
RuntimeApiVersion: v1
I0719 05:18:58.493643 1393455 ssh_runner.go:195] Run: containerd --version
I0719 05:18:58.519335 1393455 ssh_runner.go:195] Run: containerd --version
I0719 05:18:58.551036 1393455 out.go:177] * Preparing Kubernetes v1.30.3 on containerd 1.7.19 ...
I0719 05:18:58.553021 1393455 cli_runner.go:164] Run: docker network inspect embed-certs-371220 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0719 05:18:58.567608 1393455 ssh_runner.go:195] Run: grep 192.168.76.1 host.minikube.internal$ /etc/hosts
I0719 05:18:58.571564 1393455 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.76.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0719 05:18:58.582911 1393455 kubeadm.go:883] updating cluster {Name:embed-certs-371220 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.3 ClusterName:embed-certs-371220 Namespace:default APIServerHAVIP: APIServerName:minikubeCA AP
IServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:
false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0719 05:18:58.583037 1393455 preload.go:131] Checking if preload exists for k8s version v1.30.3 and runtime containerd
I0719 05:18:58.583097 1393455 ssh_runner.go:195] Run: sudo crictl images --output json
I0719 05:18:58.619061 1393455 containerd.go:627] all images are preloaded for containerd runtime.
I0719 05:18:58.619084 1393455 containerd.go:534] Images already preloaded, skipping extraction
I0719 05:18:58.619182 1393455 ssh_runner.go:195] Run: sudo crictl images --output json
I0719 05:18:58.657309 1393455 containerd.go:627] all images are preloaded for containerd runtime.
I0719 05:18:58.657333 1393455 cache_images.go:84] Images are preloaded, skipping loading
I0719 05:18:58.657342 1393455 kubeadm.go:934] updating node { 192.168.76.2 8443 v1.30.3 containerd true true} ...
I0719 05:18:58.657443 1393455 kubeadm.go:946] kubelet [Unit]
Wants=containerd.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.30.3/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=embed-certs-371220 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.76.2
[Install]
config:
{KubernetesVersion:v1.30.3 ClusterName:embed-certs-371220 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0719 05:18:58.657518 1393455 ssh_runner.go:195] Run: sudo crictl info
I0719 05:18:58.696795 1393455 cni.go:84] Creating CNI manager for ""
I0719 05:18:58.696820 1393455 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0719 05:18:58.696830 1393455 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0719 05:18:58.696857 1393455 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.76.2 APIServerPort:8443 KubernetesVersion:v1.30.3 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:embed-certs-371220 NodeName:embed-certs-371220 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.76.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.76.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPo
dPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///run/containerd/containerd.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I0719 05:18:58.696987 1393455 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta3
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.76.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///run/containerd/containerd.sock
name: "embed-certs-371220"
kubeletExtraArgs:
node-ip: 192.168.76.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta3
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.76.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.30.3
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
containerRuntimeEndpoint: unix:///run/containerd/containerd.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%!"(MISSING)
nodefs.inodesFree: "0%!"(MISSING)
imagefs.available: "0%!"(MISSING)
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0719 05:18:58.697064 1393455 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.30.3
I0719 05:18:58.706538 1393455 binaries.go:44] Found k8s binaries, skipping transfer
I0719 05:18:58.706610 1393455 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0719 05:18:58.715969 1393455 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (322 bytes)
I0719 05:18:58.735303 1393455 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0719 05:18:58.754293 1393455 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2172 bytes)
I0719 05:18:58.779101 1393455 ssh_runner.go:195] Run: grep 192.168.76.2 control-plane.minikube.internal$ /etc/hosts
I0719 05:18:58.782727 1393455 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.76.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0719 05:18:58.794083 1393455 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0719 05:18:58.898860 1393455 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0719 05:18:58.915005 1393455 certs.go:68] Setting up /home/jenkins/minikube-integration/19302-1169903/.minikube/profiles/embed-certs-371220 for IP: 192.168.76.2
I0719 05:18:58.915068 1393455 certs.go:194] generating shared ca certs ...
I0719 05:18:58.915099 1393455 certs.go:226] acquiring lock for ca certs: {Name:mkb94216b4baf781e984c9b79eeab87cfce4eb07 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0719 05:18:58.915314 1393455 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19302-1169903/.minikube/ca.key
I0719 05:18:58.915405 1393455 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19302-1169903/.minikube/proxy-client-ca.key
I0719 05:18:58.915441 1393455 certs.go:256] generating profile certs ...
I0719 05:18:58.915514 1393455 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/19302-1169903/.minikube/profiles/embed-certs-371220/client.key
I0719 05:18:58.915552 1393455 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19302-1169903/.minikube/profiles/embed-certs-371220/client.crt with IP's: []
I0719 05:18:59.351044 1393455 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19302-1169903/.minikube/profiles/embed-certs-371220/client.crt ...
I0719 05:18:59.351088 1393455 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19302-1169903/.minikube/profiles/embed-certs-371220/client.crt: {Name:mka3255e899ef5da36fa4dde4b139b3d53d1529b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0719 05:18:59.352627 1393455 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19302-1169903/.minikube/profiles/embed-certs-371220/client.key ...
I0719 05:18:59.352692 1393455 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19302-1169903/.minikube/profiles/embed-certs-371220/client.key: {Name:mk53ca093956d98b7731ac00d35486d376c5550b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0719 05:18:59.353185 1393455 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19302-1169903/.minikube/profiles/embed-certs-371220/apiserver.key.82920cc5
I0719 05:18:59.353242 1393455 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19302-1169903/.minikube/profiles/embed-certs-371220/apiserver.crt.82920cc5 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.76.2]
I0719 05:19:00.215929 1393455 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19302-1169903/.minikube/profiles/embed-certs-371220/apiserver.crt.82920cc5 ...
I0719 05:19:00.216030 1393455 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19302-1169903/.minikube/profiles/embed-certs-371220/apiserver.crt.82920cc5: {Name:mkb724e06d3bf07883ef8ecbb1bef22c462f1283 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0719 05:19:00.217047 1393455 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19302-1169903/.minikube/profiles/embed-certs-371220/apiserver.key.82920cc5 ...
I0719 05:19:00.217114 1393455 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19302-1169903/.minikube/profiles/embed-certs-371220/apiserver.key.82920cc5: {Name:mk82484f276a8178aa656d8cacd5be5881b59d86 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0719 05:19:00.217279 1393455 certs.go:381] copying /home/jenkins/minikube-integration/19302-1169903/.minikube/profiles/embed-certs-371220/apiserver.crt.82920cc5 -> /home/jenkins/minikube-integration/19302-1169903/.minikube/profiles/embed-certs-371220/apiserver.crt
I0719 05:19:00.217434 1393455 certs.go:385] copying /home/jenkins/minikube-integration/19302-1169903/.minikube/profiles/embed-certs-371220/apiserver.key.82920cc5 -> /home/jenkins/minikube-integration/19302-1169903/.minikube/profiles/embed-certs-371220/apiserver.key
I0719 05:19:00.217568 1393455 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/19302-1169903/.minikube/profiles/embed-certs-371220/proxy-client.key
I0719 05:19:00.217611 1393455 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19302-1169903/.minikube/profiles/embed-certs-371220/proxy-client.crt with IP's: []
I0719 05:19:00.547260 1393455 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19302-1169903/.minikube/profiles/embed-certs-371220/proxy-client.crt ...
I0719 05:19:00.547348 1393455 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19302-1169903/.minikube/profiles/embed-certs-371220/proxy-client.crt: {Name:mkc7cd4b813db5c43f966b2685da12b7454feef4 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0719 05:19:00.548182 1393455 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19302-1169903/.minikube/profiles/embed-certs-371220/proxy-client.key ...
I0719 05:19:00.548241 1393455 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19302-1169903/.minikube/profiles/embed-certs-371220/proxy-client.key: {Name:mk8d4611a99a42a5eb32ae33dfab49f3c7f3c9c0 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0719 05:19:00.552161 1393455 certs.go:484] found cert: /home/jenkins/minikube-integration/19302-1169903/.minikube/certs/1175286.pem (1338 bytes)
W0719 05:19:00.552301 1393455 certs.go:480] ignoring /home/jenkins/minikube-integration/19302-1169903/.minikube/certs/1175286_empty.pem, impossibly tiny 0 bytes
I0719 05:19:00.552363 1393455 certs.go:484] found cert: /home/jenkins/minikube-integration/19302-1169903/.minikube/certs/ca-key.pem (1679 bytes)
I0719 05:19:00.552434 1393455 certs.go:484] found cert: /home/jenkins/minikube-integration/19302-1169903/.minikube/certs/ca.pem (1078 bytes)
I0719 05:19:00.552509 1393455 certs.go:484] found cert: /home/jenkins/minikube-integration/19302-1169903/.minikube/certs/cert.pem (1123 bytes)
I0719 05:19:00.552578 1393455 certs.go:484] found cert: /home/jenkins/minikube-integration/19302-1169903/.minikube/certs/key.pem (1679 bytes)
I0719 05:19:00.552697 1393455 certs.go:484] found cert: /home/jenkins/minikube-integration/19302-1169903/.minikube/files/etc/ssl/certs/11752862.pem (1708 bytes)
I0719 05:19:00.553819 1393455 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19302-1169903/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0719 05:19:00.589627 1393455 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19302-1169903/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I0719 05:19:00.624282 1393455 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19302-1169903/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0719 05:19:00.655536 1393455 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19302-1169903/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0719 05:19:00.683982 1393455 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19302-1169903/.minikube/profiles/embed-certs-371220/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1428 bytes)
I0719 05:19:00.710227 1393455 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19302-1169903/.minikube/profiles/embed-certs-371220/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0719 05:19:00.737425 1393455 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19302-1169903/.minikube/profiles/embed-certs-371220/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0719 05:19:00.771806 1393455 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19302-1169903/.minikube/profiles/embed-certs-371220/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0719 05:19:00.798149 1393455 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19302-1169903/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0719 05:19:00.824606 1393455 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19302-1169903/.minikube/certs/1175286.pem --> /usr/share/ca-certificates/1175286.pem (1338 bytes)
I0719 05:19:00.863822 1393455 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19302-1169903/.minikube/files/etc/ssl/certs/11752862.pem --> /usr/share/ca-certificates/11752862.pem (1708 bytes)
I0719 05:19:00.889418 1393455 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0719 05:19:00.909650 1393455 ssh_runner.go:195] Run: openssl version
I0719 05:19:00.915495 1393455 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/1175286.pem && ln -fs /usr/share/ca-certificates/1175286.pem /etc/ssl/certs/1175286.pem"
I0719 05:19:00.926063 1393455 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/1175286.pem
I0719 05:19:00.929724 1393455 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Jul 19 04:32 /usr/share/ca-certificates/1175286.pem
I0719 05:19:00.929792 1393455 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/1175286.pem
I0719 05:19:00.936715 1393455 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/1175286.pem /etc/ssl/certs/51391683.0"
I0719 05:19:00.946040 1393455 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/11752862.pem && ln -fs /usr/share/ca-certificates/11752862.pem /etc/ssl/certs/11752862.pem"
I0719 05:19:00.955905 1393455 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/11752862.pem
I0719 05:19:00.959348 1393455 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Jul 19 04:32 /usr/share/ca-certificates/11752862.pem
I0719 05:19:00.959414 1393455 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/11752862.pem
I0719 05:19:00.966287 1393455 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/11752862.pem /etc/ssl/certs/3ec20f2e.0"
I0719 05:19:00.975732 1393455 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0719 05:19:00.986851 1393455 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0719 05:19:00.990376 1393455 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Jul 19 04:24 /usr/share/ca-certificates/minikubeCA.pem
I0719 05:19:00.990489 1393455 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0719 05:19:00.997564 1393455 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0719 05:19:01.008307 1393455 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0719 05:19:01.012142 1393455 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0719 05:19:01.012242 1393455 kubeadm.go:392] StartCluster: {Name:embed-certs-371220 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.3 ClusterName:embed-certs-371220 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APISe
rverNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:fal
se CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0719 05:19:01.012350 1393455 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}
I0719 05:19:01.012422 1393455 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0719 05:19:01.055901 1393455 cri.go:89] found id: ""
I0719 05:19:01.056004 1393455 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0719 05:19:01.064964 1393455 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0719 05:19:01.074728 1393455 kubeadm.go:214] ignoring SystemVerification for kubeadm because of docker driver
I0719 05:19:01.074839 1393455 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0719 05:19:01.084463 1393455 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0719 05:19:01.084485 1393455 kubeadm.go:157] found existing configuration files:
I0719 05:19:01.084575 1393455 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0719 05:19:01.093809 1393455 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0719 05:19:01.093921 1393455 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0719 05:19:01.103188 1393455 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0719 05:19:01.112339 1393455 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0719 05:19:01.112450 1393455 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0719 05:19:01.121900 1393455 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0719 05:19:01.132689 1393455 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0719 05:19:01.132762 1393455 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0719 05:19:01.142227 1393455 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0719 05:19:01.151526 1393455 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0719 05:19:01.151600 1393455 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0719 05:19:01.161201 1393455 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.30.3:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
I0719 05:19:01.208781 1393455 kubeadm.go:310] [init] Using Kubernetes version: v1.30.3
I0719 05:19:01.209030 1393455 kubeadm.go:310] [preflight] Running pre-flight checks
I0719 05:19:01.265577 1393455 kubeadm.go:310] [preflight] The system verification failed. Printing the output from the verification:
I0719 05:19:01.265653 1393455 kubeadm.go:310] [0;37mKERNEL_VERSION[0m: [0;32m5.15.0-1064-aws[0m
I0719 05:19:01.265693 1393455 kubeadm.go:310] [0;37mOS[0m: [0;32mLinux[0m
I0719 05:19:01.265746 1393455 kubeadm.go:310] [0;37mCGROUPS_CPU[0m: [0;32menabled[0m
I0719 05:19:01.265796 1393455 kubeadm.go:310] [0;37mCGROUPS_CPUACCT[0m: [0;32menabled[0m
I0719 05:19:01.265846 1393455 kubeadm.go:310] [0;37mCGROUPS_CPUSET[0m: [0;32menabled[0m
I0719 05:19:01.265896 1393455 kubeadm.go:310] [0;37mCGROUPS_DEVICES[0m: [0;32menabled[0m
I0719 05:19:01.265947 1393455 kubeadm.go:310] [0;37mCGROUPS_FREEZER[0m: [0;32menabled[0m
I0719 05:19:01.266001 1393455 kubeadm.go:310] [0;37mCGROUPS_MEMORY[0m: [0;32menabled[0m
I0719 05:19:01.266050 1393455 kubeadm.go:310] [0;37mCGROUPS_PIDS[0m: [0;32menabled[0m
I0719 05:19:01.266100 1393455 kubeadm.go:310] [0;37mCGROUPS_HUGETLB[0m: [0;32menabled[0m
I0719 05:19:01.266158 1393455 kubeadm.go:310] [0;37mCGROUPS_BLKIO[0m: [0;32menabled[0m
I0719 05:19:01.339400 1393455 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0719 05:19:01.339514 1393455 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0719 05:19:01.339610 1393455 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0719 05:19:01.607019 1393455 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0719 05:18:58.855306 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:19:01.355062 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:19:01.610710 1393455 out.go:204] - Generating certificates and keys ...
I0719 05:19:01.610830 1393455 kubeadm.go:310] [certs] Using existing ca certificate authority
I0719 05:19:01.610918 1393455 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0719 05:19:02.209140 1393455 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
I0719 05:19:02.530383 1393455 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
I0719 05:19:03.359863 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:19:05.858455 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:19:02.850240 1393455 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
I0719 05:19:03.350991 1393455 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
I0719 05:19:03.884113 1393455 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
I0719 05:19:03.884613 1393455 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [embed-certs-371220 localhost] and IPs [192.168.76.2 127.0.0.1 ::1]
I0719 05:19:04.398765 1393455 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
I0719 05:19:04.399122 1393455 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [embed-certs-371220 localhost] and IPs [192.168.76.2 127.0.0.1 ::1]
I0719 05:19:05.184479 1393455 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
I0719 05:19:05.303943 1393455 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
I0719 05:19:05.529109 1393455 kubeadm.go:310] [certs] Generating "sa" key and public key
I0719 05:19:05.529487 1393455 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0719 05:19:05.951231 1393455 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0719 05:19:06.218293 1393455 kubeadm.go:310] [kubeconfig] Writing "super-admin.conf" kubeconfig file
I0719 05:19:06.628339 1393455 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0719 05:19:07.509929 1393455 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0719 05:19:07.846376 1393455 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0719 05:19:07.847023 1393455 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0719 05:19:07.851440 1393455 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0719 05:19:08.355915 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:19:10.356074 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:19:07.854234 1393455 out.go:204] - Booting up control plane ...
I0719 05:19:07.854336 1393455 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0719 05:19:07.854418 1393455 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0719 05:19:07.854486 1393455 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0719 05:19:07.869096 1393455 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0719 05:19:07.870039 1393455 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0719 05:19:07.870229 1393455 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0719 05:19:07.973500 1393455 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests"
I0719 05:19:07.973599 1393455 kubeadm.go:310] [kubelet-check] Waiting for a healthy kubelet. This can take up to 4m0s
I0719 05:19:08.973975 1393455 kubeadm.go:310] [kubelet-check] The kubelet is healthy after 1.000883204s
I0719 05:19:08.974061 1393455 kubeadm.go:310] [api-check] Waiting for a healthy API server. This can take up to 4m0s
I0719 05:19:15.976150 1393455 kubeadm.go:310] [api-check] The API server is healthy after 7.002166844s
I0719 05:19:15.999089 1393455 kubeadm.go:310] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
I0719 05:19:16.021234 1393455 kubeadm.go:310] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster
I0719 05:19:16.054312 1393455 kubeadm.go:310] [upload-certs] Skipping phase. Please see --upload-certs
I0719 05:19:16.054508 1393455 kubeadm.go:310] [mark-control-plane] Marking the node embed-certs-371220 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
I0719 05:19:16.068889 1393455 kubeadm.go:310] [bootstrap-token] Using token: urfpcr.cpgn53ou444nc7n1
I0719 05:19:12.356170 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:19:14.356729 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:19:16.854892 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:19:16.071115 1393455 out.go:204] - Configuring RBAC rules ...
I0719 05:19:16.071278 1393455 kubeadm.go:310] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
I0719 05:19:16.076662 1393455 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes
I0719 05:19:16.087582 1393455 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
I0719 05:19:16.093042 1393455 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
I0719 05:19:16.098167 1393455 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
I0719 05:19:16.104046 1393455 kubeadm.go:310] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
I0719 05:19:16.384349 1393455 kubeadm.go:310] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
I0719 05:19:16.811255 1393455 kubeadm.go:310] [addons] Applied essential addon: CoreDNS
I0719 05:19:17.383014 1393455 kubeadm.go:310] [addons] Applied essential addon: kube-proxy
I0719 05:19:17.384091 1393455 kubeadm.go:310]
I0719 05:19:17.384165 1393455 kubeadm.go:310] Your Kubernetes control-plane has initialized successfully!
I0719 05:19:17.384175 1393455 kubeadm.go:310]
I0719 05:19:17.384250 1393455 kubeadm.go:310] To start using your cluster, you need to run the following as a regular user:
I0719 05:19:17.384262 1393455 kubeadm.go:310]
I0719 05:19:17.384287 1393455 kubeadm.go:310] mkdir -p $HOME/.kube
I0719 05:19:17.384347 1393455 kubeadm.go:310] sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
I0719 05:19:17.384400 1393455 kubeadm.go:310] sudo chown $(id -u):$(id -g) $HOME/.kube/config
I0719 05:19:17.384408 1393455 kubeadm.go:310]
I0719 05:19:17.384460 1393455 kubeadm.go:310] Alternatively, if you are the root user, you can run:
I0719 05:19:17.384468 1393455 kubeadm.go:310]
I0719 05:19:17.384514 1393455 kubeadm.go:310] export KUBECONFIG=/etc/kubernetes/admin.conf
I0719 05:19:17.384521 1393455 kubeadm.go:310]
I0719 05:19:17.384571 1393455 kubeadm.go:310] You should now deploy a pod network to the cluster.
I0719 05:19:17.384655 1393455 kubeadm.go:310] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
I0719 05:19:17.384725 1393455 kubeadm.go:310] https://kubernetes.io/docs/concepts/cluster-administration/addons/
I0719 05:19:17.384733 1393455 kubeadm.go:310]
I0719 05:19:17.384814 1393455 kubeadm.go:310] You can now join any number of control-plane nodes by copying certificate authorities
I0719 05:19:17.384892 1393455 kubeadm.go:310] and service account keys on each node and then running the following as root:
I0719 05:19:17.384900 1393455 kubeadm.go:310]
I0719 05:19:17.384989 1393455 kubeadm.go:310] kubeadm join control-plane.minikube.internal:8443 --token urfpcr.cpgn53ou444nc7n1 \
I0719 05:19:17.385181 1393455 kubeadm.go:310] --discovery-token-ca-cert-hash sha256:5206ca3c5eeb48efa8412a41c725aac557f213aed22954d3cd6d96a19a236248 \
I0719 05:19:17.385223 1393455 kubeadm.go:310] --control-plane
I0719 05:19:17.385263 1393455 kubeadm.go:310]
I0719 05:19:17.385402 1393455 kubeadm.go:310] Then you can join any number of worker nodes by running the following on each as root:
I0719 05:19:17.385410 1393455 kubeadm.go:310]
I0719 05:19:17.385500 1393455 kubeadm.go:310] kubeadm join control-plane.minikube.internal:8443 --token urfpcr.cpgn53ou444nc7n1 \
I0719 05:19:17.385616 1393455 kubeadm.go:310] --discovery-token-ca-cert-hash sha256:5206ca3c5eeb48efa8412a41c725aac557f213aed22954d3cd6d96a19a236248
I0719 05:19:17.389956 1393455 kubeadm.go:310] [WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/5.15.0-1064-aws\n", err: exit status 1
I0719 05:19:17.390077 1393455 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0719 05:19:17.390092 1393455 cni.go:84] Creating CNI manager for ""
I0719 05:19:17.390102 1393455 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0719 05:19:17.394098 1393455 out.go:177] * Configuring CNI (Container Networking Interface) ...
I0719 05:19:17.396296 1393455 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap
I0719 05:19:17.400302 1393455 cni.go:182] applying CNI manifest using /var/lib/minikube/binaries/v1.30.3/kubectl ...
I0719 05:19:17.400321 1393455 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2438 bytes)
I0719 05:19:17.420559 1393455 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
I0719 05:19:18.860196 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:19:20.861207 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:19:17.723403 1393455 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
I0719 05:19:17.723535 1393455 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
I0719 05:19:17.723610 1393455 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes embed-certs-371220 minikube.k8s.io/updated_at=2024_07_19T05_19_17_0700 minikube.k8s.io/version=v1.33.1 minikube.k8s.io/commit=c5c4003e63e14c031fd1d49a13aab215383064db minikube.k8s.io/name=embed-certs-371220 minikube.k8s.io/primary=true
I0719 05:19:17.957778 1393455 ops.go:34] apiserver oom_adj: -16
I0719 05:19:17.957907 1393455 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0719 05:19:18.458809 1393455 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0719 05:19:18.958993 1393455 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0719 05:19:19.457959 1393455 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0719 05:19:19.958029 1393455 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0719 05:19:20.458141 1393455 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0719 05:19:20.958024 1393455 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0719 05:19:21.458839 1393455 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0719 05:19:21.958790 1393455 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0719 05:19:22.458051 1393455 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0719 05:19:23.354593 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:19:25.354857 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:19:22.957946 1393455 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0719 05:19:23.458575 1393455 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0719 05:19:23.958510 1393455 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0719 05:19:24.458585 1393455 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0719 05:19:24.958435 1393455 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0719 05:19:25.458332 1393455 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0719 05:19:25.958333 1393455 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0719 05:19:26.458815 1393455 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0719 05:19:26.958009 1393455 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0719 05:19:27.458704 1393455 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0719 05:19:27.957990 1393455 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0719 05:19:28.458007 1393455 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0719 05:19:28.958259 1393455 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0719 05:19:29.458828 1393455 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0719 05:19:29.958029 1393455 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0719 05:19:30.458337 1393455 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0719 05:19:30.554294 1393455 kubeadm.go:1113] duration metric: took 12.830811738s to wait for elevateKubeSystemPrivileges
I0719 05:19:30.554321 1393455 kubeadm.go:394] duration metric: took 29.542090437s to StartCluster
I0719 05:19:30.554345 1393455 settings.go:142] acquiring lock: {Name:mk3315ab8b868aa7f5d94c6da5998345b76d5aca Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0719 05:19:30.554410 1393455 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/19302-1169903/kubeconfig
I0719 05:19:30.555857 1393455 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19302-1169903/kubeconfig: {Name:mkc20ac26e86e3155beb9b46782ccc5a9f7a2b0a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0719 05:19:30.556079 1393455 start.go:235] Will wait 6m0s for node &{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.30.3 ContainerRuntime:containerd ControlPlane:true Worker:true}
I0719 05:19:30.556228 1393455 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.30.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
I0719 05:19:30.556485 1393455 config.go:182] Loaded profile config "embed-certs-371220": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.30.3
I0719 05:19:30.556476 1393455 addons.go:507] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]
I0719 05:19:30.556600 1393455 addons.go:69] Setting storage-provisioner=true in profile "embed-certs-371220"
I0719 05:19:30.556618 1393455 addons.go:69] Setting default-storageclass=true in profile "embed-certs-371220"
I0719 05:19:30.556633 1393455 addons.go:234] Setting addon storage-provisioner=true in "embed-certs-371220"
I0719 05:19:30.556665 1393455 host.go:66] Checking if "embed-certs-371220" exists ...
I0719 05:19:30.556760 1393455 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "embed-certs-371220"
I0719 05:19:30.557041 1393455 cli_runner.go:164] Run: docker container inspect embed-certs-371220 --format={{.State.Status}}
I0719 05:19:30.557164 1393455 cli_runner.go:164] Run: docker container inspect embed-certs-371220 --format={{.State.Status}}
I0719 05:19:30.558746 1393455 out.go:177] * Verifying Kubernetes components...
I0719 05:19:30.565630 1393455 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0719 05:19:30.591005 1393455 addons.go:234] Setting addon default-storageclass=true in "embed-certs-371220"
I0719 05:19:30.591046 1393455 host.go:66] Checking if "embed-certs-371220" exists ...
I0719 05:19:30.591477 1393455 cli_runner.go:164] Run: docker container inspect embed-certs-371220 --format={{.State.Status}}
I0719 05:19:30.599396 1393455 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0719 05:19:30.601667 1393455 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0719 05:19:30.601690 1393455 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0719 05:19:30.601754 1393455 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-371220
I0719 05:19:30.631778 1393455 addons.go:431] installing /etc/kubernetes/addons/storageclass.yaml
I0719 05:19:30.631806 1393455 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0719 05:19:30.631893 1393455 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-371220
I0719 05:19:30.652934 1393455 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34557 SSHKeyPath:/home/jenkins/minikube-integration/19302-1169903/.minikube/machines/embed-certs-371220/id_rsa Username:docker}
I0719 05:19:30.681317 1393455 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34557 SSHKeyPath:/home/jenkins/minikube-integration/19302-1169903/.minikube/machines/embed-certs-371220/id_rsa Username:docker}
I0719 05:19:30.867299 1393455 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0719 05:19:30.959268 1393455 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.30.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^ forward . \/etc\/resolv.conf.*/i \ hosts {\n 192.168.76.1 host.minikube.internal\n fallthrough\n }' -e '/^ errors *$/i \ log' | sudo /var/lib/minikube/binaries/v1.30.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
I0719 05:19:30.959394 1393455 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0719 05:19:30.972875 1393455 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.3/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0719 05:19:31.821380 1393455 node_ready.go:35] waiting up to 6m0s for node "embed-certs-371220" to be "Ready" ...
I0719 05:19:31.821672 1393455 start.go:971] {"host.minikube.internal": 192.168.76.1} host record injected into CoreDNS's ConfigMap
I0719 05:19:31.874695 1393455 node_ready.go:49] node "embed-certs-371220" has status "Ready":"True"
I0719 05:19:31.874734 1393455 node_ready.go:38] duration metric: took 53.31626ms for node "embed-certs-371220" to be "Ready" ...
I0719 05:19:31.874745 1393455 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0719 05:19:31.883571 1393455 out.go:177] * Enabled addons: storage-provisioner, default-storageclass
I0719 05:19:27.355704 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:19:29.391475 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:19:31.857140 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:19:31.888389 1393455 pod_ready.go:78] waiting up to 6m0s for pod "coredns-7db6d8ff4d-mnc5b" in "kube-system" namespace to be "Ready" ...
I0719 05:19:31.888647 1393455 addons.go:510] duration metric: took 1.332169784s for enable addons: enabled=[storage-provisioner default-storageclass]
I0719 05:19:32.326105 1393455 kapi.go:214] "coredns" deployment in "kube-system" namespace and "embed-certs-371220" context rescaled to 1 replicas
I0719 05:19:34.355859 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:19:36.854028 1384211 pod_ready.go:102] pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace has status "Ready":"False"
I0719 05:19:36.854063 1384211 pod_ready.go:81] duration metric: took 4m0.00536304s for pod "metrics-server-9975d5f86-phjvq" in "kube-system" namespace to be "Ready" ...
E0719 05:19:36.854074 1384211 pod_ready.go:66] WaitExtra: waitPodCondition: context deadline exceeded
I0719 05:19:36.854082 1384211 pod_ready.go:38] duration metric: took 5m29.94169991s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0719 05:19:36.854095 1384211 api_server.go:52] waiting for apiserver process to appear ...
I0719 05:19:36.854125 1384211 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
I0719 05:19:36.854190 1384211 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0719 05:19:36.899539 1384211 cri.go:89] found id: "c4ee96f9f14987ba197d6ebeaedfca8a9835c03bcb4438e7948d99e01feb867f"
I0719 05:19:36.899560 1384211 cri.go:89] found id: "fb25f9a0346cc4e0812cc4849a6418ef42d67be0c75dedeec160273a75983a4a"
I0719 05:19:36.899566 1384211 cri.go:89] found id: ""
I0719 05:19:36.899573 1384211 logs.go:276] 2 containers: [c4ee96f9f14987ba197d6ebeaedfca8a9835c03bcb4438e7948d99e01feb867f fb25f9a0346cc4e0812cc4849a6418ef42d67be0c75dedeec160273a75983a4a]
I0719 05:19:36.899626 1384211 ssh_runner.go:195] Run: which crictl
I0719 05:19:36.903027 1384211 ssh_runner.go:195] Run: which crictl
I0719 05:19:36.906445 1384211 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
I0719 05:19:36.906518 1384211 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0719 05:19:36.946760 1384211 cri.go:89] found id: "456d0a34e10d1dde1a968ac307103c4ef6a4ffb93263871b27ba3a3200910ef6"
I0719 05:19:36.946783 1384211 cri.go:89] found id: "8ea851149d390f197f798dbb1e77c9ae51eb21cceef7c8955c58d5d653fec285"
I0719 05:19:36.946788 1384211 cri.go:89] found id: ""
I0719 05:19:36.946804 1384211 logs.go:276] 2 containers: [456d0a34e10d1dde1a968ac307103c4ef6a4ffb93263871b27ba3a3200910ef6 8ea851149d390f197f798dbb1e77c9ae51eb21cceef7c8955c58d5d653fec285]
I0719 05:19:36.946861 1384211 ssh_runner.go:195] Run: which crictl
I0719 05:19:36.950479 1384211 ssh_runner.go:195] Run: which crictl
I0719 05:19:36.954580 1384211 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
I0719 05:19:36.954697 1384211 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0719 05:19:32.891790 1393455 pod_ready.go:97] error getting pod "coredns-7db6d8ff4d-mnc5b" in "kube-system" namespace (skipping!): pods "coredns-7db6d8ff4d-mnc5b" not found
I0719 05:19:32.891819 1393455 pod_ready.go:81] duration metric: took 1.003350009s for pod "coredns-7db6d8ff4d-mnc5b" in "kube-system" namespace to be "Ready" ...
E0719 05:19:32.891831 1393455 pod_ready.go:66] WaitExtra: waitPodCondition: error getting pod "coredns-7db6d8ff4d-mnc5b" in "kube-system" namespace (skipping!): pods "coredns-7db6d8ff4d-mnc5b" not found
I0719 05:19:32.891874 1393455 pod_ready.go:78] waiting up to 6m0s for pod "coredns-7db6d8ff4d-rr5jl" in "kube-system" namespace to be "Ready" ...
I0719 05:19:34.898492 1393455 pod_ready.go:102] pod "coredns-7db6d8ff4d-rr5jl" in "kube-system" namespace has status "Ready":"False"
I0719 05:19:37.398628 1393455 pod_ready.go:102] pod "coredns-7db6d8ff4d-rr5jl" in "kube-system" namespace has status "Ready":"False"
I0719 05:19:37.020711 1384211 cri.go:89] found id: "c8b2082866621ae6fed2b885d44d13d0c6212ad3f4f27e55cd3d4c0ec819d697"
I0719 05:19:37.020738 1384211 cri.go:89] found id: "ec60727167db8439a76a65e4aba2ea5d113e867f686695daf0f9f2df3a9b984b"
I0719 05:19:37.020743 1384211 cri.go:89] found id: ""
I0719 05:19:37.020752 1384211 logs.go:276] 2 containers: [c8b2082866621ae6fed2b885d44d13d0c6212ad3f4f27e55cd3d4c0ec819d697 ec60727167db8439a76a65e4aba2ea5d113e867f686695daf0f9f2df3a9b984b]
I0719 05:19:37.020819 1384211 ssh_runner.go:195] Run: which crictl
I0719 05:19:37.026447 1384211 ssh_runner.go:195] Run: which crictl
I0719 05:19:37.031605 1384211 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
I0719 05:19:37.031700 1384211 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0719 05:19:37.075602 1384211 cri.go:89] found id: "62d56ad6f80d807a731bb4564ef55663b3b92ab83af2ba7115b207aaa62578ad"
I0719 05:19:37.075626 1384211 cri.go:89] found id: "31d2288b65a8bfddfa998e3247ebb91dfa488cdde250694c21541c28d32b661b"
I0719 05:19:37.075631 1384211 cri.go:89] found id: ""
I0719 05:19:37.075638 1384211 logs.go:276] 2 containers: [62d56ad6f80d807a731bb4564ef55663b3b92ab83af2ba7115b207aaa62578ad 31d2288b65a8bfddfa998e3247ebb91dfa488cdde250694c21541c28d32b661b]
I0719 05:19:37.075694 1384211 ssh_runner.go:195] Run: which crictl
I0719 05:19:37.079226 1384211 ssh_runner.go:195] Run: which crictl
I0719 05:19:37.082643 1384211 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
I0719 05:19:37.082715 1384211 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0719 05:19:37.119815 1384211 cri.go:89] found id: "ab6deb917db3a00322591b799b4f7c940babddc66581aa3657231d21bd68a000"
I0719 05:19:37.119838 1384211 cri.go:89] found id: "78aa39803d3d37bc510fe812e66f0fd6c8b18fa73ee068c031077da23ecacce0"
I0719 05:19:37.119843 1384211 cri.go:89] found id: ""
I0719 05:19:37.119850 1384211 logs.go:276] 2 containers: [ab6deb917db3a00322591b799b4f7c940babddc66581aa3657231d21bd68a000 78aa39803d3d37bc510fe812e66f0fd6c8b18fa73ee068c031077da23ecacce0]
I0719 05:19:37.119908 1384211 ssh_runner.go:195] Run: which crictl
I0719 05:19:37.123564 1384211 ssh_runner.go:195] Run: which crictl
I0719 05:19:37.127242 1384211 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
I0719 05:19:37.127372 1384211 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0719 05:19:37.165573 1384211 cri.go:89] found id: "8b74c8c28985fd1c8cd16fff081f8a3c79c626ff33e7b7705c27d8646b2344de"
I0719 05:19:37.165592 1384211 cri.go:89] found id: "31f8a36bff2a9b66f7c2a5a8fdc3fe9b14f1b569fae35aa6b7bec34dca8ef7a7"
I0719 05:19:37.165597 1384211 cri.go:89] found id: ""
I0719 05:19:37.165603 1384211 logs.go:276] 2 containers: [8b74c8c28985fd1c8cd16fff081f8a3c79c626ff33e7b7705c27d8646b2344de 31f8a36bff2a9b66f7c2a5a8fdc3fe9b14f1b569fae35aa6b7bec34dca8ef7a7]
I0719 05:19:37.165685 1384211 ssh_runner.go:195] Run: which crictl
I0719 05:19:37.169311 1384211 ssh_runner.go:195] Run: which crictl
I0719 05:19:37.173006 1384211 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
I0719 05:19:37.173080 1384211 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0719 05:19:37.223535 1384211 cri.go:89] found id: "10539463ca76eca3ef896527ce525ab179fe6b4182358afaa9eeeeb0f58f069c"
I0719 05:19:37.223557 1384211 cri.go:89] found id: "e0ea78faa765147f1c1a9e8517bc48fd17bcb16534bcab7e02bcfe8728d4dec6"
I0719 05:19:37.223561 1384211 cri.go:89] found id: ""
I0719 05:19:37.223568 1384211 logs.go:276] 2 containers: [10539463ca76eca3ef896527ce525ab179fe6b4182358afaa9eeeeb0f58f069c e0ea78faa765147f1c1a9e8517bc48fd17bcb16534bcab7e02bcfe8728d4dec6]
I0719 05:19:37.223624 1384211 ssh_runner.go:195] Run: which crictl
I0719 05:19:37.227189 1384211 ssh_runner.go:195] Run: which crictl
I0719 05:19:37.230509 1384211 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
I0719 05:19:37.230578 1384211 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I0719 05:19:37.271449 1384211 cri.go:89] found id: "6472a666aa3686f6d4a248b14ad6c12bd855ee07f9769fb002846093117bdb3c"
I0719 05:19:37.271478 1384211 cri.go:89] found id: ""
I0719 05:19:37.271486 1384211 logs.go:276] 1 containers: [6472a666aa3686f6d4a248b14ad6c12bd855ee07f9769fb002846093117bdb3c]
I0719 05:19:37.271545 1384211 ssh_runner.go:195] Run: which crictl
I0719 05:19:37.275022 1384211 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
I0719 05:19:37.275111 1384211 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0719 05:19:37.312257 1384211 cri.go:89] found id: "9fea07ce92177cea6b541d5da457322ab3fe68c5111c73979657fea3daea5d22"
I0719 05:19:37.312282 1384211 cri.go:89] found id: "5f5f26e535c99452b4f124fa647bbe2bde0544bddf60e1a422933a407836ef89"
I0719 05:19:37.312287 1384211 cri.go:89] found id: ""
I0719 05:19:37.312295 1384211 logs.go:276] 2 containers: [9fea07ce92177cea6b541d5da457322ab3fe68c5111c73979657fea3daea5d22 5f5f26e535c99452b4f124fa647bbe2bde0544bddf60e1a422933a407836ef89]
I0719 05:19:37.312362 1384211 ssh_runner.go:195] Run: which crictl
I0719 05:19:37.315991 1384211 ssh_runner.go:195] Run: which crictl
I0719 05:19:37.319403 1384211 logs.go:123] Gathering logs for dmesg ...
I0719 05:19:37.319431 1384211 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0719 05:19:37.339582 1384211 logs.go:123] Gathering logs for kube-apiserver [c4ee96f9f14987ba197d6ebeaedfca8a9835c03bcb4438e7948d99e01feb867f] ...
I0719 05:19:37.339613 1384211 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 c4ee96f9f14987ba197d6ebeaedfca8a9835c03bcb4438e7948d99e01feb867f"
I0719 05:19:37.399981 1384211 logs.go:123] Gathering logs for kube-scheduler [31d2288b65a8bfddfa998e3247ebb91dfa488cdde250694c21541c28d32b661b] ...
I0719 05:19:37.400015 1384211 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 31d2288b65a8bfddfa998e3247ebb91dfa488cdde250694c21541c28d32b661b"
I0719 05:19:37.444251 1384211 logs.go:123] Gathering logs for kindnet [10539463ca76eca3ef896527ce525ab179fe6b4182358afaa9eeeeb0f58f069c] ...
I0719 05:19:37.444285 1384211 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 10539463ca76eca3ef896527ce525ab179fe6b4182358afaa9eeeeb0f58f069c"
I0719 05:19:37.499929 1384211 logs.go:123] Gathering logs for kubernetes-dashboard [6472a666aa3686f6d4a248b14ad6c12bd855ee07f9769fb002846093117bdb3c] ...
I0719 05:19:37.499962 1384211 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 6472a666aa3686f6d4a248b14ad6c12bd855ee07f9769fb002846093117bdb3c"
I0719 05:19:37.538114 1384211 logs.go:123] Gathering logs for container status ...
I0719 05:19:37.538142 1384211 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0719 05:19:37.587552 1384211 logs.go:123] Gathering logs for storage-provisioner [5f5f26e535c99452b4f124fa647bbe2bde0544bddf60e1a422933a407836ef89] ...
I0719 05:19:37.587627 1384211 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 5f5f26e535c99452b4f124fa647bbe2bde0544bddf60e1a422933a407836ef89"
I0719 05:19:37.626284 1384211 logs.go:123] Gathering logs for kubelet ...
I0719 05:19:37.626316 1384211 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0719 05:19:37.681581 1384211 logs.go:138] Found kubelet problem: Jul 19 05:14:06 old-k8s-version-199824 kubelet[663]: E0719 05:14:06.879898 663 reflector.go:138] object-"kube-system"/"kube-proxy-token-486sl": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kube-proxy-token-486sl" is forbidden: User "system:node:old-k8s-version-199824" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-199824' and this object
W0719 05:19:37.681810 1384211 logs.go:138] Found kubelet problem: Jul 19 05:14:06 old-k8s-version-199824 kubelet[663]: E0719 05:14:06.880125 663 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:old-k8s-version-199824" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-199824' and this object
W0719 05:19:37.682026 1384211 logs.go:138] Found kubelet problem: Jul 19 05:14:06 old-k8s-version-199824 kubelet[663]: E0719 05:14:06.880466 663 reflector.go:138] object-"kube-system"/"coredns-token-zhr5r": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "coredns-token-zhr5r" is forbidden: User "system:node:old-k8s-version-199824" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-199824' and this object
W0719 05:19:37.682228 1384211 logs.go:138] Found kubelet problem: Jul 19 05:14:06 old-k8s-version-199824 kubelet[663]: E0719 05:14:06.880696 663 reflector.go:138] object-"kube-system"/"coredns": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:old-k8s-version-199824" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-199824' and this object
W0719 05:19:37.682457 1384211 logs.go:138] Found kubelet problem: Jul 19 05:14:06 old-k8s-version-199824 kubelet[663]: E0719 05:14:06.880989 663 reflector.go:138] object-"kube-system"/"storage-provisioner-token-tkjk9": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "storage-provisioner-token-tkjk9" is forbidden: User "system:node:old-k8s-version-199824" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-199824' and this object
W0719 05:19:37.682685 1384211 logs.go:138] Found kubelet problem: Jul 19 05:14:06 old-k8s-version-199824 kubelet[663]: E0719 05:14:06.881007 663 reflector.go:138] object-"kube-system"/"kindnet-token-lncwz": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kindnet-token-lncwz" is forbidden: User "system:node:old-k8s-version-199824" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-199824' and this object
W0719 05:19:37.688812 1384211 logs.go:138] Found kubelet problem: Jul 19 05:14:08 old-k8s-version-199824 kubelet[663]: E0719 05:14:08.050691 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0719 05:19:37.692895 1384211 logs.go:138] Found kubelet problem: Jul 19 05:14:08 old-k8s-version-199824 kubelet[663]: E0719 05:14:08.778488 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0719 05:19:37.695984 1384211 logs.go:138] Found kubelet problem: Jul 19 05:14:19 old-k8s-version-199824 kubelet[663]: E0719 05:14:19.553286 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0719 05:19:37.696321 1384211 logs.go:138] Found kubelet problem: Jul 19 05:14:26 old-k8s-version-199824 kubelet[663]: E0719 05:14:26.755718 663 reflector.go:138] object-"kubernetes-dashboard"/"kubernetes-dashboard-token-xs5nw": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kubernetes-dashboard-token-xs5nw" is forbidden: User "system:node:old-k8s-version-199824" cannot list resource "secrets" in API group "" in the namespace "kubernetes-dashboard": no relationship found between node 'old-k8s-version-199824' and this object
W0719 05:19:37.697933 1384211 logs.go:138] Found kubelet problem: Jul 19 05:14:34 old-k8s-version-199824 kubelet[663]: E0719 05:14:34.547673 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0719 05:19:37.698729 1384211 logs.go:138] Found kubelet problem: Jul 19 05:14:38 old-k8s-version-199824 kubelet[663]: E0719 05:14:38.956338 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
W0719 05:19:37.699253 1384211 logs.go:138] Found kubelet problem: Jul 19 05:14:39 old-k8s-version-199824 kubelet[663]: E0719 05:14:39.959828 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
W0719 05:19:37.699702 1384211 logs.go:138] Found kubelet problem: Jul 19 05:14:40 old-k8s-version-199824 kubelet[663]: E0719 05:14:40.964790 663 pod_workers.go:191] Error syncing pod 066eb7e2-3639-4912-a7c5-7a3bc8cfd104 ("storage-provisioner_kube-system(066eb7e2-3639-4912-a7c5-7a3bc8cfd104)"), skipping: failed to "StartContainer" for "storage-provisioner" with CrashLoopBackOff: "back-off 10s restarting failed container=storage-provisioner pod=storage-provisioner_kube-system(066eb7e2-3639-4912-a7c5-7a3bc8cfd104)"
W0719 05:19:37.700038 1384211 logs.go:138] Found kubelet problem: Jul 19 05:14:44 old-k8s-version-199824 kubelet[663]: E0719 05:14:44.803493 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
W0719 05:19:37.702515 1384211 logs.go:138] Found kubelet problem: Jul 19 05:14:45 old-k8s-version-199824 kubelet[663]: E0719 05:14:45.553693 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0719 05:19:37.703618 1384211 logs.go:138] Found kubelet problem: Jul 19 05:14:57 old-k8s-version-199824 kubelet[663]: E0719 05:14:57.011919 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
W0719 05:19:37.703812 1384211 logs.go:138] Found kubelet problem: Jul 19 05:14:57 old-k8s-version-199824 kubelet[663]: E0719 05:14:57.545646 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0719 05:19:37.704142 1384211 logs.go:138] Found kubelet problem: Jul 19 05:15:04 old-k8s-version-199824 kubelet[663]: E0719 05:15:04.804038 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
W0719 05:19:37.704328 1384211 logs.go:138] Found kubelet problem: Jul 19 05:15:09 old-k8s-version-199824 kubelet[663]: E0719 05:15:09.545053 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0719 05:19:37.704659 1384211 logs.go:138] Found kubelet problem: Jul 19 05:15:16 old-k8s-version-199824 kubelet[663]: E0719 05:15:16.546724 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
W0719 05:19:37.704846 1384211 logs.go:138] Found kubelet problem: Jul 19 05:15:24 old-k8s-version-199824 kubelet[663]: E0719 05:15:24.544833 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0719 05:19:37.705436 1384211 logs.go:138] Found kubelet problem: Jul 19 05:15:28 old-k8s-version-199824 kubelet[663]: E0719 05:15:28.099362 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
W0719 05:19:37.705773 1384211 logs.go:138] Found kubelet problem: Jul 19 05:15:34 old-k8s-version-199824 kubelet[663]: E0719 05:15:34.803496 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
W0719 05:19:37.708246 1384211 logs.go:138] Found kubelet problem: Jul 19 05:15:37 old-k8s-version-199824 kubelet[663]: E0719 05:15:37.554467 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0719 05:19:37.708576 1384211 logs.go:138] Found kubelet problem: Jul 19 05:15:48 old-k8s-version-199824 kubelet[663]: E0719 05:15:48.544496 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
W0719 05:19:37.708764 1384211 logs.go:138] Found kubelet problem: Jul 19 05:15:51 old-k8s-version-199824 kubelet[663]: E0719 05:15:51.545269 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0719 05:19:37.709092 1384211 logs.go:138] Found kubelet problem: Jul 19 05:16:01 old-k8s-version-199824 kubelet[663]: E0719 05:16:01.544502 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
W0719 05:19:37.709277 1384211 logs.go:138] Found kubelet problem: Jul 19 05:16:04 old-k8s-version-199824 kubelet[663]: E0719 05:16:04.544940 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0719 05:19:37.709868 1384211 logs.go:138] Found kubelet problem: Jul 19 05:16:13 old-k8s-version-199824 kubelet[663]: E0719 05:16:13.212164 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
W0719 05:19:37.710212 1384211 logs.go:138] Found kubelet problem: Jul 19 05:16:14 old-k8s-version-199824 kubelet[663]: E0719 05:16:14.803581 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
W0719 05:19:37.710399 1384211 logs.go:138] Found kubelet problem: Jul 19 05:16:15 old-k8s-version-199824 kubelet[663]: E0719 05:16:15.548045 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0719 05:19:37.710760 1384211 logs.go:138] Found kubelet problem: Jul 19 05:16:25 old-k8s-version-199824 kubelet[663]: E0719 05:16:25.545039 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
W0719 05:19:37.710950 1384211 logs.go:138] Found kubelet problem: Jul 19 05:16:26 old-k8s-version-199824 kubelet[663]: E0719 05:16:26.544814 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0719 05:19:37.711136 1384211 logs.go:138] Found kubelet problem: Jul 19 05:16:37 old-k8s-version-199824 kubelet[663]: E0719 05:16:37.545101 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0719 05:19:37.711502 1384211 logs.go:138] Found kubelet problem: Jul 19 05:16:38 old-k8s-version-199824 kubelet[663]: E0719 05:16:38.544489 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
W0719 05:19:37.711689 1384211 logs.go:138] Found kubelet problem: Jul 19 05:16:51 old-k8s-version-199824 kubelet[663]: E0719 05:16:51.546833 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0719 05:19:37.712024 1384211 logs.go:138] Found kubelet problem: Jul 19 05:16:52 old-k8s-version-199824 kubelet[663]: E0719 05:16:52.544432 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
W0719 05:19:37.714778 1384211 logs.go:138] Found kubelet problem: Jul 19 05:17:06 old-k8s-version-199824 kubelet[663]: E0719 05:17:06.557289 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0719 05:19:37.715125 1384211 logs.go:138] Found kubelet problem: Jul 19 05:17:07 old-k8s-version-199824 kubelet[663]: E0719 05:17:07.544941 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
W0719 05:19:37.715329 1384211 logs.go:138] Found kubelet problem: Jul 19 05:17:18 old-k8s-version-199824 kubelet[663]: E0719 05:17:18.544856 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0719 05:19:37.715660 1384211 logs.go:138] Found kubelet problem: Jul 19 05:17:19 old-k8s-version-199824 kubelet[663]: E0719 05:17:19.548049 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
W0719 05:19:37.715853 1384211 logs.go:138] Found kubelet problem: Jul 19 05:17:30 old-k8s-version-199824 kubelet[663]: E0719 05:17:30.544793 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0719 05:19:37.716444 1384211 logs.go:138] Found kubelet problem: Jul 19 05:17:34 old-k8s-version-199824 kubelet[663]: E0719 05:17:34.434708 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
W0719 05:19:37.716773 1384211 logs.go:138] Found kubelet problem: Jul 19 05:17:35 old-k8s-version-199824 kubelet[663]: E0719 05:17:35.438099 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
W0719 05:19:37.716963 1384211 logs.go:138] Found kubelet problem: Jul 19 05:17:44 old-k8s-version-199824 kubelet[663]: E0719 05:17:44.544860 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0719 05:19:37.717305 1384211 logs.go:138] Found kubelet problem: Jul 19 05:17:47 old-k8s-version-199824 kubelet[663]: E0719 05:17:47.548823 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
W0719 05:19:37.717493 1384211 logs.go:138] Found kubelet problem: Jul 19 05:17:58 old-k8s-version-199824 kubelet[663]: E0719 05:17:58.544841 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0719 05:19:37.717826 1384211 logs.go:138] Found kubelet problem: Jul 19 05:18:01 old-k8s-version-199824 kubelet[663]: E0719 05:18:01.545059 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
W0719 05:19:37.718013 1384211 logs.go:138] Found kubelet problem: Jul 19 05:18:10 old-k8s-version-199824 kubelet[663]: E0719 05:18:10.544965 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0719 05:19:37.718341 1384211 logs.go:138] Found kubelet problem: Jul 19 05:18:15 old-k8s-version-199824 kubelet[663]: E0719 05:18:15.545036 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
W0719 05:19:37.718530 1384211 logs.go:138] Found kubelet problem: Jul 19 05:18:23 old-k8s-version-199824 kubelet[663]: E0719 05:18:23.547544 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0719 05:19:37.718860 1384211 logs.go:138] Found kubelet problem: Jul 19 05:18:26 old-k8s-version-199824 kubelet[663]: E0719 05:18:26.545720 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
W0719 05:19:37.719200 1384211 logs.go:138] Found kubelet problem: Jul 19 05:18:38 old-k8s-version-199824 kubelet[663]: E0719 05:18:38.544881 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
W0719 05:19:37.719385 1384211 logs.go:138] Found kubelet problem: Jul 19 05:18:38 old-k8s-version-199824 kubelet[663]: E0719 05:18:38.545132 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0719 05:19:37.719720 1384211 logs.go:138] Found kubelet problem: Jul 19 05:18:50 old-k8s-version-199824 kubelet[663]: E0719 05:18:50.544554 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
W0719 05:19:37.719904 1384211 logs.go:138] Found kubelet problem: Jul 19 05:18:50 old-k8s-version-199824 kubelet[663]: E0719 05:18:50.545182 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0719 05:19:37.720093 1384211 logs.go:138] Found kubelet problem: Jul 19 05:19:01 old-k8s-version-199824 kubelet[663]: E0719 05:19:01.545861 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0719 05:19:37.720422 1384211 logs.go:138] Found kubelet problem: Jul 19 05:19:03 old-k8s-version-199824 kubelet[663]: E0719 05:19:03.544954 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
W0719 05:19:37.720609 1384211 logs.go:138] Found kubelet problem: Jul 19 05:19:13 old-k8s-version-199824 kubelet[663]: E0719 05:19:13.553562 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0719 05:19:37.720938 1384211 logs.go:138] Found kubelet problem: Jul 19 05:19:14 old-k8s-version-199824 kubelet[663]: E0719 05:19:14.544624 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
W0719 05:19:37.721269 1384211 logs.go:138] Found kubelet problem: Jul 19 05:19:25 old-k8s-version-199824 kubelet[663]: E0719 05:19:25.548824 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
W0719 05:19:37.721455 1384211 logs.go:138] Found kubelet problem: Jul 19 05:19:26 old-k8s-version-199824 kubelet[663]: E0719 05:19:26.544794 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
I0719 05:19:37.721465 1384211 logs.go:123] Gathering logs for etcd [456d0a34e10d1dde1a968ac307103c4ef6a4ffb93263871b27ba3a3200910ef6] ...
I0719 05:19:37.721479 1384211 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 456d0a34e10d1dde1a968ac307103c4ef6a4ffb93263871b27ba3a3200910ef6"
I0719 05:19:37.765178 1384211 logs.go:123] Gathering logs for etcd [8ea851149d390f197f798dbb1e77c9ae51eb21cceef7c8955c58d5d653fec285] ...
I0719 05:19:37.765265 1384211 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 8ea851149d390f197f798dbb1e77c9ae51eb21cceef7c8955c58d5d653fec285"
I0719 05:19:37.826417 1384211 logs.go:123] Gathering logs for kube-proxy [ab6deb917db3a00322591b799b4f7c940babddc66581aa3657231d21bd68a000] ...
I0719 05:19:37.826447 1384211 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 ab6deb917db3a00322591b799b4f7c940babddc66581aa3657231d21bd68a000"
I0719 05:19:37.867680 1384211 logs.go:123] Gathering logs for kube-proxy [78aa39803d3d37bc510fe812e66f0fd6c8b18fa73ee068c031077da23ecacce0] ...
I0719 05:19:37.867707 1384211 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 78aa39803d3d37bc510fe812e66f0fd6c8b18fa73ee068c031077da23ecacce0"
I0719 05:19:37.917105 1384211 logs.go:123] Gathering logs for kube-controller-manager [31f8a36bff2a9b66f7c2a5a8fdc3fe9b14f1b569fae35aa6b7bec34dca8ef7a7] ...
I0719 05:19:37.917134 1384211 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 31f8a36bff2a9b66f7c2a5a8fdc3fe9b14f1b569fae35aa6b7bec34dca8ef7a7"
I0719 05:19:37.974080 1384211 logs.go:123] Gathering logs for kube-apiserver [fb25f9a0346cc4e0812cc4849a6418ef42d67be0c75dedeec160273a75983a4a] ...
I0719 05:19:37.974113 1384211 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 fb25f9a0346cc4e0812cc4849a6418ef42d67be0c75dedeec160273a75983a4a"
I0719 05:19:38.034472 1384211 logs.go:123] Gathering logs for coredns [c8b2082866621ae6fed2b885d44d13d0c6212ad3f4f27e55cd3d4c0ec819d697] ...
I0719 05:19:38.034508 1384211 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 c8b2082866621ae6fed2b885d44d13d0c6212ad3f4f27e55cd3d4c0ec819d697"
I0719 05:19:38.079877 1384211 logs.go:123] Gathering logs for kube-controller-manager [8b74c8c28985fd1c8cd16fff081f8a3c79c626ff33e7b7705c27d8646b2344de] ...
I0719 05:19:38.079908 1384211 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 8b74c8c28985fd1c8cd16fff081f8a3c79c626ff33e7b7705c27d8646b2344de"
I0719 05:19:38.153761 1384211 logs.go:123] Gathering logs for kindnet [e0ea78faa765147f1c1a9e8517bc48fd17bcb16534bcab7e02bcfe8728d4dec6] ...
I0719 05:19:38.153832 1384211 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e0ea78faa765147f1c1a9e8517bc48fd17bcb16534bcab7e02bcfe8728d4dec6"
I0719 05:19:38.205148 1384211 logs.go:123] Gathering logs for containerd ...
I0719 05:19:38.205180 1384211 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
I0719 05:19:38.269612 1384211 logs.go:123] Gathering logs for describe nodes ...
I0719 05:19:38.269684 1384211 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0719 05:19:38.454438 1384211 logs.go:123] Gathering logs for coredns [ec60727167db8439a76a65e4aba2ea5d113e867f686695daf0f9f2df3a9b984b] ...
I0719 05:19:38.454526 1384211 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 ec60727167db8439a76a65e4aba2ea5d113e867f686695daf0f9f2df3a9b984b"
I0719 05:19:38.495308 1384211 logs.go:123] Gathering logs for kube-scheduler [62d56ad6f80d807a731bb4564ef55663b3b92ab83af2ba7115b207aaa62578ad] ...
I0719 05:19:38.495343 1384211 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 62d56ad6f80d807a731bb4564ef55663b3b92ab83af2ba7115b207aaa62578ad"
I0719 05:19:38.534496 1384211 logs.go:123] Gathering logs for storage-provisioner [9fea07ce92177cea6b541d5da457322ab3fe68c5111c73979657fea3daea5d22] ...
I0719 05:19:38.534526 1384211 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 9fea07ce92177cea6b541d5da457322ab3fe68c5111c73979657fea3daea5d22"
I0719 05:19:38.589753 1384211 out.go:304] Setting ErrFile to fd 2...
I0719 05:19:38.589778 1384211 out.go:338] TERM=,COLORTERM=, which probably does not support color
W0719 05:19:38.589845 1384211 out.go:239] X Problems detected in kubelet:
W0719 05:19:38.589861 1384211 out.go:239] Jul 19 05:19:03 old-k8s-version-199824 kubelet[663]: E0719 05:19:03.544954 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
W0719 05:19:38.589869 1384211 out.go:239] Jul 19 05:19:13 old-k8s-version-199824 kubelet[663]: E0719 05:19:13.553562 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0719 05:19:38.589895 1384211 out.go:239] Jul 19 05:19:14 old-k8s-version-199824 kubelet[663]: E0719 05:19:14.544624 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
W0719 05:19:38.589912 1384211 out.go:239] Jul 19 05:19:25 old-k8s-version-199824 kubelet[663]: E0719 05:19:25.548824 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
W0719 05:19:38.589935 1384211 out.go:239] Jul 19 05:19:26 old-k8s-version-199824 kubelet[663]: E0719 05:19:26.544794 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
I0719 05:19:38.589960 1384211 out.go:304] Setting ErrFile to fd 2...
I0719 05:19:38.589967 1384211 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0719 05:19:39.399784 1393455 pod_ready.go:102] pod "coredns-7db6d8ff4d-rr5jl" in "kube-system" namespace has status "Ready":"False"
I0719 05:19:41.898319 1393455 pod_ready.go:102] pod "coredns-7db6d8ff4d-rr5jl" in "kube-system" namespace has status "Ready":"False"
I0719 05:19:43.897636 1393455 pod_ready.go:92] pod "coredns-7db6d8ff4d-rr5jl" in "kube-system" namespace has status "Ready":"True"
I0719 05:19:43.897661 1393455 pod_ready.go:81] duration metric: took 11.005777344s for pod "coredns-7db6d8ff4d-rr5jl" in "kube-system" namespace to be "Ready" ...
I0719 05:19:43.897674 1393455 pod_ready.go:78] waiting up to 6m0s for pod "etcd-embed-certs-371220" in "kube-system" namespace to be "Ready" ...
I0719 05:19:43.905761 1393455 pod_ready.go:92] pod "etcd-embed-certs-371220" in "kube-system" namespace has status "Ready":"True"
I0719 05:19:43.905794 1393455 pod_ready.go:81] duration metric: took 8.107809ms for pod "etcd-embed-certs-371220" in "kube-system" namespace to be "Ready" ...
I0719 05:19:43.905813 1393455 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-embed-certs-371220" in "kube-system" namespace to be "Ready" ...
I0719 05:19:43.911055 1393455 pod_ready.go:92] pod "kube-apiserver-embed-certs-371220" in "kube-system" namespace has status "Ready":"True"
I0719 05:19:43.911082 1393455 pod_ready.go:81] duration metric: took 5.260886ms for pod "kube-apiserver-embed-certs-371220" in "kube-system" namespace to be "Ready" ...
I0719 05:19:43.911094 1393455 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-embed-certs-371220" in "kube-system" namespace to be "Ready" ...
I0719 05:19:43.915588 1393455 pod_ready.go:92] pod "kube-controller-manager-embed-certs-371220" in "kube-system" namespace has status "Ready":"True"
I0719 05:19:43.915610 1393455 pod_ready.go:81] duration metric: took 4.508233ms for pod "kube-controller-manager-embed-certs-371220" in "kube-system" namespace to be "Ready" ...
I0719 05:19:43.915622 1393455 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-qvj46" in "kube-system" namespace to be "Ready" ...
I0719 05:19:43.920068 1393455 pod_ready.go:92] pod "kube-proxy-qvj46" in "kube-system" namespace has status "Ready":"True"
I0719 05:19:43.920091 1393455 pod_ready.go:81] duration metric: took 4.46267ms for pod "kube-proxy-qvj46" in "kube-system" namespace to be "Ready" ...
I0719 05:19:43.920103 1393455 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-embed-certs-371220" in "kube-system" namespace to be "Ready" ...
I0719 05:19:44.295110 1393455 pod_ready.go:92] pod "kube-scheduler-embed-certs-371220" in "kube-system" namespace has status "Ready":"True"
I0719 05:19:44.295138 1393455 pod_ready.go:81] duration metric: took 375.026192ms for pod "kube-scheduler-embed-certs-371220" in "kube-system" namespace to be "Ready" ...
I0719 05:19:44.295183 1393455 pod_ready.go:38] duration metric: took 12.420426013s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0719 05:19:44.295199 1393455 api_server.go:52] waiting for apiserver process to appear ...
I0719 05:19:44.295269 1393455 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0719 05:19:44.307897 1393455 api_server.go:72] duration metric: took 13.751787242s to wait for apiserver process to appear ...
I0719 05:19:44.307921 1393455 api_server.go:88] waiting for apiserver healthz status ...
I0719 05:19:44.307940 1393455 api_server.go:253] Checking apiserver healthz at https://192.168.76.2:8443/healthz ...
I0719 05:19:44.315605 1393455 api_server.go:279] https://192.168.76.2:8443/healthz returned 200:
ok
I0719 05:19:44.316599 1393455 api_server.go:141] control plane version: v1.30.3
I0719 05:19:44.316622 1393455 api_server.go:131] duration metric: took 8.69362ms to wait for apiserver health ...
I0719 05:19:44.316631 1393455 system_pods.go:43] waiting for kube-system pods to appear ...
I0719 05:19:44.499371 1393455 system_pods.go:59] 8 kube-system pods found
I0719 05:19:44.499408 1393455 system_pods.go:61] "coredns-7db6d8ff4d-rr5jl" [9d4edffd-45bc-454c-a803-49ce2f314e7f] Running
I0719 05:19:44.499414 1393455 system_pods.go:61] "etcd-embed-certs-371220" [79534060-6d73-49c6-ab6d-e6391a03ce78] Running
I0719 05:19:44.499419 1393455 system_pods.go:61] "kindnet-pvcxp" [52361084-0168-41fc-ba98-8addf5a74876] Running
I0719 05:19:44.499456 1393455 system_pods.go:61] "kube-apiserver-embed-certs-371220" [ec0a07a4-e88d-4565-a28d-18c6ca3b73f2] Running
I0719 05:19:44.499468 1393455 system_pods.go:61] "kube-controller-manager-embed-certs-371220" [eaae4355-5e66-4541-a971-1d1731209ffb] Running
I0719 05:19:44.499473 1393455 system_pods.go:61] "kube-proxy-qvj46" [ca071d00-ca8d-4166-a611-b2ef01f07165] Running
I0719 05:19:44.499477 1393455 system_pods.go:61] "kube-scheduler-embed-certs-371220" [1227102d-5e79-4429-bfec-0bf3ec0c23e4] Running
I0719 05:19:44.499481 1393455 system_pods.go:61] "storage-provisioner" [43af895f-0c9b-49ab-a473-cd0ac8e4398d] Running
I0719 05:19:44.499495 1393455 system_pods.go:74] duration metric: took 182.858422ms to wait for pod list to return data ...
I0719 05:19:44.499503 1393455 default_sa.go:34] waiting for default service account to be created ...
I0719 05:19:44.695616 1393455 default_sa.go:45] found service account: "default"
I0719 05:19:44.695646 1393455 default_sa.go:55] duration metric: took 196.119951ms for default service account to be created ...
I0719 05:19:44.695657 1393455 system_pods.go:116] waiting for k8s-apps to be running ...
I0719 05:19:44.899608 1393455 system_pods.go:86] 8 kube-system pods found
I0719 05:19:44.899642 1393455 system_pods.go:89] "coredns-7db6d8ff4d-rr5jl" [9d4edffd-45bc-454c-a803-49ce2f314e7f] Running
I0719 05:19:44.899650 1393455 system_pods.go:89] "etcd-embed-certs-371220" [79534060-6d73-49c6-ab6d-e6391a03ce78] Running
I0719 05:19:44.899655 1393455 system_pods.go:89] "kindnet-pvcxp" [52361084-0168-41fc-ba98-8addf5a74876] Running
I0719 05:19:44.899659 1393455 system_pods.go:89] "kube-apiserver-embed-certs-371220" [ec0a07a4-e88d-4565-a28d-18c6ca3b73f2] Running
I0719 05:19:44.899664 1393455 system_pods.go:89] "kube-controller-manager-embed-certs-371220" [eaae4355-5e66-4541-a971-1d1731209ffb] Running
I0719 05:19:44.899669 1393455 system_pods.go:89] "kube-proxy-qvj46" [ca071d00-ca8d-4166-a611-b2ef01f07165] Running
I0719 05:19:44.899673 1393455 system_pods.go:89] "kube-scheduler-embed-certs-371220" [1227102d-5e79-4429-bfec-0bf3ec0c23e4] Running
I0719 05:19:44.899677 1393455 system_pods.go:89] "storage-provisioner" [43af895f-0c9b-49ab-a473-cd0ac8e4398d] Running
I0719 05:19:44.899684 1393455 system_pods.go:126] duration metric: took 204.02095ms to wait for k8s-apps to be running ...
I0719 05:19:44.899692 1393455 system_svc.go:44] waiting for kubelet service to be running ....
I0719 05:19:44.899760 1393455 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0719 05:19:44.911292 1393455 system_svc.go:56] duration metric: took 11.589223ms WaitForService to wait for kubelet
I0719 05:19:44.911319 1393455 kubeadm.go:582] duration metric: took 14.355214721s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0719 05:19:44.911339 1393455 node_conditions.go:102] verifying NodePressure condition ...
I0719 05:19:45.101804 1393455 node_conditions.go:122] node storage ephemeral capacity is 203034800Ki
I0719 05:19:45.101926 1393455 node_conditions.go:123] node cpu capacity is 2
I0719 05:19:45.101963 1393455 node_conditions.go:105] duration metric: took 190.616308ms to run NodePressure ...
I0719 05:19:45.102013 1393455 start.go:241] waiting for startup goroutines ...
I0719 05:19:45.102042 1393455 start.go:246] waiting for cluster config update ...
I0719 05:19:45.102099 1393455 start.go:255] writing updated cluster config ...
I0719 05:19:45.102533 1393455 ssh_runner.go:195] Run: rm -f paused
I0719 05:19:45.176123 1393455 start.go:600] kubectl: 1.30.3, cluster: 1.30.3 (minor skew: 0)
I0719 05:19:45.179233 1393455 out.go:177] * Done! kubectl is now configured to use "embed-certs-371220" cluster and "default" namespace by default
I0719 05:19:48.591494 1384211 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0719 05:19:48.604654 1384211 api_server.go:72] duration metric: took 5m58.737673761s to wait for apiserver process to appear ...
I0719 05:19:48.604680 1384211 api_server.go:88] waiting for apiserver healthz status ...
I0719 05:19:48.604715 1384211 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
I0719 05:19:48.604781 1384211 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0719 05:19:48.645246 1384211 cri.go:89] found id: "c4ee96f9f14987ba197d6ebeaedfca8a9835c03bcb4438e7948d99e01feb867f"
I0719 05:19:48.645276 1384211 cri.go:89] found id: "fb25f9a0346cc4e0812cc4849a6418ef42d67be0c75dedeec160273a75983a4a"
I0719 05:19:48.645282 1384211 cri.go:89] found id: ""
I0719 05:19:48.645289 1384211 logs.go:276] 2 containers: [c4ee96f9f14987ba197d6ebeaedfca8a9835c03bcb4438e7948d99e01feb867f fb25f9a0346cc4e0812cc4849a6418ef42d67be0c75dedeec160273a75983a4a]
I0719 05:19:48.645347 1384211 ssh_runner.go:195] Run: which crictl
I0719 05:19:48.649122 1384211 ssh_runner.go:195] Run: which crictl
I0719 05:19:48.652840 1384211 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
I0719 05:19:48.652913 1384211 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0719 05:19:48.692109 1384211 cri.go:89] found id: "456d0a34e10d1dde1a968ac307103c4ef6a4ffb93263871b27ba3a3200910ef6"
I0719 05:19:48.692129 1384211 cri.go:89] found id: "8ea851149d390f197f798dbb1e77c9ae51eb21cceef7c8955c58d5d653fec285"
I0719 05:19:48.692134 1384211 cri.go:89] found id: ""
I0719 05:19:48.692141 1384211 logs.go:276] 2 containers: [456d0a34e10d1dde1a968ac307103c4ef6a4ffb93263871b27ba3a3200910ef6 8ea851149d390f197f798dbb1e77c9ae51eb21cceef7c8955c58d5d653fec285]
I0719 05:19:48.692198 1384211 ssh_runner.go:195] Run: which crictl
I0719 05:19:48.696099 1384211 ssh_runner.go:195] Run: which crictl
I0719 05:19:48.699785 1384211 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
I0719 05:19:48.699884 1384211 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0719 05:19:48.739478 1384211 cri.go:89] found id: "c8b2082866621ae6fed2b885d44d13d0c6212ad3f4f27e55cd3d4c0ec819d697"
I0719 05:19:48.739502 1384211 cri.go:89] found id: "ec60727167db8439a76a65e4aba2ea5d113e867f686695daf0f9f2df3a9b984b"
I0719 05:19:48.739507 1384211 cri.go:89] found id: ""
I0719 05:19:48.739524 1384211 logs.go:276] 2 containers: [c8b2082866621ae6fed2b885d44d13d0c6212ad3f4f27e55cd3d4c0ec819d697 ec60727167db8439a76a65e4aba2ea5d113e867f686695daf0f9f2df3a9b984b]
I0719 05:19:48.739585 1384211 ssh_runner.go:195] Run: which crictl
I0719 05:19:48.743141 1384211 ssh_runner.go:195] Run: which crictl
I0719 05:19:48.746877 1384211 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
I0719 05:19:48.746966 1384211 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0719 05:19:48.792713 1384211 cri.go:89] found id: "62d56ad6f80d807a731bb4564ef55663b3b92ab83af2ba7115b207aaa62578ad"
I0719 05:19:48.792737 1384211 cri.go:89] found id: "31d2288b65a8bfddfa998e3247ebb91dfa488cdde250694c21541c28d32b661b"
I0719 05:19:48.792743 1384211 cri.go:89] found id: ""
I0719 05:19:48.792751 1384211 logs.go:276] 2 containers: [62d56ad6f80d807a731bb4564ef55663b3b92ab83af2ba7115b207aaa62578ad 31d2288b65a8bfddfa998e3247ebb91dfa488cdde250694c21541c28d32b661b]
I0719 05:19:48.792819 1384211 ssh_runner.go:195] Run: which crictl
I0719 05:19:48.796337 1384211 ssh_runner.go:195] Run: which crictl
I0719 05:19:48.799848 1384211 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
I0719 05:19:48.799917 1384211 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0719 05:19:48.840832 1384211 cri.go:89] found id: "ab6deb917db3a00322591b799b4f7c940babddc66581aa3657231d21bd68a000"
I0719 05:19:48.840894 1384211 cri.go:89] found id: "78aa39803d3d37bc510fe812e66f0fd6c8b18fa73ee068c031077da23ecacce0"
I0719 05:19:48.840914 1384211 cri.go:89] found id: ""
I0719 05:19:48.840939 1384211 logs.go:276] 2 containers: [ab6deb917db3a00322591b799b4f7c940babddc66581aa3657231d21bd68a000 78aa39803d3d37bc510fe812e66f0fd6c8b18fa73ee068c031077da23ecacce0]
I0719 05:19:48.841012 1384211 ssh_runner.go:195] Run: which crictl
I0719 05:19:48.845655 1384211 ssh_runner.go:195] Run: which crictl
I0719 05:19:48.849428 1384211 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
I0719 05:19:48.849521 1384211 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0719 05:19:48.895343 1384211 cri.go:89] found id: "8b74c8c28985fd1c8cd16fff081f8a3c79c626ff33e7b7705c27d8646b2344de"
I0719 05:19:48.895365 1384211 cri.go:89] found id: "31f8a36bff2a9b66f7c2a5a8fdc3fe9b14f1b569fae35aa6b7bec34dca8ef7a7"
I0719 05:19:48.895370 1384211 cri.go:89] found id: ""
I0719 05:19:48.895385 1384211 logs.go:276] 2 containers: [8b74c8c28985fd1c8cd16fff081f8a3c79c626ff33e7b7705c27d8646b2344de 31f8a36bff2a9b66f7c2a5a8fdc3fe9b14f1b569fae35aa6b7bec34dca8ef7a7]
I0719 05:19:48.895448 1384211 ssh_runner.go:195] Run: which crictl
I0719 05:19:48.899241 1384211 ssh_runner.go:195] Run: which crictl
I0719 05:19:48.902654 1384211 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
I0719 05:19:48.902725 1384211 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0719 05:19:48.940093 1384211 cri.go:89] found id: "10539463ca76eca3ef896527ce525ab179fe6b4182358afaa9eeeeb0f58f069c"
I0719 05:19:48.940158 1384211 cri.go:89] found id: "e0ea78faa765147f1c1a9e8517bc48fd17bcb16534bcab7e02bcfe8728d4dec6"
I0719 05:19:48.940169 1384211 cri.go:89] found id: ""
I0719 05:19:48.940177 1384211 logs.go:276] 2 containers: [10539463ca76eca3ef896527ce525ab179fe6b4182358afaa9eeeeb0f58f069c e0ea78faa765147f1c1a9e8517bc48fd17bcb16534bcab7e02bcfe8728d4dec6]
I0719 05:19:48.940262 1384211 ssh_runner.go:195] Run: which crictl
I0719 05:19:48.944026 1384211 ssh_runner.go:195] Run: which crictl
I0719 05:19:48.947549 1384211 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
I0719 05:19:48.947674 1384211 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0719 05:19:48.989665 1384211 cri.go:89] found id: "9fea07ce92177cea6b541d5da457322ab3fe68c5111c73979657fea3daea5d22"
I0719 05:19:48.989691 1384211 cri.go:89] found id: "5f5f26e535c99452b4f124fa647bbe2bde0544bddf60e1a422933a407836ef89"
I0719 05:19:48.989696 1384211 cri.go:89] found id: ""
I0719 05:19:48.989703 1384211 logs.go:276] 2 containers: [9fea07ce92177cea6b541d5da457322ab3fe68c5111c73979657fea3daea5d22 5f5f26e535c99452b4f124fa647bbe2bde0544bddf60e1a422933a407836ef89]
I0719 05:19:48.989781 1384211 ssh_runner.go:195] Run: which crictl
I0719 05:19:48.994050 1384211 ssh_runner.go:195] Run: which crictl
I0719 05:19:48.997789 1384211 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
I0719 05:19:48.997895 1384211 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I0719 05:19:49.039568 1384211 cri.go:89] found id: "6472a666aa3686f6d4a248b14ad6c12bd855ee07f9769fb002846093117bdb3c"
I0719 05:19:49.039592 1384211 cri.go:89] found id: ""
I0719 05:19:49.039600 1384211 logs.go:276] 1 containers: [6472a666aa3686f6d4a248b14ad6c12bd855ee07f9769fb002846093117bdb3c]
I0719 05:19:49.039655 1384211 ssh_runner.go:195] Run: which crictl
I0719 05:19:49.043660 1384211 logs.go:123] Gathering logs for dmesg ...
I0719 05:19:49.043682 1384211 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0719 05:19:49.062713 1384211 logs.go:123] Gathering logs for describe nodes ...
I0719 05:19:49.062740 1384211 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0719 05:19:49.209258 1384211 logs.go:123] Gathering logs for coredns [c8b2082866621ae6fed2b885d44d13d0c6212ad3f4f27e55cd3d4c0ec819d697] ...
I0719 05:19:49.209288 1384211 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 c8b2082866621ae6fed2b885d44d13d0c6212ad3f4f27e55cd3d4c0ec819d697"
I0719 05:19:49.257893 1384211 logs.go:123] Gathering logs for kindnet [e0ea78faa765147f1c1a9e8517bc48fd17bcb16534bcab7e02bcfe8728d4dec6] ...
I0719 05:19:49.257928 1384211 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e0ea78faa765147f1c1a9e8517bc48fd17bcb16534bcab7e02bcfe8728d4dec6"
I0719 05:19:49.309457 1384211 logs.go:123] Gathering logs for containerd ...
I0719 05:19:49.309493 1384211 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
I0719 05:19:49.373482 1384211 logs.go:123] Gathering logs for kube-apiserver [c4ee96f9f14987ba197d6ebeaedfca8a9835c03bcb4438e7948d99e01feb867f] ...
I0719 05:19:49.373517 1384211 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 c4ee96f9f14987ba197d6ebeaedfca8a9835c03bcb4438e7948d99e01feb867f"
I0719 05:19:49.434446 1384211 logs.go:123] Gathering logs for kube-scheduler [31d2288b65a8bfddfa998e3247ebb91dfa488cdde250694c21541c28d32b661b] ...
I0719 05:19:49.434495 1384211 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 31d2288b65a8bfddfa998e3247ebb91dfa488cdde250694c21541c28d32b661b"
I0719 05:19:49.517653 1384211 logs.go:123] Gathering logs for kindnet [10539463ca76eca3ef896527ce525ab179fe6b4182358afaa9eeeeb0f58f069c] ...
I0719 05:19:49.517749 1384211 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 10539463ca76eca3ef896527ce525ab179fe6b4182358afaa9eeeeb0f58f069c"
I0719 05:19:49.621759 1384211 logs.go:123] Gathering logs for kubernetes-dashboard [6472a666aa3686f6d4a248b14ad6c12bd855ee07f9769fb002846093117bdb3c] ...
I0719 05:19:49.621842 1384211 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 6472a666aa3686f6d4a248b14ad6c12bd855ee07f9769fb002846093117bdb3c"
I0719 05:19:49.664546 1384211 logs.go:123] Gathering logs for container status ...
I0719 05:19:49.664619 1384211 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0719 05:19:49.725263 1384211 logs.go:123] Gathering logs for kube-apiserver [fb25f9a0346cc4e0812cc4849a6418ef42d67be0c75dedeec160273a75983a4a] ...
I0719 05:19:49.725290 1384211 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 fb25f9a0346cc4e0812cc4849a6418ef42d67be0c75dedeec160273a75983a4a"
I0719 05:19:49.796726 1384211 logs.go:123] Gathering logs for etcd [8ea851149d390f197f798dbb1e77c9ae51eb21cceef7c8955c58d5d653fec285] ...
I0719 05:19:49.796759 1384211 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 8ea851149d390f197f798dbb1e77c9ae51eb21cceef7c8955c58d5d653fec285"
I0719 05:19:49.847376 1384211 logs.go:123] Gathering logs for kube-proxy [78aa39803d3d37bc510fe812e66f0fd6c8b18fa73ee068c031077da23ecacce0] ...
I0719 05:19:49.847414 1384211 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 78aa39803d3d37bc510fe812e66f0fd6c8b18fa73ee068c031077da23ecacce0"
I0719 05:19:49.893049 1384211 logs.go:123] Gathering logs for kube-controller-manager [31f8a36bff2a9b66f7c2a5a8fdc3fe9b14f1b569fae35aa6b7bec34dca8ef7a7] ...
I0719 05:19:49.893082 1384211 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 31f8a36bff2a9b66f7c2a5a8fdc3fe9b14f1b569fae35aa6b7bec34dca8ef7a7"
I0719 05:19:49.948334 1384211 logs.go:123] Gathering logs for storage-provisioner [5f5f26e535c99452b4f124fa647bbe2bde0544bddf60e1a422933a407836ef89] ...
I0719 05:19:49.948382 1384211 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 5f5f26e535c99452b4f124fa647bbe2bde0544bddf60e1a422933a407836ef89"
I0719 05:19:49.993378 1384211 logs.go:123] Gathering logs for kubelet ...
I0719 05:19:49.993405 1384211 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0719 05:19:50.053768 1384211 logs.go:138] Found kubelet problem: Jul 19 05:14:06 old-k8s-version-199824 kubelet[663]: E0719 05:14:06.879898 663 reflector.go:138] object-"kube-system"/"kube-proxy-token-486sl": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kube-proxy-token-486sl" is forbidden: User "system:node:old-k8s-version-199824" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-199824' and this object
W0719 05:19:50.053997 1384211 logs.go:138] Found kubelet problem: Jul 19 05:14:06 old-k8s-version-199824 kubelet[663]: E0719 05:14:06.880125 663 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:old-k8s-version-199824" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-199824' and this object
W0719 05:19:50.054214 1384211 logs.go:138] Found kubelet problem: Jul 19 05:14:06 old-k8s-version-199824 kubelet[663]: E0719 05:14:06.880466 663 reflector.go:138] object-"kube-system"/"coredns-token-zhr5r": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "coredns-token-zhr5r" is forbidden: User "system:node:old-k8s-version-199824" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-199824' and this object
W0719 05:19:50.054417 1384211 logs.go:138] Found kubelet problem: Jul 19 05:14:06 old-k8s-version-199824 kubelet[663]: E0719 05:14:06.880696 663 reflector.go:138] object-"kube-system"/"coredns": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:old-k8s-version-199824" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-199824' and this object
W0719 05:19:50.054647 1384211 logs.go:138] Found kubelet problem: Jul 19 05:14:06 old-k8s-version-199824 kubelet[663]: E0719 05:14:06.880989 663 reflector.go:138] object-"kube-system"/"storage-provisioner-token-tkjk9": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "storage-provisioner-token-tkjk9" is forbidden: User "system:node:old-k8s-version-199824" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-199824' and this object
W0719 05:19:50.054862 1384211 logs.go:138] Found kubelet problem: Jul 19 05:14:06 old-k8s-version-199824 kubelet[663]: E0719 05:14:06.881007 663 reflector.go:138] object-"kube-system"/"kindnet-token-lncwz": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kindnet-token-lncwz" is forbidden: User "system:node:old-k8s-version-199824" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-199824' and this object
W0719 05:19:50.061021 1384211 logs.go:138] Found kubelet problem: Jul 19 05:14:08 old-k8s-version-199824 kubelet[663]: E0719 05:14:08.050691 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0719 05:19:50.064579 1384211 logs.go:138] Found kubelet problem: Jul 19 05:14:08 old-k8s-version-199824 kubelet[663]: E0719 05:14:08.778488 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0719 05:19:50.067607 1384211 logs.go:138] Found kubelet problem: Jul 19 05:14:19 old-k8s-version-199824 kubelet[663]: E0719 05:14:19.553286 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0719 05:19:50.067945 1384211 logs.go:138] Found kubelet problem: Jul 19 05:14:26 old-k8s-version-199824 kubelet[663]: E0719 05:14:26.755718 663 reflector.go:138] object-"kubernetes-dashboard"/"kubernetes-dashboard-token-xs5nw": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kubernetes-dashboard-token-xs5nw" is forbidden: User "system:node:old-k8s-version-199824" cannot list resource "secrets" in API group "" in the namespace "kubernetes-dashboard": no relationship found between node 'old-k8s-version-199824' and this object
W0719 05:19:50.069540 1384211 logs.go:138] Found kubelet problem: Jul 19 05:14:34 old-k8s-version-199824 kubelet[663]: E0719 05:14:34.547673 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0719 05:19:50.070344 1384211 logs.go:138] Found kubelet problem: Jul 19 05:14:38 old-k8s-version-199824 kubelet[663]: E0719 05:14:38.956338 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
W0719 05:19:50.070806 1384211 logs.go:138] Found kubelet problem: Jul 19 05:14:39 old-k8s-version-199824 kubelet[663]: E0719 05:14:39.959828 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
W0719 05:19:50.071298 1384211 logs.go:138] Found kubelet problem: Jul 19 05:14:40 old-k8s-version-199824 kubelet[663]: E0719 05:14:40.964790 663 pod_workers.go:191] Error syncing pod 066eb7e2-3639-4912-a7c5-7a3bc8cfd104 ("storage-provisioner_kube-system(066eb7e2-3639-4912-a7c5-7a3bc8cfd104)"), skipping: failed to "StartContainer" for "storage-provisioner" with CrashLoopBackOff: "back-off 10s restarting failed container=storage-provisioner pod=storage-provisioner_kube-system(066eb7e2-3639-4912-a7c5-7a3bc8cfd104)"
W0719 05:19:50.071634 1384211 logs.go:138] Found kubelet problem: Jul 19 05:14:44 old-k8s-version-199824 kubelet[663]: E0719 05:14:44.803493 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
W0719 05:19:50.074089 1384211 logs.go:138] Found kubelet problem: Jul 19 05:14:45 old-k8s-version-199824 kubelet[663]: E0719 05:14:45.553693 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0719 05:19:50.075166 1384211 logs.go:138] Found kubelet problem: Jul 19 05:14:57 old-k8s-version-199824 kubelet[663]: E0719 05:14:57.011919 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
W0719 05:19:50.075379 1384211 logs.go:138] Found kubelet problem: Jul 19 05:14:57 old-k8s-version-199824 kubelet[663]: E0719 05:14:57.545646 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0719 05:19:50.075711 1384211 logs.go:138] Found kubelet problem: Jul 19 05:15:04 old-k8s-version-199824 kubelet[663]: E0719 05:15:04.804038 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
W0719 05:19:50.075901 1384211 logs.go:138] Found kubelet problem: Jul 19 05:15:09 old-k8s-version-199824 kubelet[663]: E0719 05:15:09.545053 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0719 05:19:50.076233 1384211 logs.go:138] Found kubelet problem: Jul 19 05:15:16 old-k8s-version-199824 kubelet[663]: E0719 05:15:16.546724 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
W0719 05:19:50.076419 1384211 logs.go:138] Found kubelet problem: Jul 19 05:15:24 old-k8s-version-199824 kubelet[663]: E0719 05:15:24.544833 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0719 05:19:50.077010 1384211 logs.go:138] Found kubelet problem: Jul 19 05:15:28 old-k8s-version-199824 kubelet[663]: E0719 05:15:28.099362 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
W0719 05:19:50.077343 1384211 logs.go:138] Found kubelet problem: Jul 19 05:15:34 old-k8s-version-199824 kubelet[663]: E0719 05:15:34.803496 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
W0719 05:19:50.079810 1384211 logs.go:138] Found kubelet problem: Jul 19 05:15:37 old-k8s-version-199824 kubelet[663]: E0719 05:15:37.554467 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0719 05:19:50.080143 1384211 logs.go:138] Found kubelet problem: Jul 19 05:15:48 old-k8s-version-199824 kubelet[663]: E0719 05:15:48.544496 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
W0719 05:19:50.080329 1384211 logs.go:138] Found kubelet problem: Jul 19 05:15:51 old-k8s-version-199824 kubelet[663]: E0719 05:15:51.545269 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0719 05:19:50.080658 1384211 logs.go:138] Found kubelet problem: Jul 19 05:16:01 old-k8s-version-199824 kubelet[663]: E0719 05:16:01.544502 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
W0719 05:19:50.080901 1384211 logs.go:138] Found kubelet problem: Jul 19 05:16:04 old-k8s-version-199824 kubelet[663]: E0719 05:16:04.544940 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0719 05:19:50.081498 1384211 logs.go:138] Found kubelet problem: Jul 19 05:16:13 old-k8s-version-199824 kubelet[663]: E0719 05:16:13.212164 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
W0719 05:19:50.081834 1384211 logs.go:138] Found kubelet problem: Jul 19 05:16:14 old-k8s-version-199824 kubelet[663]: E0719 05:16:14.803581 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
W0719 05:19:50.082018 1384211 logs.go:138] Found kubelet problem: Jul 19 05:16:15 old-k8s-version-199824 kubelet[663]: E0719 05:16:15.548045 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0719 05:19:50.082598 1384211 logs.go:138] Found kubelet problem: Jul 19 05:16:25 old-k8s-version-199824 kubelet[663]: E0719 05:16:25.545039 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
W0719 05:19:50.082798 1384211 logs.go:138] Found kubelet problem: Jul 19 05:16:26 old-k8s-version-199824 kubelet[663]: E0719 05:16:26.544814 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0719 05:19:50.082981 1384211 logs.go:138] Found kubelet problem: Jul 19 05:16:37 old-k8s-version-199824 kubelet[663]: E0719 05:16:37.545101 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0719 05:19:50.083415 1384211 logs.go:138] Found kubelet problem: Jul 19 05:16:38 old-k8s-version-199824 kubelet[663]: E0719 05:16:38.544489 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
W0719 05:19:50.083607 1384211 logs.go:138] Found kubelet problem: Jul 19 05:16:51 old-k8s-version-199824 kubelet[663]: E0719 05:16:51.546833 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0719 05:19:50.083949 1384211 logs.go:138] Found kubelet problem: Jul 19 05:16:52 old-k8s-version-199824 kubelet[663]: E0719 05:16:52.544432 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
W0719 05:19:50.086423 1384211 logs.go:138] Found kubelet problem: Jul 19 05:17:06 old-k8s-version-199824 kubelet[663]: E0719 05:17:06.557289 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0719 05:19:50.086751 1384211 logs.go:138] Found kubelet problem: Jul 19 05:17:07 old-k8s-version-199824 kubelet[663]: E0719 05:17:07.544941 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
W0719 05:19:50.086937 1384211 logs.go:138] Found kubelet problem: Jul 19 05:17:18 old-k8s-version-199824 kubelet[663]: E0719 05:17:18.544856 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0719 05:19:50.087276 1384211 logs.go:138] Found kubelet problem: Jul 19 05:17:19 old-k8s-version-199824 kubelet[663]: E0719 05:17:19.548049 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
W0719 05:19:50.087461 1384211 logs.go:138] Found kubelet problem: Jul 19 05:17:30 old-k8s-version-199824 kubelet[663]: E0719 05:17:30.544793 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0719 05:19:50.088067 1384211 logs.go:138] Found kubelet problem: Jul 19 05:17:34 old-k8s-version-199824 kubelet[663]: E0719 05:17:34.434708 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
W0719 05:19:50.088400 1384211 logs.go:138] Found kubelet problem: Jul 19 05:17:35 old-k8s-version-199824 kubelet[663]: E0719 05:17:35.438099 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
W0719 05:19:50.088585 1384211 logs.go:138] Found kubelet problem: Jul 19 05:17:44 old-k8s-version-199824 kubelet[663]: E0719 05:17:44.544860 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0719 05:19:50.088916 1384211 logs.go:138] Found kubelet problem: Jul 19 05:17:47 old-k8s-version-199824 kubelet[663]: E0719 05:17:47.548823 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
W0719 05:19:50.089101 1384211 logs.go:138] Found kubelet problem: Jul 19 05:17:58 old-k8s-version-199824 kubelet[663]: E0719 05:17:58.544841 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0719 05:19:50.089432 1384211 logs.go:138] Found kubelet problem: Jul 19 05:18:01 old-k8s-version-199824 kubelet[663]: E0719 05:18:01.545059 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
W0719 05:19:50.089618 1384211 logs.go:138] Found kubelet problem: Jul 19 05:18:10 old-k8s-version-199824 kubelet[663]: E0719 05:18:10.544965 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0719 05:19:50.089949 1384211 logs.go:138] Found kubelet problem: Jul 19 05:18:15 old-k8s-version-199824 kubelet[663]: E0719 05:18:15.545036 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
W0719 05:19:50.090135 1384211 logs.go:138] Found kubelet problem: Jul 19 05:18:23 old-k8s-version-199824 kubelet[663]: E0719 05:18:23.547544 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0719 05:19:50.090470 1384211 logs.go:138] Found kubelet problem: Jul 19 05:18:26 old-k8s-version-199824 kubelet[663]: E0719 05:18:26.545720 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
W0719 05:19:50.090803 1384211 logs.go:138] Found kubelet problem: Jul 19 05:18:38 old-k8s-version-199824 kubelet[663]: E0719 05:18:38.544881 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
W0719 05:19:50.090988 1384211 logs.go:138] Found kubelet problem: Jul 19 05:18:38 old-k8s-version-199824 kubelet[663]: E0719 05:18:38.545132 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0719 05:19:50.091357 1384211 logs.go:138] Found kubelet problem: Jul 19 05:18:50 old-k8s-version-199824 kubelet[663]: E0719 05:18:50.544554 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
W0719 05:19:50.091543 1384211 logs.go:138] Found kubelet problem: Jul 19 05:18:50 old-k8s-version-199824 kubelet[663]: E0719 05:18:50.545182 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0719 05:19:50.091735 1384211 logs.go:138] Found kubelet problem: Jul 19 05:19:01 old-k8s-version-199824 kubelet[663]: E0719 05:19:01.545861 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0719 05:19:50.092066 1384211 logs.go:138] Found kubelet problem: Jul 19 05:19:03 old-k8s-version-199824 kubelet[663]: E0719 05:19:03.544954 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
W0719 05:19:50.092251 1384211 logs.go:138] Found kubelet problem: Jul 19 05:19:13 old-k8s-version-199824 kubelet[663]: E0719 05:19:13.553562 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0719 05:19:50.092582 1384211 logs.go:138] Found kubelet problem: Jul 19 05:19:14 old-k8s-version-199824 kubelet[663]: E0719 05:19:14.544624 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
W0719 05:19:50.092913 1384211 logs.go:138] Found kubelet problem: Jul 19 05:19:25 old-k8s-version-199824 kubelet[663]: E0719 05:19:25.548824 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
W0719 05:19:50.093099 1384211 logs.go:138] Found kubelet problem: Jul 19 05:19:26 old-k8s-version-199824 kubelet[663]: E0719 05:19:26.544794 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0719 05:19:50.093284 1384211 logs.go:138] Found kubelet problem: Jul 19 05:19:38 old-k8s-version-199824 kubelet[663]: E0719 05:19:38.545560 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0719 05:19:50.093612 1384211 logs.go:138] Found kubelet problem: Jul 19 05:19:39 old-k8s-version-199824 kubelet[663]: E0719 05:19:39.544604 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
I0719 05:19:50.093624 1384211 logs.go:123] Gathering logs for etcd [456d0a34e10d1dde1a968ac307103c4ef6a4ffb93263871b27ba3a3200910ef6] ...
I0719 05:19:50.093640 1384211 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 456d0a34e10d1dde1a968ac307103c4ef6a4ffb93263871b27ba3a3200910ef6"
I0719 05:19:50.155702 1384211 logs.go:123] Gathering logs for coredns [ec60727167db8439a76a65e4aba2ea5d113e867f686695daf0f9f2df3a9b984b] ...
I0719 05:19:50.155740 1384211 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 ec60727167db8439a76a65e4aba2ea5d113e867f686695daf0f9f2df3a9b984b"
I0719 05:19:50.199105 1384211 logs.go:123] Gathering logs for kube-scheduler [62d56ad6f80d807a731bb4564ef55663b3b92ab83af2ba7115b207aaa62578ad] ...
I0719 05:19:50.199223 1384211 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 62d56ad6f80d807a731bb4564ef55663b3b92ab83af2ba7115b207aaa62578ad"
I0719 05:19:50.243024 1384211 logs.go:123] Gathering logs for kube-proxy [ab6deb917db3a00322591b799b4f7c940babddc66581aa3657231d21bd68a000] ...
I0719 05:19:50.243051 1384211 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 ab6deb917db3a00322591b799b4f7c940babddc66581aa3657231d21bd68a000"
I0719 05:19:50.284030 1384211 logs.go:123] Gathering logs for kube-controller-manager [8b74c8c28985fd1c8cd16fff081f8a3c79c626ff33e7b7705c27d8646b2344de] ...
I0719 05:19:50.284058 1384211 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 8b74c8c28985fd1c8cd16fff081f8a3c79c626ff33e7b7705c27d8646b2344de"
I0719 05:19:50.355314 1384211 logs.go:123] Gathering logs for storage-provisioner [9fea07ce92177cea6b541d5da457322ab3fe68c5111c73979657fea3daea5d22] ...
I0719 05:19:50.355351 1384211 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 9fea07ce92177cea6b541d5da457322ab3fe68c5111c73979657fea3daea5d22"
I0719 05:19:50.396188 1384211 out.go:304] Setting ErrFile to fd 2...
I0719 05:19:50.396213 1384211 out.go:338] TERM=,COLORTERM=, which probably does not support color
W0719 05:19:50.396258 1384211 out.go:239] X Problems detected in kubelet:
W0719 05:19:50.396273 1384211 out.go:239] Jul 19 05:19:14 old-k8s-version-199824 kubelet[663]: E0719 05:19:14.544624 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
W0719 05:19:50.396280 1384211 out.go:239] Jul 19 05:19:25 old-k8s-version-199824 kubelet[663]: E0719 05:19:25.548824 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
W0719 05:19:50.396292 1384211 out.go:239] Jul 19 05:19:26 old-k8s-version-199824 kubelet[663]: E0719 05:19:26.544794 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0719 05:19:50.396300 1384211 out.go:239] Jul 19 05:19:38 old-k8s-version-199824 kubelet[663]: E0719 05:19:38.545560 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0719 05:19:50.396306 1384211 out.go:239] Jul 19 05:19:39 old-k8s-version-199824 kubelet[663]: E0719 05:19:39.544604 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
I0719 05:19:50.396316 1384211 out.go:304] Setting ErrFile to fd 2...
I0719 05:19:50.396321 1384211 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0719 05:20:00.397174 1384211 api_server.go:253] Checking apiserver healthz at https://192.168.85.2:8443/healthz ...
I0719 05:20:00.421029 1384211 api_server.go:279] https://192.168.85.2:8443/healthz returned 200:
ok
I0719 05:20:00.424548 1384211 out.go:177]
W0719 05:20:00.428654 1384211 out.go:239] X Exiting due to K8S_UNHEALTHY_CONTROL_PLANE: wait 6m0s for node: wait for healthy API server: controlPlane never updated to v1.20.0
W0719 05:20:00.428751 1384211 out.go:239] * Suggestion: Control Plane could not update, try minikube delete --all --purge
W0719 05:20:00.428803 1384211 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/11417
W0719 05:20:00.428813 1384211 out.go:239] *
W0719 05:20:00.429909 1384211 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0719 05:20:00.451930 1384211 out.go:177]
==> container status <==
CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID POD
367d4fb3bbc6e 523cad1a4df73 2 minutes ago Exited dashboard-metrics-scraper 5 bc2cd7d895800 dashboard-metrics-scraper-8d5bb5db8-xfcg8
9fea07ce92177 ba04bb24b9575 5 minutes ago Running storage-provisioner 2 af201d88ecb83 storage-provisioner
6472a666aa368 20b332c9a70d8 5 minutes ago Running kubernetes-dashboard 0 736990bbafcb4 kubernetes-dashboard-cd95d586-xsjcr
ab6deb917db3a 25a5233254979 5 minutes ago Running kube-proxy 1 54a8256f2c8b8 kube-proxy-f8hp8
c8b2082866621 db91994f4ee8f 5 minutes ago Running coredns 1 5b0735dc5d1c2 coredns-74ff55c5b-ddsjt
5f5f26e535c99 ba04bb24b9575 5 minutes ago Exited storage-provisioner 1 af201d88ecb83 storage-provisioner
10539463ca76e 5e32961ddcea3 5 minutes ago Running kindnet-cni 1 515815097f2b3 kindnet-mkdjk
6831703057902 1611cd07b61d5 5 minutes ago Running busybox 1 39b02657ab3c2 busybox
456d0a34e10d1 05b738aa1bc63 6 minutes ago Running etcd 1 1e071b7efbab5 etcd-old-k8s-version-199824
8b74c8c28985f 1df8a2b116bd1 6 minutes ago Running kube-controller-manager 1 aa3f3480fa90b kube-controller-manager-old-k8s-version-199824
c4ee96f9f1498 2c08bbbc02d3a 6 minutes ago Running kube-apiserver 1 e2d9da57b811e kube-apiserver-old-k8s-version-199824
62d56ad6f80d8 e7605f88f17d6 6 minutes ago Running kube-scheduler 1 344e0cc380fc9 kube-scheduler-old-k8s-version-199824
90c7e9f5edc81 1611cd07b61d5 6 minutes ago Exited busybox 0 4662a7c637ded busybox
ec60727167db8 db91994f4ee8f 8 minutes ago Exited coredns 0 5e8ce9ade3cd4 coredns-74ff55c5b-ddsjt
e0ea78faa7651 5e32961ddcea3 8 minutes ago Exited kindnet-cni 0 afef699166569 kindnet-mkdjk
78aa39803d3d3 25a5233254979 8 minutes ago Exited kube-proxy 0 3af2563fa1a4a kube-proxy-f8hp8
31d2288b65a8b e7605f88f17d6 9 minutes ago Exited kube-scheduler 0 e51ce944fe493 kube-scheduler-old-k8s-version-199824
fb25f9a0346cc 2c08bbbc02d3a 9 minutes ago Exited kube-apiserver 0 0e3fd310b1d59 kube-apiserver-old-k8s-version-199824
31f8a36bff2a9 1df8a2b116bd1 9 minutes ago Exited kube-controller-manager 0 d4e8c16d23c3b kube-controller-manager-old-k8s-version-199824
8ea851149d390 05b738aa1bc63 9 minutes ago Exited etcd 0 2bb801adf310b etcd-old-k8s-version-199824
==> containerd <==
Jul 19 05:16:12 old-k8s-version-199824 containerd[569]: time="2024-07-19T05:16:12.584221151Z" level=info msg="CreateContainer within sandbox \"bc2cd7d895800c9b4a3efe4e2202870babca406e0258a7a8ef42bbfecacc217b\" for name:\"dashboard-metrics-scraper\" attempt:4 returns container id \"69bdf11c3fe52189514ea496818dfa382698a9dc328bdb03e6ec96366b38a29a\""
Jul 19 05:16:12 old-k8s-version-199824 containerd[569]: time="2024-07-19T05:16:12.585729059Z" level=info msg="StartContainer for \"69bdf11c3fe52189514ea496818dfa382698a9dc328bdb03e6ec96366b38a29a\""
Jul 19 05:16:12 old-k8s-version-199824 containerd[569]: time="2024-07-19T05:16:12.657660028Z" level=info msg="StartContainer for \"69bdf11c3fe52189514ea496818dfa382698a9dc328bdb03e6ec96366b38a29a\" returns successfully"
Jul 19 05:16:12 old-k8s-version-199824 containerd[569]: time="2024-07-19T05:16:12.682627551Z" level=info msg="shim disconnected" id=69bdf11c3fe52189514ea496818dfa382698a9dc328bdb03e6ec96366b38a29a namespace=k8s.io
Jul 19 05:16:12 old-k8s-version-199824 containerd[569]: time="2024-07-19T05:16:12.682686775Z" level=warning msg="cleaning up after shim disconnected" id=69bdf11c3fe52189514ea496818dfa382698a9dc328bdb03e6ec96366b38a29a namespace=k8s.io
Jul 19 05:16:12 old-k8s-version-199824 containerd[569]: time="2024-07-19T05:16:12.682698008Z" level=info msg="cleaning up dead shim" namespace=k8s.io
Jul 19 05:16:13 old-k8s-version-199824 containerd[569]: time="2024-07-19T05:16:13.216820601Z" level=info msg="RemoveContainer for \"929a615c0a02f2bbd5ae749974ed0ac2330be9c6e1fe2671b0138307a2885524\""
Jul 19 05:16:13 old-k8s-version-199824 containerd[569]: time="2024-07-19T05:16:13.222981590Z" level=info msg="RemoveContainer for \"929a615c0a02f2bbd5ae749974ed0ac2330be9c6e1fe2671b0138307a2885524\" returns successfully"
Jul 19 05:17:06 old-k8s-version-199824 containerd[569]: time="2024-07-19T05:17:06.545314558Z" level=info msg="PullImage \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jul 19 05:17:06 old-k8s-version-199824 containerd[569]: time="2024-07-19T05:17:06.554675158Z" level=info msg="trying next host" error="failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host" host=fake.domain
Jul 19 05:17:06 old-k8s-version-199824 containerd[569]: time="2024-07-19T05:17:06.556523931Z" level=error msg="PullImage \"fake.domain/registry.k8s.io/echoserver:1.4\" failed" error="failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
Jul 19 05:17:06 old-k8s-version-199824 containerd[569]: time="2024-07-19T05:17:06.556597645Z" level=info msg="stop pulling image fake.domain/registry.k8s.io/echoserver:1.4: active requests=0, bytes read=0"
Jul 19 05:17:33 old-k8s-version-199824 containerd[569]: time="2024-07-19T05:17:33.547014138Z" level=info msg="CreateContainer within sandbox \"bc2cd7d895800c9b4a3efe4e2202870babca406e0258a7a8ef42bbfecacc217b\" for container name:\"dashboard-metrics-scraper\" attempt:5"
Jul 19 05:17:33 old-k8s-version-199824 containerd[569]: time="2024-07-19T05:17:33.563636626Z" level=info msg="CreateContainer within sandbox \"bc2cd7d895800c9b4a3efe4e2202870babca406e0258a7a8ef42bbfecacc217b\" for name:\"dashboard-metrics-scraper\" attempt:5 returns container id \"367d4fb3bbc6e1c62dbb91c33116ff35a64feafe29003c525f5015462afbb8db\""
Jul 19 05:17:33 old-k8s-version-199824 containerd[569]: time="2024-07-19T05:17:33.564194770Z" level=info msg="StartContainer for \"367d4fb3bbc6e1c62dbb91c33116ff35a64feafe29003c525f5015462afbb8db\""
Jul 19 05:17:33 old-k8s-version-199824 containerd[569]: time="2024-07-19T05:17:33.643491424Z" level=info msg="StartContainer for \"367d4fb3bbc6e1c62dbb91c33116ff35a64feafe29003c525f5015462afbb8db\" returns successfully"
Jul 19 05:17:33 old-k8s-version-199824 containerd[569]: time="2024-07-19T05:17:33.671899511Z" level=info msg="shim disconnected" id=367d4fb3bbc6e1c62dbb91c33116ff35a64feafe29003c525f5015462afbb8db namespace=k8s.io
Jul 19 05:17:33 old-k8s-version-199824 containerd[569]: time="2024-07-19T05:17:33.672083265Z" level=warning msg="cleaning up after shim disconnected" id=367d4fb3bbc6e1c62dbb91c33116ff35a64feafe29003c525f5015462afbb8db namespace=k8s.io
Jul 19 05:17:33 old-k8s-version-199824 containerd[569]: time="2024-07-19T05:17:33.672095121Z" level=info msg="cleaning up dead shim" namespace=k8s.io
Jul 19 05:17:34 old-k8s-version-199824 containerd[569]: time="2024-07-19T05:17:34.435054672Z" level=info msg="RemoveContainer for \"69bdf11c3fe52189514ea496818dfa382698a9dc328bdb03e6ec96366b38a29a\""
Jul 19 05:17:34 old-k8s-version-199824 containerd[569]: time="2024-07-19T05:17:34.441764909Z" level=info msg="RemoveContainer for \"69bdf11c3fe52189514ea496818dfa382698a9dc328bdb03e6ec96366b38a29a\" returns successfully"
Jul 19 05:19:51 old-k8s-version-199824 containerd[569]: time="2024-07-19T05:19:51.545540130Z" level=info msg="PullImage \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jul 19 05:19:51 old-k8s-version-199824 containerd[569]: time="2024-07-19T05:19:51.564944913Z" level=info msg="trying next host" error="failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host" host=fake.domain
Jul 19 05:19:51 old-k8s-version-199824 containerd[569]: time="2024-07-19T05:19:51.566803564Z" level=error msg="PullImage \"fake.domain/registry.k8s.io/echoserver:1.4\" failed" error="failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
Jul 19 05:19:51 old-k8s-version-199824 containerd[569]: time="2024-07-19T05:19:51.566856036Z" level=info msg="stop pulling image fake.domain/registry.k8s.io/echoserver:1.4: active requests=0, bytes read=0"
==> coredns [c8b2082866621ae6fed2b885d44d13d0c6212ad3f4f27e55cd3d4c0ec819d697] <==
.:53
[INFO] plugin/reload: Running configuration MD5 = 093a0bf1423dd8c4eee62372bb216168
CoreDNS-1.7.0
linux/arm64, go1.14.4, f59c03d
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] 127.0.0.1:58405 - 39770 "HINFO IN 3812340323874672050.3337676844708037432. udp 57 false 512" NXDOMAIN qr,rd,ra 57 0.032917917s
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/ready: Still waiting on: "kubernetes"
I0719 05:14:40.026150 1 trace.go:116] Trace[2019727887]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125 (started: 2024-07-19 05:14:10.025218762 +0000 UTC m=+0.063005857) (total time: 30.000749997s):
Trace[2019727887]: [30.000749997s] [30.000749997s] END
E0719 05:14:40.026187 1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to list *v1.Namespace: Get "https://10.96.0.1:443/api/v1/namespaces?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
I0719 05:14:40.026207 1 trace.go:116] Trace[1427131847]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125 (started: 2024-07-19 05:14:10.025829188 +0000 UTC m=+0.063616275) (total time: 30.000230409s):
Trace[1427131847]: [30.000230409s] [30.000230409s] END
E0719 05:14:40.026211 1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to list *v1.Service: Get "https://10.96.0.1:443/api/v1/services?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
I0719 05:14:40.026261 1 trace.go:116] Trace[911902081]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125 (started: 2024-07-19 05:14:10.026082217 +0000 UTC m=+0.063869312) (total time: 30.00016252s):
Trace[911902081]: [30.00016252s] [30.00016252s] END
E0719 05:14:40.026269 1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to list *v1.Endpoints: Get "https://10.96.0.1:443/api/v1/endpoints?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
==> coredns [ec60727167db8439a76a65e4aba2ea5d113e867f686695daf0f9f2df3a9b984b] <==
.:53
[INFO] plugin/reload: Running configuration MD5 = 093a0bf1423dd8c4eee62372bb216168
CoreDNS-1.7.0
linux/arm64, go1.14.4, f59c03d
[INFO] 127.0.0.1:41732 - 32109 "HINFO IN 8366602363655379228.5906562623523190718. udp 57 false 512" NXDOMAIN qr,rd,ra 57 0.039835865s
==> describe nodes <==
Name: old-k8s-version-199824
Roles: control-plane,master
Labels: beta.kubernetes.io/arch=arm64
beta.kubernetes.io/os=linux
kubernetes.io/arch=arm64
kubernetes.io/hostname=old-k8s-version-199824
kubernetes.io/os=linux
minikube.k8s.io/commit=c5c4003e63e14c031fd1d49a13aab215383064db
minikube.k8s.io/name=old-k8s-version-199824
minikube.k8s.io/primary=true
minikube.k8s.io/updated_at=2024_07_19T05_11_08_0700
minikube.k8s.io/version=v1.33.1
node-role.kubernetes.io/control-plane=
node-role.kubernetes.io/master=
Annotations: kubeadm.alpha.kubernetes.io/cri-socket: /run/containerd/containerd.sock
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Fri, 19 Jul 2024 05:11:04 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: old-k8s-version-199824
AcquireTime: <unset>
RenewTime: Fri, 19 Jul 2024 05:19:59 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Fri, 19 Jul 2024 05:15:07 +0000 Fri, 19 Jul 2024 05:10:58 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Fri, 19 Jul 2024 05:15:07 +0000 Fri, 19 Jul 2024 05:10:58 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Fri, 19 Jul 2024 05:15:07 +0000 Fri, 19 Jul 2024 05:10:58 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Fri, 19 Jul 2024 05:15:07 +0000 Fri, 19 Jul 2024 05:11:23 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.85.2
Hostname: old-k8s-version-199824
Capacity:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022360Ki
pods: 110
Allocatable:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022360Ki
pods: 110
System Info:
Machine ID: 2be127578bae4cff89d96e5668eaafd0
System UUID: acd05cca-abd9-45d6-9643-3f8156a4f153
Boot ID: 45102b33-7db6-4964-b105-8d738bacba74
Kernel Version: 5.15.0-1064-aws
OS Image: Ubuntu 22.04.4 LTS
Operating System: linux
Architecture: arm64
Container Runtime Version: containerd://1.7.19
Kubelet Version: v1.20.0
Kube-Proxy Version: v1.20.0
PodCIDR: 10.244.0.0/24
PodCIDRs: 10.244.0.0/24
Non-terminated Pods: (12 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits AGE
--------- ---- ------------ ---------- --------------- ------------- ---
default busybox 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 6m43s
kube-system coredns-74ff55c5b-ddsjt 100m (5%!)(MISSING) 0 (0%!)(MISSING) 70Mi (0%!)(MISSING) 170Mi (2%!)(MISSING) 8m39s
kube-system etcd-old-k8s-version-199824 100m (5%!)(MISSING) 0 (0%!)(MISSING) 100Mi (1%!)(MISSING) 0 (0%!)(MISSING) 8m46s
kube-system kindnet-mkdjk 100m (5%!)(MISSING) 100m (5%!)(MISSING) 50Mi (0%!)(MISSING) 50Mi (0%!)(MISSING) 8m39s
kube-system kube-apiserver-old-k8s-version-199824 250m (12%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 8m46s
kube-system kube-controller-manager-old-k8s-version-199824 200m (10%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 8m46s
kube-system kube-proxy-f8hp8 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 8m39s
kube-system kube-scheduler-old-k8s-version-199824 100m (5%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 8m46s
kube-system metrics-server-9975d5f86-phjvq 100m (5%!)(MISSING) 0 (0%!)(MISSING) 200Mi (2%!)(MISSING) 0 (0%!)(MISSING) 6m32s
kube-system storage-provisioner 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 8m38s
kubernetes-dashboard dashboard-metrics-scraper-8d5bb5db8-xfcg8 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 5m36s
kubernetes-dashboard kubernetes-dashboard-cd95d586-xsjcr 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 5m36s
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 950m (47%!)(MISSING) 100m (5%!)(MISSING)
memory 420Mi (5%!)(MISSING) 220Mi (2%!)(MISSING)
ephemeral-storage 100Mi (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-1Gi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-2Mi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-32Mi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-64Ki 0 (0%!)(MISSING) 0 (0%!)(MISSING)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal NodeHasSufficientMemory 9m5s (x5 over 9m5s) kubelet Node old-k8s-version-199824 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 9m5s (x4 over 9m5s) kubelet Node old-k8s-version-199824 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 9m5s (x4 over 9m5s) kubelet Node old-k8s-version-199824 status is now: NodeHasSufficientPID
Normal Starting 8m46s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 8m46s kubelet Node old-k8s-version-199824 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 8m46s kubelet Node old-k8s-version-199824 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 8m46s kubelet Node old-k8s-version-199824 status is now: NodeHasSufficientPID
Normal NodeAllocatableEnforced 8m46s kubelet Updated Node Allocatable limit across pods
Normal NodeReady 8m39s kubelet Node old-k8s-version-199824 status is now: NodeReady
Normal Starting 8m38s kube-proxy Starting kube-proxy.
Normal Starting 6m5s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 6m5s (x8 over 6m5s) kubelet Node old-k8s-version-199824 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 6m5s (x7 over 6m5s) kubelet Node old-k8s-version-199824 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 6m5s (x8 over 6m5s) kubelet Node old-k8s-version-199824 status is now: NodeHasSufficientPID
Normal NodeAllocatableEnforced 6m5s kubelet Updated Node Allocatable limit across pods
Normal Starting 5m52s kube-proxy Starting kube-proxy.
==> dmesg <==
[ +0.001107] FS-Cache: O-key=[8] 'd5405c0100000000'
[ +0.000717] FS-Cache: N-cookie c=00000054 [p=0000004b fl=2 nc=0 na=1]
[ +0.000944] FS-Cache: N-cookie d=0000000021ae1ab8{9p.inode} n=000000008832baf6
[ +0.001064] FS-Cache: N-key=[8] 'd5405c0100000000'
[ +0.002757] FS-Cache: Duplicate cookie detected
[ +0.000687] FS-Cache: O-cookie c=0000004e [p=0000004b fl=226 nc=0 na=1]
[ +0.000986] FS-Cache: O-cookie d=0000000021ae1ab8{9p.inode} n=000000009ff38fab
[ +0.001076] FS-Cache: O-key=[8] 'd5405c0100000000'
[ +0.000717] FS-Cache: N-cookie c=00000055 [p=0000004b fl=2 nc=0 na=1]
[ +0.000952] FS-Cache: N-cookie d=0000000021ae1ab8{9p.inode} n=00000000344bdacb
[ +0.001064] FS-Cache: N-key=[8] 'd5405c0100000000'
[ +2.784850] FS-Cache: Duplicate cookie detected
[ +0.000707] FS-Cache: O-cookie c=0000004c [p=0000004b fl=226 nc=0 na=1]
[ +0.000964] FS-Cache: O-cookie d=0000000021ae1ab8{9p.inode} n=00000000082c0ebf
[ +0.001052] FS-Cache: O-key=[8] 'd4405c0100000000'
[ +0.000736] FS-Cache: N-cookie c=00000057 [p=0000004b fl=2 nc=0 na=1]
[ +0.000948] FS-Cache: N-cookie d=0000000021ae1ab8{9p.inode} n=000000008832baf6
[ +0.001050] FS-Cache: N-key=[8] 'd4405c0100000000'
[ +0.246684] FS-Cache: Duplicate cookie detected
[ +0.000711] FS-Cache: O-cookie c=00000051 [p=0000004b fl=226 nc=0 na=1]
[ +0.000968] FS-Cache: O-cookie d=0000000021ae1ab8{9p.inode} n=00000000b89d7df6
[ +0.001052] FS-Cache: O-key=[8] 'da405c0100000000'
[ +0.000728] FS-Cache: N-cookie c=00000058 [p=0000004b fl=2 nc=0 na=1]
[ +0.000943] FS-Cache: N-cookie d=0000000021ae1ab8{9p.inode} n=00000000317c9237
[ +0.001041] FS-Cache: N-key=[8] 'da405c0100000000'
==> etcd [456d0a34e10d1dde1a968ac307103c4ef6a4ffb93263871b27ba3a3200910ef6] <==
2024-07-19 05:15:55.656726 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-19 05:16:05.656772 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-19 05:16:15.656936 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-19 05:16:25.656738 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-19 05:16:35.656739 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-19 05:16:45.656607 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-19 05:16:55.656744 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-19 05:17:05.656918 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-19 05:17:15.656666 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-19 05:17:25.656708 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-19 05:17:35.656730 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-19 05:17:45.656832 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-19 05:17:55.656876 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-19 05:18:05.656726 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-19 05:18:15.656759 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-19 05:18:25.656775 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-19 05:18:35.656687 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-19 05:18:45.658372 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-19 05:18:55.656871 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-19 05:19:05.656692 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-19 05:19:15.656607 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-19 05:19:25.656949 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-19 05:19:35.656772 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-19 05:19:45.656690 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-19 05:19:55.656872 I | etcdserver/api/etcdhttp: /health OK (status code 200)
==> etcd [8ea851149d390f197f798dbb1e77c9ae51eb21cceef7c8955c58d5d653fec285] <==
raft2024/07/19 05:10:58 INFO: 9f0758e1c58a86ed received MsgVoteResp from 9f0758e1c58a86ed at term 2
raft2024/07/19 05:10:58 INFO: 9f0758e1c58a86ed became leader at term 2
raft2024/07/19 05:10:58 INFO: raft.node: 9f0758e1c58a86ed elected leader 9f0758e1c58a86ed at term 2
2024-07-19 05:10:58.911946 I | etcdserver: setting up the initial cluster version to 3.4
2024-07-19 05:10:58.917292 N | etcdserver/membership: set the initial cluster version to 3.4
2024-07-19 05:10:58.917496 I | etcdserver/api: enabled capabilities for version 3.4
2024-07-19 05:10:58.917597 I | etcdserver: published {Name:old-k8s-version-199824 ClientURLs:[https://192.168.85.2:2379]} to cluster 68eaea490fab4e05
2024-07-19 05:10:58.917718 I | embed: ready to serve client requests
2024-07-19 05:10:58.919452 I | embed: serving client requests on 127.0.0.1:2379
2024-07-19 05:10:58.919758 I | embed: ready to serve client requests
2024-07-19 05:10:58.924796 I | embed: serving client requests on 192.168.85.2:2379
2024-07-19 05:11:25.982446 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-19 05:11:28.780112 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-19 05:11:38.779807 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-19 05:11:48.779763 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-19 05:11:58.779774 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-19 05:12:08.779765 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-19 05:12:18.779636 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-19 05:12:28.779935 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-19 05:12:38.779815 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-19 05:12:48.780078 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-19 05:12:58.779801 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-19 05:13:08.779935 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-19 05:13:18.779647 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-07-19 05:13:28.786275 I | etcdserver/api/etcdhttp: /health OK (status code 200)
==> kernel <==
05:20:02 up 7:02, 0 users, load average: 1.94, 2.22, 2.48
Linux old-k8s-version-199824 5.15.0-1064-aws #70~20.04.1-Ubuntu SMP Thu Jun 27 14:52:48 UTC 2024 aarch64 aarch64 aarch64 GNU/Linux
PRETTY_NAME="Ubuntu 22.04.4 LTS"
==> kindnet [10539463ca76eca3ef896527ce525ab179fe6b4182358afaa9eeeeb0f58f069c] <==
I0719 05:19:00.228483 1 main.go:303] handling current node
W0719 05:19:05.954131 1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: failed to list *v1.Pod: pods is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "pods" in API group "" at the cluster scope
E0719 05:19:05.954166 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "pods" in API group "" at the cluster scope
W0719 05:19:08.236328 1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: failed to list *v1.Namespace: namespaces is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "namespaces" in API group "" at the cluster scope
E0719 05:19:08.236367 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "namespaces" in API group "" at the cluster scope
I0719 05:19:10.228487 1 main.go:299] Handling node with IPs: map[192.168.85.2:{}]
I0719 05:19:10.228757 1 main.go:303] handling current node
W0719 05:19:14.634838 1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
E0719 05:19:14.634879 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: Failed to watch *v1.NetworkPolicy: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
I0719 05:19:20.229020 1 main.go:299] Handling node with IPs: map[192.168.85.2:{}]
I0719 05:19:20.229060 1 main.go:303] handling current node
I0719 05:19:30.228817 1 main.go:299] Handling node with IPs: map[192.168.85.2:{}]
I0719 05:19:30.228863 1 main.go:303] handling current node
I0719 05:19:40.228997 1 main.go:299] Handling node with IPs: map[192.168.85.2:{}]
I0719 05:19:40.229030 1 main.go:303] handling current node
W0719 05:19:43.420226 1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: failed to list *v1.Namespace: namespaces is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "namespaces" in API group "" at the cluster scope
E0719 05:19:43.420259 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "namespaces" in API group "" at the cluster scope
I0719 05:19:50.229067 1 main.go:299] Handling node with IPs: map[192.168.85.2:{}]
I0719 05:19:50.229109 1 main.go:303] handling current node
W0719 05:19:56.285967 1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: failed to list *v1.Pod: pods is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "pods" in API group "" at the cluster scope
E0719 05:19:56.286019 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "pods" in API group "" at the cluster scope
W0719 05:19:56.948207 1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
E0719 05:19:56.948255 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: Failed to watch *v1.NetworkPolicy: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
I0719 05:20:00.229176 1 main.go:299] Handling node with IPs: map[192.168.85.2:{}]
I0719 05:20:00.229492 1 main.go:303] handling current node
==> kindnet [e0ea78faa765147f1c1a9e8517bc48fd17bcb16534bcab7e02bcfe8728d4dec6] <==
I0719 05:12:18.104313 1 main.go:303] handling current node
I0719 05:12:28.103069 1 main.go:299] Handling node with IPs: map[192.168.85.2:{}]
I0719 05:12:28.103118 1 main.go:303] handling current node
W0719 05:12:31.805539 1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: failed to list *v1.Namespace: namespaces is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "namespaces" in API group "" at the cluster scope
E0719 05:12:31.805628 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "namespaces" in API group "" at the cluster scope
I0719 05:12:38.103298 1 main.go:299] Handling node with IPs: map[192.168.85.2:{}]
I0719 05:12:38.103536 1 main.go:303] handling current node
W0719 05:12:47.906325 1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: failed to list *v1.Pod: pods is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "pods" in API group "" at the cluster scope
E0719 05:12:47.906617 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "pods" in API group "" at the cluster scope
I0719 05:12:48.105150 1 main.go:299] Handling node with IPs: map[192.168.85.2:{}]
I0719 05:12:48.105187 1 main.go:303] handling current node
W0719 05:12:57.453882 1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
E0719 05:12:57.453921 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: Failed to watch *v1.NetworkPolicy: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
I0719 05:12:58.103117 1 main.go:299] Handling node with IPs: map[192.168.85.2:{}]
I0719 05:12:58.103178 1 main.go:303] handling current node
I0719 05:13:08.103683 1 main.go:299] Handling node with IPs: map[192.168.85.2:{}]
I0719 05:13:08.103714 1 main.go:303] handling current node
W0719 05:13:10.059323 1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: failed to list *v1.Namespace: namespaces is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "namespaces" in API group "" at the cluster scope
E0719 05:13:10.059361 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "namespaces" in API group "" at the cluster scope
I0719 05:13:18.103519 1 main.go:299] Handling node with IPs: map[192.168.85.2:{}]
I0719 05:13:18.103579 1 main.go:303] handling current node
W0719 05:13:21.276229 1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: failed to list *v1.Pod: pods is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "pods" in API group "" at the cluster scope
E0719 05:13:21.276266 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "pods" in API group "" at the cluster scope
I0719 05:13:28.104119 1 main.go:299] Handling node with IPs: map[192.168.85.2:{}]
I0719 05:13:28.104174 1 main.go:303] handling current node
==> kube-apiserver [c4ee96f9f14987ba197d6ebeaedfca8a9835c03bcb4438e7948d99e01feb867f] <==
I0719 05:16:36.780207 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0719 05:16:36.780215 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
W0719 05:17:10.473071 1 handler_proxy.go:102] no RequestInfo found in the context
E0719 05:17:10.473331 1 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I0719 05:17:10.473370 1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
I0719 05:17:15.614108 1 client.go:360] parsed scheme: "passthrough"
I0719 05:17:15.614157 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0719 05:17:15.614166 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0719 05:17:57.640346 1 client.go:360] parsed scheme: "passthrough"
I0719 05:17:57.640393 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0719 05:17:57.640425 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0719 05:18:28.768653 1 client.go:360] parsed scheme: "passthrough"
I0719 05:18:28.768791 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0719 05:18:28.768837 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0719 05:19:07.562737 1 client.go:360] parsed scheme: "passthrough"
I0719 05:19:07.562813 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0719 05:19:07.562822 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
W0719 05:19:07.798102 1 handler_proxy.go:102] no RequestInfo found in the context
E0719 05:19:07.798202 1 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I0719 05:19:07.798221 1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
I0719 05:19:45.932249 1 client.go:360] parsed scheme: "passthrough"
I0719 05:19:45.932294 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0719 05:19:45.932303 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
==> kube-apiserver [fb25f9a0346cc4e0812cc4849a6418ef42d67be0c75dedeec160273a75983a4a] <==
I0719 05:11:06.108310 1 controller.go:606] quota admission added evaluator for: roles.rbac.authorization.k8s.io
I0719 05:11:06.162598 1 controller.go:606] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io
W0719 05:11:06.274790 1 lease.go:233] Resetting endpoints for master service "kubernetes" to [192.168.85.2]
I0719 05:11:06.276236 1 controller.go:606] quota admission added evaluator for: endpoints
I0719 05:11:06.292032 1 controller.go:606] quota admission added evaluator for: endpointslices.discovery.k8s.io
I0719 05:11:06.637884 1 controller.go:606] quota admission added evaluator for: leases.coordination.k8s.io
I0719 05:11:07.357020 1 controller.go:606] quota admission added evaluator for: serviceaccounts
I0719 05:11:07.670133 1 controller.go:606] quota admission added evaluator for: deployments.apps
I0719 05:11:07.733772 1 controller.go:606] quota admission added evaluator for: daemonsets.apps
I0719 05:11:23.300840 1 controller.go:606] quota admission added evaluator for: replicasets.apps
I0719 05:11:23.307949 1 controller.go:606] quota admission added evaluator for: controllerrevisions.apps
I0719 05:11:35.650514 1 client.go:360] parsed scheme: "passthrough"
I0719 05:11:35.650562 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0719 05:11:35.650570 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0719 05:12:05.737693 1 client.go:360] parsed scheme: "passthrough"
I0719 05:12:05.737754 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0719 05:12:05.737762 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0719 05:12:36.653847 1 client.go:360] parsed scheme: "passthrough"
I0719 05:12:36.653920 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0719 05:12:36.653938 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0719 05:13:12.563691 1 client.go:360] parsed scheme: "passthrough"
I0719 05:13:12.563737 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0719 05:13:12.563746 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
E0719 05:13:28.503637 1 upgradeaware.go:387] Error proxying data from backend to client: write tcp 192.168.85.2:8443->192.168.85.1:51102: write: broken pipe
E0719 05:13:28.504055 1 upgradeaware.go:373] Error proxying data from client to backend: write tcp 192.168.85.2:37606->192.168.85.2:10250: write: broken pipe
==> kube-controller-manager [31f8a36bff2a9b66f7c2a5a8fdc3fe9b14f1b569fae35aa6b7bec34dca8ef7a7] <==
I0719 05:11:23.483717 1 shared_informer.go:247] Caches are synced for namespace
I0719 05:11:23.503880 1 shared_informer.go:247] Caches are synced for ReplicationController
I0719 05:11:23.518250 1 shared_informer.go:247] Caches are synced for taint
I0719 05:11:23.518411 1 node_lifecycle_controller.go:1429] Initializing eviction metric for zone:
W0719 05:11:23.518502 1 node_lifecycle_controller.go:1044] Missing timestamp for Node old-k8s-version-199824. Assuming now as a timestamp.
I0719 05:11:23.518557 1 node_lifecycle_controller.go:1195] Controller detected that all Nodes are not-Ready. Entering master disruption mode.
I0719 05:11:23.518646 1 event.go:291] "Event occurred" object="old-k8s-version-199824" kind="Node" apiVersion="v1" type="Normal" reason="RegisteredNode" message="Node old-k8s-version-199824 event: Registered Node old-k8s-version-199824 in Controller"
I0719 05:11:23.518675 1 taint_manager.go:187] Starting NoExecuteTaintManager
I0719 05:11:23.519036 1 shared_informer.go:247] Caches are synced for disruption
I0719 05:11:23.519223 1 disruption.go:339] Sending events to api server.
I0719 05:11:23.522978 1 shared_informer.go:247] Caches are synced for service account
I0719 05:11:23.570500 1 shared_informer.go:247] Caches are synced for resource quota
I0719 05:11:23.696468 1 shared_informer.go:240] Waiting for caches to sync for garbage collector
I0719 05:11:23.916933 1 shared_informer.go:240] Waiting for caches to sync for resource quota
I0719 05:11:23.916975 1 shared_informer.go:247] Caches are synced for resource quota
I0719 05:11:23.996619 1 shared_informer.go:247] Caches are synced for garbage collector
I0719 05:11:24.010287 1 shared_informer.go:247] Caches are synced for garbage collector
I0719 05:11:24.010441 1 garbagecollector.go:151] Garbage collector: all resource monitors have synced. Proceeding to collect garbage
I0719 05:11:24.948160 1 event.go:291] "Event occurred" object="kube-system/coredns" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled down replica set coredns-74ff55c5b to 1"
I0719 05:11:24.996282 1 event.go:291] "Event occurred" object="kube-system/coredns-74ff55c5b" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulDelete" message="Deleted pod: coredns-74ff55c5b-7vgb6"
I0719 05:11:28.518802 1 node_lifecycle_controller.go:1222] Controller detected that some Nodes are Ready. Exiting master disruption mode.
I0719 05:13:29.281918 1 event.go:291] "Event occurred" object="kube-system/metrics-server" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set metrics-server-9975d5f86 to 1"
I0719 05:13:29.326657 1 event.go:291] "Event occurred" object="kube-system/metrics-server-9975d5f86" kind="ReplicaSet" apiVersion="apps/v1" type="Warning" reason="FailedCreate" message="Error creating: pods \"metrics-server-9975d5f86-\" is forbidden: error looking up service account kube-system/metrics-server: serviceaccount \"metrics-server\" not found"
E0719 05:13:29.377016 1 replica_set.go:532] sync "kube-system/metrics-server-9975d5f86" failed with pods "metrics-server-9975d5f86-" is forbidden: error looking up service account kube-system/metrics-server: serviceaccount "metrics-server" not found
E0719 05:13:29.436304 1 clusterroleaggregation_controller.go:181] edit failed with : Operation cannot be fulfilled on clusterroles.rbac.authorization.k8s.io "edit": the object has been modified; please apply your changes to the latest version and try again
==> kube-controller-manager [8b74c8c28985fd1c8cd16fff081f8a3c79c626ff33e7b7705c27d8646b2344de] <==
E0719 05:15:57.905183 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0719 05:16:03.572526 1 request.go:655] Throttling request took 1.048427093s, request: GET:https://192.168.85.2:8443/apis/scheduling.k8s.io/v1?timeout=32s
W0719 05:16:04.424415 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0719 05:16:28.406975 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0719 05:16:36.075011 1 request.go:655] Throttling request took 1.048197438s, request: GET:https://192.168.85.2:8443/apis/extensions/v1beta1?timeout=32s
W0719 05:16:36.926445 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0719 05:16:58.908895 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0719 05:17:08.577021 1 request.go:655] Throttling request took 1.048044491s, request: GET:https://192.168.85.2:8443/apis/extensions/v1beta1?timeout=32s
W0719 05:17:09.428569 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0719 05:17:29.410645 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0719 05:17:41.078946 1 request.go:655] Throttling request took 1.045885486s, request: GET:https://192.168.85.2:8443/apis/extensions/v1beta1?timeout=32s
W0719 05:17:41.930421 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0719 05:17:59.912449 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0719 05:18:13.580780 1 request.go:655] Throttling request took 1.048364893s, request: GET:https://192.168.85.2:8443/apis/apiextensions.k8s.io/v1beta1?timeout=32s
W0719 05:18:14.432284 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0719 05:18:30.414291 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0719 05:18:46.082853 1 request.go:655] Throttling request took 1.038830534s, request: GET:https://192.168.85.2:8443/apis/extensions/v1beta1?timeout=32s
W0719 05:18:46.934373 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0719 05:19:00.916575 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0719 05:19:18.585040 1 request.go:655] Throttling request took 1.048000806s, request: GET:https://192.168.85.2:8443/apis/extensions/v1beta1?timeout=32s
W0719 05:19:19.438944 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0719 05:19:31.418540 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0719 05:19:51.089451 1 request.go:655] Throttling request took 1.047990941s, request: GET:https://192.168.85.2:8443/apis/extensions/v1beta1?timeout=32s
W0719 05:19:51.940909 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0719 05:20:01.920553 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
==> kube-proxy [78aa39803d3d37bc510fe812e66f0fd6c8b18fa73ee068c031077da23ecacce0] <==
I0719 05:11:24.395801 1 node.go:172] Successfully retrieved node IP: 192.168.85.2
I0719 05:11:24.395999 1 server_others.go:142] kube-proxy node IP is an IPv4 address (192.168.85.2), assume IPv4 operation
W0719 05:11:24.435258 1 server_others.go:578] Unknown proxy mode "", assuming iptables proxy
I0719 05:11:24.435341 1 server_others.go:185] Using iptables Proxier.
I0719 05:11:24.435553 1 server.go:650] Version: v1.20.0
I0719 05:11:24.436021 1 config.go:315] Starting service config controller
I0719 05:11:24.436029 1 shared_informer.go:240] Waiting for caches to sync for service config
I0719 05:11:24.436648 1 config.go:224] Starting endpoint slice config controller
I0719 05:11:24.436655 1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config
I0719 05:11:24.536531 1 shared_informer.go:247] Caches are synced for service config
I0719 05:11:24.541228 1 shared_informer.go:247] Caches are synced for endpoint slice config
==> kube-proxy [ab6deb917db3a00322591b799b4f7c940babddc66581aa3657231d21bd68a000] <==
I0719 05:14:10.211076 1 node.go:172] Successfully retrieved node IP: 192.168.85.2
I0719 05:14:10.211422 1 server_others.go:142] kube-proxy node IP is an IPv4 address (192.168.85.2), assume IPv4 operation
W0719 05:14:10.316812 1 server_others.go:578] Unknown proxy mode "", assuming iptables proxy
I0719 05:14:10.316913 1 server_others.go:185] Using iptables Proxier.
I0719 05:14:10.317200 1 server.go:650] Version: v1.20.0
I0719 05:14:10.317877 1 config.go:315] Starting service config controller
I0719 05:14:10.317992 1 shared_informer.go:240] Waiting for caches to sync for service config
I0719 05:14:10.318079 1 config.go:224] Starting endpoint slice config controller
I0719 05:14:10.318136 1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config
I0719 05:14:10.418203 1 shared_informer.go:247] Caches are synced for service config
I0719 05:14:10.418410 1 shared_informer.go:247] Caches are synced for endpoint slice config
==> kube-scheduler [31d2288b65a8bfddfa998e3247ebb91dfa488cdde250694c21541c28d32b661b] <==
I0719 05:11:00.842993 1 serving.go:331] Generated self-signed cert in-memory
W0719 05:11:04.876093 1 requestheader_controller.go:193] Unable to get configmap/extension-apiserver-authentication in kube-system. Usually fixed by 'kubectl create rolebinding -n kube-system ROLEBINDING_NAME --role=extension-apiserver-authentication-reader --serviceaccount=YOUR_NS:YOUR_SA'
W0719 05:11:04.876127 1 authentication.go:332] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"
W0719 05:11:04.876136 1 authentication.go:333] Continuing without authentication configuration. This may treat all requests as anonymous.
W0719 05:11:04.876142 1 authentication.go:334] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false
I0719 05:11:04.952057 1 secure_serving.go:197] Serving securely on 127.0.0.1:10259
I0719 05:11:04.953184 1 configmap_cafile_content.go:202] Starting client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0719 05:11:04.953439 1 shared_informer.go:240] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0719 05:11:04.953205 1 tlsconfig.go:240] Starting DynamicServingCertificateController
E0719 05:11:04.963132 1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
E0719 05:11:04.973449 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
E0719 05:11:04.973460 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
E0719 05:11:04.973661 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
E0719 05:11:04.973809 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1beta1.PodDisruptionBudget: failed to list *v1beta1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
E0719 05:11:04.973876 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
E0719 05:11:04.973939 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
E0719 05:11:04.974005 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
E0719 05:11:04.974185 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
E0719 05:11:04.974060 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
E0719 05:11:04.974122 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
E0719 05:11:04.974426 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
E0719 05:11:05.812129 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
E0719 05:11:05.812427 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
I0719 05:11:06.256321 1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
==> kube-scheduler [62d56ad6f80d807a731bb4564ef55663b3b92ab83af2ba7115b207aaa62578ad] <==
I0719 05:14:03.028837 1 serving.go:331] Generated self-signed cert in-memory
W0719 05:14:06.509644 1 requestheader_controller.go:193] Unable to get configmap/extension-apiserver-authentication in kube-system. Usually fixed by 'kubectl create rolebinding -n kube-system ROLEBINDING_NAME --role=extension-apiserver-authentication-reader --serviceaccount=YOUR_NS:YOUR_SA'
W0719 05:14:06.509681 1 authentication.go:332] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"
W0719 05:14:06.509691 1 authentication.go:333] Continuing without authentication configuration. This may treat all requests as anonymous.
W0719 05:14:06.509696 1 authentication.go:334] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false
I0719 05:14:06.922429 1 secure_serving.go:197] Serving securely on 127.0.0.1:10259
I0719 05:14:06.931747 1 configmap_cafile_content.go:202] Starting client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0719 05:14:06.931779 1 shared_informer.go:240] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0719 05:14:06.931963 1 tlsconfig.go:240] Starting DynamicServingCertificateController
I0719 05:14:07.132063 1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
==> kubelet <==
Jul 19 05:18:26 old-k8s-version-199824 kubelet[663]: E0719 05:18:26.545720 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
Jul 19 05:18:38 old-k8s-version-199824 kubelet[663]: I0719 05:18:38.544117 663 scope.go:95] [topologymanager] RemoveContainer - Container ID: 367d4fb3bbc6e1c62dbb91c33116ff35a64feafe29003c525f5015462afbb8db
Jul 19 05:18:38 old-k8s-version-199824 kubelet[663]: E0719 05:18:38.544881 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
Jul 19 05:18:38 old-k8s-version-199824 kubelet[663]: E0719 05:18:38.545132 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jul 19 05:18:50 old-k8s-version-199824 kubelet[663]: I0719 05:18:50.544236 663 scope.go:95] [topologymanager] RemoveContainer - Container ID: 367d4fb3bbc6e1c62dbb91c33116ff35a64feafe29003c525f5015462afbb8db
Jul 19 05:18:50 old-k8s-version-199824 kubelet[663]: E0719 05:18:50.544554 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
Jul 19 05:18:50 old-k8s-version-199824 kubelet[663]: E0719 05:18:50.545182 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jul 19 05:19:01 old-k8s-version-199824 kubelet[663]: E0719 05:19:01.545861 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jul 19 05:19:03 old-k8s-version-199824 kubelet[663]: I0719 05:19:03.544156 663 scope.go:95] [topologymanager] RemoveContainer - Container ID: 367d4fb3bbc6e1c62dbb91c33116ff35a64feafe29003c525f5015462afbb8db
Jul 19 05:19:03 old-k8s-version-199824 kubelet[663]: E0719 05:19:03.544954 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
Jul 19 05:19:13 old-k8s-version-199824 kubelet[663]: E0719 05:19:13.553562 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jul 19 05:19:14 old-k8s-version-199824 kubelet[663]: I0719 05:19:14.544214 663 scope.go:95] [topologymanager] RemoveContainer - Container ID: 367d4fb3bbc6e1c62dbb91c33116ff35a64feafe29003c525f5015462afbb8db
Jul 19 05:19:14 old-k8s-version-199824 kubelet[663]: E0719 05:19:14.544624 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
Jul 19 05:19:25 old-k8s-version-199824 kubelet[663]: I0719 05:19:25.548111 663 scope.go:95] [topologymanager] RemoveContainer - Container ID: 367d4fb3bbc6e1c62dbb91c33116ff35a64feafe29003c525f5015462afbb8db
Jul 19 05:19:25 old-k8s-version-199824 kubelet[663]: E0719 05:19:25.548824 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
Jul 19 05:19:26 old-k8s-version-199824 kubelet[663]: E0719 05:19:26.544794 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jul 19 05:19:38 old-k8s-version-199824 kubelet[663]: E0719 05:19:38.545560 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jul 19 05:19:39 old-k8s-version-199824 kubelet[663]: I0719 05:19:39.544113 663 scope.go:95] [topologymanager] RemoveContainer - Container ID: 367d4fb3bbc6e1c62dbb91c33116ff35a64feafe29003c525f5015462afbb8db
Jul 19 05:19:39 old-k8s-version-199824 kubelet[663]: E0719 05:19:39.544604 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
Jul 19 05:19:51 old-k8s-version-199824 kubelet[663]: E0719 05:19:51.567342 663 remote_image.go:113] PullImage "fake.domain/registry.k8s.io/echoserver:1.4" from image service failed: rpc error: code = Unknown desc = failed to pull and unpack image "fake.domain/registry.k8s.io/echoserver:1.4": failed to resolve reference "fake.domain/registry.k8s.io/echoserver:1.4": failed to do request: Head "https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host
Jul 19 05:19:51 old-k8s-version-199824 kubelet[663]: E0719 05:19:51.567396 663 kuberuntime_image.go:51] Pull image "fake.domain/registry.k8s.io/echoserver:1.4" failed: rpc error: code = Unknown desc = failed to pull and unpack image "fake.domain/registry.k8s.io/echoserver:1.4": failed to resolve reference "fake.domain/registry.k8s.io/echoserver:1.4": failed to do request: Head "https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host
Jul 19 05:19:51 old-k8s-version-199824 kubelet[663]: E0719 05:19:51.567529 663 kuberuntime_manager.go:829] container &Container{Name:metrics-server,Image:fake.domain/registry.k8s.io/echoserver:1.4,Command:[],Args:[--cert-dir=/tmp --secure-port=4443 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --kubelet-use-node-status-port --metric-resolution=60s --kubelet-insecure-tls],WorkingDir:,Ports:[]ContainerPort{ContainerPort{Name:https,HostPort:0,ContainerPort:4443,Protocol:TCP,HostIP:,},},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{cpu: {{100 -3} {<nil>} 100m DecimalSI},memory: {{209715200 0} {<nil>} BinarySI},},},VolumeMounts:[]VolumeMount{VolumeMount{Name:tmp-dir,ReadOnly:false,MountPath:/tmp,SubPath:,MountPropagation:nil,SubPathExpr:,},VolumeMount{Name:metrics-server-token-cqtm4,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:&Probe{Handler:Handler{Exec
:nil,HTTPGet:&HTTPGetAction{Path:/livez,Port:{1 0 https},Host:,Scheme:HTTPS,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,},InitialDelaySeconds:0,TimeoutSeconds:1,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,},ReadinessProbe:&Probe{Handler:Handler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/readyz,Port:{1 0 https},Host:,Scheme:HTTPS,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,},InitialDelaySeconds:0,TimeoutSeconds:1,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:*1000,RunAsNonRoot:*true,ReadOnlyRootFilesystem:*true,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,} start failed in pod metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5
b-0d95-4128-a806-f333c2d39391): ErrImagePull: rpc error: code = Unknown desc = failed to pull and unpack image "fake.domain/registry.k8s.io/echoserver:1.4": failed to resolve reference "fake.domain/registry.k8s.io/echoserver:1.4": failed to do request: Head "https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host
Jul 19 05:19:51 old-k8s-version-199824 kubelet[663]: E0719 05:19:51.567566 663 pod_workers.go:191] Error syncing pod c6ff4b5b-0d95-4128-a806-f333c2d39391 ("metrics-server-9975d5f86-phjvq_kube-system(c6ff4b5b-0d95-4128-a806-f333c2d39391)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
Jul 19 05:19:54 old-k8s-version-199824 kubelet[663]: I0719 05:19:54.544112 663 scope.go:95] [topologymanager] RemoveContainer - Container ID: 367d4fb3bbc6e1c62dbb91c33116ff35a64feafe29003c525f5015462afbb8db
Jul 19 05:19:54 old-k8s-version-199824 kubelet[663]: E0719 05:19:54.544469 663 pod_workers.go:191] Error syncing pod cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1 ("dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xfcg8_kubernetes-dashboard(cb3d7118-493e-4e38-8a7a-c74d1a1d8ab1)"
==> kubernetes-dashboard [6472a666aa3686f6d4a248b14ad6c12bd855ee07f9769fb002846093117bdb3c] <==
2024/07/19 05:14:32 Starting overwatch
2024/07/19 05:14:32 Using namespace: kubernetes-dashboard
2024/07/19 05:14:32 Using in-cluster config to connect to apiserver
2024/07/19 05:14:32 Using secret token for csrf signing
2024/07/19 05:14:32 Initializing csrf token from kubernetes-dashboard-csrf secret
2024/07/19 05:14:32 Empty token. Generating and storing in a secret kubernetes-dashboard-csrf
2024/07/19 05:14:32 Successful initial request to the apiserver, version: v1.20.0
2024/07/19 05:14:32 Generating JWE encryption key
2024/07/19 05:14:32 New synchronizer has been registered: kubernetes-dashboard-key-holder-kubernetes-dashboard. Starting
2024/07/19 05:14:32 Starting secret synchronizer for kubernetes-dashboard-key-holder in namespace kubernetes-dashboard
2024/07/19 05:14:33 Initializing JWE encryption key from synchronized object
2024/07/19 05:14:33 Creating in-cluster Sidecar client
2024/07/19 05:14:33 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/07/19 05:14:33 Serving insecurely on HTTP port: 9090
2024/07/19 05:15:03 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/07/19 05:15:33 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/07/19 05:16:03 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/07/19 05:16:33 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/07/19 05:17:03 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/07/19 05:17:33 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/07/19 05:18:03 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/07/19 05:18:33 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/07/19 05:19:03 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/07/19 05:19:33 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
==> storage-provisioner [5f5f26e535c99452b4f124fa647bbe2bde0544bddf60e1a422933a407836ef89] <==
I0719 05:14:09.934172 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
F0719 05:14:39.936904 1 main.go:39] error getting server version: Get "https://10.96.0.1:443/version?timeout=32s": dial tcp 10.96.0.1:443: i/o timeout
==> storage-provisioner [9fea07ce92177cea6b541d5da457322ab3fe68c5111c73979657fea3daea5d22] <==
I0719 05:14:51.661104 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
I0719 05:14:51.677589 1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
I0719 05:14:51.677634 1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
I0719 05:15:09.151582 1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
I0719 05:15:09.152004 1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_old-k8s-version-199824_4bdefb9a-d1d3-4238-8a0a-219e7a4708ba!
I0719 05:15:09.151815 1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"259d23d7-19b2-4b36-8bf1-c6f0b771a268", APIVersion:"v1", ResourceVersion:"867", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' old-k8s-version-199824_4bdefb9a-d1d3-4238-8a0a-219e7a4708ba became leader
I0719 05:15:09.252735 1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_old-k8s-version-199824_4bdefb9a-d1d3-4238-8a0a-219e7a4708ba!
-- /stdout --
helpers_test.go:254: (dbg) Run: out/minikube-linux-arm64 status --format={{.APIServer}} -p old-k8s-version-199824 -n old-k8s-version-199824
helpers_test.go:261: (dbg) Run: kubectl --context old-k8s-version-199824 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:272: non-running pods: metrics-server-9975d5f86-phjvq
helpers_test.go:274: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: describe non-running pods <======
helpers_test.go:277: (dbg) Run: kubectl --context old-k8s-version-199824 describe pod metrics-server-9975d5f86-phjvq
E0719 05:20:03.555772 1175286 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19302-1169903/.minikube/profiles/functional-187420/client.crt: no such file or directory
helpers_test.go:277: (dbg) Non-zero exit: kubectl --context old-k8s-version-199824 describe pod metrics-server-9975d5f86-phjvq: exit status 1 (106.824266ms)
** stderr **
Error from server (NotFound): pods "metrics-server-9975d5f86-phjvq" not found
** /stderr **
helpers_test.go:279: kubectl --context old-k8s-version-199824 describe pod metrics-server-9975d5f86-phjvq: exit status 1
--- FAIL: TestStartStop/group/old-k8s-version/serial/SecondStart (381.73s)