=== RUN TestStartStop/group/old-k8s-version/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run: out/minikube-linux-arm64 start -p old-k8s-version-216078 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=containerd --kubernetes-version=v1.20.0
E0818 19:29:10.146003 159549 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19423-154159/.minikube/profiles/functional-249969/client.crt: no such file or directory" logger="UnhandledError"
start_stop_delete_test.go:256: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p old-k8s-version-216078 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=containerd --kubernetes-version=v1.20.0: exit status 80 (6m12.488716083s)
-- stdout --
* [old-k8s-version-216078] minikube v1.33.1 on Ubuntu 20.04 (arm64)
- MINIKUBE_LOCATION=19423
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/19423-154159/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/19423-154159/.minikube
- MINIKUBE_BIN=out/minikube-linux-arm64
- MINIKUBE_FORCE_SYSTEMD=
* Kubernetes 1.31.0 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.31.0
* Using the docker driver based on existing profile
* Starting "old-k8s-version-216078" primary control-plane node in "old-k8s-version-216078" cluster
* Pulling base image v0.0.44-1723740748-19452 ...
* Restarting existing docker container for "old-k8s-version-216078" ...
* Preparing Kubernetes v1.20.0 on containerd 1.7.20 ...
* Verifying Kubernetes components...
- Using image gcr.io/k8s-minikube/storage-provisioner:v5
- Using image fake.domain/registry.k8s.io/echoserver:1.4
- Using image docker.io/kubernetesui/dashboard:v2.7.0
- Using image registry.k8s.io/echoserver:1.4
* Some dashboard features require the metrics-server addon. To enable all features please run:
minikube -p old-k8s-version-216078 addons enable metrics-server
* Enabled addons: storage-provisioner, metrics-server, dashboard, default-storageclass
-- /stdout --
** stderr **
I0818 19:28:16.256452 365394 out.go:345] Setting OutFile to fd 1 ...
I0818 19:28:16.256752 365394 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0818 19:28:16.256784 365394 out.go:358] Setting ErrFile to fd 2...
I0818 19:28:16.256805 365394 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0818 19:28:16.257111 365394 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19423-154159/.minikube/bin
I0818 19:28:16.257553 365394 out.go:352] Setting JSON to false
I0818 19:28:16.258602 365394 start.go:129] hostinfo: {"hostname":"ip-172-31-31-251","uptime":101441,"bootTime":1723907856,"procs":203,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1067-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"982e3628-3742-4b3e-bb63-ac1b07660ec7"}
I0818 19:28:16.258698 365394 start.go:139] virtualization:
I0818 19:28:16.262725 365394 out.go:177] * [old-k8s-version-216078] minikube v1.33.1 on Ubuntu 20.04 (arm64)
I0818 19:28:16.264642 365394 out.go:177] - MINIKUBE_LOCATION=19423
I0818 19:28:16.264720 365394 notify.go:220] Checking for updates...
I0818 19:28:16.271487 365394 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0818 19:28:16.273639 365394 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/19423-154159/kubeconfig
I0818 19:28:16.275419 365394 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/19423-154159/.minikube
I0818 19:28:16.276979 365394 out.go:177] - MINIKUBE_BIN=out/minikube-linux-arm64
I0818 19:28:16.278695 365394 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0818 19:28:16.281412 365394 config.go:182] Loaded profile config "old-k8s-version-216078": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0
I0818 19:28:16.283890 365394 out.go:177] * Kubernetes 1.31.0 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.31.0
I0818 19:28:16.285782 365394 driver.go:394] Setting default libvirt URI to qemu:///system
I0818 19:28:16.311971 365394 docker.go:123] docker version: linux-27.1.2:Docker Engine - Community
I0818 19:28:16.312095 365394 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0818 19:28:16.417375 365394 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:50 OomKillDisable:true NGoroutines:68 SystemTime:2024-08-18 19:28:16.407410424 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1067-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214896640 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:27.1.2 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:8fc6bcff51318944179630522a095cc9dbf9f353 Expected:8fc6bcff51318944179630522a095cc9dbf9f353} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.16.2] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.1]] Warnings:<nil>}}
I0818 19:28:16.417483 365394 docker.go:307] overlay module found
I0818 19:28:16.420028 365394 out.go:177] * Using the docker driver based on existing profile
I0818 19:28:16.422252 365394 start.go:297] selected driver: docker
I0818 19:28:16.422275 365394 start.go:901] validating driver "docker" against &{Name:old-k8s-version-216078 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723740748-19452@sha256:2211a6931895d2d502e957e9667096db10734a96767d670cb4dbffdd37397b0d Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-216078 Namespace:default APIServerHAVIP: AP
IServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:fa
lse MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0818 19:28:16.422377 365394 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0818 19:28:16.422967 365394 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0818 19:28:16.505161 365394 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:50 OomKillDisable:true NGoroutines:68 SystemTime:2024-08-18 19:28:16.491719167 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1067-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214896640 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:27.1.2 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:8fc6bcff51318944179630522a095cc9dbf9f353 Expected:8fc6bcff51318944179630522a095cc9dbf9f353} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.16.2] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.1]] Warnings:<nil>}}
I0818 19:28:16.505551 365394 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0818 19:28:16.505597 365394 cni.go:84] Creating CNI manager for ""
I0818 19:28:16.505618 365394 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0818 19:28:16.505681 365394 start.go:340] cluster config:
{Name:old-k8s-version-216078 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723740748-19452@sha256:2211a6931895d2d502e957e9667096db10734a96767d670cb4dbffdd37397b0d Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-216078 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local
ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:do
cker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0818 19:28:16.507715 365394 out.go:177] * Starting "old-k8s-version-216078" primary control-plane node in "old-k8s-version-216078" cluster
I0818 19:28:16.509782 365394 cache.go:121] Beginning downloading kic base image for docker with containerd
I0818 19:28:16.511497 365394 out.go:177] * Pulling base image v0.0.44-1723740748-19452 ...
I0818 19:28:16.513867 365394 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime containerd
I0818 19:28:16.513951 365394 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19423-154159/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-containerd-overlay2-arm64.tar.lz4
I0818 19:28:16.513966 365394 cache.go:56] Caching tarball of preloaded images
I0818 19:28:16.514053 365394 preload.go:172] Found /home/jenkins/minikube-integration/19423-154159/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-containerd-overlay2-arm64.tar.lz4 in cache, skipping download
I0818 19:28:16.514067 365394 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on containerd
I0818 19:28:16.514179 365394 profile.go:143] Saving config to /home/jenkins/minikube-integration/19423-154159/.minikube/profiles/old-k8s-version-216078/config.json ...
I0818 19:28:16.514406 365394 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723740748-19452@sha256:2211a6931895d2d502e957e9667096db10734a96767d670cb4dbffdd37397b0d in local docker daemon
W0818 19:28:16.543381 365394 image.go:95] image gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723740748-19452@sha256:2211a6931895d2d502e957e9667096db10734a96767d670cb4dbffdd37397b0d is of wrong architecture
I0818 19:28:16.543406 365394 cache.go:149] Downloading gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723740748-19452@sha256:2211a6931895d2d502e957e9667096db10734a96767d670cb4dbffdd37397b0d to local cache
I0818 19:28:16.543486 365394 image.go:63] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723740748-19452@sha256:2211a6931895d2d502e957e9667096db10734a96767d670cb4dbffdd37397b0d in local cache directory
I0818 19:28:16.543509 365394 image.go:66] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723740748-19452@sha256:2211a6931895d2d502e957e9667096db10734a96767d670cb4dbffdd37397b0d in local cache directory, skipping pull
I0818 19:28:16.543518 365394 image.go:135] gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723740748-19452@sha256:2211a6931895d2d502e957e9667096db10734a96767d670cb4dbffdd37397b0d exists in cache, skipping pull
I0818 19:28:16.543525 365394 cache.go:152] successfully saved gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723740748-19452@sha256:2211a6931895d2d502e957e9667096db10734a96767d670cb4dbffdd37397b0d as a tarball
I0818 19:28:16.543532 365394 cache.go:162] Loading gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723740748-19452@sha256:2211a6931895d2d502e957e9667096db10734a96767d670cb4dbffdd37397b0d from local cache
I0818 19:28:16.665787 365394 cache.go:164] successfully loaded and using gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723740748-19452@sha256:2211a6931895d2d502e957e9667096db10734a96767d670cb4dbffdd37397b0d from cached tarball
I0818 19:28:16.665825 365394 cache.go:194] Successfully downloaded all kic artifacts
I0818 19:28:16.665862 365394 start.go:360] acquireMachinesLock for old-k8s-version-216078: {Name:mk9b9141f9b82034bdca9129b9fbed209f3e897c Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0818 19:28:16.665931 365394 start.go:364] duration metric: took 42.068µs to acquireMachinesLock for "old-k8s-version-216078"
I0818 19:28:16.665959 365394 start.go:96] Skipping create...Using existing machine configuration
I0818 19:28:16.665967 365394 fix.go:54] fixHost starting:
I0818 19:28:16.666242 365394 cli_runner.go:164] Run: docker container inspect old-k8s-version-216078 --format={{.State.Status}}
I0818 19:28:16.682233 365394 fix.go:112] recreateIfNeeded on old-k8s-version-216078: state=Stopped err=<nil>
W0818 19:28:16.682265 365394 fix.go:138] unexpected machine state, will restart: <nil>
I0818 19:28:16.684429 365394 out.go:177] * Restarting existing docker container for "old-k8s-version-216078" ...
I0818 19:28:16.686564 365394 cli_runner.go:164] Run: docker start old-k8s-version-216078
I0818 19:28:17.048638 365394 cli_runner.go:164] Run: docker container inspect old-k8s-version-216078 --format={{.State.Status}}
I0818 19:28:17.079010 365394 kic.go:430] container "old-k8s-version-216078" state is running.
I0818 19:28:17.079419 365394 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-216078
I0818 19:28:17.103416 365394 profile.go:143] Saving config to /home/jenkins/minikube-integration/19423-154159/.minikube/profiles/old-k8s-version-216078/config.json ...
I0818 19:28:17.103646 365394 machine.go:93] provisionDockerMachine start ...
I0818 19:28:17.103713 365394 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-216078
I0818 19:28:17.125430 365394 main.go:141] libmachine: Using SSH client type: native
I0818 19:28:17.125717 365394 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e49d0] 0x3e7230 <nil> [] 0s} 127.0.0.1 38614 <nil> <nil>}
I0818 19:28:17.125734 365394 main.go:141] libmachine: About to run SSH command:
hostname
I0818 19:28:17.128320 365394 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: EOF
I0818 19:28:20.271872 365394 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-216078
I0818 19:28:20.271895 365394 ubuntu.go:169] provisioning hostname "old-k8s-version-216078"
I0818 19:28:20.271957 365394 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-216078
I0818 19:28:20.294135 365394 main.go:141] libmachine: Using SSH client type: native
I0818 19:28:20.294394 365394 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e49d0] 0x3e7230 <nil> [] 0s} 127.0.0.1 38614 <nil> <nil>}
I0818 19:28:20.294409 365394 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-216078 && echo "old-k8s-version-216078" | sudo tee /etc/hostname
I0818 19:28:20.448336 365394 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-216078
I0818 19:28:20.448502 365394 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-216078
I0818 19:28:20.472596 365394 main.go:141] libmachine: Using SSH client type: native
I0818 19:28:20.472862 365394 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e49d0] 0x3e7230 <nil> [] 0s} 127.0.0.1 38614 <nil> <nil>}
I0818 19:28:20.472880 365394 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-216078' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-216078/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-216078' | sudo tee -a /etc/hosts;
fi
fi
I0818 19:28:20.616194 365394 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0818 19:28:20.616271 365394 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/19423-154159/.minikube CaCertPath:/home/jenkins/minikube-integration/19423-154159/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19423-154159/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19423-154159/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19423-154159/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19423-154159/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19423-154159/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19423-154159/.minikube}
I0818 19:28:20.616312 365394 ubuntu.go:177] setting up certificates
I0818 19:28:20.616352 365394 provision.go:84] configureAuth start
I0818 19:28:20.616457 365394 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-216078
I0818 19:28:20.638277 365394 provision.go:143] copyHostCerts
I0818 19:28:20.638345 365394 exec_runner.go:144] found /home/jenkins/minikube-integration/19423-154159/.minikube/ca.pem, removing ...
I0818 19:28:20.638354 365394 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19423-154159/.minikube/ca.pem
I0818 19:28:20.638427 365394 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19423-154159/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19423-154159/.minikube/ca.pem (1082 bytes)
I0818 19:28:20.638521 365394 exec_runner.go:144] found /home/jenkins/minikube-integration/19423-154159/.minikube/cert.pem, removing ...
I0818 19:28:20.638526 365394 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19423-154159/.minikube/cert.pem
I0818 19:28:20.638551 365394 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19423-154159/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19423-154159/.minikube/cert.pem (1123 bytes)
I0818 19:28:20.638602 365394 exec_runner.go:144] found /home/jenkins/minikube-integration/19423-154159/.minikube/key.pem, removing ...
I0818 19:28:20.638607 365394 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19423-154159/.minikube/key.pem
I0818 19:28:20.638628 365394 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19423-154159/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19423-154159/.minikube/key.pem (1675 bytes)
I0818 19:28:20.638674 365394 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19423-154159/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19423-154159/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19423-154159/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-216078 san=[127.0.0.1 192.168.76.2 localhost minikube old-k8s-version-216078]
I0818 19:28:20.879095 365394 provision.go:177] copyRemoteCerts
I0818 19:28:20.879211 365394 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0818 19:28:20.879295 365394 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-216078
I0818 19:28:20.896493 365394 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:38614 SSHKeyPath:/home/jenkins/minikube-integration/19423-154159/.minikube/machines/old-k8s-version-216078/id_rsa Username:docker}
I0818 19:28:20.997670 365394 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19423-154159/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
I0818 19:28:21.029046 365394 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19423-154159/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0818 19:28:21.058340 365394 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19423-154159/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0818 19:28:21.090800 365394 provision.go:87] duration metric: took 474.416511ms to configureAuth
I0818 19:28:21.090870 365394 ubuntu.go:193] setting minikube options for container-runtime
I0818 19:28:21.091109 365394 config.go:182] Loaded profile config "old-k8s-version-216078": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0
I0818 19:28:21.091142 365394 machine.go:96] duration metric: took 3.987479614s to provisionDockerMachine
I0818 19:28:21.091165 365394 start.go:293] postStartSetup for "old-k8s-version-216078" (driver="docker")
I0818 19:28:21.091191 365394 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0818 19:28:21.091279 365394 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0818 19:28:21.091352 365394 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-216078
I0818 19:28:21.114992 365394 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:38614 SSHKeyPath:/home/jenkins/minikube-integration/19423-154159/.minikube/machines/old-k8s-version-216078/id_rsa Username:docker}
I0818 19:28:21.217636 365394 ssh_runner.go:195] Run: cat /etc/os-release
I0818 19:28:21.221215 365394 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0818 19:28:21.221250 365394 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0818 19:28:21.221262 365394 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0818 19:28:21.221269 365394 info.go:137] Remote host: Ubuntu 22.04.4 LTS
I0818 19:28:21.221279 365394 filesync.go:126] Scanning /home/jenkins/minikube-integration/19423-154159/.minikube/addons for local assets ...
I0818 19:28:21.221332 365394 filesync.go:126] Scanning /home/jenkins/minikube-integration/19423-154159/.minikube/files for local assets ...
I0818 19:28:21.221446 365394 filesync.go:149] local asset: /home/jenkins/minikube-integration/19423-154159/.minikube/files/etc/ssl/certs/1595492.pem -> 1595492.pem in /etc/ssl/certs
I0818 19:28:21.221553 365394 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0818 19:28:21.230883 365394 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19423-154159/.minikube/files/etc/ssl/certs/1595492.pem --> /etc/ssl/certs/1595492.pem (1708 bytes)
I0818 19:28:21.256737 365394 start.go:296] duration metric: took 165.542979ms for postStartSetup
I0818 19:28:21.256847 365394 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0818 19:28:21.256891 365394 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-216078
I0818 19:28:21.277738 365394 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:38614 SSHKeyPath:/home/jenkins/minikube-integration/19423-154159/.minikube/machines/old-k8s-version-216078/id_rsa Username:docker}
I0818 19:28:21.374251 365394 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I0818 19:28:21.382086 365394 fix.go:56] duration metric: took 4.716113097s for fixHost
I0818 19:28:21.382113 365394 start.go:83] releasing machines lock for "old-k8s-version-216078", held for 4.716167907s
I0818 19:28:21.382179 365394 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-216078
I0818 19:28:21.413408 365394 ssh_runner.go:195] Run: cat /version.json
I0818 19:28:21.413456 365394 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-216078
I0818 19:28:21.413700 365394 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0818 19:28:21.413755 365394 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-216078
I0818 19:28:21.442451 365394 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:38614 SSHKeyPath:/home/jenkins/minikube-integration/19423-154159/.minikube/machines/old-k8s-version-216078/id_rsa Username:docker}
I0818 19:28:21.502583 365394 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:38614 SSHKeyPath:/home/jenkins/minikube-integration/19423-154159/.minikube/machines/old-k8s-version-216078/id_rsa Username:docker}
I0818 19:28:21.730947 365394 ssh_runner.go:195] Run: systemctl --version
I0818 19:28:21.735285 365394 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I0818 19:28:21.741992 365394 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
I0818 19:28:21.761547 365394 cni.go:230] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
I0818 19:28:21.761628 365394 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0818 19:28:21.774620 365394 cni.go:259] no active bridge cni configs found in "/etc/cni/net.d" - nothing to disable
I0818 19:28:21.774649 365394 start.go:495] detecting cgroup driver to use...
I0818 19:28:21.774683 365394 detect.go:187] detected "cgroupfs" cgroup driver on host os
I0818 19:28:21.774752 365394 ssh_runner.go:195] Run: sudo systemctl stop -f crio
I0818 19:28:21.788100 365394 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I0818 19:28:21.803288 365394 docker.go:217] disabling cri-docker service (if available) ...
I0818 19:28:21.803380 365394 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0818 19:28:21.815678 365394 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0818 19:28:21.828921 365394 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0818 19:28:21.918517 365394 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0818 19:28:22.013352 365394 docker.go:233] disabling docker service ...
I0818 19:28:22.013445 365394 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0818 19:28:22.028497 365394 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0818 19:28:22.042002 365394 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0818 19:28:22.143545 365394 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0818 19:28:22.234863 365394 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0818 19:28:22.246557 365394 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock
" | sudo tee /etc/crictl.yaml"
I0818 19:28:22.265330 365394 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.2"|' /etc/containerd/config.toml"
I0818 19:28:22.277148 365394 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
I0818 19:28:22.286735 365394 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...
I0818 19:28:22.286804 365394 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
I0818 19:28:22.296294 365394 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0818 19:28:22.308440 365394 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
I0818 19:28:22.318814 365394 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0818 19:28:22.329651 365394 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0818 19:28:22.338792 365394 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
I0818 19:28:22.348605 365394 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0818 19:28:22.357765 365394 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0818 19:28:22.369139 365394 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0818 19:28:22.460411 365394 ssh_runner.go:195] Run: sudo systemctl restart containerd
I0818 19:28:22.625527 365394 start.go:542] Will wait 60s for socket path /run/containerd/containerd.sock
I0818 19:28:22.625616 365394 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
I0818 19:28:22.634054 365394 start.go:563] Will wait 60s for crictl version
I0818 19:28:22.634120 365394 ssh_runner.go:195] Run: which crictl
I0818 19:28:22.637913 365394 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0818 19:28:22.677279 365394 start.go:579] Version: 0.1.0
RuntimeName: containerd
RuntimeVersion: 1.7.20
RuntimeApiVersion: v1
I0818 19:28:22.677348 365394 ssh_runner.go:195] Run: containerd --version
I0818 19:28:22.700128 365394 ssh_runner.go:195] Run: containerd --version
I0818 19:28:22.729067 365394 out.go:177] * Preparing Kubernetes v1.20.0 on containerd 1.7.20 ...
I0818 19:28:22.731345 365394 cli_runner.go:164] Run: docker network inspect old-k8s-version-216078 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0818 19:28:22.750298 365394 ssh_runner.go:195] Run: grep 192.168.76.1 host.minikube.internal$ /etc/hosts
I0818 19:28:22.753931 365394 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.76.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0818 19:28:22.764515 365394 kubeadm.go:883] updating cluster {Name:old-k8s-version-216078 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723740748-19452@sha256:2211a6931895d2d502e957e9667096db10734a96767d670cb4dbffdd37397b0d Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-216078 Namespace:default APIServerHAVIP: APIServerName:minik
ubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/
home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0818 19:28:22.764634 365394 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime containerd
I0818 19:28:22.764689 365394 ssh_runner.go:195] Run: sudo crictl images --output json
I0818 19:28:22.811544 365394 containerd.go:627] all images are preloaded for containerd runtime.
I0818 19:28:22.811572 365394 containerd.go:534] Images already preloaded, skipping extraction
I0818 19:28:22.811668 365394 ssh_runner.go:195] Run: sudo crictl images --output json
I0818 19:28:22.849076 365394 containerd.go:627] all images are preloaded for containerd runtime.
I0818 19:28:22.849143 365394 cache_images.go:84] Images are preloaded, skipping loading
I0818 19:28:22.849159 365394 kubeadm.go:934] updating node { 192.168.76.2 8443 v1.20.0 containerd true true} ...
I0818 19:28:22.849275 365394 kubeadm.go:946] kubelet [Unit]
Wants=containerd.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///run/containerd/containerd.sock --hostname-override=old-k8s-version-216078 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.76.2
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-216078 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0818 19:28:22.849352 365394 ssh_runner.go:195] Run: sudo crictl info
I0818 19:28:22.902734 365394 cni.go:84] Creating CNI manager for ""
I0818 19:28:22.902828 365394 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0818 19:28:22.902862 365394 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0818 19:28:22.902891 365394 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.76.2 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-216078 NodeName:old-k8s-version-216078 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.76.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.76.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt
StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0818 19:28:22.903062 365394 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.76.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /run/containerd/containerd.sock
name: "old-k8s-version-216078"
kubeletExtraArgs:
node-ip: 192.168.76.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.76.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0818 19:28:22.903138 365394 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0818 19:28:22.916456 365394 binaries.go:44] Found k8s binaries, skipping transfer
I0818 19:28:22.916564 365394 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0818 19:28:22.927349 365394 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (442 bytes)
I0818 19:28:22.946316 365394 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0818 19:28:22.965262 365394 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2125 bytes)
I0818 19:28:22.991547 365394 ssh_runner.go:195] Run: grep 192.168.76.2 control-plane.minikube.internal$ /etc/hosts
I0818 19:28:22.995171 365394 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.76.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0818 19:28:23.009263 365394 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0818 19:28:23.109672 365394 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0818 19:28:23.129467 365394 certs.go:68] Setting up /home/jenkins/minikube-integration/19423-154159/.minikube/profiles/old-k8s-version-216078 for IP: 192.168.76.2
I0818 19:28:23.129528 365394 certs.go:194] generating shared ca certs ...
I0818 19:28:23.129560 365394 certs.go:226] acquiring lock for ca certs: {Name:mk31d70c02908ccfff2b137754f7d1e0b3715b1f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0818 19:28:23.129723 365394 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19423-154159/.minikube/ca.key
I0818 19:28:23.129806 365394 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19423-154159/.minikube/proxy-client-ca.key
I0818 19:28:23.129830 365394 certs.go:256] generating profile certs ...
I0818 19:28:23.129931 365394 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/19423-154159/.minikube/profiles/old-k8s-version-216078/client.key
I0818 19:28:23.130022 365394 certs.go:359] skipping valid signed profile cert regeneration for "minikube": /home/jenkins/minikube-integration/19423-154159/.minikube/profiles/old-k8s-version-216078/apiserver.key.95d38173
I0818 19:28:23.130087 365394 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/19423-154159/.minikube/profiles/old-k8s-version-216078/proxy-client.key
I0818 19:28:23.130233 365394 certs.go:484] found cert: /home/jenkins/minikube-integration/19423-154159/.minikube/certs/159549.pem (1338 bytes)
W0818 19:28:23.130297 365394 certs.go:480] ignoring /home/jenkins/minikube-integration/19423-154159/.minikube/certs/159549_empty.pem, impossibly tiny 0 bytes
I0818 19:28:23.130322 365394 certs.go:484] found cert: /home/jenkins/minikube-integration/19423-154159/.minikube/certs/ca-key.pem (1679 bytes)
I0818 19:28:23.130369 365394 certs.go:484] found cert: /home/jenkins/minikube-integration/19423-154159/.minikube/certs/ca.pem (1082 bytes)
I0818 19:28:23.130434 365394 certs.go:484] found cert: /home/jenkins/minikube-integration/19423-154159/.minikube/certs/cert.pem (1123 bytes)
I0818 19:28:23.130483 365394 certs.go:484] found cert: /home/jenkins/minikube-integration/19423-154159/.minikube/certs/key.pem (1675 bytes)
I0818 19:28:23.130548 365394 certs.go:484] found cert: /home/jenkins/minikube-integration/19423-154159/.minikube/files/etc/ssl/certs/1595492.pem (1708 bytes)
I0818 19:28:23.131224 365394 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19423-154159/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0818 19:28:23.164954 365394 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19423-154159/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I0818 19:28:23.197793 365394 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19423-154159/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0818 19:28:23.228481 365394 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19423-154159/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0818 19:28:23.258505 365394 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19423-154159/.minikube/profiles/old-k8s-version-216078/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0818 19:28:23.295591 365394 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19423-154159/.minikube/profiles/old-k8s-version-216078/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0818 19:28:23.332470 365394 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19423-154159/.minikube/profiles/old-k8s-version-216078/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0818 19:28:23.362454 365394 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19423-154159/.minikube/profiles/old-k8s-version-216078/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0818 19:28:23.390365 365394 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19423-154159/.minikube/files/etc/ssl/certs/1595492.pem --> /usr/share/ca-certificates/1595492.pem (1708 bytes)
I0818 19:28:23.417113 365394 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19423-154159/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0818 19:28:23.445393 365394 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19423-154159/.minikube/certs/159549.pem --> /usr/share/ca-certificates/159549.pem (1338 bytes)
I0818 19:28:23.471539 365394 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0818 19:28:23.491253 365394 ssh_runner.go:195] Run: openssl version
I0818 19:28:23.497213 365394 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/1595492.pem && ln -fs /usr/share/ca-certificates/1595492.pem /etc/ssl/certs/1595492.pem"
I0818 19:28:23.506845 365394 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/1595492.pem
I0818 19:28:23.510482 365394 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Aug 18 18:48 /usr/share/ca-certificates/1595492.pem
I0818 19:28:23.510560 365394 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/1595492.pem
I0818 19:28:23.517422 365394 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/1595492.pem /etc/ssl/certs/3ec20f2e.0"
I0818 19:28:23.527435 365394 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0818 19:28:23.537580 365394 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0818 19:28:23.543910 365394 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Aug 18 18:38 /usr/share/ca-certificates/minikubeCA.pem
I0818 19:28:23.543973 365394 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0818 19:28:23.551271 365394 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0818 19:28:23.560251 365394 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/159549.pem && ln -fs /usr/share/ca-certificates/159549.pem /etc/ssl/certs/159549.pem"
I0818 19:28:23.569623 365394 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/159549.pem
I0818 19:28:23.573375 365394 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Aug 18 18:48 /usr/share/ca-certificates/159549.pem
I0818 19:28:23.573474 365394 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/159549.pem
I0818 19:28:23.583519 365394 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/159549.pem /etc/ssl/certs/51391683.0"
I0818 19:28:23.592707 365394 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0818 19:28:23.598404 365394 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
I0818 19:28:23.605965 365394 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
I0818 19:28:23.613580 365394 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
I0818 19:28:23.620292 365394 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
I0818 19:28:23.626795 365394 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
I0818 19:28:23.633433 365394 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
I0818 19:28:23.640195 365394 kubeadm.go:392] StartCluster: {Name:old-k8s-version-216078 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723740748-19452@sha256:2211a6931895d2d502e957e9667096db10734a96767d670cb4dbffdd37397b0d Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-216078 Namespace:default APIServerHAVIP: APIServerName:minikube
CA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/hom
e/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0818 19:28:23.640304 365394 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}
I0818 19:28:23.640378 365394 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0818 19:28:23.683873 365394 cri.go:89] found id: "f7dac504cb498237ca5f7b6a524527cefe7917920a3d413a7c4cd970c819a894"
I0818 19:28:23.683898 365394 cri.go:89] found id: "80ee1e729513b71685fa053c5499a375152679a2ba2012d6cc5008ba2faab62c"
I0818 19:28:23.683904 365394 cri.go:89] found id: "f4df0f963919a929cc762d019dd1d149a386596ccd181272d8750d152ffd40c0"
I0818 19:28:23.683909 365394 cri.go:89] found id: "905b265420907d5b4b8ee43b00a698a67557ffce65488b60828117b20fde26b1"
I0818 19:28:23.683912 365394 cri.go:89] found id: "c1f327db25afffcb7632d994277e73b15d44e051118ecff71b21299a38bcbe10"
I0818 19:28:23.683916 365394 cri.go:89] found id: "dac35e1e30e3e5a45ee7083d88bb89388a2e328ba629d84ddaa0317c718721e1"
I0818 19:28:23.683919 365394 cri.go:89] found id: "00fecac5b274921d65e34f858a2d0fb18402e84618ee482b50df18739b0495ad"
I0818 19:28:23.683922 365394 cri.go:89] found id: "a80fdd47f7301370c07df42778e346c5b3f9a5082205cddd92243b2292907316"
I0818 19:28:23.683931 365394 cri.go:89] found id: ""
I0818 19:28:23.683984 365394 ssh_runner.go:195] Run: sudo runc --root /run/containerd/runc/k8s.io list -f json
I0818 19:28:23.696174 365394 cri.go:116] JSON = null
W0818 19:28:23.696249 365394 kubeadm.go:399] unpause failed: list paused: list returned 0 containers, but ps returned 8
I0818 19:28:23.696332 365394 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0818 19:28:23.707868 365394 kubeadm.go:408] found existing configuration files, will attempt cluster restart
I0818 19:28:23.707889 365394 kubeadm.go:593] restartPrimaryControlPlane start ...
I0818 19:28:23.707940 365394 ssh_runner.go:195] Run: sudo test -d /data/minikube
I0818 19:28:23.716465 365394 kubeadm.go:130] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
stdout:
stderr:
I0818 19:28:23.716889 365394 kubeconfig.go:47] verify endpoint returned: get endpoint: "old-k8s-version-216078" does not appear in /home/jenkins/minikube-integration/19423-154159/kubeconfig
I0818 19:28:23.717005 365394 kubeconfig.go:62] /home/jenkins/minikube-integration/19423-154159/kubeconfig needs updating (will repair): [kubeconfig missing "old-k8s-version-216078" cluster setting kubeconfig missing "old-k8s-version-216078" context setting]
I0818 19:28:23.717286 365394 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19423-154159/kubeconfig: {Name:mk1cf742f712a0c2eee94d91acebc845c12c0cf4 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0818 19:28:23.718504 365394 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
I0818 19:28:23.730379 365394 kubeadm.go:630] The running cluster does not require reconfiguration: 192.168.76.2
I0818 19:28:23.730414 365394 kubeadm.go:597] duration metric: took 22.517902ms to restartPrimaryControlPlane
I0818 19:28:23.730425 365394 kubeadm.go:394] duration metric: took 90.240995ms to StartCluster
I0818 19:28:23.730440 365394 settings.go:142] acquiring lock: {Name:mk0e4cdfcdf22fb3f19678cc9275d3e9545c0e60 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0818 19:28:23.730516 365394 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/19423-154159/kubeconfig
I0818 19:28:23.731136 365394 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19423-154159/kubeconfig: {Name:mk1cf742f712a0c2eee94d91acebc845c12c0cf4 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0818 19:28:23.731371 365394 start.go:235] Will wait 6m0s for node &{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}
I0818 19:28:23.731601 365394 config.go:182] Loaded profile config "old-k8s-version-216078": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0
I0818 19:28:23.731641 365394 addons.go:507] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:true default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]
I0818 19:28:23.731712 365394 addons.go:69] Setting storage-provisioner=true in profile "old-k8s-version-216078"
I0818 19:28:23.731734 365394 addons.go:234] Setting addon storage-provisioner=true in "old-k8s-version-216078"
W0818 19:28:23.731740 365394 addons.go:243] addon storage-provisioner should already be in state true
I0818 19:28:23.731766 365394 host.go:66] Checking if "old-k8s-version-216078" exists ...
I0818 19:28:23.732244 365394 cli_runner.go:164] Run: docker container inspect old-k8s-version-216078 --format={{.State.Status}}
I0818 19:28:23.732657 365394 addons.go:69] Setting metrics-server=true in profile "old-k8s-version-216078"
I0818 19:28:23.732691 365394 addons.go:234] Setting addon metrics-server=true in "old-k8s-version-216078"
W0818 19:28:23.732701 365394 addons.go:243] addon metrics-server should already be in state true
I0818 19:28:23.732732 365394 host.go:66] Checking if "old-k8s-version-216078" exists ...
I0818 19:28:23.733137 365394 cli_runner.go:164] Run: docker container inspect old-k8s-version-216078 --format={{.State.Status}}
I0818 19:28:23.734557 365394 out.go:177] * Verifying Kubernetes components...
I0818 19:28:23.734879 365394 addons.go:69] Setting default-storageclass=true in profile "old-k8s-version-216078"
I0818 19:28:23.734945 365394 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "old-k8s-version-216078"
I0818 19:28:23.736432 365394 addons.go:69] Setting dashboard=true in profile "old-k8s-version-216078"
I0818 19:28:23.736475 365394 addons.go:234] Setting addon dashboard=true in "old-k8s-version-216078"
W0818 19:28:23.736507 365394 addons.go:243] addon dashboard should already be in state true
I0818 19:28:23.736539 365394 host.go:66] Checking if "old-k8s-version-216078" exists ...
I0818 19:28:23.737024 365394 cli_runner.go:164] Run: docker container inspect old-k8s-version-216078 --format={{.State.Status}}
I0818 19:28:23.737879 365394 cli_runner.go:164] Run: docker container inspect old-k8s-version-216078 --format={{.State.Status}}
I0818 19:28:23.742810 365394 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0818 19:28:23.783913 365394 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0818 19:28:23.785986 365394 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0818 19:28:23.786008 365394 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0818 19:28:23.786071 365394 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-216078
I0818 19:28:23.789529 365394 out.go:177] - Using image fake.domain/registry.k8s.io/echoserver:1.4
I0818 19:28:23.794694 365394 addons.go:431] installing /etc/kubernetes/addons/metrics-apiservice.yaml
I0818 19:28:23.794729 365394 ssh_runner.go:362] scp metrics-server/metrics-apiservice.yaml --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
I0818 19:28:23.794803 365394 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-216078
I0818 19:28:23.824747 365394 out.go:177] - Using image docker.io/kubernetesui/dashboard:v2.7.0
I0818 19:28:23.835692 365394 addons.go:234] Setting addon default-storageclass=true in "old-k8s-version-216078"
W0818 19:28:23.835716 365394 addons.go:243] addon default-storageclass should already be in state true
I0818 19:28:23.835740 365394 host.go:66] Checking if "old-k8s-version-216078" exists ...
I0818 19:28:23.836197 365394 cli_runner.go:164] Run: docker container inspect old-k8s-version-216078 --format={{.State.Status}}
I0818 19:28:23.847859 365394 out.go:177] - Using image registry.k8s.io/echoserver:1.4
I0818 19:28:23.850044 365394 addons.go:431] installing /etc/kubernetes/addons/dashboard-ns.yaml
I0818 19:28:23.850065 365394 ssh_runner.go:362] scp dashboard/dashboard-ns.yaml --> /etc/kubernetes/addons/dashboard-ns.yaml (759 bytes)
I0818 19:28:23.850137 365394 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-216078
I0818 19:28:23.865688 365394 addons.go:431] installing /etc/kubernetes/addons/storageclass.yaml
I0818 19:28:23.865713 365394 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0818 19:28:23.865779 365394 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-216078
I0818 19:28:23.878851 365394 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0818 19:28:23.880739 365394 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:38614 SSHKeyPath:/home/jenkins/minikube-integration/19423-154159/.minikube/machines/old-k8s-version-216078/id_rsa Username:docker}
I0818 19:28:23.891969 365394 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:38614 SSHKeyPath:/home/jenkins/minikube-integration/19423-154159/.minikube/machines/old-k8s-version-216078/id_rsa Username:docker}
I0818 19:28:23.907221 365394 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:38614 SSHKeyPath:/home/jenkins/minikube-integration/19423-154159/.minikube/machines/old-k8s-version-216078/id_rsa Username:docker}
I0818 19:28:23.915151 365394 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:38614 SSHKeyPath:/home/jenkins/minikube-integration/19423-154159/.minikube/machines/old-k8s-version-216078/id_rsa Username:docker}
I0818 19:28:23.955877 365394 node_ready.go:35] waiting up to 6m0s for node "old-k8s-version-216078" to be "Ready" ...
I0818 19:28:24.029281 365394 addons.go:431] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
I0818 19:28:24.029350 365394 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1825 bytes)
I0818 19:28:24.034544 365394 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0818 19:28:24.057785 365394 addons.go:431] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
I0818 19:28:24.057830 365394 ssh_runner.go:362] scp metrics-server/metrics-server-rbac.yaml --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
I0818 19:28:24.088590 365394 addons.go:431] installing /etc/kubernetes/addons/dashboard-clusterrole.yaml
I0818 19:28:24.088617 365394 ssh_runner.go:362] scp dashboard/dashboard-clusterrole.yaml --> /etc/kubernetes/addons/dashboard-clusterrole.yaml (1001 bytes)
I0818 19:28:24.099030 365394 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0818 19:28:24.132157 365394 addons.go:431] installing /etc/kubernetes/addons/metrics-server-service.yaml
I0818 19:28:24.132184 365394 ssh_runner.go:362] scp metrics-server/metrics-server-service.yaml --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
I0818 19:28:24.139408 365394 addons.go:431] installing /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml
I0818 19:28:24.139444 365394 ssh_runner.go:362] scp dashboard/dashboard-clusterrolebinding.yaml --> /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml (1018 bytes)
I0818 19:28:24.181395 365394 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0818 19:28:24.191750 365394 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0818 19:28:24.191811 365394 retry.go:31] will retry after 274.098508ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0818 19:28:24.248721 365394 addons.go:431] installing /etc/kubernetes/addons/dashboard-configmap.yaml
I0818 19:28:24.248762 365394 ssh_runner.go:362] scp dashboard/dashboard-configmap.yaml --> /etc/kubernetes/addons/dashboard-configmap.yaml (837 bytes)
W0818 19:28:24.281154 365394 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0818 19:28:24.281188 365394 retry.go:31] will retry after 186.5229ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0818 19:28:24.296264 365394 addons.go:431] installing /etc/kubernetes/addons/dashboard-dp.yaml
I0818 19:28:24.296291 365394 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-dp.yaml (4201 bytes)
W0818 19:28:24.315729 365394 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0818 19:28:24.315762 365394 retry.go:31] will retry after 353.745978ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0818 19:28:24.319541 365394 addons.go:431] installing /etc/kubernetes/addons/dashboard-role.yaml
I0818 19:28:24.319568 365394 ssh_runner.go:362] scp dashboard/dashboard-role.yaml --> /etc/kubernetes/addons/dashboard-role.yaml (1724 bytes)
I0818 19:28:24.337999 365394 addons.go:431] installing /etc/kubernetes/addons/dashboard-rolebinding.yaml
I0818 19:28:24.338068 365394 ssh_runner.go:362] scp dashboard/dashboard-rolebinding.yaml --> /etc/kubernetes/addons/dashboard-rolebinding.yaml (1046 bytes)
I0818 19:28:24.356280 365394 addons.go:431] installing /etc/kubernetes/addons/dashboard-sa.yaml
I0818 19:28:24.356305 365394 ssh_runner.go:362] scp dashboard/dashboard-sa.yaml --> /etc/kubernetes/addons/dashboard-sa.yaml (837 bytes)
I0818 19:28:24.374748 365394 addons.go:431] installing /etc/kubernetes/addons/dashboard-secret.yaml
I0818 19:28:24.374810 365394 ssh_runner.go:362] scp dashboard/dashboard-secret.yaml --> /etc/kubernetes/addons/dashboard-secret.yaml (1389 bytes)
I0818 19:28:24.393182 365394 addons.go:431] installing /etc/kubernetes/addons/dashboard-svc.yaml
I0818 19:28:24.393205 365394 ssh_runner.go:362] scp dashboard/dashboard-svc.yaml --> /etc/kubernetes/addons/dashboard-svc.yaml (1294 bytes)
I0818 19:28:24.412348 365394 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0818 19:28:24.467086 365394 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I0818 19:28:24.468205 365394 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0818 19:28:24.513690 365394 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0818 19:28:24.513721 365394 retry.go:31] will retry after 297.303431ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0818 19:28:24.599678 365394 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0818 19:28:24.599716 365394 retry.go:31] will retry after 418.670962ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0818 19:28:24.599750 365394 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0818 19:28:24.599760 365394 retry.go:31] will retry after 519.310011ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0818 19:28:24.669995 365394 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0818 19:28:24.750350 365394 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0818 19:28:24.750386 365394 retry.go:31] will retry after 433.957523ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0818 19:28:24.811778 365394 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0818 19:28:24.920226 365394 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0818 19:28:24.920259 365394 retry.go:31] will retry after 546.190672ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0818 19:28:25.018961 365394 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I0818 19:28:25.119810 365394 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I0818 19:28:25.184780 365394 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0818 19:28:25.224220 365394 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0818 19:28:25.224259 365394 retry.go:31] will retry after 301.18108ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0818 19:28:25.306139 365394 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0818 19:28:25.306171 365394 retry.go:31] will retry after 798.351817ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0818 19:28:25.318066 365394 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0818 19:28:25.318099 365394 retry.go:31] will retry after 317.642649ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0818 19:28:25.467003 365394 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0818 19:28:25.525932 365394 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0818 19:28:25.579288 365394 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0818 19:28:25.579324 365394 retry.go:31] will retry after 558.227574ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0818 19:28:25.636607 365394 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0818 19:28:25.722996 365394 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0818 19:28:25.723032 365394 retry.go:31] will retry after 926.967076ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0818 19:28:25.907777 365394 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0818 19:28:25.907825 365394 retry.go:31] will retry after 1.132009601s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0818 19:28:25.956474 365394 node_ready.go:53] error getting node "old-k8s-version-216078": Get "https://192.168.76.2:8443/api/v1/nodes/old-k8s-version-216078": dial tcp 192.168.76.2:8443: connect: connection refused
I0818 19:28:26.104667 365394 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I0818 19:28:26.137911 365394 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0818 19:28:26.252855 365394 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0818 19:28:26.252909 365394 retry.go:31] will retry after 1.039958798s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0818 19:28:26.328205 365394 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0818 19:28:26.328239 365394 retry.go:31] will retry after 513.95598ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0818 19:28:26.650171 365394 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0818 19:28:26.738548 365394 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0818 19:28:26.738580 365394 retry.go:31] will retry after 683.511251ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0818 19:28:26.842820 365394 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0818 19:28:26.942718 365394 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0818 19:28:26.942747 365394 retry.go:31] will retry after 927.13556ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0818 19:28:27.040809 365394 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0818 19:28:27.192715 365394 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0818 19:28:27.192745 365394 retry.go:31] will retry after 1.583782834s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0818 19:28:27.294040 365394 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0818 19:28:27.386415 365394 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0818 19:28:27.386444 365394 retry.go:31] will retry after 1.316723762s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0818 19:28:27.422760 365394 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0818 19:28:27.523898 365394 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0818 19:28:27.524006 365394 retry.go:31] will retry after 1.225213217s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0818 19:28:27.870480 365394 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0818 19:28:27.957147 365394 node_ready.go:53] error getting node "old-k8s-version-216078": Get "https://192.168.76.2:8443/api/v1/nodes/old-k8s-version-216078": dial tcp 192.168.76.2:8443: connect: connection refused
W0818 19:28:27.961689 365394 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0818 19:28:27.961720 365394 retry.go:31] will retry after 1.738176148s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0818 19:28:28.703840 365394 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I0818 19:28:28.750117 365394 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I0818 19:28:28.777388 365394 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0818 19:28:28.812146 365394 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0818 19:28:28.812175 365394 retry.go:31] will retry after 1.23296768s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0818 19:28:28.986506 365394 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0818 19:28:28.986535 365394 retry.go:31] will retry after 3.879002696s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0818 19:28:28.986573 365394 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0818 19:28:28.986580 365394 retry.go:31] will retry after 1.276576491s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0818 19:28:29.700811 365394 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0818 19:28:29.795254 365394 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0818 19:28:29.795285 365394 retry.go:31] will retry after 2.205868674s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0818 19:28:30.048225 365394 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0818 19:28:30.221329 365394 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0818 19:28:30.221361 365394 retry.go:31] will retry after 2.872198088s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0818 19:28:30.263718 365394 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0818 19:28:30.363282 365394 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0818 19:28:30.363314 365394 retry.go:31] will retry after 2.178284097s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0818 19:28:30.456920 365394 node_ready.go:53] error getting node "old-k8s-version-216078": Get "https://192.168.76.2:8443/api/v1/nodes/old-k8s-version-216078": dial tcp 192.168.76.2:8443: connect: connection refused
I0818 19:28:32.001289 365394 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0818 19:28:32.104342 365394 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0818 19:28:32.104369 365394 retry.go:31] will retry after 4.324393365s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0818 19:28:32.457278 365394 node_ready.go:53] error getting node "old-k8s-version-216078": Get "https://192.168.76.2:8443/api/v1/nodes/old-k8s-version-216078": dial tcp 192.168.76.2:8443: connect: connection refused
I0818 19:28:32.542586 365394 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0818 19:28:32.763640 365394 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0818 19:28:32.763670 365394 retry.go:31] will retry after 5.550464785s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0818 19:28:32.865887 365394 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I0818 19:28:33.093972 365394 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0818 19:28:33.288869 365394 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0818 19:28:33.288909 365394 retry.go:31] will retry after 3.621098907s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0818 19:28:33.495930 365394 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0818 19:28:33.495959 365394 retry.go:31] will retry after 3.167914032s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0818 19:28:36.428984 365394 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0818 19:28:36.664749 365394 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I0818 19:28:36.910194 365394 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I0818 19:28:38.315108 365394 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0818 19:28:43.957591 365394 node_ready.go:53] error getting node "old-k8s-version-216078": Get "https://192.168.76.2:8443/api/v1/nodes/old-k8s-version-216078": net/http: TLS handshake timeout
I0818 19:28:45.997266 365394 node_ready.go:49] node "old-k8s-version-216078" has status "Ready":"True"
I0818 19:28:45.997289 365394 node_ready.go:38] duration metric: took 22.04137427s for node "old-k8s-version-216078" to be "Ready" ...
I0818 19:28:45.997299 365394 pod_ready.go:36] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0818 19:28:46.354164 365394 pod_ready.go:79] waiting up to 6m0s for pod "coredns-74ff55c5b-vvtgz" in "kube-system" namespace to be "Ready" ...
I0818 19:28:46.625285 365394 pod_ready.go:93] pod "coredns-74ff55c5b-vvtgz" in "kube-system" namespace has status "Ready":"True"
I0818 19:28:46.625357 365394 pod_ready.go:82] duration metric: took 271.099181ms for pod "coredns-74ff55c5b-vvtgz" in "kube-system" namespace to be "Ready" ...
I0818 19:28:46.625382 365394 pod_ready.go:79] waiting up to 6m0s for pod "etcd-old-k8s-version-216078" in "kube-system" namespace to be "Ready" ...
I0818 19:28:48.638291 365394 pod_ready.go:103] pod "etcd-old-k8s-version-216078" in "kube-system" namespace has status "Ready":"False"
I0818 19:28:48.945463 365394 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: (12.2806759s)
I0818 19:28:48.945686 365394 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: (12.035468934s)
I0818 19:28:48.945760 365394 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (10.630628821s)
I0818 19:28:48.945775 365394 addons.go:475] Verifying addon metrics-server=true in "old-k8s-version-216078"
I0818 19:28:48.945823 365394 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: (12.5168061s)
I0818 19:28:48.949318 365394 out.go:177] * Some dashboard features require the metrics-server addon. To enable all features please run:
minikube -p old-k8s-version-216078 addons enable metrics-server
I0818 19:28:48.954812 365394 out.go:177] * Enabled addons: storage-provisioner, metrics-server, dashboard, default-storageclass
I0818 19:28:48.956780 365394 addons.go:510] duration metric: took 25.225124735s for enable addons: enabled=[storage-provisioner metrics-server dashboard default-storageclass]
I0818 19:28:51.134053 365394 pod_ready.go:103] pod "etcd-old-k8s-version-216078" in "kube-system" namespace has status "Ready":"False"
I0818 19:28:53.631500 365394 pod_ready.go:103] pod "etcd-old-k8s-version-216078" in "kube-system" namespace has status "Ready":"False"
I0818 19:28:55.634241 365394 pod_ready.go:103] pod "etcd-old-k8s-version-216078" in "kube-system" namespace has status "Ready":"False"
I0818 19:28:58.132967 365394 pod_ready.go:103] pod "etcd-old-k8s-version-216078" in "kube-system" namespace has status "Ready":"False"
I0818 19:29:00.151360 365394 pod_ready.go:103] pod "etcd-old-k8s-version-216078" in "kube-system" namespace has status "Ready":"False"
I0818 19:29:02.631656 365394 pod_ready.go:103] pod "etcd-old-k8s-version-216078" in "kube-system" namespace has status "Ready":"False"
I0818 19:29:04.693139 365394 pod_ready.go:103] pod "etcd-old-k8s-version-216078" in "kube-system" namespace has status "Ready":"False"
I0818 19:29:07.132804 365394 pod_ready.go:103] pod "etcd-old-k8s-version-216078" in "kube-system" namespace has status "Ready":"False"
I0818 19:29:09.632512 365394 pod_ready.go:103] pod "etcd-old-k8s-version-216078" in "kube-system" namespace has status "Ready":"False"
I0818 19:29:12.142696 365394 pod_ready.go:103] pod "etcd-old-k8s-version-216078" in "kube-system" namespace has status "Ready":"False"
I0818 19:29:14.631245 365394 pod_ready.go:103] pod "etcd-old-k8s-version-216078" in "kube-system" namespace has status "Ready":"False"
I0818 19:29:16.632179 365394 pod_ready.go:103] pod "etcd-old-k8s-version-216078" in "kube-system" namespace has status "Ready":"False"
I0818 19:29:18.632379 365394 pod_ready.go:103] pod "etcd-old-k8s-version-216078" in "kube-system" namespace has status "Ready":"False"
I0818 19:29:21.133658 365394 pod_ready.go:103] pod "etcd-old-k8s-version-216078" in "kube-system" namespace has status "Ready":"False"
I0818 19:29:23.134949 365394 pod_ready.go:103] pod "etcd-old-k8s-version-216078" in "kube-system" namespace has status "Ready":"False"
I0818 19:29:25.631396 365394 pod_ready.go:103] pod "etcd-old-k8s-version-216078" in "kube-system" namespace has status "Ready":"False"
I0818 19:29:28.131696 365394 pod_ready.go:103] pod "etcd-old-k8s-version-216078" in "kube-system" namespace has status "Ready":"False"
I0818 19:29:30.132127 365394 pod_ready.go:103] pod "etcd-old-k8s-version-216078" in "kube-system" namespace has status "Ready":"False"
I0818 19:29:32.132678 365394 pod_ready.go:103] pod "etcd-old-k8s-version-216078" in "kube-system" namespace has status "Ready":"False"
I0818 19:29:34.132867 365394 pod_ready.go:103] pod "etcd-old-k8s-version-216078" in "kube-system" namespace has status "Ready":"False"
I0818 19:29:36.180870 365394 pod_ready.go:103] pod "etcd-old-k8s-version-216078" in "kube-system" namespace has status "Ready":"False"
I0818 19:29:38.632159 365394 pod_ready.go:103] pod "etcd-old-k8s-version-216078" in "kube-system" namespace has status "Ready":"False"
I0818 19:29:40.632379 365394 pod_ready.go:103] pod "etcd-old-k8s-version-216078" in "kube-system" namespace has status "Ready":"False"
I0818 19:29:42.633402 365394 pod_ready.go:103] pod "etcd-old-k8s-version-216078" in "kube-system" namespace has status "Ready":"False"
I0818 19:29:45.133471 365394 pod_ready.go:103] pod "etcd-old-k8s-version-216078" in "kube-system" namespace has status "Ready":"False"
I0818 19:29:47.135990 365394 pod_ready.go:103] pod "etcd-old-k8s-version-216078" in "kube-system" namespace has status "Ready":"False"
I0818 19:29:49.633217 365394 pod_ready.go:103] pod "etcd-old-k8s-version-216078" in "kube-system" namespace has status "Ready":"False"
I0818 19:29:51.640856 365394 pod_ready.go:103] pod "etcd-old-k8s-version-216078" in "kube-system" namespace has status "Ready":"False"
I0818 19:29:54.133075 365394 pod_ready.go:103] pod "etcd-old-k8s-version-216078" in "kube-system" namespace has status "Ready":"False"
I0818 19:29:56.632009 365394 pod_ready.go:103] pod "etcd-old-k8s-version-216078" in "kube-system" namespace has status "Ready":"False"
I0818 19:29:58.632349 365394 pod_ready.go:103] pod "etcd-old-k8s-version-216078" in "kube-system" namespace has status "Ready":"False"
I0818 19:30:00.633785 365394 pod_ready.go:103] pod "etcd-old-k8s-version-216078" in "kube-system" namespace has status "Ready":"False"
I0818 19:30:03.132478 365394 pod_ready.go:103] pod "etcd-old-k8s-version-216078" in "kube-system" namespace has status "Ready":"False"
I0818 19:30:05.632865 365394 pod_ready.go:103] pod "etcd-old-k8s-version-216078" in "kube-system" namespace has status "Ready":"False"
I0818 19:30:08.132900 365394 pod_ready.go:103] pod "etcd-old-k8s-version-216078" in "kube-system" namespace has status "Ready":"False"
I0818 19:30:10.631985 365394 pod_ready.go:103] pod "etcd-old-k8s-version-216078" in "kube-system" namespace has status "Ready":"False"
I0818 19:30:13.131586 365394 pod_ready.go:103] pod "etcd-old-k8s-version-216078" in "kube-system" namespace has status "Ready":"False"
I0818 19:30:15.133127 365394 pod_ready.go:103] pod "etcd-old-k8s-version-216078" in "kube-system" namespace has status "Ready":"False"
I0818 19:30:16.131560 365394 pod_ready.go:93] pod "etcd-old-k8s-version-216078" in "kube-system" namespace has status "Ready":"True"
I0818 19:30:16.131587 365394 pod_ready.go:82] duration metric: took 1m29.506182017s for pod "etcd-old-k8s-version-216078" in "kube-system" namespace to be "Ready" ...
I0818 19:30:16.131603 365394 pod_ready.go:79] waiting up to 6m0s for pod "kube-apiserver-old-k8s-version-216078" in "kube-system" namespace to be "Ready" ...
I0818 19:30:16.137187 365394 pod_ready.go:93] pod "kube-apiserver-old-k8s-version-216078" in "kube-system" namespace has status "Ready":"True"
I0818 19:30:16.137215 365394 pod_ready.go:82] duration metric: took 5.603096ms for pod "kube-apiserver-old-k8s-version-216078" in "kube-system" namespace to be "Ready" ...
I0818 19:30:16.137227 365394 pod_ready.go:79] waiting up to 6m0s for pod "kube-controller-manager-old-k8s-version-216078" in "kube-system" namespace to be "Ready" ...
I0818 19:30:16.142670 365394 pod_ready.go:93] pod "kube-controller-manager-old-k8s-version-216078" in "kube-system" namespace has status "Ready":"True"
I0818 19:30:16.142699 365394 pod_ready.go:82] duration metric: took 5.464791ms for pod "kube-controller-manager-old-k8s-version-216078" in "kube-system" namespace to be "Ready" ...
I0818 19:30:16.142711 365394 pod_ready.go:79] waiting up to 6m0s for pod "kube-proxy-n9glb" in "kube-system" namespace to be "Ready" ...
I0818 19:30:16.148075 365394 pod_ready.go:93] pod "kube-proxy-n9glb" in "kube-system" namespace has status "Ready":"True"
I0818 19:30:16.148097 365394 pod_ready.go:82] duration metric: took 5.3784ms for pod "kube-proxy-n9glb" in "kube-system" namespace to be "Ready" ...
I0818 19:30:16.148108 365394 pod_ready.go:79] waiting up to 6m0s for pod "kube-scheduler-old-k8s-version-216078" in "kube-system" namespace to be "Ready" ...
I0818 19:30:16.153170 365394 pod_ready.go:93] pod "kube-scheduler-old-k8s-version-216078" in "kube-system" namespace has status "Ready":"True"
I0818 19:30:16.153193 365394 pod_ready.go:82] duration metric: took 5.077404ms for pod "kube-scheduler-old-k8s-version-216078" in "kube-system" namespace to be "Ready" ...
I0818 19:30:16.153205 365394 pod_ready.go:79] waiting up to 6m0s for pod "metrics-server-9975d5f86-5k9lw" in "kube-system" namespace to be "Ready" ...
I0818 19:30:18.159444 365394 pod_ready.go:103] pod "metrics-server-9975d5f86-5k9lw" in "kube-system" namespace has status "Ready":"False"
I0818 19:30:20.658805 365394 pod_ready.go:103] pod "metrics-server-9975d5f86-5k9lw" in "kube-system" namespace has status "Ready":"False"
I0818 19:30:22.659119 365394 pod_ready.go:103] pod "metrics-server-9975d5f86-5k9lw" in "kube-system" namespace has status "Ready":"False"
I0818 19:30:24.659361 365394 pod_ready.go:103] pod "metrics-server-9975d5f86-5k9lw" in "kube-system" namespace has status "Ready":"False"
I0818 19:30:26.659633 365394 pod_ready.go:103] pod "metrics-server-9975d5f86-5k9lw" in "kube-system" namespace has status "Ready":"False"
I0818 19:30:29.160376 365394 pod_ready.go:103] pod "metrics-server-9975d5f86-5k9lw" in "kube-system" namespace has status "Ready":"False"
I0818 19:30:31.160428 365394 pod_ready.go:103] pod "metrics-server-9975d5f86-5k9lw" in "kube-system" namespace has status "Ready":"False"
I0818 19:30:33.658986 365394 pod_ready.go:103] pod "metrics-server-9975d5f86-5k9lw" in "kube-system" namespace has status "Ready":"False"
I0818 19:30:35.660424 365394 pod_ready.go:103] pod "metrics-server-9975d5f86-5k9lw" in "kube-system" namespace has status "Ready":"False"
I0818 19:30:38.159303 365394 pod_ready.go:103] pod "metrics-server-9975d5f86-5k9lw" in "kube-system" namespace has status "Ready":"False"
I0818 19:30:40.160672 365394 pod_ready.go:103] pod "metrics-server-9975d5f86-5k9lw" in "kube-system" namespace has status "Ready":"False"
I0818 19:30:42.165873 365394 pod_ready.go:103] pod "metrics-server-9975d5f86-5k9lw" in "kube-system" namespace has status "Ready":"False"
I0818 19:30:44.659138 365394 pod_ready.go:103] pod "metrics-server-9975d5f86-5k9lw" in "kube-system" namespace has status "Ready":"False"
I0818 19:30:46.719028 365394 pod_ready.go:103] pod "metrics-server-9975d5f86-5k9lw" in "kube-system" namespace has status "Ready":"False"
I0818 19:30:49.159300 365394 pod_ready.go:103] pod "metrics-server-9975d5f86-5k9lw" in "kube-system" namespace has status "Ready":"False"
I0818 19:30:51.159552 365394 pod_ready.go:103] pod "metrics-server-9975d5f86-5k9lw" in "kube-system" namespace has status "Ready":"False"
I0818 19:30:53.160508 365394 pod_ready.go:103] pod "metrics-server-9975d5f86-5k9lw" in "kube-system" namespace has status "Ready":"False"
I0818 19:30:55.160797 365394 pod_ready.go:103] pod "metrics-server-9975d5f86-5k9lw" in "kube-system" namespace has status "Ready":"False"
I0818 19:30:57.659679 365394 pod_ready.go:103] pod "metrics-server-9975d5f86-5k9lw" in "kube-system" namespace has status "Ready":"False"
I0818 19:30:59.660030 365394 pod_ready.go:103] pod "metrics-server-9975d5f86-5k9lw" in "kube-system" namespace has status "Ready":"False"
I0818 19:31:01.667587 365394 pod_ready.go:103] pod "metrics-server-9975d5f86-5k9lw" in "kube-system" namespace has status "Ready":"False"
I0818 19:31:04.160120 365394 pod_ready.go:103] pod "metrics-server-9975d5f86-5k9lw" in "kube-system" namespace has status "Ready":"False"
I0818 19:31:06.661038 365394 pod_ready.go:103] pod "metrics-server-9975d5f86-5k9lw" in "kube-system" namespace has status "Ready":"False"
I0818 19:31:09.159406 365394 pod_ready.go:103] pod "metrics-server-9975d5f86-5k9lw" in "kube-system" namespace has status "Ready":"False"
I0818 19:31:11.159873 365394 pod_ready.go:103] pod "metrics-server-9975d5f86-5k9lw" in "kube-system" namespace has status "Ready":"False"
I0818 19:31:13.160968 365394 pod_ready.go:103] pod "metrics-server-9975d5f86-5k9lw" in "kube-system" namespace has status "Ready":"False"
I0818 19:31:15.659657 365394 pod_ready.go:103] pod "metrics-server-9975d5f86-5k9lw" in "kube-system" namespace has status "Ready":"False"
I0818 19:31:17.659766 365394 pod_ready.go:103] pod "metrics-server-9975d5f86-5k9lw" in "kube-system" namespace has status "Ready":"False"
I0818 19:31:20.160774 365394 pod_ready.go:103] pod "metrics-server-9975d5f86-5k9lw" in "kube-system" namespace has status "Ready":"False"
I0818 19:31:22.161059 365394 pod_ready.go:103] pod "metrics-server-9975d5f86-5k9lw" in "kube-system" namespace has status "Ready":"False"
I0818 19:31:24.659329 365394 pod_ready.go:103] pod "metrics-server-9975d5f86-5k9lw" in "kube-system" namespace has status "Ready":"False"
I0818 19:31:27.160302 365394 pod_ready.go:103] pod "metrics-server-9975d5f86-5k9lw" in "kube-system" namespace has status "Ready":"False"
I0818 19:31:29.661610 365394 pod_ready.go:103] pod "metrics-server-9975d5f86-5k9lw" in "kube-system" namespace has status "Ready":"False"
I0818 19:31:32.160382 365394 pod_ready.go:103] pod "metrics-server-9975d5f86-5k9lw" in "kube-system" namespace has status "Ready":"False"
I0818 19:31:34.658853 365394 pod_ready.go:103] pod "metrics-server-9975d5f86-5k9lw" in "kube-system" namespace has status "Ready":"False"
I0818 19:31:36.660658 365394 pod_ready.go:103] pod "metrics-server-9975d5f86-5k9lw" in "kube-system" namespace has status "Ready":"False"
I0818 19:31:39.159309 365394 pod_ready.go:103] pod "metrics-server-9975d5f86-5k9lw" in "kube-system" namespace has status "Ready":"False"
I0818 19:31:41.160598 365394 pod_ready.go:103] pod "metrics-server-9975d5f86-5k9lw" in "kube-system" namespace has status "Ready":"False"
I0818 19:31:43.658732 365394 pod_ready.go:103] pod "metrics-server-9975d5f86-5k9lw" in "kube-system" namespace has status "Ready":"False"
I0818 19:31:45.659263 365394 pod_ready.go:103] pod "metrics-server-9975d5f86-5k9lw" in "kube-system" namespace has status "Ready":"False"
I0818 19:31:47.659838 365394 pod_ready.go:103] pod "metrics-server-9975d5f86-5k9lw" in "kube-system" namespace has status "Ready":"False"
I0818 19:31:50.159885 365394 pod_ready.go:103] pod "metrics-server-9975d5f86-5k9lw" in "kube-system" namespace has status "Ready":"False"
I0818 19:31:52.160234 365394 pod_ready.go:103] pod "metrics-server-9975d5f86-5k9lw" in "kube-system" namespace has status "Ready":"False"
I0818 19:31:54.659861 365394 pod_ready.go:103] pod "metrics-server-9975d5f86-5k9lw" in "kube-system" namespace has status "Ready":"False"
I0818 19:31:56.660403 365394 pod_ready.go:103] pod "metrics-server-9975d5f86-5k9lw" in "kube-system" namespace has status "Ready":"False"
I0818 19:31:59.159326 365394 pod_ready.go:103] pod "metrics-server-9975d5f86-5k9lw" in "kube-system" namespace has status "Ready":"False"
I0818 19:32:01.159471 365394 pod_ready.go:103] pod "metrics-server-9975d5f86-5k9lw" in "kube-system" namespace has status "Ready":"False"
I0818 19:32:03.160341 365394 pod_ready.go:103] pod "metrics-server-9975d5f86-5k9lw" in "kube-system" namespace has status "Ready":"False"
I0818 19:32:05.660515 365394 pod_ready.go:103] pod "metrics-server-9975d5f86-5k9lw" in "kube-system" namespace has status "Ready":"False"
I0818 19:32:08.160071 365394 pod_ready.go:103] pod "metrics-server-9975d5f86-5k9lw" in "kube-system" namespace has status "Ready":"False"
I0818 19:32:10.161151 365394 pod_ready.go:103] pod "metrics-server-9975d5f86-5k9lw" in "kube-system" namespace has status "Ready":"False"
I0818 19:32:12.660275 365394 pod_ready.go:103] pod "metrics-server-9975d5f86-5k9lw" in "kube-system" namespace has status "Ready":"False"
I0818 19:32:15.159961 365394 pod_ready.go:103] pod "metrics-server-9975d5f86-5k9lw" in "kube-system" namespace has status "Ready":"False"
I0818 19:32:17.659024 365394 pod_ready.go:103] pod "metrics-server-9975d5f86-5k9lw" in "kube-system" namespace has status "Ready":"False"
I0818 19:32:20.159439 365394 pod_ready.go:103] pod "metrics-server-9975d5f86-5k9lw" in "kube-system" namespace has status "Ready":"False"
I0818 19:32:22.160038 365394 pod_ready.go:103] pod "metrics-server-9975d5f86-5k9lw" in "kube-system" namespace has status "Ready":"False"
I0818 19:32:24.160156 365394 pod_ready.go:103] pod "metrics-server-9975d5f86-5k9lw" in "kube-system" namespace has status "Ready":"False"
I0818 19:32:26.659676 365394 pod_ready.go:103] pod "metrics-server-9975d5f86-5k9lw" in "kube-system" namespace has status "Ready":"False"
I0818 19:32:29.159547 365394 pod_ready.go:103] pod "metrics-server-9975d5f86-5k9lw" in "kube-system" namespace has status "Ready":"False"
I0818 19:32:31.659019 365394 pod_ready.go:103] pod "metrics-server-9975d5f86-5k9lw" in "kube-system" namespace has status "Ready":"False"
I0818 19:32:34.161582 365394 pod_ready.go:103] pod "metrics-server-9975d5f86-5k9lw" in "kube-system" namespace has status "Ready":"False"
I0818 19:32:36.659504 365394 pod_ready.go:103] pod "metrics-server-9975d5f86-5k9lw" in "kube-system" namespace has status "Ready":"False"
I0818 19:32:39.159972 365394 pod_ready.go:103] pod "metrics-server-9975d5f86-5k9lw" in "kube-system" namespace has status "Ready":"False"
I0818 19:32:41.660264 365394 pod_ready.go:103] pod "metrics-server-9975d5f86-5k9lw" in "kube-system" namespace has status "Ready":"False"
I0818 19:32:44.159742 365394 pod_ready.go:103] pod "metrics-server-9975d5f86-5k9lw" in "kube-system" namespace has status "Ready":"False"
I0818 19:32:46.659441 365394 pod_ready.go:103] pod "metrics-server-9975d5f86-5k9lw" in "kube-system" namespace has status "Ready":"False"
I0818 19:32:48.659757 365394 pod_ready.go:103] pod "metrics-server-9975d5f86-5k9lw" in "kube-system" namespace has status "Ready":"False"
I0818 19:32:51.160016 365394 pod_ready.go:103] pod "metrics-server-9975d5f86-5k9lw" in "kube-system" namespace has status "Ready":"False"
I0818 19:32:53.658678 365394 pod_ready.go:103] pod "metrics-server-9975d5f86-5k9lw" in "kube-system" namespace has status "Ready":"False"
I0818 19:32:55.659947 365394 pod_ready.go:103] pod "metrics-server-9975d5f86-5k9lw" in "kube-system" namespace has status "Ready":"False"
I0818 19:32:58.159336 365394 pod_ready.go:103] pod "metrics-server-9975d5f86-5k9lw" in "kube-system" namespace has status "Ready":"False"
I0818 19:33:00.178292 365394 pod_ready.go:103] pod "metrics-server-9975d5f86-5k9lw" in "kube-system" namespace has status "Ready":"False"
I0818 19:33:02.660110 365394 pod_ready.go:103] pod "metrics-server-9975d5f86-5k9lw" in "kube-system" namespace has status "Ready":"False"
I0818 19:33:05.160170 365394 pod_ready.go:103] pod "metrics-server-9975d5f86-5k9lw" in "kube-system" namespace has status "Ready":"False"
I0818 19:33:07.168917 365394 pod_ready.go:103] pod "metrics-server-9975d5f86-5k9lw" in "kube-system" namespace has status "Ready":"False"
I0818 19:33:09.660628 365394 pod_ready.go:103] pod "metrics-server-9975d5f86-5k9lw" in "kube-system" namespace has status "Ready":"False"
I0818 19:33:12.159904 365394 pod_ready.go:103] pod "metrics-server-9975d5f86-5k9lw" in "kube-system" namespace has status "Ready":"False"
I0818 19:33:14.659581 365394 pod_ready.go:103] pod "metrics-server-9975d5f86-5k9lw" in "kube-system" namespace has status "Ready":"False"
I0818 19:33:17.166067 365394 pod_ready.go:103] pod "metrics-server-9975d5f86-5k9lw" in "kube-system" namespace has status "Ready":"False"
I0818 19:33:19.666334 365394 pod_ready.go:103] pod "metrics-server-9975d5f86-5k9lw" in "kube-system" namespace has status "Ready":"False"
I0818 19:33:22.159726 365394 pod_ready.go:103] pod "metrics-server-9975d5f86-5k9lw" in "kube-system" namespace has status "Ready":"False"
I0818 19:33:24.160172 365394 pod_ready.go:103] pod "metrics-server-9975d5f86-5k9lw" in "kube-system" namespace has status "Ready":"False"
I0818 19:33:26.659028 365394 pod_ready.go:103] pod "metrics-server-9975d5f86-5k9lw" in "kube-system" namespace has status "Ready":"False"
I0818 19:33:28.659584 365394 pod_ready.go:103] pod "metrics-server-9975d5f86-5k9lw" in "kube-system" namespace has status "Ready":"False"
I0818 19:33:31.159720 365394 pod_ready.go:103] pod "metrics-server-9975d5f86-5k9lw" in "kube-system" namespace has status "Ready":"False"
I0818 19:33:33.167274 365394 pod_ready.go:103] pod "metrics-server-9975d5f86-5k9lw" in "kube-system" namespace has status "Ready":"False"
I0818 19:33:35.659876 365394 pod_ready.go:103] pod "metrics-server-9975d5f86-5k9lw" in "kube-system" namespace has status "Ready":"False"
I0818 19:33:38.161316 365394 pod_ready.go:103] pod "metrics-server-9975d5f86-5k9lw" in "kube-system" namespace has status "Ready":"False"
I0818 19:33:40.659653 365394 pod_ready.go:103] pod "metrics-server-9975d5f86-5k9lw" in "kube-system" namespace has status "Ready":"False"
I0818 19:33:43.159333 365394 pod_ready.go:103] pod "metrics-server-9975d5f86-5k9lw" in "kube-system" namespace has status "Ready":"False"
I0818 19:33:45.162436 365394 pod_ready.go:103] pod "metrics-server-9975d5f86-5k9lw" in "kube-system" namespace has status "Ready":"False"
I0818 19:33:47.660004 365394 pod_ready.go:103] pod "metrics-server-9975d5f86-5k9lw" in "kube-system" namespace has status "Ready":"False"
I0818 19:33:50.165408 365394 pod_ready.go:103] pod "metrics-server-9975d5f86-5k9lw" in "kube-system" namespace has status "Ready":"False"
I0818 19:33:52.660266 365394 pod_ready.go:103] pod "metrics-server-9975d5f86-5k9lw" in "kube-system" namespace has status "Ready":"False"
I0818 19:33:55.160748 365394 pod_ready.go:103] pod "metrics-server-9975d5f86-5k9lw" in "kube-system" namespace has status "Ready":"False"
I0818 19:33:57.659541 365394 pod_ready.go:103] pod "metrics-server-9975d5f86-5k9lw" in "kube-system" namespace has status "Ready":"False"
I0818 19:33:59.660186 365394 pod_ready.go:103] pod "metrics-server-9975d5f86-5k9lw" in "kube-system" namespace has status "Ready":"False"
I0818 19:34:02.159314 365394 pod_ready.go:103] pod "metrics-server-9975d5f86-5k9lw" in "kube-system" namespace has status "Ready":"False"
I0818 19:34:04.160513 365394 pod_ready.go:103] pod "metrics-server-9975d5f86-5k9lw" in "kube-system" namespace has status "Ready":"False"
I0818 19:34:06.659607 365394 pod_ready.go:103] pod "metrics-server-9975d5f86-5k9lw" in "kube-system" namespace has status "Ready":"False"
I0818 19:34:08.659655 365394 pod_ready.go:103] pod "metrics-server-9975d5f86-5k9lw" in "kube-system" namespace has status "Ready":"False"
I0818 19:34:11.159587 365394 pod_ready.go:103] pod "metrics-server-9975d5f86-5k9lw" in "kube-system" namespace has status "Ready":"False"
I0818 19:34:13.168138 365394 pod_ready.go:103] pod "metrics-server-9975d5f86-5k9lw" in "kube-system" namespace has status "Ready":"False"
I0818 19:34:15.178986 365394 pod_ready.go:103] pod "metrics-server-9975d5f86-5k9lw" in "kube-system" namespace has status "Ready":"False"
I0818 19:34:16.161288 365394 pod_ready.go:82] duration metric: took 4m0.008068993s for pod "metrics-server-9975d5f86-5k9lw" in "kube-system" namespace to be "Ready" ...
E0818 19:34:16.161316 365394 pod_ready.go:67] WaitExtra: waitPodCondition: context deadline exceeded
I0818 19:34:16.161326 365394 pod_ready.go:39] duration metric: took 5m30.164015814s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0818 19:34:16.161346 365394 api_server.go:52] waiting for apiserver process to appear ...
I0818 19:34:16.161377 365394 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
I0818 19:34:16.161438 365394 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0818 19:34:16.243626 365394 cri.go:89] found id: "a70df47e0a4c904f4234489c4b6931a0c40e23791ebbe701bdf79b173c708054"
I0818 19:34:16.243651 365394 cri.go:89] found id: "a80fdd47f7301370c07df42778e346c5b3f9a5082205cddd92243b2292907316"
I0818 19:34:16.243668 365394 cri.go:89] found id: ""
I0818 19:34:16.243676 365394 logs.go:276] 2 containers: [a70df47e0a4c904f4234489c4b6931a0c40e23791ebbe701bdf79b173c708054 a80fdd47f7301370c07df42778e346c5b3f9a5082205cddd92243b2292907316]
I0818 19:34:16.243729 365394 ssh_runner.go:195] Run: which crictl
I0818 19:34:16.250808 365394 ssh_runner.go:195] Run: which crictl
I0818 19:34:16.255664 365394 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
I0818 19:34:16.255739 365394 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0818 19:34:16.332699 365394 cri.go:89] found id: "03fbfc746eafcd2d037579ee9352ca8a230e2d686179a89c453eeae19ba4b178"
I0818 19:34:16.332722 365394 cri.go:89] found id: "dac35e1e30e3e5a45ee7083d88bb89388a2e328ba629d84ddaa0317c718721e1"
I0818 19:34:16.332727 365394 cri.go:89] found id: ""
I0818 19:34:16.332749 365394 logs.go:276] 2 containers: [03fbfc746eafcd2d037579ee9352ca8a230e2d686179a89c453eeae19ba4b178 dac35e1e30e3e5a45ee7083d88bb89388a2e328ba629d84ddaa0317c718721e1]
I0818 19:34:16.332805 365394 ssh_runner.go:195] Run: which crictl
I0818 19:34:16.338994 365394 ssh_runner.go:195] Run: which crictl
I0818 19:34:16.347143 365394 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
I0818 19:34:16.347323 365394 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0818 19:34:16.414776 365394 cri.go:89] found id: "9cb4a0a17af824f66e9d214beb9b26be48e63a6e4f9896caf75d310dbc8cd195"
I0818 19:34:16.414802 365394 cri.go:89] found id: "f7dac504cb498237ca5f7b6a524527cefe7917920a3d413a7c4cd970c819a894"
I0818 19:34:16.414812 365394 cri.go:89] found id: ""
I0818 19:34:16.414823 365394 logs.go:276] 2 containers: [9cb4a0a17af824f66e9d214beb9b26be48e63a6e4f9896caf75d310dbc8cd195 f7dac504cb498237ca5f7b6a524527cefe7917920a3d413a7c4cd970c819a894]
I0818 19:34:16.414925 365394 ssh_runner.go:195] Run: which crictl
I0818 19:34:16.422222 365394 ssh_runner.go:195] Run: which crictl
I0818 19:34:16.428687 365394 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
I0818 19:34:16.428787 365394 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0818 19:34:16.509373 365394 cri.go:89] found id: "3f55d380c20ce8abf819eb90f1107f99b6883a3af7d8b0c875d12639b6f5a1a4"
I0818 19:34:16.509418 365394 cri.go:89] found id: "c1f327db25afffcb7632d994277e73b15d44e051118ecff71b21299a38bcbe10"
I0818 19:34:16.509429 365394 cri.go:89] found id: ""
I0818 19:34:16.509438 365394 logs.go:276] 2 containers: [3f55d380c20ce8abf819eb90f1107f99b6883a3af7d8b0c875d12639b6f5a1a4 c1f327db25afffcb7632d994277e73b15d44e051118ecff71b21299a38bcbe10]
I0818 19:34:16.509519 365394 ssh_runner.go:195] Run: which crictl
I0818 19:34:16.515307 365394 ssh_runner.go:195] Run: which crictl
I0818 19:34:16.519719 365394 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
I0818 19:34:16.519907 365394 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0818 19:34:16.598251 365394 cri.go:89] found id: "d9c85aaaa043f149f3f6daad7c932a643b6619f4c4cb7755b152310052480f6f"
I0818 19:34:16.598273 365394 cri.go:89] found id: "905b265420907d5b4b8ee43b00a698a67557ffce65488b60828117b20fde26b1"
I0818 19:34:16.598278 365394 cri.go:89] found id: ""
I0818 19:34:16.598289 365394 logs.go:276] 2 containers: [d9c85aaaa043f149f3f6daad7c932a643b6619f4c4cb7755b152310052480f6f 905b265420907d5b4b8ee43b00a698a67557ffce65488b60828117b20fde26b1]
I0818 19:34:16.598352 365394 ssh_runner.go:195] Run: which crictl
I0818 19:34:16.605307 365394 ssh_runner.go:195] Run: which crictl
I0818 19:34:16.611188 365394 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
I0818 19:34:16.611266 365394 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0818 19:34:16.674927 365394 cri.go:89] found id: "6b77034b70c13c794e7e71994e90063cf36dd1fa6cbe8d1784b7ceee707c9aca"
I0818 19:34:16.674951 365394 cri.go:89] found id: "00fecac5b274921d65e34f858a2d0fb18402e84618ee482b50df18739b0495ad"
I0818 19:34:16.674957 365394 cri.go:89] found id: ""
I0818 19:34:16.674965 365394 logs.go:276] 2 containers: [6b77034b70c13c794e7e71994e90063cf36dd1fa6cbe8d1784b7ceee707c9aca 00fecac5b274921d65e34f858a2d0fb18402e84618ee482b50df18739b0495ad]
I0818 19:34:16.675024 365394 ssh_runner.go:195] Run: which crictl
I0818 19:34:16.679400 365394 ssh_runner.go:195] Run: which crictl
I0818 19:34:16.682802 365394 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
I0818 19:34:16.682868 365394 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0818 19:34:16.728600 365394 cri.go:89] found id: "136b3774b3686f0bcd42b41a696212f7023654f7c9a799d192302697dae329d1"
I0818 19:34:16.728621 365394 cri.go:89] found id: "80ee1e729513b71685fa053c5499a375152679a2ba2012d6cc5008ba2faab62c"
I0818 19:34:16.728626 365394 cri.go:89] found id: ""
I0818 19:34:16.728633 365394 logs.go:276] 2 containers: [136b3774b3686f0bcd42b41a696212f7023654f7c9a799d192302697dae329d1 80ee1e729513b71685fa053c5499a375152679a2ba2012d6cc5008ba2faab62c]
I0818 19:34:16.728692 365394 ssh_runner.go:195] Run: which crictl
I0818 19:34:16.732280 365394 ssh_runner.go:195] Run: which crictl
I0818 19:34:16.735563 365394 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
I0818 19:34:16.735678 365394 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0818 19:34:16.776231 365394 cri.go:89] found id: "35e10341a264471c2a4ba4fc06d275735b1230d24e7fa77bea16c30257e91109"
I0818 19:34:16.776254 365394 cri.go:89] found id: "48b1e06eab89513ac1b65a73dd1d7880d6028031dc94ee400b4ceb77169245aa"
I0818 19:34:16.776259 365394 cri.go:89] found id: ""
I0818 19:34:16.776267 365394 logs.go:276] 2 containers: [35e10341a264471c2a4ba4fc06d275735b1230d24e7fa77bea16c30257e91109 48b1e06eab89513ac1b65a73dd1d7880d6028031dc94ee400b4ceb77169245aa]
I0818 19:34:16.776324 365394 ssh_runner.go:195] Run: which crictl
I0818 19:34:16.779901 365394 ssh_runner.go:195] Run: which crictl
I0818 19:34:16.783067 365394 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
I0818 19:34:16.783149 365394 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I0818 19:34:16.825413 365394 cri.go:89] found id: "aea462f9a5614878af08a599d3ec3ce490ef7ff8d286df3bad62c54b80d55394"
I0818 19:34:16.825435 365394 cri.go:89] found id: ""
I0818 19:34:16.825444 365394 logs.go:276] 1 containers: [aea462f9a5614878af08a599d3ec3ce490ef7ff8d286df3bad62c54b80d55394]
I0818 19:34:16.825499 365394 ssh_runner.go:195] Run: which crictl
I0818 19:34:16.829000 365394 logs.go:123] Gathering logs for dmesg ...
I0818 19:34:16.829067 365394 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0818 19:34:16.845161 365394 logs.go:123] Gathering logs for etcd [03fbfc746eafcd2d037579ee9352ca8a230e2d686179a89c453eeae19ba4b178] ...
I0818 19:34:16.845193 365394 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 03fbfc746eafcd2d037579ee9352ca8a230e2d686179a89c453eeae19ba4b178"
I0818 19:34:16.899783 365394 logs.go:123] Gathering logs for kube-scheduler [3f55d380c20ce8abf819eb90f1107f99b6883a3af7d8b0c875d12639b6f5a1a4] ...
I0818 19:34:16.899919 365394 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 3f55d380c20ce8abf819eb90f1107f99b6883a3af7d8b0c875d12639b6f5a1a4"
I0818 19:34:16.941128 365394 logs.go:123] Gathering logs for kube-controller-manager [00fecac5b274921d65e34f858a2d0fb18402e84618ee482b50df18739b0495ad] ...
I0818 19:34:16.941168 365394 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 00fecac5b274921d65e34f858a2d0fb18402e84618ee482b50df18739b0495ad"
I0818 19:34:17.016362 365394 logs.go:123] Gathering logs for storage-provisioner [35e10341a264471c2a4ba4fc06d275735b1230d24e7fa77bea16c30257e91109] ...
I0818 19:34:17.016400 365394 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 35e10341a264471c2a4ba4fc06d275735b1230d24e7fa77bea16c30257e91109"
I0818 19:34:17.071278 365394 logs.go:123] Gathering logs for kubernetes-dashboard [aea462f9a5614878af08a599d3ec3ce490ef7ff8d286df3bad62c54b80d55394] ...
I0818 19:34:17.071318 365394 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 aea462f9a5614878af08a599d3ec3ce490ef7ff8d286df3bad62c54b80d55394"
I0818 19:34:17.148503 365394 logs.go:123] Gathering logs for kube-proxy [d9c85aaaa043f149f3f6daad7c932a643b6619f4c4cb7755b152310052480f6f] ...
I0818 19:34:17.148774 365394 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 d9c85aaaa043f149f3f6daad7c932a643b6619f4c4cb7755b152310052480f6f"
I0818 19:34:17.219704 365394 logs.go:123] Gathering logs for kube-proxy [905b265420907d5b4b8ee43b00a698a67557ffce65488b60828117b20fde26b1] ...
I0818 19:34:17.219728 365394 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 905b265420907d5b4b8ee43b00a698a67557ffce65488b60828117b20fde26b1"
I0818 19:34:17.276392 365394 logs.go:123] Gathering logs for kube-controller-manager [6b77034b70c13c794e7e71994e90063cf36dd1fa6cbe8d1784b7ceee707c9aca] ...
I0818 19:34:17.276421 365394 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 6b77034b70c13c794e7e71994e90063cf36dd1fa6cbe8d1784b7ceee707c9aca"
I0818 19:34:17.403147 365394 logs.go:123] Gathering logs for storage-provisioner [48b1e06eab89513ac1b65a73dd1d7880d6028031dc94ee400b4ceb77169245aa] ...
I0818 19:34:17.403183 365394 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 48b1e06eab89513ac1b65a73dd1d7880d6028031dc94ee400b4ceb77169245aa"
I0818 19:34:17.450187 365394 logs.go:123] Gathering logs for containerd ...
I0818 19:34:17.450216 365394 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
I0818 19:34:17.528357 365394 logs.go:123] Gathering logs for container status ...
I0818 19:34:17.528397 365394 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0818 19:34:17.619646 365394 logs.go:123] Gathering logs for kubelet ...
I0818 19:34:17.619677 365394 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0818 19:34:17.682312 365394 logs.go:138] Found kubelet problem: Aug 18 19:28:46 old-k8s-version-216078 kubelet[659]: E0818 19:28:46.116436 659 reflector.go:138] object-"kube-system"/"kube-proxy-token-gkhsq": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kube-proxy-token-gkhsq" is forbidden: User "system:node:old-k8s-version-216078" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-216078' and this object
W0818 19:34:17.682589 365394 logs.go:138] Found kubelet problem: Aug 18 19:28:46 old-k8s-version-216078 kubelet[659]: E0818 19:28:46.117472 659 reflector.go:138] object-"kube-system"/"coredns": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:old-k8s-version-216078" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-216078' and this object
W0818 19:34:17.682950 365394 logs.go:138] Found kubelet problem: Aug 18 19:28:46 old-k8s-version-216078 kubelet[659]: E0818 19:28:46.130723 659 reflector.go:138] object-"kube-system"/"storage-provisioner-token-jg9hx": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "storage-provisioner-token-jg9hx" is forbidden: User "system:node:old-k8s-version-216078" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-216078' and this object
W0818 19:34:17.683233 365394 logs.go:138] Found kubelet problem: Aug 18 19:28:46 old-k8s-version-216078 kubelet[659]: E0818 19:28:46.130814 659 reflector.go:138] object-"default"/"default-token-79mlg": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "default-token-79mlg" is forbidden: User "system:node:old-k8s-version-216078" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'old-k8s-version-216078' and this object
W0818 19:34:17.683613 365394 logs.go:138] Found kubelet problem: Aug 18 19:28:46 old-k8s-version-216078 kubelet[659]: E0818 19:28:46.137493 659 reflector.go:138] object-"kube-system"/"metrics-server-token-lkhr7": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "metrics-server-token-lkhr7" is forbidden: User "system:node:old-k8s-version-216078" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-216078' and this object
W0818 19:34:17.683926 365394 logs.go:138] Found kubelet problem: Aug 18 19:28:46 old-k8s-version-216078 kubelet[659]: E0818 19:28:46.137601 659 reflector.go:138] object-"kube-system"/"kindnet-token-pj6jq": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kindnet-token-pj6jq" is forbidden: User "system:node:old-k8s-version-216078" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-216078' and this object
W0818 19:34:17.684195 365394 logs.go:138] Found kubelet problem: Aug 18 19:28:46 old-k8s-version-216078 kubelet[659]: E0818 19:28:46.137667 659 reflector.go:138] object-"kube-system"/"coredns-token-tstz9": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "coredns-token-tstz9" is forbidden: User "system:node:old-k8s-version-216078" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-216078' and this object
W0818 19:34:17.684437 365394 logs.go:138] Found kubelet problem: Aug 18 19:28:46 old-k8s-version-216078 kubelet[659]: E0818 19:28:46.137736 659 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:old-k8s-version-216078" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-216078' and this object
W0818 19:34:17.694259 365394 logs.go:138] Found kubelet problem: Aug 18 19:28:49 old-k8s-version-216078 kubelet[659]: E0818 19:28:49.150627 659 pod_workers.go:191] Error syncing pod 40ad3299-8676-4f1f-a314-c139b58a3e50 ("metrics-server-9975d5f86-5k9lw_kube-system(40ad3299-8676-4f1f-a314-c139b58a3e50)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0818 19:34:17.694481 365394 logs.go:138] Found kubelet problem: Aug 18 19:28:49 old-k8s-version-216078 kubelet[659]: E0818 19:28:49.197339 659 pod_workers.go:191] Error syncing pod 40ad3299-8676-4f1f-a314-c139b58a3e50 ("metrics-server-9975d5f86-5k9lw_kube-system(40ad3299-8676-4f1f-a314-c139b58a3e50)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0818 19:34:17.698078 365394 logs.go:138] Found kubelet problem: Aug 18 19:28:59 old-k8s-version-216078 kubelet[659]: E0818 19:28:59.777587 659 pod_workers.go:191] Error syncing pod 40ad3299-8676-4f1f-a314-c139b58a3e50 ("metrics-server-9975d5f86-5k9lw_kube-system(40ad3299-8676-4f1f-a314-c139b58a3e50)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0818 19:34:17.700642 365394 logs.go:138] Found kubelet problem: Aug 18 19:29:11 old-k8s-version-216078 kubelet[659]: E0818 19:29:11.292167 659 pod_workers.go:191] Error syncing pod 8c3c11f9-c5cc-46fd-af21-f01b7f474e46 ("dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"
W0818 19:34:17.701410 365394 logs.go:138] Found kubelet problem: Aug 18 19:29:12 old-k8s-version-216078 kubelet[659]: E0818 19:29:12.336846 659 pod_workers.go:191] Error syncing pod 8c3c11f9-c5cc-46fd-af21-f01b7f474e46 ("dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"
W0818 19:34:17.701625 365394 logs.go:138] Found kubelet problem: Aug 18 19:29:14 old-k8s-version-216078 kubelet[659]: E0818 19:29:14.740520 659 pod_workers.go:191] Error syncing pod 40ad3299-8676-4f1f-a314-c139b58a3e50 ("metrics-server-9975d5f86-5k9lw_kube-system(40ad3299-8676-4f1f-a314-c139b58a3e50)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0818 19:34:17.702008 365394 logs.go:138] Found kubelet problem: Aug 18 19:29:17 old-k8s-version-216078 kubelet[659]: E0818 19:29:17.681494 659 pod_workers.go:191] Error syncing pod 8c3c11f9-c5cc-46fd-af21-f01b7f474e46 ("dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"
W0818 19:34:17.702525 365394 logs.go:138] Found kubelet problem: Aug 18 19:29:20 old-k8s-version-216078 kubelet[659]: E0818 19:29:20.366319 659 pod_workers.go:191] Error syncing pod b224ab7a-edb7-4ab4-9f31-ddafa7172d46 ("storage-provisioner_kube-system(b224ab7a-edb7-4ab4-9f31-ddafa7172d46)"), skipping: failed to "StartContainer" for "storage-provisioner" with CrashLoopBackOff: "back-off 10s restarting failed container=storage-provisioner pod=storage-provisioner_kube-system(b224ab7a-edb7-4ab4-9f31-ddafa7172d46)"
W0818 19:34:17.705773 365394 logs.go:138] Found kubelet problem: Aug 18 19:29:27 old-k8s-version-216078 kubelet[659]: E0818 19:29:27.748257 659 pod_workers.go:191] Error syncing pod 40ad3299-8676-4f1f-a314-c139b58a3e50 ("metrics-server-9975d5f86-5k9lw_kube-system(40ad3299-8676-4f1f-a314-c139b58a3e50)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0818 19:34:17.706438 365394 logs.go:138] Found kubelet problem: Aug 18 19:29:30 old-k8s-version-216078 kubelet[659]: E0818 19:29:30.417852 659 pod_workers.go:191] Error syncing pod 8c3c11f9-c5cc-46fd-af21-f01b7f474e46 ("dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"
W0818 19:34:17.706945 365394 logs.go:138] Found kubelet problem: Aug 18 19:29:37 old-k8s-version-216078 kubelet[659]: E0818 19:29:37.681274 659 pod_workers.go:191] Error syncing pod 8c3c11f9-c5cc-46fd-af21-f01b7f474e46 ("dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"
W0818 19:34:17.707162 365394 logs.go:138] Found kubelet problem: Aug 18 19:29:42 old-k8s-version-216078 kubelet[659]: E0818 19:29:42.772972 659 pod_workers.go:191] Error syncing pod 40ad3299-8676-4f1f-a314-c139b58a3e50 ("metrics-server-9975d5f86-5k9lw_kube-system(40ad3299-8676-4f1f-a314-c139b58a3e50)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0818 19:34:17.707534 365394 logs.go:138] Found kubelet problem: Aug 18 19:29:49 old-k8s-version-216078 kubelet[659]: E0818 19:29:49.740124 659 pod_workers.go:191] Error syncing pod 8c3c11f9-c5cc-46fd-af21-f01b7f474e46 ("dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"
W0818 19:34:17.707746 365394 logs.go:138] Found kubelet problem: Aug 18 19:29:56 old-k8s-version-216078 kubelet[659]: E0818 19:29:56.740480 659 pod_workers.go:191] Error syncing pod 40ad3299-8676-4f1f-a314-c139b58a3e50 ("metrics-server-9975d5f86-5k9lw_kube-system(40ad3299-8676-4f1f-a314-c139b58a3e50)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0818 19:34:17.708431 365394 logs.go:138] Found kubelet problem: Aug 18 19:30:01 old-k8s-version-216078 kubelet[659]: E0818 19:30:01.513179 659 pod_workers.go:191] Error syncing pod 8c3c11f9-c5cc-46fd-af21-f01b7f474e46 ("dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"
W0818 19:34:17.708780 365394 logs.go:138] Found kubelet problem: Aug 18 19:30:07 old-k8s-version-216078 kubelet[659]: E0818 19:30:07.681775 659 pod_workers.go:191] Error syncing pod 8c3c11f9-c5cc-46fd-af21-f01b7f474e46 ("dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"
W0818 19:34:17.711748 365394 logs.go:138] Found kubelet problem: Aug 18 19:30:10 old-k8s-version-216078 kubelet[659]: E0818 19:30:10.748586 659 pod_workers.go:191] Error syncing pod 40ad3299-8676-4f1f-a314-c139b58a3e50 ("metrics-server-9975d5f86-5k9lw_kube-system(40ad3299-8676-4f1f-a314-c139b58a3e50)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0818 19:34:17.712177 365394 logs.go:138] Found kubelet problem: Aug 18 19:30:21 old-k8s-version-216078 kubelet[659]: E0818 19:30:21.740932 659 pod_workers.go:191] Error syncing pod 8c3c11f9-c5cc-46fd-af21-f01b7f474e46 ("dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"
W0818 19:34:17.712387 365394 logs.go:138] Found kubelet problem: Aug 18 19:30:25 old-k8s-version-216078 kubelet[659]: E0818 19:30:25.740889 659 pod_workers.go:191] Error syncing pod 40ad3299-8676-4f1f-a314-c139b58a3e50 ("metrics-server-9975d5f86-5k9lw_kube-system(40ad3299-8676-4f1f-a314-c139b58a3e50)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0818 19:34:17.712748 365394 logs.go:138] Found kubelet problem: Aug 18 19:30:35 old-k8s-version-216078 kubelet[659]: E0818 19:30:35.740311 659 pod_workers.go:191] Error syncing pod 8c3c11f9-c5cc-46fd-af21-f01b7f474e46 ("dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"
W0818 19:34:17.712948 365394 logs.go:138] Found kubelet problem: Aug 18 19:30:37 old-k8s-version-216078 kubelet[659]: E0818 19:30:37.740695 659 pod_workers.go:191] Error syncing pod 40ad3299-8676-4f1f-a314-c139b58a3e50 ("metrics-server-9975d5f86-5k9lw_kube-system(40ad3299-8676-4f1f-a314-c139b58a3e50)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0818 19:34:17.713322 365394 logs.go:138] Found kubelet problem: Aug 18 19:30:50 old-k8s-version-216078 kubelet[659]: E0818 19:30:50.741003 659 pod_workers.go:191] Error syncing pod 40ad3299-8676-4f1f-a314-c139b58a3e50 ("metrics-server-9975d5f86-5k9lw_kube-system(40ad3299-8676-4f1f-a314-c139b58a3e50)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0818 19:34:17.713829 365394 logs.go:138] Found kubelet problem: Aug 18 19:30:51 old-k8s-version-216078 kubelet[659]: E0818 19:30:51.639933 659 pod_workers.go:191] Error syncing pod 8c3c11f9-c5cc-46fd-af21-f01b7f474e46 ("dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"
W0818 19:34:17.714214 365394 logs.go:138] Found kubelet problem: Aug 18 19:30:57 old-k8s-version-216078 kubelet[659]: E0818 19:30:57.681246 659 pod_workers.go:191] Error syncing pod 8c3c11f9-c5cc-46fd-af21-f01b7f474e46 ("dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"
W0818 19:34:17.714413 365394 logs.go:138] Found kubelet problem: Aug 18 19:31:05 old-k8s-version-216078 kubelet[659]: E0818 19:31:05.740483 659 pod_workers.go:191] Error syncing pod 40ad3299-8676-4f1f-a314-c139b58a3e50 ("metrics-server-9975d5f86-5k9lw_kube-system(40ad3299-8676-4f1f-a314-c139b58a3e50)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0818 19:34:17.714780 365394 logs.go:138] Found kubelet problem: Aug 18 19:31:10 old-k8s-version-216078 kubelet[659]: E0818 19:31:10.740145 659 pod_workers.go:191] Error syncing pod 8c3c11f9-c5cc-46fd-af21-f01b7f474e46 ("dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"
W0818 19:34:17.714995 365394 logs.go:138] Found kubelet problem: Aug 18 19:31:18 old-k8s-version-216078 kubelet[659]: E0818 19:31:18.740514 659 pod_workers.go:191] Error syncing pod 40ad3299-8676-4f1f-a314-c139b58a3e50 ("metrics-server-9975d5f86-5k9lw_kube-system(40ad3299-8676-4f1f-a314-c139b58a3e50)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0818 19:34:17.715393 365394 logs.go:138] Found kubelet problem: Aug 18 19:31:23 old-k8s-version-216078 kubelet[659]: E0818 19:31:23.744229 659 pod_workers.go:191] Error syncing pod 8c3c11f9-c5cc-46fd-af21-f01b7f474e46 ("dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"
W0818 19:34:17.715611 365394 logs.go:138] Found kubelet problem: Aug 18 19:31:29 old-k8s-version-216078 kubelet[659]: E0818 19:31:29.741416 659 pod_workers.go:191] Error syncing pod 40ad3299-8676-4f1f-a314-c139b58a3e50 ("metrics-server-9975d5f86-5k9lw_kube-system(40ad3299-8676-4f1f-a314-c139b58a3e50)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0818 19:34:17.716019 365394 logs.go:138] Found kubelet problem: Aug 18 19:31:38 old-k8s-version-216078 kubelet[659]: E0818 19:31:38.740103 659 pod_workers.go:191] Error syncing pod 8c3c11f9-c5cc-46fd-af21-f01b7f474e46 ("dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"
W0818 19:34:17.720670 365394 logs.go:138] Found kubelet problem: Aug 18 19:31:40 old-k8s-version-216078 kubelet[659]: E0818 19:31:40.747496 659 pod_workers.go:191] Error syncing pod 40ad3299-8676-4f1f-a314-c139b58a3e50 ("metrics-server-9975d5f86-5k9lw_kube-system(40ad3299-8676-4f1f-a314-c139b58a3e50)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0818 19:34:17.721103 365394 logs.go:138] Found kubelet problem: Aug 18 19:31:52 old-k8s-version-216078 kubelet[659]: E0818 19:31:52.740064 659 pod_workers.go:191] Error syncing pod 8c3c11f9-c5cc-46fd-af21-f01b7f474e46 ("dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"
W0818 19:34:17.721320 365394 logs.go:138] Found kubelet problem: Aug 18 19:31:52 old-k8s-version-216078 kubelet[659]: E0818 19:31:52.741572 659 pod_workers.go:191] Error syncing pod 40ad3299-8676-4f1f-a314-c139b58a3e50 ("metrics-server-9975d5f86-5k9lw_kube-system(40ad3299-8676-4f1f-a314-c139b58a3e50)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0818 19:34:17.721722 365394 logs.go:138] Found kubelet problem: Aug 18 19:32:04 old-k8s-version-216078 kubelet[659]: E0818 19:32:04.740152 659 pod_workers.go:191] Error syncing pod 8c3c11f9-c5cc-46fd-af21-f01b7f474e46 ("dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"
W0818 19:34:17.721938 365394 logs.go:138] Found kubelet problem: Aug 18 19:32:05 old-k8s-version-216078 kubelet[659]: E0818 19:32:05.740613 659 pod_workers.go:191] Error syncing pod 40ad3299-8676-4f1f-a314-c139b58a3e50 ("metrics-server-9975d5f86-5k9lw_kube-system(40ad3299-8676-4f1f-a314-c139b58a3e50)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0818 19:34:17.722165 365394 logs.go:138] Found kubelet problem: Aug 18 19:32:16 old-k8s-version-216078 kubelet[659]: E0818 19:32:16.740992 659 pod_workers.go:191] Error syncing pod 40ad3299-8676-4f1f-a314-c139b58a3e50 ("metrics-server-9975d5f86-5k9lw_kube-system(40ad3299-8676-4f1f-a314-c139b58a3e50)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0818 19:34:17.722842 365394 logs.go:138] Found kubelet problem: Aug 18 19:32:17 old-k8s-version-216078 kubelet[659]: E0818 19:32:17.876392 659 pod_workers.go:191] Error syncing pod 8c3c11f9-c5cc-46fd-af21-f01b7f474e46 ("dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"
W0818 19:34:17.723219 365394 logs.go:138] Found kubelet problem: Aug 18 19:32:27 old-k8s-version-216078 kubelet[659]: E0818 19:32:27.681615 659 pod_workers.go:191] Error syncing pod 8c3c11f9-c5cc-46fd-af21-f01b7f474e46 ("dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"
W0818 19:34:17.723422 365394 logs.go:138] Found kubelet problem: Aug 18 19:32:31 old-k8s-version-216078 kubelet[659]: E0818 19:32:31.743158 659 pod_workers.go:191] Error syncing pod 40ad3299-8676-4f1f-a314-c139b58a3e50 ("metrics-server-9975d5f86-5k9lw_kube-system(40ad3299-8676-4f1f-a314-c139b58a3e50)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0818 19:34:17.723815 365394 logs.go:138] Found kubelet problem: Aug 18 19:32:42 old-k8s-version-216078 kubelet[659]: E0818 19:32:42.740105 659 pod_workers.go:191] Error syncing pod 8c3c11f9-c5cc-46fd-af21-f01b7f474e46 ("dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"
W0818 19:34:17.724033 365394 logs.go:138] Found kubelet problem: Aug 18 19:32:45 old-k8s-version-216078 kubelet[659]: E0818 19:32:45.740578 659 pod_workers.go:191] Error syncing pod 40ad3299-8676-4f1f-a314-c139b58a3e50 ("metrics-server-9975d5f86-5k9lw_kube-system(40ad3299-8676-4f1f-a314-c139b58a3e50)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0818 19:34:17.724417 365394 logs.go:138] Found kubelet problem: Aug 18 19:32:57 old-k8s-version-216078 kubelet[659]: E0818 19:32:57.740499 659 pod_workers.go:191] Error syncing pod 8c3c11f9-c5cc-46fd-af21-f01b7f474e46 ("dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"
W0818 19:34:17.724633 365394 logs.go:138] Found kubelet problem: Aug 18 19:32:58 old-k8s-version-216078 kubelet[659]: E0818 19:32:58.740474 659 pod_workers.go:191] Error syncing pod 40ad3299-8676-4f1f-a314-c139b58a3e50 ("metrics-server-9975d5f86-5k9lw_kube-system(40ad3299-8676-4f1f-a314-c139b58a3e50)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0818 19:34:17.725032 365394 logs.go:138] Found kubelet problem: Aug 18 19:33:10 old-k8s-version-216078 kubelet[659]: E0818 19:33:10.740134 659 pod_workers.go:191] Error syncing pod 8c3c11f9-c5cc-46fd-af21-f01b7f474e46 ("dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"
W0818 19:34:17.725268 365394 logs.go:138] Found kubelet problem: Aug 18 19:33:12 old-k8s-version-216078 kubelet[659]: E0818 19:33:12.740523 659 pod_workers.go:191] Error syncing pod 40ad3299-8676-4f1f-a314-c139b58a3e50 ("metrics-server-9975d5f86-5k9lw_kube-system(40ad3299-8676-4f1f-a314-c139b58a3e50)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0818 19:34:17.725663 365394 logs.go:138] Found kubelet problem: Aug 18 19:33:21 old-k8s-version-216078 kubelet[659]: E0818 19:33:21.744175 659 pod_workers.go:191] Error syncing pod 8c3c11f9-c5cc-46fd-af21-f01b7f474e46 ("dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"
W0818 19:34:17.726002 365394 logs.go:138] Found kubelet problem: Aug 18 19:33:26 old-k8s-version-216078 kubelet[659]: E0818 19:33:26.742186 659 pod_workers.go:191] Error syncing pod 40ad3299-8676-4f1f-a314-c139b58a3e50 ("metrics-server-9975d5f86-5k9lw_kube-system(40ad3299-8676-4f1f-a314-c139b58a3e50)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0818 19:34:17.726377 365394 logs.go:138] Found kubelet problem: Aug 18 19:33:33 old-k8s-version-216078 kubelet[659]: E0818 19:33:33.745221 659 pod_workers.go:191] Error syncing pod 8c3c11f9-c5cc-46fd-af21-f01b7f474e46 ("dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"
W0818 19:34:17.726576 365394 logs.go:138] Found kubelet problem: Aug 18 19:33:37 old-k8s-version-216078 kubelet[659]: E0818 19:33:37.740667 659 pod_workers.go:191] Error syncing pod 40ad3299-8676-4f1f-a314-c139b58a3e50 ("metrics-server-9975d5f86-5k9lw_kube-system(40ad3299-8676-4f1f-a314-c139b58a3e50)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0818 19:34:17.726949 365394 logs.go:138] Found kubelet problem: Aug 18 19:33:46 old-k8s-version-216078 kubelet[659]: E0818 19:33:46.740184 659 pod_workers.go:191] Error syncing pod 8c3c11f9-c5cc-46fd-af21-f01b7f474e46 ("dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"
W0818 19:34:17.727179 365394 logs.go:138] Found kubelet problem: Aug 18 19:33:48 old-k8s-version-216078 kubelet[659]: E0818 19:33:48.741619 659 pod_workers.go:191] Error syncing pod 40ad3299-8676-4f1f-a314-c139b58a3e50 ("metrics-server-9975d5f86-5k9lw_kube-system(40ad3299-8676-4f1f-a314-c139b58a3e50)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0818 19:34:17.727551 365394 logs.go:138] Found kubelet problem: Aug 18 19:33:59 old-k8s-version-216078 kubelet[659]: E0818 19:33:59.740109 659 pod_workers.go:191] Error syncing pod 8c3c11f9-c5cc-46fd-af21-f01b7f474e46 ("dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"
W0818 19:34:17.727776 365394 logs.go:138] Found kubelet problem: Aug 18 19:34:02 old-k8s-version-216078 kubelet[659]: E0818 19:34:02.740456 659 pod_workers.go:191] Error syncing pod 40ad3299-8676-4f1f-a314-c139b58a3e50 ("metrics-server-9975d5f86-5k9lw_kube-system(40ad3299-8676-4f1f-a314-c139b58a3e50)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0818 19:34:17.728248 365394 logs.go:138] Found kubelet problem: Aug 18 19:34:10 old-k8s-version-216078 kubelet[659]: E0818 19:34:10.740182 659 pod_workers.go:191] Error syncing pod 8c3c11f9-c5cc-46fd-af21-f01b7f474e46 ("dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"
W0818 19:34:17.728718 365394 logs.go:138] Found kubelet problem: Aug 18 19:34:15 old-k8s-version-216078 kubelet[659]: E0818 19:34:15.741175 659 pod_workers.go:191] Error syncing pod 40ad3299-8676-4f1f-a314-c139b58a3e50 ("metrics-server-9975d5f86-5k9lw_kube-system(40ad3299-8676-4f1f-a314-c139b58a3e50)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
I0818 19:34:17.728740 365394 logs.go:123] Gathering logs for kube-apiserver [a80fdd47f7301370c07df42778e346c5b3f9a5082205cddd92243b2292907316] ...
I0818 19:34:17.728755 365394 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 a80fdd47f7301370c07df42778e346c5b3f9a5082205cddd92243b2292907316"
I0818 19:34:17.819506 365394 logs.go:123] Gathering logs for etcd [dac35e1e30e3e5a45ee7083d88bb89388a2e328ba629d84ddaa0317c718721e1] ...
I0818 19:34:17.819607 365394 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 dac35e1e30e3e5a45ee7083d88bb89388a2e328ba629d84ddaa0317c718721e1"
I0818 19:34:17.873771 365394 logs.go:123] Gathering logs for coredns [9cb4a0a17af824f66e9d214beb9b26be48e63a6e4f9896caf75d310dbc8cd195] ...
I0818 19:34:17.873809 365394 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 9cb4a0a17af824f66e9d214beb9b26be48e63a6e4f9896caf75d310dbc8cd195"
I0818 19:34:17.943754 365394 logs.go:123] Gathering logs for coredns [f7dac504cb498237ca5f7b6a524527cefe7917920a3d413a7c4cd970c819a894] ...
I0818 19:34:17.943828 365394 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 f7dac504cb498237ca5f7b6a524527cefe7917920a3d413a7c4cd970c819a894"
I0818 19:34:17.999633 365394 logs.go:123] Gathering logs for kindnet [136b3774b3686f0bcd42b41a696212f7023654f7c9a799d192302697dae329d1] ...
I0818 19:34:17.999662 365394 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 136b3774b3686f0bcd42b41a696212f7023654f7c9a799d192302697dae329d1"
I0818 19:34:18.083570 365394 logs.go:123] Gathering logs for describe nodes ...
I0818 19:34:18.083614 365394 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0818 19:34:18.296468 365394 logs.go:123] Gathering logs for kube-apiserver [a70df47e0a4c904f4234489c4b6931a0c40e23791ebbe701bdf79b173c708054] ...
I0818 19:34:18.296516 365394 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 a70df47e0a4c904f4234489c4b6931a0c40e23791ebbe701bdf79b173c708054"
I0818 19:34:18.408946 365394 logs.go:123] Gathering logs for kube-scheduler [c1f327db25afffcb7632d994277e73b15d44e051118ecff71b21299a38bcbe10] ...
I0818 19:34:18.408985 365394 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 c1f327db25afffcb7632d994277e73b15d44e051118ecff71b21299a38bcbe10"
I0818 19:34:18.565143 365394 logs.go:123] Gathering logs for kindnet [80ee1e729513b71685fa053c5499a375152679a2ba2012d6cc5008ba2faab62c] ...
I0818 19:34:18.565179 365394 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 80ee1e729513b71685fa053c5499a375152679a2ba2012d6cc5008ba2faab62c"
I0818 19:34:18.658398 365394 out.go:358] Setting ErrFile to fd 2...
I0818 19:34:18.658433 365394 out.go:392] TERM=,COLORTERM=, which probably does not support color
W0818 19:34:18.658675 365394 out.go:270] X Problems detected in kubelet:
X Problems detected in kubelet:
W0818 19:34:18.658761 365394 out.go:270] Aug 18 19:33:48 old-k8s-version-216078 kubelet[659]: E0818 19:33:48.741619 659 pod_workers.go:191] Error syncing pod 40ad3299-8676-4f1f-a314-c139b58a3e50 ("metrics-server-9975d5f86-5k9lw_kube-system(40ad3299-8676-4f1f-a314-c139b58a3e50)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Aug 18 19:33:48 old-k8s-version-216078 kubelet[659]: E0818 19:33:48.741619 659 pod_workers.go:191] Error syncing pod 40ad3299-8676-4f1f-a314-c139b58a3e50 ("metrics-server-9975d5f86-5k9lw_kube-system(40ad3299-8676-4f1f-a314-c139b58a3e50)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0818 19:34:18.658792 365394 out.go:270] Aug 18 19:33:59 old-k8s-version-216078 kubelet[659]: E0818 19:33:59.740109 659 pod_workers.go:191] Error syncing pod 8c3c11f9-c5cc-46fd-af21-f01b7f474e46 ("dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"
Aug 18 19:33:59 old-k8s-version-216078 kubelet[659]: E0818 19:33:59.740109 659 pod_workers.go:191] Error syncing pod 8c3c11f9-c5cc-46fd-af21-f01b7f474e46 ("dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"
W0818 19:34:18.658809 365394 out.go:270] Aug 18 19:34:02 old-k8s-version-216078 kubelet[659]: E0818 19:34:02.740456 659 pod_workers.go:191] Error syncing pod 40ad3299-8676-4f1f-a314-c139b58a3e50 ("metrics-server-9975d5f86-5k9lw_kube-system(40ad3299-8676-4f1f-a314-c139b58a3e50)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Aug 18 19:34:02 old-k8s-version-216078 kubelet[659]: E0818 19:34:02.740456 659 pod_workers.go:191] Error syncing pod 40ad3299-8676-4f1f-a314-c139b58a3e50 ("metrics-server-9975d5f86-5k9lw_kube-system(40ad3299-8676-4f1f-a314-c139b58a3e50)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0818 19:34:18.658836 365394 out.go:270] Aug 18 19:34:10 old-k8s-version-216078 kubelet[659]: E0818 19:34:10.740182 659 pod_workers.go:191] Error syncing pod 8c3c11f9-c5cc-46fd-af21-f01b7f474e46 ("dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"
Aug 18 19:34:10 old-k8s-version-216078 kubelet[659]: E0818 19:34:10.740182 659 pod_workers.go:191] Error syncing pod 8c3c11f9-c5cc-46fd-af21-f01b7f474e46 ("dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"
W0818 19:34:18.658848 365394 out.go:270] Aug 18 19:34:15 old-k8s-version-216078 kubelet[659]: E0818 19:34:15.741175 659 pod_workers.go:191] Error syncing pod 40ad3299-8676-4f1f-a314-c139b58a3e50 ("metrics-server-9975d5f86-5k9lw_kube-system(40ad3299-8676-4f1f-a314-c139b58a3e50)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Aug 18 19:34:15 old-k8s-version-216078 kubelet[659]: E0818 19:34:15.741175 659 pod_workers.go:191] Error syncing pod 40ad3299-8676-4f1f-a314-c139b58a3e50 ("metrics-server-9975d5f86-5k9lw_kube-system(40ad3299-8676-4f1f-a314-c139b58a3e50)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
I0818 19:34:18.658864 365394 out.go:358] Setting ErrFile to fd 2...
I0818 19:34:18.658873 365394 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0818 19:34:28.659657 365394 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0818 19:34:28.677401 365394 api_server.go:72] duration metric: took 6m4.945994591s to wait for apiserver process to appear ...
I0818 19:34:28.677425 365394 api_server.go:88] waiting for apiserver healthz status ...
I0818 19:34:28.679981 365394 out.go:201]
W0818 19:34:28.681909 365394 out.go:270] X Exiting due to GUEST_START: failed to start node: wait 6m0s for node: wait for healthy API server: apiserver healthz never reported healthy: cluster wait timed out during healthz check
X Exiting due to GUEST_START: failed to start node: wait 6m0s for node: wait for healthy API server: apiserver healthz never reported healthy: cluster wait timed out during healthz check
W0818 19:34:28.681926 365394 out.go:270] *
*
W0818 19:34:28.682790 365394 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0818 19:34:28.684398 365394 out.go:201]
** /stderr **
start_stop_delete_test.go:259: failed to start minikube post-stop. args "out/minikube-linux-arm64 start -p old-k8s-version-216078 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=containerd --kubernetes-version=v1.20.0": exit status 80
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: docker inspect <======
helpers_test.go:231: (dbg) Run: docker inspect old-k8s-version-216078
helpers_test.go:235: (dbg) docker inspect old-k8s-version-216078:
-- stdout --
[
{
"Id": "4027f4b33bb4ca37c406698bb1856a2f1c16a4c18c58d19b3d099d0206277db7",
"Created": "2024-08-18T19:25:29.097327473Z",
"Path": "/usr/local/bin/entrypoint",
"Args": [
"/sbin/init"
],
"State": {
"Status": "running",
"Running": true,
"Paused": false,
"Restarting": false,
"OOMKilled": false,
"Dead": false,
"Pid": 365591,
"ExitCode": 0,
"Error": "",
"StartedAt": "2024-08-18T19:28:16.864292841Z",
"FinishedAt": "2024-08-18T19:28:15.64235168Z"
},
"Image": "sha256:decdd59746a9dba10062a73f6cd4b910c7b4e60613660b1022f8357747681c4d",
"ResolvConfPath": "/var/lib/docker/containers/4027f4b33bb4ca37c406698bb1856a2f1c16a4c18c58d19b3d099d0206277db7/resolv.conf",
"HostnamePath": "/var/lib/docker/containers/4027f4b33bb4ca37c406698bb1856a2f1c16a4c18c58d19b3d099d0206277db7/hostname",
"HostsPath": "/var/lib/docker/containers/4027f4b33bb4ca37c406698bb1856a2f1c16a4c18c58d19b3d099d0206277db7/hosts",
"LogPath": "/var/lib/docker/containers/4027f4b33bb4ca37c406698bb1856a2f1c16a4c18c58d19b3d099d0206277db7/4027f4b33bb4ca37c406698bb1856a2f1c16a4c18c58d19b3d099d0206277db7-json.log",
"Name": "/old-k8s-version-216078",
"RestartCount": 0,
"Driver": "overlay2",
"Platform": "linux",
"MountLabel": "",
"ProcessLabel": "",
"AppArmorProfile": "unconfined",
"ExecIDs": null,
"HostConfig": {
"Binds": [
"/lib/modules:/lib/modules:ro",
"old-k8s-version-216078:/var"
],
"ContainerIDFile": "",
"LogConfig": {
"Type": "json-file",
"Config": {}
},
"NetworkMode": "old-k8s-version-216078",
"PortBindings": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
]
},
"RestartPolicy": {
"Name": "no",
"MaximumRetryCount": 0
},
"AutoRemove": false,
"VolumeDriver": "",
"VolumesFrom": null,
"ConsoleSize": [
0,
0
],
"CapAdd": null,
"CapDrop": null,
"CgroupnsMode": "host",
"Dns": [],
"DnsOptions": [],
"DnsSearch": [],
"ExtraHosts": null,
"GroupAdd": null,
"IpcMode": "private",
"Cgroup": "",
"Links": null,
"OomScoreAdj": 0,
"PidMode": "",
"Privileged": true,
"PublishAllPorts": false,
"ReadonlyRootfs": false,
"SecurityOpt": [
"seccomp=unconfined",
"apparmor=unconfined",
"label=disable"
],
"Tmpfs": {
"/run": "",
"/tmp": ""
},
"UTSMode": "",
"UsernsMode": "",
"ShmSize": 67108864,
"Runtime": "runc",
"Isolation": "",
"CpuShares": 0,
"Memory": 2306867200,
"NanoCpus": 2000000000,
"CgroupParent": "",
"BlkioWeight": 0,
"BlkioWeightDevice": [],
"BlkioDeviceReadBps": [],
"BlkioDeviceWriteBps": [],
"BlkioDeviceReadIOps": [],
"BlkioDeviceWriteIOps": [],
"CpuPeriod": 0,
"CpuQuota": 0,
"CpuRealtimePeriod": 0,
"CpuRealtimeRuntime": 0,
"CpusetCpus": "",
"CpusetMems": "",
"Devices": [],
"DeviceCgroupRules": null,
"DeviceRequests": null,
"MemoryReservation": 0,
"MemorySwap": 4613734400,
"MemorySwappiness": null,
"OomKillDisable": false,
"PidsLimit": null,
"Ulimits": [],
"CpuCount": 0,
"CpuPercent": 0,
"IOMaximumIOps": 0,
"IOMaximumBandwidth": 0,
"MaskedPaths": null,
"ReadonlyPaths": null
},
"GraphDriver": {
"Data": {
"LowerDir": "/var/lib/docker/overlay2/8b105a9abeb464767bfe46c6063ee3ad96eb77ff9bfff6d4de991537b2d4e1da-init/diff:/var/lib/docker/overlay2/335569924eb2f5a2927a3aad525f5945de522a21e4174960fd450e8e86ba9355/diff",
"MergedDir": "/var/lib/docker/overlay2/8b105a9abeb464767bfe46c6063ee3ad96eb77ff9bfff6d4de991537b2d4e1da/merged",
"UpperDir": "/var/lib/docker/overlay2/8b105a9abeb464767bfe46c6063ee3ad96eb77ff9bfff6d4de991537b2d4e1da/diff",
"WorkDir": "/var/lib/docker/overlay2/8b105a9abeb464767bfe46c6063ee3ad96eb77ff9bfff6d4de991537b2d4e1da/work"
},
"Name": "overlay2"
},
"Mounts": [
{
"Type": "bind",
"Source": "/lib/modules",
"Destination": "/lib/modules",
"Mode": "ro",
"RW": false,
"Propagation": "rprivate"
},
{
"Type": "volume",
"Name": "old-k8s-version-216078",
"Source": "/var/lib/docker/volumes/old-k8s-version-216078/_data",
"Destination": "/var",
"Driver": "local",
"Mode": "z",
"RW": true,
"Propagation": ""
}
],
"Config": {
"Hostname": "old-k8s-version-216078",
"Domainname": "",
"User": "",
"AttachStdin": false,
"AttachStdout": false,
"AttachStderr": false,
"ExposedPorts": {
"22/tcp": {},
"2376/tcp": {},
"32443/tcp": {},
"5000/tcp": {},
"8443/tcp": {}
},
"Tty": true,
"OpenStdin": false,
"StdinOnce": false,
"Env": [
"container=docker",
"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
],
"Cmd": null,
"Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723740748-19452@sha256:2211a6931895d2d502e957e9667096db10734a96767d670cb4dbffdd37397b0d",
"Volumes": null,
"WorkingDir": "/",
"Entrypoint": [
"/usr/local/bin/entrypoint",
"/sbin/init"
],
"OnBuild": null,
"Labels": {
"created_by.minikube.sigs.k8s.io": "true",
"mode.minikube.sigs.k8s.io": "old-k8s-version-216078",
"name.minikube.sigs.k8s.io": "old-k8s-version-216078",
"role.minikube.sigs.k8s.io": ""
},
"StopSignal": "SIGRTMIN+3"
},
"NetworkSettings": {
"Bridge": "",
"SandboxID": "65978f536a4bcac74dcd69df859c07c200cfa78882d13bf6e736112c109a6bcd",
"SandboxKey": "/var/run/docker/netns/65978f536a4b",
"Ports": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "38614"
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "38615"
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "38618"
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "38616"
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "38617"
}
]
},
"HairpinMode": false,
"LinkLocalIPv6Address": "",
"LinkLocalIPv6PrefixLen": 0,
"SecondaryIPAddresses": null,
"SecondaryIPv6Addresses": null,
"EndpointID": "",
"Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"IPAddress": "",
"IPPrefixLen": 0,
"IPv6Gateway": "",
"MacAddress": "",
"Networks": {
"old-k8s-version-216078": {
"IPAMConfig": {
"IPv4Address": "192.168.76.2"
},
"Links": null,
"Aliases": null,
"MacAddress": "02:42:c0:a8:4c:02",
"DriverOpts": null,
"NetworkID": "ecefefb0f0941da8d1c771dd876ea88ec636acf09d04e88b8b772411019d4e9f",
"EndpointID": "ef8c5a035f526ece98584f2b4e128d03177684e2120a9131b4a4b02b9b2a0f64",
"Gateway": "192.168.76.1",
"IPAddress": "192.168.76.2",
"IPPrefixLen": 24,
"IPv6Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"DNSNames": [
"old-k8s-version-216078",
"4027f4b33bb4"
]
}
}
}
}
]
-- /stdout --
helpers_test.go:239: (dbg) Run: out/minikube-linux-arm64 status --format={{.Host}} -p old-k8s-version-216078 -n old-k8s-version-216078
helpers_test.go:244: <<< TestStartStop/group/old-k8s-version/serial/SecondStart FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: minikube logs <======
helpers_test.go:247: (dbg) Run: out/minikube-linux-arm64 -p old-k8s-version-216078 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-arm64 -p old-k8s-version-216078 logs -n 25: (2.858493374s)
helpers_test.go:252: TestStartStop/group/old-k8s-version/serial/SecondStart logs:
-- stdout --
==> Audit <==
|---------|--------------------------------------------------------|--------------------------|---------|---------|---------------------|---------------------|
| Command | Args | Profile | User | Version | Start Time | End Time |
|---------|--------------------------------------------------------|--------------------------|---------|---------|---------------------|---------------------|
| start | -p cert-expiration-045829 | cert-expiration-045829 | jenkins | v1.33.1 | 18 Aug 24 19:24 UTC | 18 Aug 24 19:24 UTC |
| | --memory=2048 | | | | | |
| | --cert-expiration=3m | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| ssh | force-systemd-env-467857 | force-systemd-env-467857 | jenkins | v1.33.1 | 18 Aug 24 19:24 UTC | 18 Aug 24 19:24 UTC |
| | ssh cat | | | | | |
| | /etc/containerd/config.toml | | | | | |
| delete | -p force-systemd-env-467857 | force-systemd-env-467857 | jenkins | v1.33.1 | 18 Aug 24 19:24 UTC | 18 Aug 24 19:24 UTC |
| start | -p cert-options-562344 | cert-options-562344 | jenkins | v1.33.1 | 18 Aug 24 19:24 UTC | 18 Aug 24 19:25 UTC |
| | --memory=2048 | | | | | |
| | --apiserver-ips=127.0.0.1 | | | | | |
| | --apiserver-ips=192.168.15.15 | | | | | |
| | --apiserver-names=localhost | | | | | |
| | --apiserver-names=www.google.com | | | | | |
| | --apiserver-port=8555 | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| ssh | cert-options-562344 ssh | cert-options-562344 | jenkins | v1.33.1 | 18 Aug 24 19:25 UTC | 18 Aug 24 19:25 UTC |
| | openssl x509 -text -noout -in | | | | | |
| | /var/lib/minikube/certs/apiserver.crt | | | | | |
| ssh | -p cert-options-562344 -- sudo | cert-options-562344 | jenkins | v1.33.1 | 18 Aug 24 19:25 UTC | 18 Aug 24 19:25 UTC |
| | cat /etc/kubernetes/admin.conf | | | | | |
| delete | -p cert-options-562344 | cert-options-562344 | jenkins | v1.33.1 | 18 Aug 24 19:25 UTC | 18 Aug 24 19:25 UTC |
| start | -p old-k8s-version-216078 | old-k8s-version-216078 | jenkins | v1.33.1 | 18 Aug 24 19:25 UTC | 18 Aug 24 19:27 UTC |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --kvm-network=default | | | | | |
| | --kvm-qemu-uri=qemu:///system | | | | | |
| | --disable-driver-mounts | | | | | |
| | --keep-context=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --kubernetes-version=v1.20.0 | | | | | |
| start | -p cert-expiration-045829 | cert-expiration-045829 | jenkins | v1.33.1 | 18 Aug 24 19:27 UTC | 18 Aug 24 19:28 UTC |
| | --memory=2048 | | | | | |
| | --cert-expiration=8760h | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| delete | -p cert-expiration-045829 | cert-expiration-045829 | jenkins | v1.33.1 | 18 Aug 24 19:28 UTC | 18 Aug 24 19:28 UTC |
| addons | enable metrics-server -p old-k8s-version-216078 | old-k8s-version-216078 | jenkins | v1.33.1 | 18 Aug 24 19:28 UTC | 18 Aug 24 19:28 UTC |
| | --images=MetricsServer=registry.k8s.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| stop | -p old-k8s-version-216078 | old-k8s-version-216078 | jenkins | v1.33.1 | 18 Aug 24 19:28 UTC | 18 Aug 24 19:28 UTC |
| | --alsologtostderr -v=3 | | | | | |
| start | -p no-preload-091348 | no-preload-091348 | jenkins | v1.33.1 | 18 Aug 24 19:28 UTC | 18 Aug 24 19:29 UTC |
| | --memory=2200 | | | | | |
| | --alsologtostderr | | | | | |
| | --wait=true --preload=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --kubernetes-version=v1.31.0 | | | | | |
| addons | enable dashboard -p old-k8s-version-216078 | old-k8s-version-216078 | jenkins | v1.33.1 | 18 Aug 24 19:28 UTC | 18 Aug 24 19:28 UTC |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| start | -p old-k8s-version-216078 | old-k8s-version-216078 | jenkins | v1.33.1 | 18 Aug 24 19:28 UTC | |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --kvm-network=default | | | | | |
| | --kvm-qemu-uri=qemu:///system | | | | | |
| | --disable-driver-mounts | | | | | |
| | --keep-context=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --kubernetes-version=v1.20.0 | | | | | |
| addons | enable metrics-server -p no-preload-091348 | no-preload-091348 | jenkins | v1.33.1 | 18 Aug 24 19:29 UTC | 18 Aug 24 19:29 UTC |
| | --images=MetricsServer=registry.k8s.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| stop | -p no-preload-091348 | no-preload-091348 | jenkins | v1.33.1 | 18 Aug 24 19:29 UTC | 18 Aug 24 19:29 UTC |
| | --alsologtostderr -v=3 | | | | | |
| addons | enable dashboard -p no-preload-091348 | no-preload-091348 | jenkins | v1.33.1 | 18 Aug 24 19:29 UTC | 18 Aug 24 19:29 UTC |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| start | -p no-preload-091348 | no-preload-091348 | jenkins | v1.33.1 | 18 Aug 24 19:29 UTC | 18 Aug 24 19:34 UTC |
| | --memory=2200 | | | | | |
| | --alsologtostderr | | | | | |
| | --wait=true --preload=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --kubernetes-version=v1.31.0 | | | | | |
| image | no-preload-091348 image list | no-preload-091348 | jenkins | v1.33.1 | 18 Aug 24 19:34 UTC | 18 Aug 24 19:34 UTC |
| | --format=json | | | | | |
| pause | -p no-preload-091348 | no-preload-091348 | jenkins | v1.33.1 | 18 Aug 24 19:34 UTC | 18 Aug 24 19:34 UTC |
| | --alsologtostderr -v=1 | | | | | |
| unpause | -p no-preload-091348 | no-preload-091348 | jenkins | v1.33.1 | 18 Aug 24 19:34 UTC | 18 Aug 24 19:34 UTC |
| | --alsologtostderr -v=1 | | | | | |
| delete | -p no-preload-091348 | no-preload-091348 | jenkins | v1.33.1 | 18 Aug 24 19:34 UTC | 18 Aug 24 19:34 UTC |
| delete | -p no-preload-091348 | no-preload-091348 | jenkins | v1.33.1 | 18 Aug 24 19:34 UTC | 18 Aug 24 19:34 UTC |
| start | -p embed-certs-568075 | embed-certs-568075 | jenkins | v1.33.1 | 18 Aug 24 19:34 UTC | |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --embed-certs --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --kubernetes-version=v1.31.0 | | | | | |
|---------|--------------------------------------------------------|--------------------------|---------|---------|---------------------|---------------------|
==> Last Start <==
Log file created at: 2024/08/18 19:34:18
Running on machine: ip-172-31-31-251
Binary: Built with gc go1.22.5 for linux/arm64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I0818 19:34:18.832528 376647 out.go:345] Setting OutFile to fd 1 ...
I0818 19:34:18.832660 376647 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0818 19:34:18.832670 376647 out.go:358] Setting ErrFile to fd 2...
I0818 19:34:18.832676 376647 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0818 19:34:18.832937 376647 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19423-154159/.minikube/bin
I0818 19:34:18.833346 376647 out.go:352] Setting JSON to false
I0818 19:34:18.834364 376647 start.go:129] hostinfo: {"hostname":"ip-172-31-31-251","uptime":101803,"bootTime":1723907856,"procs":224,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1067-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"982e3628-3742-4b3e-bb63-ac1b07660ec7"}
I0818 19:34:18.834440 376647 start.go:139] virtualization:
I0818 19:34:18.837321 376647 out.go:177] * [embed-certs-568075] minikube v1.33.1 on Ubuntu 20.04 (arm64)
I0818 19:34:18.840342 376647 out.go:177] - MINIKUBE_LOCATION=19423
I0818 19:34:18.840591 376647 notify.go:220] Checking for updates...
I0818 19:34:18.845265 376647 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0818 19:34:18.847003 376647 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/19423-154159/kubeconfig
I0818 19:34:18.848846 376647 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/19423-154159/.minikube
I0818 19:34:18.850914 376647 out.go:177] - MINIKUBE_BIN=out/minikube-linux-arm64
I0818 19:34:18.852853 376647 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0818 19:34:18.855777 376647 config.go:182] Loaded profile config "old-k8s-version-216078": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0
I0818 19:34:18.855929 376647 driver.go:394] Setting default libvirt URI to qemu:///system
I0818 19:34:18.889488 376647 docker.go:123] docker version: linux-27.1.2:Docker Engine - Community
I0818 19:34:18.889618 376647 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0818 19:34:18.960327 376647 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:35 OomKillDisable:true NGoroutines:53 SystemTime:2024-08-18 19:34:18.949655128 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1067-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214896640 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:27.1.2 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:8fc6bcff51318944179630522a095cc9dbf9f353 Expected:8fc6bcff51318944179630522a095cc9dbf9f353} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.16.2] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.1]] Warnings:<nil>}}
I0818 19:34:18.960448 376647 docker.go:307] overlay module found
I0818 19:34:18.962717 376647 out.go:177] * Using the docker driver based on user configuration
I0818 19:34:18.964523 376647 start.go:297] selected driver: docker
I0818 19:34:18.964548 376647 start.go:901] validating driver "docker" against <nil>
I0818 19:34:18.964562 376647 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0818 19:34:18.965279 376647 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0818 19:34:19.023395 376647 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:35 OomKillDisable:true NGoroutines:53 SystemTime:2024-08-18 19:34:19.013448219 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1067-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214896640 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:27.1.2 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:8fc6bcff51318944179630522a095cc9dbf9f353 Expected:8fc6bcff51318944179630522a095cc9dbf9f353} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.16.2] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.1]] Warnings:<nil>}}
I0818 19:34:19.023584 376647 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0818 19:34:19.023866 376647 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0818 19:34:19.025861 376647 out.go:177] * Using Docker driver with root privileges
I0818 19:34:19.027969 376647 cni.go:84] Creating CNI manager for ""
I0818 19:34:19.027994 376647 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0818 19:34:19.028011 376647 start_flags.go:319] Found "CNI" CNI - setting NetworkPlugin=cni
I0818 19:34:19.028107 376647 start.go:340] cluster config:
{Name:embed-certs-568075 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723740748-19452@sha256:2211a6931895d2d502e957e9667096db10734a96767d670cb4dbffdd37397b0d Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:embed-certs-568075 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Contain
erRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: Stati
cIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0818 19:34:19.029970 376647 out.go:177] * Starting "embed-certs-568075" primary control-plane node in "embed-certs-568075" cluster
I0818 19:34:19.031860 376647 cache.go:121] Beginning downloading kic base image for docker with containerd
I0818 19:34:19.033360 376647 out.go:177] * Pulling base image v0.0.44-1723740748-19452 ...
I0818 19:34:19.035317 376647 preload.go:131] Checking if preload exists for k8s version v1.31.0 and runtime containerd
I0818 19:34:19.035379 376647 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19423-154159/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-containerd-overlay2-arm64.tar.lz4
I0818 19:34:19.035390 376647 cache.go:56] Caching tarball of preloaded images
I0818 19:34:19.035398 376647 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723740748-19452@sha256:2211a6931895d2d502e957e9667096db10734a96767d670cb4dbffdd37397b0d in local docker daemon
I0818 19:34:19.035474 376647 preload.go:172] Found /home/jenkins/minikube-integration/19423-154159/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-containerd-overlay2-arm64.tar.lz4 in cache, skipping download
I0818 19:34:19.035485 376647 cache.go:59] Finished verifying existence of preloaded tar for v1.31.0 on containerd
I0818 19:34:19.035592 376647 profile.go:143] Saving config to /home/jenkins/minikube-integration/19423-154159/.minikube/profiles/embed-certs-568075/config.json ...
I0818 19:34:19.035614 376647 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19423-154159/.minikube/profiles/embed-certs-568075/config.json: {Name:mk682197b18358175a74e249f8d7f83acb1daf7e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
W0818 19:34:19.054758 376647 image.go:95] image gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723740748-19452@sha256:2211a6931895d2d502e957e9667096db10734a96767d670cb4dbffdd37397b0d is of wrong architecture
I0818 19:34:19.054782 376647 cache.go:149] Downloading gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723740748-19452@sha256:2211a6931895d2d502e957e9667096db10734a96767d670cb4dbffdd37397b0d to local cache
I0818 19:34:19.054852 376647 image.go:63] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723740748-19452@sha256:2211a6931895d2d502e957e9667096db10734a96767d670cb4dbffdd37397b0d in local cache directory
I0818 19:34:19.054875 376647 image.go:66] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723740748-19452@sha256:2211a6931895d2d502e957e9667096db10734a96767d670cb4dbffdd37397b0d in local cache directory, skipping pull
I0818 19:34:19.054885 376647 image.go:135] gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723740748-19452@sha256:2211a6931895d2d502e957e9667096db10734a96767d670cb4dbffdd37397b0d exists in cache, skipping pull
I0818 19:34:19.054893 376647 cache.go:152] successfully saved gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723740748-19452@sha256:2211a6931895d2d502e957e9667096db10734a96767d670cb4dbffdd37397b0d as a tarball
I0818 19:34:19.054902 376647 cache.go:162] Loading gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723740748-19452@sha256:2211a6931895d2d502e957e9667096db10734a96767d670cb4dbffdd37397b0d from local cache
I0818 19:34:19.189978 376647 cache.go:164] successfully loaded and using gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723740748-19452@sha256:2211a6931895d2d502e957e9667096db10734a96767d670cb4dbffdd37397b0d from cached tarball
I0818 19:34:19.190022 376647 cache.go:194] Successfully downloaded all kic artifacts
I0818 19:34:19.190059 376647 start.go:360] acquireMachinesLock for embed-certs-568075: {Name:mkc9849c557d3f200fc5aa91646d695933a9517a Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0818 19:34:19.190983 376647 start.go:364] duration metric: took 897.465µs to acquireMachinesLock for "embed-certs-568075"
I0818 19:34:19.191034 376647 start.go:93] Provisioning new machine with config: &{Name:embed-certs-568075 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723740748-19452@sha256:2211a6931895d2d502e957e9667096db10734a96767d670cb4dbffdd37397b0d Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:embed-certs-568075 Namespace:default APIServerHAVIP: APIServe
rName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableM
etrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:containerd ControlPlane:true Worker:true}
I0818 19:34:19.191124 376647 start.go:125] createHost starting for "" (driver="docker")
I0818 19:34:16.332699 365394 cri.go:89] found id: "03fbfc746eafcd2d037579ee9352ca8a230e2d686179a89c453eeae19ba4b178"
I0818 19:34:16.332722 365394 cri.go:89] found id: "dac35e1e30e3e5a45ee7083d88bb89388a2e328ba629d84ddaa0317c718721e1"
I0818 19:34:16.332727 365394 cri.go:89] found id: ""
I0818 19:34:16.332749 365394 logs.go:276] 2 containers: [03fbfc746eafcd2d037579ee9352ca8a230e2d686179a89c453eeae19ba4b178 dac35e1e30e3e5a45ee7083d88bb89388a2e328ba629d84ddaa0317c718721e1]
I0818 19:34:16.332805 365394 ssh_runner.go:195] Run: which crictl
I0818 19:34:16.338994 365394 ssh_runner.go:195] Run: which crictl
I0818 19:34:16.347143 365394 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
I0818 19:34:16.347323 365394 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0818 19:34:16.414776 365394 cri.go:89] found id: "9cb4a0a17af824f66e9d214beb9b26be48e63a6e4f9896caf75d310dbc8cd195"
I0818 19:34:16.414802 365394 cri.go:89] found id: "f7dac504cb498237ca5f7b6a524527cefe7917920a3d413a7c4cd970c819a894"
I0818 19:34:16.414812 365394 cri.go:89] found id: ""
I0818 19:34:16.414823 365394 logs.go:276] 2 containers: [9cb4a0a17af824f66e9d214beb9b26be48e63a6e4f9896caf75d310dbc8cd195 f7dac504cb498237ca5f7b6a524527cefe7917920a3d413a7c4cd970c819a894]
I0818 19:34:16.414925 365394 ssh_runner.go:195] Run: which crictl
I0818 19:34:16.422222 365394 ssh_runner.go:195] Run: which crictl
I0818 19:34:16.428687 365394 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
I0818 19:34:16.428787 365394 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0818 19:34:16.509373 365394 cri.go:89] found id: "3f55d380c20ce8abf819eb90f1107f99b6883a3af7d8b0c875d12639b6f5a1a4"
I0818 19:34:16.509418 365394 cri.go:89] found id: "c1f327db25afffcb7632d994277e73b15d44e051118ecff71b21299a38bcbe10"
I0818 19:34:16.509429 365394 cri.go:89] found id: ""
I0818 19:34:16.509438 365394 logs.go:276] 2 containers: [3f55d380c20ce8abf819eb90f1107f99b6883a3af7d8b0c875d12639b6f5a1a4 c1f327db25afffcb7632d994277e73b15d44e051118ecff71b21299a38bcbe10]
I0818 19:34:16.509519 365394 ssh_runner.go:195] Run: which crictl
I0818 19:34:16.515307 365394 ssh_runner.go:195] Run: which crictl
I0818 19:34:16.519719 365394 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
I0818 19:34:16.519907 365394 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0818 19:34:16.598251 365394 cri.go:89] found id: "d9c85aaaa043f149f3f6daad7c932a643b6619f4c4cb7755b152310052480f6f"
I0818 19:34:16.598273 365394 cri.go:89] found id: "905b265420907d5b4b8ee43b00a698a67557ffce65488b60828117b20fde26b1"
I0818 19:34:16.598278 365394 cri.go:89] found id: ""
I0818 19:34:16.598289 365394 logs.go:276] 2 containers: [d9c85aaaa043f149f3f6daad7c932a643b6619f4c4cb7755b152310052480f6f 905b265420907d5b4b8ee43b00a698a67557ffce65488b60828117b20fde26b1]
I0818 19:34:16.598352 365394 ssh_runner.go:195] Run: which crictl
I0818 19:34:16.605307 365394 ssh_runner.go:195] Run: which crictl
I0818 19:34:16.611188 365394 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
I0818 19:34:16.611266 365394 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0818 19:34:16.674927 365394 cri.go:89] found id: "6b77034b70c13c794e7e71994e90063cf36dd1fa6cbe8d1784b7ceee707c9aca"
I0818 19:34:16.674951 365394 cri.go:89] found id: "00fecac5b274921d65e34f858a2d0fb18402e84618ee482b50df18739b0495ad"
I0818 19:34:16.674957 365394 cri.go:89] found id: ""
I0818 19:34:16.674965 365394 logs.go:276] 2 containers: [6b77034b70c13c794e7e71994e90063cf36dd1fa6cbe8d1784b7ceee707c9aca 00fecac5b274921d65e34f858a2d0fb18402e84618ee482b50df18739b0495ad]
I0818 19:34:16.675024 365394 ssh_runner.go:195] Run: which crictl
I0818 19:34:16.679400 365394 ssh_runner.go:195] Run: which crictl
I0818 19:34:16.682802 365394 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
I0818 19:34:16.682868 365394 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0818 19:34:16.728600 365394 cri.go:89] found id: "136b3774b3686f0bcd42b41a696212f7023654f7c9a799d192302697dae329d1"
I0818 19:34:16.728621 365394 cri.go:89] found id: "80ee1e729513b71685fa053c5499a375152679a2ba2012d6cc5008ba2faab62c"
I0818 19:34:16.728626 365394 cri.go:89] found id: ""
I0818 19:34:16.728633 365394 logs.go:276] 2 containers: [136b3774b3686f0bcd42b41a696212f7023654f7c9a799d192302697dae329d1 80ee1e729513b71685fa053c5499a375152679a2ba2012d6cc5008ba2faab62c]
I0818 19:34:16.728692 365394 ssh_runner.go:195] Run: which crictl
I0818 19:34:16.732280 365394 ssh_runner.go:195] Run: which crictl
I0818 19:34:16.735563 365394 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
I0818 19:34:16.735678 365394 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0818 19:34:16.776231 365394 cri.go:89] found id: "35e10341a264471c2a4ba4fc06d275735b1230d24e7fa77bea16c30257e91109"
I0818 19:34:16.776254 365394 cri.go:89] found id: "48b1e06eab89513ac1b65a73dd1d7880d6028031dc94ee400b4ceb77169245aa"
I0818 19:34:16.776259 365394 cri.go:89] found id: ""
I0818 19:34:16.776267 365394 logs.go:276] 2 containers: [35e10341a264471c2a4ba4fc06d275735b1230d24e7fa77bea16c30257e91109 48b1e06eab89513ac1b65a73dd1d7880d6028031dc94ee400b4ceb77169245aa]
I0818 19:34:16.776324 365394 ssh_runner.go:195] Run: which crictl
I0818 19:34:16.779901 365394 ssh_runner.go:195] Run: which crictl
I0818 19:34:16.783067 365394 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
I0818 19:34:16.783149 365394 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I0818 19:34:16.825413 365394 cri.go:89] found id: "aea462f9a5614878af08a599d3ec3ce490ef7ff8d286df3bad62c54b80d55394"
I0818 19:34:16.825435 365394 cri.go:89] found id: ""
I0818 19:34:16.825444 365394 logs.go:276] 1 containers: [aea462f9a5614878af08a599d3ec3ce490ef7ff8d286df3bad62c54b80d55394]
I0818 19:34:16.825499 365394 ssh_runner.go:195] Run: which crictl
I0818 19:34:16.829000 365394 logs.go:123] Gathering logs for dmesg ...
I0818 19:34:16.829067 365394 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0818 19:34:16.845161 365394 logs.go:123] Gathering logs for etcd [03fbfc746eafcd2d037579ee9352ca8a230e2d686179a89c453eeae19ba4b178] ...
I0818 19:34:16.845193 365394 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 03fbfc746eafcd2d037579ee9352ca8a230e2d686179a89c453eeae19ba4b178"
I0818 19:34:16.899783 365394 logs.go:123] Gathering logs for kube-scheduler [3f55d380c20ce8abf819eb90f1107f99b6883a3af7d8b0c875d12639b6f5a1a4] ...
I0818 19:34:16.899919 365394 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 3f55d380c20ce8abf819eb90f1107f99b6883a3af7d8b0c875d12639b6f5a1a4"
I0818 19:34:16.941128 365394 logs.go:123] Gathering logs for kube-controller-manager [00fecac5b274921d65e34f858a2d0fb18402e84618ee482b50df18739b0495ad] ...
I0818 19:34:16.941168 365394 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 00fecac5b274921d65e34f858a2d0fb18402e84618ee482b50df18739b0495ad"
I0818 19:34:17.016362 365394 logs.go:123] Gathering logs for storage-provisioner [35e10341a264471c2a4ba4fc06d275735b1230d24e7fa77bea16c30257e91109] ...
I0818 19:34:17.016400 365394 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 35e10341a264471c2a4ba4fc06d275735b1230d24e7fa77bea16c30257e91109"
I0818 19:34:17.071278 365394 logs.go:123] Gathering logs for kubernetes-dashboard [aea462f9a5614878af08a599d3ec3ce490ef7ff8d286df3bad62c54b80d55394] ...
I0818 19:34:17.071318 365394 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 aea462f9a5614878af08a599d3ec3ce490ef7ff8d286df3bad62c54b80d55394"
I0818 19:34:17.148503 365394 logs.go:123] Gathering logs for kube-proxy [d9c85aaaa043f149f3f6daad7c932a643b6619f4c4cb7755b152310052480f6f] ...
I0818 19:34:17.148774 365394 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 d9c85aaaa043f149f3f6daad7c932a643b6619f4c4cb7755b152310052480f6f"
I0818 19:34:17.219704 365394 logs.go:123] Gathering logs for kube-proxy [905b265420907d5b4b8ee43b00a698a67557ffce65488b60828117b20fde26b1] ...
I0818 19:34:17.219728 365394 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 905b265420907d5b4b8ee43b00a698a67557ffce65488b60828117b20fde26b1"
I0818 19:34:17.276392 365394 logs.go:123] Gathering logs for kube-controller-manager [6b77034b70c13c794e7e71994e90063cf36dd1fa6cbe8d1784b7ceee707c9aca] ...
I0818 19:34:17.276421 365394 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 6b77034b70c13c794e7e71994e90063cf36dd1fa6cbe8d1784b7ceee707c9aca"
I0818 19:34:17.403147 365394 logs.go:123] Gathering logs for storage-provisioner [48b1e06eab89513ac1b65a73dd1d7880d6028031dc94ee400b4ceb77169245aa] ...
I0818 19:34:17.403183 365394 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 48b1e06eab89513ac1b65a73dd1d7880d6028031dc94ee400b4ceb77169245aa"
I0818 19:34:17.450187 365394 logs.go:123] Gathering logs for containerd ...
I0818 19:34:17.450216 365394 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
I0818 19:34:17.528357 365394 logs.go:123] Gathering logs for container status ...
I0818 19:34:17.528397 365394 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0818 19:34:17.619646 365394 logs.go:123] Gathering logs for kubelet ...
I0818 19:34:17.619677 365394 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0818 19:34:17.682312 365394 logs.go:138] Found kubelet problem: Aug 18 19:28:46 old-k8s-version-216078 kubelet[659]: E0818 19:28:46.116436 659 reflector.go:138] object-"kube-system"/"kube-proxy-token-gkhsq": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kube-proxy-token-gkhsq" is forbidden: User "system:node:old-k8s-version-216078" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-216078' and this object
W0818 19:34:17.682589 365394 logs.go:138] Found kubelet problem: Aug 18 19:28:46 old-k8s-version-216078 kubelet[659]: E0818 19:28:46.117472 659 reflector.go:138] object-"kube-system"/"coredns": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:old-k8s-version-216078" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-216078' and this object
W0818 19:34:17.682950 365394 logs.go:138] Found kubelet problem: Aug 18 19:28:46 old-k8s-version-216078 kubelet[659]: E0818 19:28:46.130723 659 reflector.go:138] object-"kube-system"/"storage-provisioner-token-jg9hx": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "storage-provisioner-token-jg9hx" is forbidden: User "system:node:old-k8s-version-216078" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-216078' and this object
W0818 19:34:17.683233 365394 logs.go:138] Found kubelet problem: Aug 18 19:28:46 old-k8s-version-216078 kubelet[659]: E0818 19:28:46.130814 659 reflector.go:138] object-"default"/"default-token-79mlg": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "default-token-79mlg" is forbidden: User "system:node:old-k8s-version-216078" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'old-k8s-version-216078' and this object
W0818 19:34:17.683613 365394 logs.go:138] Found kubelet problem: Aug 18 19:28:46 old-k8s-version-216078 kubelet[659]: E0818 19:28:46.137493 659 reflector.go:138] object-"kube-system"/"metrics-server-token-lkhr7": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "metrics-server-token-lkhr7" is forbidden: User "system:node:old-k8s-version-216078" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-216078' and this object
W0818 19:34:17.683926 365394 logs.go:138] Found kubelet problem: Aug 18 19:28:46 old-k8s-version-216078 kubelet[659]: E0818 19:28:46.137601 659 reflector.go:138] object-"kube-system"/"kindnet-token-pj6jq": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kindnet-token-pj6jq" is forbidden: User "system:node:old-k8s-version-216078" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-216078' and this object
W0818 19:34:17.684195 365394 logs.go:138] Found kubelet problem: Aug 18 19:28:46 old-k8s-version-216078 kubelet[659]: E0818 19:28:46.137667 659 reflector.go:138] object-"kube-system"/"coredns-token-tstz9": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "coredns-token-tstz9" is forbidden: User "system:node:old-k8s-version-216078" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-216078' and this object
W0818 19:34:17.684437 365394 logs.go:138] Found kubelet problem: Aug 18 19:28:46 old-k8s-version-216078 kubelet[659]: E0818 19:28:46.137736 659 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:old-k8s-version-216078" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-216078' and this object
W0818 19:34:17.694259 365394 logs.go:138] Found kubelet problem: Aug 18 19:28:49 old-k8s-version-216078 kubelet[659]: E0818 19:28:49.150627 659 pod_workers.go:191] Error syncing pod 40ad3299-8676-4f1f-a314-c139b58a3e50 ("metrics-server-9975d5f86-5k9lw_kube-system(40ad3299-8676-4f1f-a314-c139b58a3e50)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0818 19:34:17.694481 365394 logs.go:138] Found kubelet problem: Aug 18 19:28:49 old-k8s-version-216078 kubelet[659]: E0818 19:28:49.197339 659 pod_workers.go:191] Error syncing pod 40ad3299-8676-4f1f-a314-c139b58a3e50 ("metrics-server-9975d5f86-5k9lw_kube-system(40ad3299-8676-4f1f-a314-c139b58a3e50)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0818 19:34:17.698078 365394 logs.go:138] Found kubelet problem: Aug 18 19:28:59 old-k8s-version-216078 kubelet[659]: E0818 19:28:59.777587 659 pod_workers.go:191] Error syncing pod 40ad3299-8676-4f1f-a314-c139b58a3e50 ("metrics-server-9975d5f86-5k9lw_kube-system(40ad3299-8676-4f1f-a314-c139b58a3e50)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0818 19:34:17.700642 365394 logs.go:138] Found kubelet problem: Aug 18 19:29:11 old-k8s-version-216078 kubelet[659]: E0818 19:29:11.292167 659 pod_workers.go:191] Error syncing pod 8c3c11f9-c5cc-46fd-af21-f01b7f474e46 ("dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"
W0818 19:34:17.701410 365394 logs.go:138] Found kubelet problem: Aug 18 19:29:12 old-k8s-version-216078 kubelet[659]: E0818 19:29:12.336846 659 pod_workers.go:191] Error syncing pod 8c3c11f9-c5cc-46fd-af21-f01b7f474e46 ("dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"
W0818 19:34:17.701625 365394 logs.go:138] Found kubelet problem: Aug 18 19:29:14 old-k8s-version-216078 kubelet[659]: E0818 19:29:14.740520 659 pod_workers.go:191] Error syncing pod 40ad3299-8676-4f1f-a314-c139b58a3e50 ("metrics-server-9975d5f86-5k9lw_kube-system(40ad3299-8676-4f1f-a314-c139b58a3e50)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0818 19:34:17.702008 365394 logs.go:138] Found kubelet problem: Aug 18 19:29:17 old-k8s-version-216078 kubelet[659]: E0818 19:29:17.681494 659 pod_workers.go:191] Error syncing pod 8c3c11f9-c5cc-46fd-af21-f01b7f474e46 ("dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"
W0818 19:34:17.702525 365394 logs.go:138] Found kubelet problem: Aug 18 19:29:20 old-k8s-version-216078 kubelet[659]: E0818 19:29:20.366319 659 pod_workers.go:191] Error syncing pod b224ab7a-edb7-4ab4-9f31-ddafa7172d46 ("storage-provisioner_kube-system(b224ab7a-edb7-4ab4-9f31-ddafa7172d46)"), skipping: failed to "StartContainer" for "storage-provisioner" with CrashLoopBackOff: "back-off 10s restarting failed container=storage-provisioner pod=storage-provisioner_kube-system(b224ab7a-edb7-4ab4-9f31-ddafa7172d46)"
W0818 19:34:17.705773 365394 logs.go:138] Found kubelet problem: Aug 18 19:29:27 old-k8s-version-216078 kubelet[659]: E0818 19:29:27.748257 659 pod_workers.go:191] Error syncing pod 40ad3299-8676-4f1f-a314-c139b58a3e50 ("metrics-server-9975d5f86-5k9lw_kube-system(40ad3299-8676-4f1f-a314-c139b58a3e50)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0818 19:34:17.706438 365394 logs.go:138] Found kubelet problem: Aug 18 19:29:30 old-k8s-version-216078 kubelet[659]: E0818 19:29:30.417852 659 pod_workers.go:191] Error syncing pod 8c3c11f9-c5cc-46fd-af21-f01b7f474e46 ("dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"
W0818 19:34:17.706945 365394 logs.go:138] Found kubelet problem: Aug 18 19:29:37 old-k8s-version-216078 kubelet[659]: E0818 19:29:37.681274 659 pod_workers.go:191] Error syncing pod 8c3c11f9-c5cc-46fd-af21-f01b7f474e46 ("dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"
W0818 19:34:17.707162 365394 logs.go:138] Found kubelet problem: Aug 18 19:29:42 old-k8s-version-216078 kubelet[659]: E0818 19:29:42.772972 659 pod_workers.go:191] Error syncing pod 40ad3299-8676-4f1f-a314-c139b58a3e50 ("metrics-server-9975d5f86-5k9lw_kube-system(40ad3299-8676-4f1f-a314-c139b58a3e50)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0818 19:34:17.707534 365394 logs.go:138] Found kubelet problem: Aug 18 19:29:49 old-k8s-version-216078 kubelet[659]: E0818 19:29:49.740124 659 pod_workers.go:191] Error syncing pod 8c3c11f9-c5cc-46fd-af21-f01b7f474e46 ("dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"
W0818 19:34:17.707746 365394 logs.go:138] Found kubelet problem: Aug 18 19:29:56 old-k8s-version-216078 kubelet[659]: E0818 19:29:56.740480 659 pod_workers.go:191] Error syncing pod 40ad3299-8676-4f1f-a314-c139b58a3e50 ("metrics-server-9975d5f86-5k9lw_kube-system(40ad3299-8676-4f1f-a314-c139b58a3e50)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0818 19:34:17.708431 365394 logs.go:138] Found kubelet problem: Aug 18 19:30:01 old-k8s-version-216078 kubelet[659]: E0818 19:30:01.513179 659 pod_workers.go:191] Error syncing pod 8c3c11f9-c5cc-46fd-af21-f01b7f474e46 ("dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"
W0818 19:34:17.708780 365394 logs.go:138] Found kubelet problem: Aug 18 19:30:07 old-k8s-version-216078 kubelet[659]: E0818 19:30:07.681775 659 pod_workers.go:191] Error syncing pod 8c3c11f9-c5cc-46fd-af21-f01b7f474e46 ("dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"
W0818 19:34:17.711748 365394 logs.go:138] Found kubelet problem: Aug 18 19:30:10 old-k8s-version-216078 kubelet[659]: E0818 19:30:10.748586 659 pod_workers.go:191] Error syncing pod 40ad3299-8676-4f1f-a314-c139b58a3e50 ("metrics-server-9975d5f86-5k9lw_kube-system(40ad3299-8676-4f1f-a314-c139b58a3e50)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0818 19:34:17.712177 365394 logs.go:138] Found kubelet problem: Aug 18 19:30:21 old-k8s-version-216078 kubelet[659]: E0818 19:30:21.740932 659 pod_workers.go:191] Error syncing pod 8c3c11f9-c5cc-46fd-af21-f01b7f474e46 ("dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"
W0818 19:34:17.712387 365394 logs.go:138] Found kubelet problem: Aug 18 19:30:25 old-k8s-version-216078 kubelet[659]: E0818 19:30:25.740889 659 pod_workers.go:191] Error syncing pod 40ad3299-8676-4f1f-a314-c139b58a3e50 ("metrics-server-9975d5f86-5k9lw_kube-system(40ad3299-8676-4f1f-a314-c139b58a3e50)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0818 19:34:17.712748 365394 logs.go:138] Found kubelet problem: Aug 18 19:30:35 old-k8s-version-216078 kubelet[659]: E0818 19:30:35.740311 659 pod_workers.go:191] Error syncing pod 8c3c11f9-c5cc-46fd-af21-f01b7f474e46 ("dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"
W0818 19:34:17.712948 365394 logs.go:138] Found kubelet problem: Aug 18 19:30:37 old-k8s-version-216078 kubelet[659]: E0818 19:30:37.740695 659 pod_workers.go:191] Error syncing pod 40ad3299-8676-4f1f-a314-c139b58a3e50 ("metrics-server-9975d5f86-5k9lw_kube-system(40ad3299-8676-4f1f-a314-c139b58a3e50)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0818 19:34:17.713322 365394 logs.go:138] Found kubelet problem: Aug 18 19:30:50 old-k8s-version-216078 kubelet[659]: E0818 19:30:50.741003 659 pod_workers.go:191] Error syncing pod 40ad3299-8676-4f1f-a314-c139b58a3e50 ("metrics-server-9975d5f86-5k9lw_kube-system(40ad3299-8676-4f1f-a314-c139b58a3e50)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0818 19:34:17.713829 365394 logs.go:138] Found kubelet problem: Aug 18 19:30:51 old-k8s-version-216078 kubelet[659]: E0818 19:30:51.639933 659 pod_workers.go:191] Error syncing pod 8c3c11f9-c5cc-46fd-af21-f01b7f474e46 ("dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"
W0818 19:34:17.714214 365394 logs.go:138] Found kubelet problem: Aug 18 19:30:57 old-k8s-version-216078 kubelet[659]: E0818 19:30:57.681246 659 pod_workers.go:191] Error syncing pod 8c3c11f9-c5cc-46fd-af21-f01b7f474e46 ("dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"
W0818 19:34:17.714413 365394 logs.go:138] Found kubelet problem: Aug 18 19:31:05 old-k8s-version-216078 kubelet[659]: E0818 19:31:05.740483 659 pod_workers.go:191] Error syncing pod 40ad3299-8676-4f1f-a314-c139b58a3e50 ("metrics-server-9975d5f86-5k9lw_kube-system(40ad3299-8676-4f1f-a314-c139b58a3e50)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0818 19:34:17.714780 365394 logs.go:138] Found kubelet problem: Aug 18 19:31:10 old-k8s-version-216078 kubelet[659]: E0818 19:31:10.740145 659 pod_workers.go:191] Error syncing pod 8c3c11f9-c5cc-46fd-af21-f01b7f474e46 ("dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"
W0818 19:34:17.714995 365394 logs.go:138] Found kubelet problem: Aug 18 19:31:18 old-k8s-version-216078 kubelet[659]: E0818 19:31:18.740514 659 pod_workers.go:191] Error syncing pod 40ad3299-8676-4f1f-a314-c139b58a3e50 ("metrics-server-9975d5f86-5k9lw_kube-system(40ad3299-8676-4f1f-a314-c139b58a3e50)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0818 19:34:17.715393 365394 logs.go:138] Found kubelet problem: Aug 18 19:31:23 old-k8s-version-216078 kubelet[659]: E0818 19:31:23.744229 659 pod_workers.go:191] Error syncing pod 8c3c11f9-c5cc-46fd-af21-f01b7f474e46 ("dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"
W0818 19:34:17.715611 365394 logs.go:138] Found kubelet problem: Aug 18 19:31:29 old-k8s-version-216078 kubelet[659]: E0818 19:31:29.741416 659 pod_workers.go:191] Error syncing pod 40ad3299-8676-4f1f-a314-c139b58a3e50 ("metrics-server-9975d5f86-5k9lw_kube-system(40ad3299-8676-4f1f-a314-c139b58a3e50)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0818 19:34:17.716019 365394 logs.go:138] Found kubelet problem: Aug 18 19:31:38 old-k8s-version-216078 kubelet[659]: E0818 19:31:38.740103 659 pod_workers.go:191] Error syncing pod 8c3c11f9-c5cc-46fd-af21-f01b7f474e46 ("dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"
W0818 19:34:17.720670 365394 logs.go:138] Found kubelet problem: Aug 18 19:31:40 old-k8s-version-216078 kubelet[659]: E0818 19:31:40.747496 659 pod_workers.go:191] Error syncing pod 40ad3299-8676-4f1f-a314-c139b58a3e50 ("metrics-server-9975d5f86-5k9lw_kube-system(40ad3299-8676-4f1f-a314-c139b58a3e50)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0818 19:34:17.721103 365394 logs.go:138] Found kubelet problem: Aug 18 19:31:52 old-k8s-version-216078 kubelet[659]: E0818 19:31:52.740064 659 pod_workers.go:191] Error syncing pod 8c3c11f9-c5cc-46fd-af21-f01b7f474e46 ("dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"
W0818 19:34:17.721320 365394 logs.go:138] Found kubelet problem: Aug 18 19:31:52 old-k8s-version-216078 kubelet[659]: E0818 19:31:52.741572 659 pod_workers.go:191] Error syncing pod 40ad3299-8676-4f1f-a314-c139b58a3e50 ("metrics-server-9975d5f86-5k9lw_kube-system(40ad3299-8676-4f1f-a314-c139b58a3e50)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0818 19:34:17.721722 365394 logs.go:138] Found kubelet problem: Aug 18 19:32:04 old-k8s-version-216078 kubelet[659]: E0818 19:32:04.740152 659 pod_workers.go:191] Error syncing pod 8c3c11f9-c5cc-46fd-af21-f01b7f474e46 ("dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"
W0818 19:34:17.721938 365394 logs.go:138] Found kubelet problem: Aug 18 19:32:05 old-k8s-version-216078 kubelet[659]: E0818 19:32:05.740613 659 pod_workers.go:191] Error syncing pod 40ad3299-8676-4f1f-a314-c139b58a3e50 ("metrics-server-9975d5f86-5k9lw_kube-system(40ad3299-8676-4f1f-a314-c139b58a3e50)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0818 19:34:17.722165 365394 logs.go:138] Found kubelet problem: Aug 18 19:32:16 old-k8s-version-216078 kubelet[659]: E0818 19:32:16.740992 659 pod_workers.go:191] Error syncing pod 40ad3299-8676-4f1f-a314-c139b58a3e50 ("metrics-server-9975d5f86-5k9lw_kube-system(40ad3299-8676-4f1f-a314-c139b58a3e50)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0818 19:34:17.722842 365394 logs.go:138] Found kubelet problem: Aug 18 19:32:17 old-k8s-version-216078 kubelet[659]: E0818 19:32:17.876392 659 pod_workers.go:191] Error syncing pod 8c3c11f9-c5cc-46fd-af21-f01b7f474e46 ("dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"
W0818 19:34:17.723219 365394 logs.go:138] Found kubelet problem: Aug 18 19:32:27 old-k8s-version-216078 kubelet[659]: E0818 19:32:27.681615 659 pod_workers.go:191] Error syncing pod 8c3c11f9-c5cc-46fd-af21-f01b7f474e46 ("dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"
W0818 19:34:17.723422 365394 logs.go:138] Found kubelet problem: Aug 18 19:32:31 old-k8s-version-216078 kubelet[659]: E0818 19:32:31.743158 659 pod_workers.go:191] Error syncing pod 40ad3299-8676-4f1f-a314-c139b58a3e50 ("metrics-server-9975d5f86-5k9lw_kube-system(40ad3299-8676-4f1f-a314-c139b58a3e50)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0818 19:34:17.723815 365394 logs.go:138] Found kubelet problem: Aug 18 19:32:42 old-k8s-version-216078 kubelet[659]: E0818 19:32:42.740105 659 pod_workers.go:191] Error syncing pod 8c3c11f9-c5cc-46fd-af21-f01b7f474e46 ("dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"
W0818 19:34:17.724033 365394 logs.go:138] Found kubelet problem: Aug 18 19:32:45 old-k8s-version-216078 kubelet[659]: E0818 19:32:45.740578 659 pod_workers.go:191] Error syncing pod 40ad3299-8676-4f1f-a314-c139b58a3e50 ("metrics-server-9975d5f86-5k9lw_kube-system(40ad3299-8676-4f1f-a314-c139b58a3e50)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0818 19:34:17.724417 365394 logs.go:138] Found kubelet problem: Aug 18 19:32:57 old-k8s-version-216078 kubelet[659]: E0818 19:32:57.740499 659 pod_workers.go:191] Error syncing pod 8c3c11f9-c5cc-46fd-af21-f01b7f474e46 ("dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"
W0818 19:34:17.724633 365394 logs.go:138] Found kubelet problem: Aug 18 19:32:58 old-k8s-version-216078 kubelet[659]: E0818 19:32:58.740474 659 pod_workers.go:191] Error syncing pod 40ad3299-8676-4f1f-a314-c139b58a3e50 ("metrics-server-9975d5f86-5k9lw_kube-system(40ad3299-8676-4f1f-a314-c139b58a3e50)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0818 19:34:17.725032 365394 logs.go:138] Found kubelet problem: Aug 18 19:33:10 old-k8s-version-216078 kubelet[659]: E0818 19:33:10.740134 659 pod_workers.go:191] Error syncing pod 8c3c11f9-c5cc-46fd-af21-f01b7f474e46 ("dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"
W0818 19:34:17.725268 365394 logs.go:138] Found kubelet problem: Aug 18 19:33:12 old-k8s-version-216078 kubelet[659]: E0818 19:33:12.740523 659 pod_workers.go:191] Error syncing pod 40ad3299-8676-4f1f-a314-c139b58a3e50 ("metrics-server-9975d5f86-5k9lw_kube-system(40ad3299-8676-4f1f-a314-c139b58a3e50)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0818 19:34:17.725663 365394 logs.go:138] Found kubelet problem: Aug 18 19:33:21 old-k8s-version-216078 kubelet[659]: E0818 19:33:21.744175 659 pod_workers.go:191] Error syncing pod 8c3c11f9-c5cc-46fd-af21-f01b7f474e46 ("dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"
W0818 19:34:17.726002 365394 logs.go:138] Found kubelet problem: Aug 18 19:33:26 old-k8s-version-216078 kubelet[659]: E0818 19:33:26.742186 659 pod_workers.go:191] Error syncing pod 40ad3299-8676-4f1f-a314-c139b58a3e50 ("metrics-server-9975d5f86-5k9lw_kube-system(40ad3299-8676-4f1f-a314-c139b58a3e50)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0818 19:34:17.726377 365394 logs.go:138] Found kubelet problem: Aug 18 19:33:33 old-k8s-version-216078 kubelet[659]: E0818 19:33:33.745221 659 pod_workers.go:191] Error syncing pod 8c3c11f9-c5cc-46fd-af21-f01b7f474e46 ("dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"
W0818 19:34:17.726576 365394 logs.go:138] Found kubelet problem: Aug 18 19:33:37 old-k8s-version-216078 kubelet[659]: E0818 19:33:37.740667 659 pod_workers.go:191] Error syncing pod 40ad3299-8676-4f1f-a314-c139b58a3e50 ("metrics-server-9975d5f86-5k9lw_kube-system(40ad3299-8676-4f1f-a314-c139b58a3e50)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0818 19:34:17.726949 365394 logs.go:138] Found kubelet problem: Aug 18 19:33:46 old-k8s-version-216078 kubelet[659]: E0818 19:33:46.740184 659 pod_workers.go:191] Error syncing pod 8c3c11f9-c5cc-46fd-af21-f01b7f474e46 ("dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"
W0818 19:34:17.727179 365394 logs.go:138] Found kubelet problem: Aug 18 19:33:48 old-k8s-version-216078 kubelet[659]: E0818 19:33:48.741619 659 pod_workers.go:191] Error syncing pod 40ad3299-8676-4f1f-a314-c139b58a3e50 ("metrics-server-9975d5f86-5k9lw_kube-system(40ad3299-8676-4f1f-a314-c139b58a3e50)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0818 19:34:17.727551 365394 logs.go:138] Found kubelet problem: Aug 18 19:33:59 old-k8s-version-216078 kubelet[659]: E0818 19:33:59.740109 659 pod_workers.go:191] Error syncing pod 8c3c11f9-c5cc-46fd-af21-f01b7f474e46 ("dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"
W0818 19:34:17.727776 365394 logs.go:138] Found kubelet problem: Aug 18 19:34:02 old-k8s-version-216078 kubelet[659]: E0818 19:34:02.740456 659 pod_workers.go:191] Error syncing pod 40ad3299-8676-4f1f-a314-c139b58a3e50 ("metrics-server-9975d5f86-5k9lw_kube-system(40ad3299-8676-4f1f-a314-c139b58a3e50)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0818 19:34:17.728248 365394 logs.go:138] Found kubelet problem: Aug 18 19:34:10 old-k8s-version-216078 kubelet[659]: E0818 19:34:10.740182 659 pod_workers.go:191] Error syncing pod 8c3c11f9-c5cc-46fd-af21-f01b7f474e46 ("dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"
W0818 19:34:17.728718 365394 logs.go:138] Found kubelet problem: Aug 18 19:34:15 old-k8s-version-216078 kubelet[659]: E0818 19:34:15.741175 659 pod_workers.go:191] Error syncing pod 40ad3299-8676-4f1f-a314-c139b58a3e50 ("metrics-server-9975d5f86-5k9lw_kube-system(40ad3299-8676-4f1f-a314-c139b58a3e50)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
I0818 19:34:17.728740 365394 logs.go:123] Gathering logs for kube-apiserver [a80fdd47f7301370c07df42778e346c5b3f9a5082205cddd92243b2292907316] ...
I0818 19:34:17.728755 365394 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 a80fdd47f7301370c07df42778e346c5b3f9a5082205cddd92243b2292907316"
I0818 19:34:17.819506 365394 logs.go:123] Gathering logs for etcd [dac35e1e30e3e5a45ee7083d88bb89388a2e328ba629d84ddaa0317c718721e1] ...
I0818 19:34:17.819607 365394 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 dac35e1e30e3e5a45ee7083d88bb89388a2e328ba629d84ddaa0317c718721e1"
I0818 19:34:17.873771 365394 logs.go:123] Gathering logs for coredns [9cb4a0a17af824f66e9d214beb9b26be48e63a6e4f9896caf75d310dbc8cd195] ...
I0818 19:34:17.873809 365394 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 9cb4a0a17af824f66e9d214beb9b26be48e63a6e4f9896caf75d310dbc8cd195"
I0818 19:34:17.943754 365394 logs.go:123] Gathering logs for coredns [f7dac504cb498237ca5f7b6a524527cefe7917920a3d413a7c4cd970c819a894] ...
I0818 19:34:17.943828 365394 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 f7dac504cb498237ca5f7b6a524527cefe7917920a3d413a7c4cd970c819a894"
I0818 19:34:17.999633 365394 logs.go:123] Gathering logs for kindnet [136b3774b3686f0bcd42b41a696212f7023654f7c9a799d192302697dae329d1] ...
I0818 19:34:17.999662 365394 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 136b3774b3686f0bcd42b41a696212f7023654f7c9a799d192302697dae329d1"
I0818 19:34:18.083570 365394 logs.go:123] Gathering logs for describe nodes ...
I0818 19:34:18.083614 365394 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0818 19:34:18.296468 365394 logs.go:123] Gathering logs for kube-apiserver [a70df47e0a4c904f4234489c4b6931a0c40e23791ebbe701bdf79b173c708054] ...
I0818 19:34:18.296516 365394 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 a70df47e0a4c904f4234489c4b6931a0c40e23791ebbe701bdf79b173c708054"
I0818 19:34:18.408946 365394 logs.go:123] Gathering logs for kube-scheduler [c1f327db25afffcb7632d994277e73b15d44e051118ecff71b21299a38bcbe10] ...
I0818 19:34:18.408985 365394 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 c1f327db25afffcb7632d994277e73b15d44e051118ecff71b21299a38bcbe10"
I0818 19:34:18.565143 365394 logs.go:123] Gathering logs for kindnet [80ee1e729513b71685fa053c5499a375152679a2ba2012d6cc5008ba2faab62c] ...
I0818 19:34:18.565179 365394 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 80ee1e729513b71685fa053c5499a375152679a2ba2012d6cc5008ba2faab62c"
I0818 19:34:18.658398 365394 out.go:358] Setting ErrFile to fd 2...
I0818 19:34:18.658433 365394 out.go:392] TERM=,COLORTERM=, which probably does not support color
W0818 19:34:18.658675 365394 out.go:270] X Problems detected in kubelet:
W0818 19:34:18.658761 365394 out.go:270] Aug 18 19:33:48 old-k8s-version-216078 kubelet[659]: E0818 19:33:48.741619 659 pod_workers.go:191] Error syncing pod 40ad3299-8676-4f1f-a314-c139b58a3e50 ("metrics-server-9975d5f86-5k9lw_kube-system(40ad3299-8676-4f1f-a314-c139b58a3e50)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0818 19:34:18.658792 365394 out.go:270] Aug 18 19:33:59 old-k8s-version-216078 kubelet[659]: E0818 19:33:59.740109 659 pod_workers.go:191] Error syncing pod 8c3c11f9-c5cc-46fd-af21-f01b7f474e46 ("dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"
W0818 19:34:18.658809 365394 out.go:270] Aug 18 19:34:02 old-k8s-version-216078 kubelet[659]: E0818 19:34:02.740456 659 pod_workers.go:191] Error syncing pod 40ad3299-8676-4f1f-a314-c139b58a3e50 ("metrics-server-9975d5f86-5k9lw_kube-system(40ad3299-8676-4f1f-a314-c139b58a3e50)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0818 19:34:18.658836 365394 out.go:270] Aug 18 19:34:10 old-k8s-version-216078 kubelet[659]: E0818 19:34:10.740182 659 pod_workers.go:191] Error syncing pod 8c3c11f9-c5cc-46fd-af21-f01b7f474e46 ("dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"
W0818 19:34:18.658848 365394 out.go:270] Aug 18 19:34:15 old-k8s-version-216078 kubelet[659]: E0818 19:34:15.741175 659 pod_workers.go:191] Error syncing pod 40ad3299-8676-4f1f-a314-c139b58a3e50 ("metrics-server-9975d5f86-5k9lw_kube-system(40ad3299-8676-4f1f-a314-c139b58a3e50)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
I0818 19:34:18.658864 365394 out.go:358] Setting ErrFile to fd 2...
I0818 19:34:18.658873 365394 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0818 19:34:19.194097 376647 out.go:235] * Creating docker container (CPUs=2, Memory=2200MB) ...
I0818 19:34:19.194353 376647 start.go:159] libmachine.API.Create for "embed-certs-568075" (driver="docker")
I0818 19:34:19.194392 376647 client.go:168] LocalClient.Create starting
I0818 19:34:19.194479 376647 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19423-154159/.minikube/certs/ca.pem
I0818 19:34:19.194522 376647 main.go:141] libmachine: Decoding PEM data...
I0818 19:34:19.194542 376647 main.go:141] libmachine: Parsing certificate...
I0818 19:34:19.194599 376647 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19423-154159/.minikube/certs/cert.pem
I0818 19:34:19.194620 376647 main.go:141] libmachine: Decoding PEM data...
I0818 19:34:19.194630 376647 main.go:141] libmachine: Parsing certificate...
I0818 19:34:19.195017 376647 cli_runner.go:164] Run: docker network inspect embed-certs-568075 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
W0818 19:34:19.210772 376647 cli_runner.go:211] docker network inspect embed-certs-568075 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
I0818 19:34:19.210847 376647 network_create.go:284] running [docker network inspect embed-certs-568075] to gather additional debugging logs...
I0818 19:34:19.210864 376647 cli_runner.go:164] Run: docker network inspect embed-certs-568075
W0818 19:34:19.235088 376647 cli_runner.go:211] docker network inspect embed-certs-568075 returned with exit code 1
I0818 19:34:19.235120 376647 network_create.go:287] error running [docker network inspect embed-certs-568075]: docker network inspect embed-certs-568075: exit status 1
stdout:
[]
stderr:
Error response from daemon: network embed-certs-568075 not found
I0818 19:34:19.235134 376647 network_create.go:289] output of [docker network inspect embed-certs-568075]: -- stdout --
[]
-- /stdout --
** stderr **
Error response from daemon: network embed-certs-568075 not found
** /stderr **
I0818 19:34:19.235238 376647 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0818 19:34:19.251430 376647 network.go:211] skipping subnet 192.168.49.0/24 that is taken: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName:br-c2352e65d8eb IfaceIPv4:192.168.49.1 IfaceMTU:1500 IfaceMAC:02:42:84:67:35:66} reservation:<nil>}
I0818 19:34:19.251914 376647 network.go:211] skipping subnet 192.168.58.0/24 that is taken: &{IP:192.168.58.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.58.0/24 Gateway:192.168.58.1 ClientMin:192.168.58.2 ClientMax:192.168.58.254 Broadcast:192.168.58.255 IsPrivate:true Interface:{IfaceName:br-8c8d5c217e77 IfaceIPv4:192.168.58.1 IfaceMTU:1500 IfaceMAC:02:42:64:96:86:e3} reservation:<nil>}
I0818 19:34:19.252359 376647 network.go:211] skipping subnet 192.168.67.0/24 that is taken: &{IP:192.168.67.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.67.0/24 Gateway:192.168.67.1 ClientMin:192.168.67.2 ClientMax:192.168.67.254 Broadcast:192.168.67.255 IsPrivate:true Interface:{IfaceName:br-06b8887a5149 IfaceIPv4:192.168.67.1 IfaceMTU:1500 IfaceMAC:02:42:66:a4:e2:23} reservation:<nil>}
I0818 19:34:19.252751 376647 network.go:211] skipping subnet 192.168.76.0/24 that is taken: &{IP:192.168.76.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.76.0/24 Gateway:192.168.76.1 ClientMin:192.168.76.2 ClientMax:192.168.76.254 Broadcast:192.168.76.255 IsPrivate:true Interface:{IfaceName:br-ecefefb0f094 IfaceIPv4:192.168.76.1 IfaceMTU:1500 IfaceMAC:02:42:79:13:5e:c5} reservation:<nil>}
I0818 19:34:19.253376 376647 network.go:206] using free private subnet 192.168.85.0/24: &{IP:192.168.85.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.85.0/24 Gateway:192.168.85.1 ClientMin:192.168.85.2 ClientMax:192.168.85.254 Broadcast:192.168.85.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0x400187d0e0}
I0818 19:34:19.253441 376647 network_create.go:124] attempt to create docker network embed-certs-568075 192.168.85.0/24 with gateway 192.168.85.1 and MTU of 1500 ...
I0818 19:34:19.253536 376647 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.85.0/24 --gateway=192.168.85.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=embed-certs-568075 embed-certs-568075
I0818 19:34:19.328644 376647 network_create.go:108] docker network embed-certs-568075 192.168.85.0/24 created
I0818 19:34:19.328678 376647 kic.go:121] calculated static IP "192.168.85.2" for the "embed-certs-568075" container
I0818 19:34:19.328775 376647 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
I0818 19:34:19.344570 376647 cli_runner.go:164] Run: docker volume create embed-certs-568075 --label name.minikube.sigs.k8s.io=embed-certs-568075 --label created_by.minikube.sigs.k8s.io=true
I0818 19:34:19.361491 376647 oci.go:103] Successfully created a docker volume embed-certs-568075
I0818 19:34:19.361580 376647 cli_runner.go:164] Run: docker run --rm --name embed-certs-568075-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=embed-certs-568075 --entrypoint /usr/bin/test -v embed-certs-568075:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723740748-19452@sha256:2211a6931895d2d502e957e9667096db10734a96767d670cb4dbffdd37397b0d -d /var/lib
I0818 19:34:20.051961 376647 oci.go:107] Successfully prepared a docker volume embed-certs-568075
I0818 19:34:20.052029 376647 preload.go:131] Checking if preload exists for k8s version v1.31.0 and runtime containerd
I0818 19:34:20.052060 376647 kic.go:194] Starting extracting preloaded images to volume ...
I0818 19:34:20.052151 376647 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/19423-154159/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-containerd-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v embed-certs-568075:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723740748-19452@sha256:2211a6931895d2d502e957e9667096db10734a96767d670cb4dbffdd37397b0d -I lz4 -xf /preloaded.tar -C /extractDir
I0818 19:34:28.659657 365394 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0818 19:34:28.677401 365394 api_server.go:72] duration metric: took 6m4.945994591s to wait for apiserver process to appear ...
I0818 19:34:28.677425 365394 api_server.go:88] waiting for apiserver healthz status ...
I0818 19:34:28.679981 365394 out.go:201]
W0818 19:34:28.681909 365394 out.go:270] X Exiting due to GUEST_START: failed to start node: wait 6m0s for node: wait for healthy API server: apiserver healthz never reported healthy: cluster wait timed out during healthz check
W0818 19:34:28.681926 365394 out.go:270] *
W0818 19:34:28.682790 365394 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0818 19:34:28.684398 365394 out.go:201]
I0818 19:34:25.135041 376647 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/19423-154159/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-containerd-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v embed-certs-568075:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723740748-19452@sha256:2211a6931895d2d502e957e9667096db10734a96767d670cb4dbffdd37397b0d -I lz4 -xf /preloaded.tar -C /extractDir: (5.082839168s)
I0818 19:34:25.135077 376647 kic.go:203] duration metric: took 5.083012722s to extract preloaded images to volume ...
W0818 19:34:25.135228 376647 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
I0818 19:34:25.135343 376647 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
I0818 19:34:25.193878 376647 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname embed-certs-568075 --name embed-certs-568075 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=embed-certs-568075 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=embed-certs-568075 --network embed-certs-568075 --ip 192.168.85.2 --volume embed-certs-568075:/var --security-opt apparmor=unconfined --memory=2200mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723740748-19452@sha256:2211a6931895d2d502e957e9667096db10734a96767d670cb4dbffdd37397b0d
I0818 19:34:25.533643 376647 cli_runner.go:164] Run: docker container inspect embed-certs-568075 --format={{.State.Running}}
I0818 19:34:25.560630 376647 cli_runner.go:164] Run: docker container inspect embed-certs-568075 --format={{.State.Status}}
I0818 19:34:25.581316 376647 cli_runner.go:164] Run: docker exec embed-certs-568075 stat /var/lib/dpkg/alternatives/iptables
I0818 19:34:25.638700 376647 oci.go:144] the created container "embed-certs-568075" has a running status.
I0818 19:34:25.638734 376647 kic.go:225] Creating ssh key for kic: /home/jenkins/minikube-integration/19423-154159/.minikube/machines/embed-certs-568075/id_rsa...
I0818 19:34:26.164166 376647 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/19423-154159/.minikube/machines/embed-certs-568075/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
I0818 19:34:26.191066 376647 cli_runner.go:164] Run: docker container inspect embed-certs-568075 --format={{.State.Status}}
I0818 19:34:26.232079 376647 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
I0818 19:34:26.232116 376647 kic_runner.go:114] Args: [docker exec --privileged embed-certs-568075 chown docker:docker /home/docker/.ssh/authorized_keys]
I0818 19:34:26.322443 376647 cli_runner.go:164] Run: docker container inspect embed-certs-568075 --format={{.State.Status}}
I0818 19:34:26.346380 376647 machine.go:93] provisionDockerMachine start ...
I0818 19:34:26.346482 376647 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-568075
I0818 19:34:26.369606 376647 main.go:141] libmachine: Using SSH client type: native
I0818 19:34:26.369882 376647 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e49d0] 0x3e7230 <nil> [] 0s} 127.0.0.1 38624 <nil> <nil>}
I0818 19:34:26.369897 376647 main.go:141] libmachine: About to run SSH command:
hostname
I0818 19:34:26.542275 376647 main.go:141] libmachine: SSH cmd err, output: <nil>: embed-certs-568075
I0818 19:34:26.542318 376647 ubuntu.go:169] provisioning hostname "embed-certs-568075"
I0818 19:34:26.542394 376647 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-568075
I0818 19:34:26.566719 376647 main.go:141] libmachine: Using SSH client type: native
I0818 19:34:26.566976 376647 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e49d0] 0x3e7230 <nil> [] 0s} 127.0.0.1 38624 <nil> <nil>}
I0818 19:34:26.566991 376647 main.go:141] libmachine: About to run SSH command:
sudo hostname embed-certs-568075 && echo "embed-certs-568075" | sudo tee /etc/hostname
I0818 19:34:26.723271 376647 main.go:141] libmachine: SSH cmd err, output: <nil>: embed-certs-568075
I0818 19:34:26.723380 376647 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-568075
I0818 19:34:26.761932 376647 main.go:141] libmachine: Using SSH client type: native
I0818 19:34:26.762235 376647 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e49d0] 0x3e7230 <nil> [] 0s} 127.0.0.1 38624 <nil> <nil>}
I0818 19:34:26.762259 376647 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sembed-certs-568075' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 embed-certs-568075/g' /etc/hosts;
else
echo '127.0.1.1 embed-certs-568075' | sudo tee -a /etc/hosts;
fi
fi
I0818 19:34:26.899881 376647 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0818 19:34:26.899911 376647 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/19423-154159/.minikube CaCertPath:/home/jenkins/minikube-integration/19423-154159/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19423-154159/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19423-154159/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19423-154159/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19423-154159/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19423-154159/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19423-154159/.minikube}
I0818 19:34:26.899940 376647 ubuntu.go:177] setting up certificates
I0818 19:34:26.899950 376647 provision.go:84] configureAuth start
I0818 19:34:26.900023 376647 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-568075
I0818 19:34:26.924238 376647 provision.go:143] copyHostCerts
I0818 19:34:26.924297 376647 exec_runner.go:144] found /home/jenkins/minikube-integration/19423-154159/.minikube/ca.pem, removing ...
I0818 19:34:26.924307 376647 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19423-154159/.minikube/ca.pem
I0818 19:34:26.924385 376647 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19423-154159/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19423-154159/.minikube/ca.pem (1082 bytes)
I0818 19:34:26.924477 376647 exec_runner.go:144] found /home/jenkins/minikube-integration/19423-154159/.minikube/cert.pem, removing ...
I0818 19:34:26.924482 376647 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19423-154159/.minikube/cert.pem
I0818 19:34:26.924513 376647 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19423-154159/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19423-154159/.minikube/cert.pem (1123 bytes)
I0818 19:34:26.924564 376647 exec_runner.go:144] found /home/jenkins/minikube-integration/19423-154159/.minikube/key.pem, removing ...
I0818 19:34:26.924569 376647 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19423-154159/.minikube/key.pem
I0818 19:34:26.924590 376647 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19423-154159/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19423-154159/.minikube/key.pem (1675 bytes)
I0818 19:34:26.924803 376647 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19423-154159/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19423-154159/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19423-154159/.minikube/certs/ca-key.pem org=jenkins.embed-certs-568075 san=[127.0.0.1 192.168.85.2 embed-certs-568075 localhost minikube]
I0818 19:34:27.535542 376647 provision.go:177] copyRemoteCerts
I0818 19:34:27.535620 376647 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0818 19:34:27.535665 376647 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-568075
I0818 19:34:27.558893 376647 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:38624 SSHKeyPath:/home/jenkins/minikube-integration/19423-154159/.minikube/machines/embed-certs-568075/id_rsa Username:docker}
I0818 19:34:27.652776 376647 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19423-154159/.minikube/machines/server.pem --> /etc/docker/server.pem (1224 bytes)
I0818 19:34:27.677498 376647 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19423-154159/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0818 19:34:27.701893 376647 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19423-154159/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
I0818 19:34:27.726129 376647 provision.go:87] duration metric: took 826.161156ms to configureAuth
I0818 19:34:27.726157 376647 ubuntu.go:193] setting minikube options for container-runtime
I0818 19:34:27.726343 376647 config.go:182] Loaded profile config "embed-certs-568075": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.31.0
I0818 19:34:27.726356 376647 machine.go:96] duration metric: took 1.379950388s to provisionDockerMachine
I0818 19:34:27.726364 376647 client.go:171] duration metric: took 8.531961394s to LocalClient.Create
I0818 19:34:27.726381 376647 start.go:167] duration metric: took 8.53202957s to libmachine.API.Create "embed-certs-568075"
I0818 19:34:27.726396 376647 start.go:293] postStartSetup for "embed-certs-568075" (driver="docker")
I0818 19:34:27.726407 376647 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0818 19:34:27.726461 376647 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0818 19:34:27.726509 376647 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-568075
I0818 19:34:27.750024 376647 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:38624 SSHKeyPath:/home/jenkins/minikube-integration/19423-154159/.minikube/machines/embed-certs-568075/id_rsa Username:docker}
I0818 19:34:27.849358 376647 ssh_runner.go:195] Run: cat /etc/os-release
I0818 19:34:27.852663 376647 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0818 19:34:27.852708 376647 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0818 19:34:27.852722 376647 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0818 19:34:27.852733 376647 info.go:137] Remote host: Ubuntu 22.04.4 LTS
I0818 19:34:27.852743 376647 filesync.go:126] Scanning /home/jenkins/minikube-integration/19423-154159/.minikube/addons for local assets ...
I0818 19:34:27.852807 376647 filesync.go:126] Scanning /home/jenkins/minikube-integration/19423-154159/.minikube/files for local assets ...
I0818 19:34:27.852893 376647 filesync.go:149] local asset: /home/jenkins/minikube-integration/19423-154159/.minikube/files/etc/ssl/certs/1595492.pem -> 1595492.pem in /etc/ssl/certs
I0818 19:34:27.852999 376647 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0818 19:34:27.862149 376647 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19423-154159/.minikube/files/etc/ssl/certs/1595492.pem --> /etc/ssl/certs/1595492.pem (1708 bytes)
I0818 19:34:27.890178 376647 start.go:296] duration metric: took 163.765374ms for postStartSetup
I0818 19:34:27.890547 376647 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-568075
I0818 19:34:27.907152 376647 profile.go:143] Saving config to /home/jenkins/minikube-integration/19423-154159/.minikube/profiles/embed-certs-568075/config.json ...
I0818 19:34:27.907566 376647 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0818 19:34:27.907627 376647 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-568075
I0818 19:34:27.924459 376647 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:38624 SSHKeyPath:/home/jenkins/minikube-integration/19423-154159/.minikube/machines/embed-certs-568075/id_rsa Username:docker}
I0818 19:34:28.015255 376647 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I0818 19:34:28.020592 376647 start.go:128] duration metric: took 8.829450914s to createHost
I0818 19:34:28.020665 376647 start.go:83] releasing machines lock for "embed-certs-568075", held for 8.829660431s
I0818 19:34:28.020775 376647 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-568075
I0818 19:34:28.038536 376647 ssh_runner.go:195] Run: cat /version.json
I0818 19:34:28.038594 376647 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-568075
I0818 19:34:28.038593 376647 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0818 19:34:28.038728 376647 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-568075
I0818 19:34:28.060419 376647 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:38624 SSHKeyPath:/home/jenkins/minikube-integration/19423-154159/.minikube/machines/embed-certs-568075/id_rsa Username:docker}
I0818 19:34:28.073721 376647 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:38624 SSHKeyPath:/home/jenkins/minikube-integration/19423-154159/.minikube/machines/embed-certs-568075/id_rsa Username:docker}
I0818 19:34:28.278122 376647 ssh_runner.go:195] Run: systemctl --version
I0818 19:34:28.282696 376647 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I0818 19:34:28.287407 376647 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
I0818 19:34:28.317548 376647 cni.go:230] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
I0818 19:34:28.317635 376647 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0818 19:34:28.348301 376647 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist, /etc/cni/net.d/100-crio-bridge.conf] bridge cni config(s)
I0818 19:34:28.348332 376647 start.go:495] detecting cgroup driver to use...
I0818 19:34:28.348366 376647 detect.go:187] detected "cgroupfs" cgroup driver on host os
I0818 19:34:28.348415 376647 ssh_runner.go:195] Run: sudo systemctl stop -f crio
I0818 19:34:28.361019 376647 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I0818 19:34:28.372914 376647 docker.go:217] disabling cri-docker service (if available) ...
I0818 19:34:28.373001 376647 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0818 19:34:28.387525 376647 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0818 19:34:28.403850 376647 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0818 19:34:28.488775 376647 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0818 19:34:28.608468 376647 docker.go:233] disabling docker service ...
I0818 19:34:28.608601 376647 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0818 19:34:28.659711 376647 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0818 19:34:28.674416 376647 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
==> container status <==
CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID POD
3b6d2b1b4ae9a 523cad1a4df73 2 minutes ago Exited dashboard-metrics-scraper 5 b1b3f127eaec2 dashboard-metrics-scraper-8d5bb5db8-shnnv
35e10341a2644 ba04bb24b9575 4 minutes ago Running storage-provisioner 2 00a3fa24cc162 storage-provisioner
aea462f9a5614 20b332c9a70d8 5 minutes ago Running kubernetes-dashboard 0 d0c5c58c15196 kubernetes-dashboard-cd95d586-fmtrv
9cb4a0a17af82 db91994f4ee8f 5 minutes ago Running coredns 1 58ccf093e9043 coredns-74ff55c5b-vvtgz
d9c85aaaa043f 25a5233254979 5 minutes ago Running kube-proxy 1 bbc99c8e00507 kube-proxy-n9glb
4929b781535fb 1611cd07b61d5 5 minutes ago Running busybox 1 1e1850220e011 busybox
48b1e06eab895 ba04bb24b9575 5 minutes ago Exited storage-provisioner 1 00a3fa24cc162 storage-provisioner
136b3774b3686 6a23fa8fd2b78 5 minutes ago Running kindnet-cni 1 8480a3a5d659e kindnet-mbxls
a70df47e0a4c9 2c08bbbc02d3a 5 minutes ago Running kube-apiserver 1 e4f2705cb2add kube-apiserver-old-k8s-version-216078
03fbfc746eafc 05b738aa1bc63 5 minutes ago Running etcd 1 b0bb457b89f22 etcd-old-k8s-version-216078
6b77034b70c13 1df8a2b116bd1 5 minutes ago Running kube-controller-manager 1 44bd951e4089d kube-controller-manager-old-k8s-version-216078
3f55d380c20ce e7605f88f17d6 5 minutes ago Running kube-scheduler 1 a2fbca7deeaf2 kube-scheduler-old-k8s-version-216078
d1bac58a8da9c 1611cd07b61d5 6 minutes ago Exited busybox 0 200388e8854ea busybox
f7dac504cb498 db91994f4ee8f 7 minutes ago Exited coredns 0 2c9efb1c45f69 coredns-74ff55c5b-vvtgz
80ee1e729513b 6a23fa8fd2b78 8 minutes ago Exited kindnet-cni 0 f8ffb39a715af kindnet-mbxls
905b265420907 25a5233254979 8 minutes ago Exited kube-proxy 0 c3d046b4a4c01 kube-proxy-n9glb
c1f327db25aff e7605f88f17d6 8 minutes ago Exited kube-scheduler 0 40dc09dd25a8c kube-scheduler-old-k8s-version-216078
dac35e1e30e3e 05b738aa1bc63 8 minutes ago Exited etcd 0 8b77af9a5bd6b etcd-old-k8s-version-216078
00fecac5b2749 1df8a2b116bd1 8 minutes ago Exited kube-controller-manager 0 74c3576c02b95 kube-controller-manager-old-k8s-version-216078
a80fdd47f7301 2c08bbbc02d3a 8 minutes ago Exited kube-apiserver 0 bb844606ba7a1 kube-apiserver-old-k8s-version-216078
==> containerd <==
Aug 18 19:30:50 old-k8s-version-216078 containerd[569]: time="2024-08-18T19:30:50.760257444Z" level=info msg="CreateContainer within sandbox \"b1b3f127eaec2053dc974a2d56b2af6fd92c0d8b3e7c46097bc42787f8ca8682\" for name:\"dashboard-metrics-scraper\" attempt:4 returns container id \"f04e6e02d7fa8356180971c3afc1d6efb4a91bb0892d59fbd091ae730e74fba7\""
Aug 18 19:30:50 old-k8s-version-216078 containerd[569]: time="2024-08-18T19:30:50.760854455Z" level=info msg="StartContainer for \"f04e6e02d7fa8356180971c3afc1d6efb4a91bb0892d59fbd091ae730e74fba7\""
Aug 18 19:30:50 old-k8s-version-216078 containerd[569]: time="2024-08-18T19:30:50.836043210Z" level=info msg="StartContainer for \"f04e6e02d7fa8356180971c3afc1d6efb4a91bb0892d59fbd091ae730e74fba7\" returns successfully"
Aug 18 19:30:50 old-k8s-version-216078 containerd[569]: time="2024-08-18T19:30:50.864684576Z" level=info msg="shim disconnected" id=f04e6e02d7fa8356180971c3afc1d6efb4a91bb0892d59fbd091ae730e74fba7 namespace=k8s.io
Aug 18 19:30:50 old-k8s-version-216078 containerd[569]: time="2024-08-18T19:30:50.864746196Z" level=warning msg="cleaning up after shim disconnected" id=f04e6e02d7fa8356180971c3afc1d6efb4a91bb0892d59fbd091ae730e74fba7 namespace=k8s.io
Aug 18 19:30:50 old-k8s-version-216078 containerd[569]: time="2024-08-18T19:30:50.864757347Z" level=info msg="cleaning up dead shim" namespace=k8s.io
Aug 18 19:30:51 old-k8s-version-216078 containerd[569]: time="2024-08-18T19:30:51.643105652Z" level=info msg="RemoveContainer for \"9ef12fb84dcc5f6a6eb29583f4ae47f23d3e3a9e2ebe8af984f2f5f3e4635569\""
Aug 18 19:30:51 old-k8s-version-216078 containerd[569]: time="2024-08-18T19:30:51.662897239Z" level=info msg="RemoveContainer for \"9ef12fb84dcc5f6a6eb29583f4ae47f23d3e3a9e2ebe8af984f2f5f3e4635569\" returns successfully"
Aug 18 19:31:40 old-k8s-version-216078 containerd[569]: time="2024-08-18T19:31:40.741042623Z" level=info msg="PullImage \"fake.domain/registry.k8s.io/echoserver:1.4\""
Aug 18 19:31:40 old-k8s-version-216078 containerd[569]: time="2024-08-18T19:31:40.745645658Z" level=info msg="trying next host" error="failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host" host=fake.domain
Aug 18 19:31:40 old-k8s-version-216078 containerd[569]: time="2024-08-18T19:31:40.747056934Z" level=error msg="PullImage \"fake.domain/registry.k8s.io/echoserver:1.4\" failed" error="failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
Aug 18 19:31:40 old-k8s-version-216078 containerd[569]: time="2024-08-18T19:31:40.747088983Z" level=info msg="stop pulling image fake.domain/registry.k8s.io/echoserver:1.4: active requests=0, bytes read=0"
Aug 18 19:32:17 old-k8s-version-216078 containerd[569]: time="2024-08-18T19:32:17.742602167Z" level=info msg="CreateContainer within sandbox \"b1b3f127eaec2053dc974a2d56b2af6fd92c0d8b3e7c46097bc42787f8ca8682\" for container name:\"dashboard-metrics-scraper\" attempt:5"
Aug 18 19:32:17 old-k8s-version-216078 containerd[569]: time="2024-08-18T19:32:17.760417418Z" level=info msg="CreateContainer within sandbox \"b1b3f127eaec2053dc974a2d56b2af6fd92c0d8b3e7c46097bc42787f8ca8682\" for name:\"dashboard-metrics-scraper\" attempt:5 returns container id \"3b6d2b1b4ae9a754515adb79d3fa5549aad0d5f9d5b9082c3a443b893020e7d2\""
Aug 18 19:32:17 old-k8s-version-216078 containerd[569]: time="2024-08-18T19:32:17.760931574Z" level=info msg="StartContainer for \"3b6d2b1b4ae9a754515adb79d3fa5549aad0d5f9d5b9082c3a443b893020e7d2\""
Aug 18 19:32:17 old-k8s-version-216078 containerd[569]: time="2024-08-18T19:32:17.826475058Z" level=info msg="StartContainer for \"3b6d2b1b4ae9a754515adb79d3fa5549aad0d5f9d5b9082c3a443b893020e7d2\" returns successfully"
Aug 18 19:32:17 old-k8s-version-216078 containerd[569]: time="2024-08-18T19:32:17.852140206Z" level=info msg="shim disconnected" id=3b6d2b1b4ae9a754515adb79d3fa5549aad0d5f9d5b9082c3a443b893020e7d2 namespace=k8s.io
Aug 18 19:32:17 old-k8s-version-216078 containerd[569]: time="2024-08-18T19:32:17.852201900Z" level=warning msg="cleaning up after shim disconnected" id=3b6d2b1b4ae9a754515adb79d3fa5549aad0d5f9d5b9082c3a443b893020e7d2 namespace=k8s.io
Aug 18 19:32:17 old-k8s-version-216078 containerd[569]: time="2024-08-18T19:32:17.852214117Z" level=info msg="cleaning up dead shim" namespace=k8s.io
Aug 18 19:32:17 old-k8s-version-216078 containerd[569]: time="2024-08-18T19:32:17.878033398Z" level=info msg="RemoveContainer for \"f04e6e02d7fa8356180971c3afc1d6efb4a91bb0892d59fbd091ae730e74fba7\""
Aug 18 19:32:17 old-k8s-version-216078 containerd[569]: time="2024-08-18T19:32:17.899234777Z" level=info msg="RemoveContainer for \"f04e6e02d7fa8356180971c3afc1d6efb4a91bb0892d59fbd091ae730e74fba7\" returns successfully"
Aug 18 19:34:26 old-k8s-version-216078 containerd[569]: time="2024-08-18T19:34:26.744364488Z" level=info msg="PullImage \"fake.domain/registry.k8s.io/echoserver:1.4\""
Aug 18 19:34:26 old-k8s-version-216078 containerd[569]: time="2024-08-18T19:34:26.752916291Z" level=info msg="trying next host" error="failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host" host=fake.domain
Aug 18 19:34:26 old-k8s-version-216078 containerd[569]: time="2024-08-18T19:34:26.756643251Z" level=error msg="PullImage \"fake.domain/registry.k8s.io/echoserver:1.4\" failed" error="failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
Aug 18 19:34:26 old-k8s-version-216078 containerd[569]: time="2024-08-18T19:34:26.757593122Z" level=info msg="stop pulling image fake.domain/registry.k8s.io/echoserver:1.4: active requests=0, bytes read=0"
==> coredns [9cb4a0a17af824f66e9d214beb9b26be48e63a6e4f9896caf75d310dbc8cd195] <==
.:53
[INFO] plugin/reload: Running configuration MD5 = b494d968e357ba1b925cee838fbd78ed
CoreDNS-1.7.0
linux/arm64, go1.14.4, f59c03d
[INFO] 127.0.0.1:42596 - 61776 "HINFO IN 1862080754105022271.5888583688692755596. udp 57 false 512" NXDOMAIN qr,rd,ra 57 0.011439832s
==> coredns [f7dac504cb498237ca5f7b6a524527cefe7917920a3d413a7c4cd970c819a894] <==
.:53
[INFO] plugin/reload: Running configuration MD5 = b494d968e357ba1b925cee838fbd78ed
CoreDNS-1.7.0
linux/arm64, go1.14.4, f59c03d
[INFO] 127.0.0.1:58444 - 44724 "HINFO IN 212848429246740913.5217799900105664813. udp 56 false 512" NXDOMAIN qr,rd,ra 56 0.019464638s
==> describe nodes <==
Name: old-k8s-version-216078
Roles: control-plane,master
Labels: beta.kubernetes.io/arch=arm64
beta.kubernetes.io/os=linux
kubernetes.io/arch=arm64
kubernetes.io/hostname=old-k8s-version-216078
kubernetes.io/os=linux
minikube.k8s.io/commit=3607dd695a2685a662a9ebe804e6840665786af5
minikube.k8s.io/name=old-k8s-version-216078
minikube.k8s.io/primary=true
minikube.k8s.io/updated_at=2024_08_18T19_26_08_0700
minikube.k8s.io/version=v1.33.1
node-role.kubernetes.io/control-plane=
node-role.kubernetes.io/master=
Annotations: kubeadm.alpha.kubernetes.io/cri-socket: /run/containerd/containerd.sock
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Sun, 18 Aug 2024 19:26:04 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: old-k8s-version-216078
AcquireTime: <unset>
RenewTime: Sun, 18 Aug 2024 19:34:28 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Sun, 18 Aug 2024 19:29:39 +0000 Sun, 18 Aug 2024 19:25:58 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Sun, 18 Aug 2024 19:29:39 +0000 Sun, 18 Aug 2024 19:25:58 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Sun, 18 Aug 2024 19:29:39 +0000 Sun, 18 Aug 2024 19:25:58 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Sun, 18 Aug 2024 19:29:39 +0000 Sun, 18 Aug 2024 19:26:23 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.76.2
Hostname: old-k8s-version-216078
Capacity:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022360Ki
pods: 110
Allocatable:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022360Ki
pods: 110
System Info:
Machine ID: 99166311889b4661b085793883fca85b
System UUID: 12b18352-3445-4fa7-8e5f-c567cc3538f4
Boot ID: 46f0c01d-aaa8-472d-87c6-dade3bb189f7
Kernel Version: 5.15.0-1067-aws
OS Image: Ubuntu 22.04.4 LTS
Operating System: linux
Architecture: arm64
Container Runtime Version: containerd://1.7.20
Kubelet Version: v1.20.0
Kube-Proxy Version: v1.20.0
PodCIDR: 10.244.0.0/24
PodCIDRs: 10.244.0.0/24
Non-terminated Pods: (12 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits AGE
--------- ---- ------------ ---------- --------------- ------------- ---
default busybox 0 (0%) 0 (0%) 0 (0%) 0 (0%) 6m36s
kube-system coredns-74ff55c5b-vvtgz 100m (5%) 0 (0%) 70Mi (0%) 170Mi (2%) 8m7s
kube-system etcd-old-k8s-version-216078 100m (5%) 0 (0%) 100Mi (1%) 0 (0%) 8m14s
kube-system kindnet-mbxls 100m (5%) 100m (5%) 50Mi (0%) 50Mi (0%) 8m7s
kube-system kube-apiserver-old-k8s-version-216078 250m (12%) 0 (0%) 0 (0%) 0 (0%) 8m14s
kube-system kube-controller-manager-old-k8s-version-216078 200m (10%) 0 (0%) 0 (0%) 0 (0%) 8m14s
kube-system kube-proxy-n9glb 0 (0%) 0 (0%) 0 (0%) 0 (0%) 8m7s
kube-system kube-scheduler-old-k8s-version-216078 100m (5%) 0 (0%) 0 (0%) 0 (0%) 8m14s
kube-system metrics-server-9975d5f86-5k9lw 100m (5%) 0 (0%) 200Mi (2%) 0 (0%) 6m27s
kube-system storage-provisioner 0 (0%) 0 (0%) 0 (0%) 0 (0%) 8m6s
kubernetes-dashboard dashboard-metrics-scraper-8d5bb5db8-shnnv 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m26s
kubernetes-dashboard kubernetes-dashboard-cd95d586-fmtrv 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m26s
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 950m (47%) 100m (5%)
memory 420Mi (5%) 220Mi (2%)
ephemeral-storage 100Mi (0%) 0 (0%)
hugepages-1Gi 0 (0%) 0 (0%)
hugepages-2Mi 0 (0%) 0 (0%)
hugepages-32Mi 0 (0%) 0 (0%)
hugepages-64Ki 0 (0%) 0 (0%)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal NodeHasSufficientMemory 8m34s (x4 over 8m34s) kubelet Node old-k8s-version-216078 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 8m34s (x3 over 8m34s) kubelet Node old-k8s-version-216078 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 8m34s (x4 over 8m34s) kubelet Node old-k8s-version-216078 status is now: NodeHasSufficientPID
Normal Starting 8m15s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 8m15s kubelet Node old-k8s-version-216078 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 8m15s kubelet Node old-k8s-version-216078 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 8m15s kubelet Node old-k8s-version-216078 status is now: NodeHasSufficientPID
Normal NodeAllocatableEnforced 8m15s kubelet Updated Node Allocatable limit across pods
Normal NodeReady 8m7s kubelet Node old-k8s-version-216078 status is now: NodeReady
Normal Starting 8m6s kube-proxy Starting kube-proxy.
Normal Starting 5m59s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 5m59s (x8 over 5m59s) kubelet Node old-k8s-version-216078 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 5m59s (x7 over 5m59s) kubelet Node old-k8s-version-216078 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 5m59s (x8 over 5m59s) kubelet Node old-k8s-version-216078 status is now: NodeHasSufficientPID
Normal NodeAllocatableEnforced 5m59s kubelet Updated Node Allocatable limit across pods
Normal Starting 5m41s kube-proxy Starting kube-proxy.
==> dmesg <==
==> etcd [03fbfc746eafcd2d037579ee9352ca8a230e2d686179a89c453eeae19ba4b178] <==
2024-08-18 19:30:21.639240 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-18 19:30:31.639129 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-18 19:30:41.639126 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-18 19:30:51.639672 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-18 19:31:01.639426 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-18 19:31:11.639006 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-18 19:31:21.639298 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-18 19:31:31.641291 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-18 19:31:41.639129 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-18 19:31:51.639102 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-18 19:32:01.639124 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-18 19:32:11.639099 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-18 19:32:21.639216 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-18 19:32:31.639212 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-18 19:32:41.639979 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-18 19:32:51.639108 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-18 19:33:01.639071 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-18 19:33:11.639063 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-18 19:33:21.639153 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-18 19:33:31.639168 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-18 19:33:41.639035 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-18 19:33:51.639001 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-18 19:34:01.639096 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-18 19:34:11.639098 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-18 19:34:21.639068 I | etcdserver/api/etcdhttp: /health OK (status code 200)
==> etcd [dac35e1e30e3e5a45ee7083d88bb89388a2e328ba629d84ddaa0317c718721e1] <==
raft2024/08/18 19:25:58 INFO: ea7e25599daad906 is starting a new election at term 1
raft2024/08/18 19:25:58 INFO: ea7e25599daad906 became candidate at term 2
raft2024/08/18 19:25:58 INFO: ea7e25599daad906 received MsgVoteResp from ea7e25599daad906 at term 2
raft2024/08/18 19:25:58 INFO: ea7e25599daad906 became leader at term 2
raft2024/08/18 19:25:58 INFO: raft.node: ea7e25599daad906 elected leader ea7e25599daad906 at term 2
2024-08-18 19:25:58.223871 I | etcdserver: setting up the initial cluster version to 3.4
2024-08-18 19:25:58.227576 N | etcdserver/membership: set the initial cluster version to 3.4
2024-08-18 19:25:58.227804 I | etcdserver/api: enabled capabilities for version 3.4
2024-08-18 19:25:58.227922 I | etcdserver: published {Name:old-k8s-version-216078 ClientURLs:[https://192.168.76.2:2379]} to cluster 6f20f2c4b2fb5f8a
2024-08-18 19:25:58.228147 I | embed: ready to serve client requests
2024-08-18 19:25:58.229908 I | embed: serving client requests on 192.168.76.2:2379
2024-08-18 19:25:58.234024 I | embed: ready to serve client requests
2024-08-18 19:25:58.235613 I | embed: serving client requests on 127.0.0.1:2379
2024-08-18 19:26:18.397418 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-18 19:26:22.081963 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-18 19:26:32.082030 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-18 19:26:42.082250 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-18 19:26:52.082038 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-18 19:27:02.082094 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-18 19:27:12.082017 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-18 19:27:22.082012 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-18 19:27:32.082043 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-18 19:27:42.082291 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-18 19:27:52.082223 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-18 19:28:02.085345 I | etcdserver/api/etcdhttp: /health OK (status code 200)
==> kernel <==
19:34:30 up 1 day, 4:16, 0 users, load average: 1.31, 1.92, 2.43
Linux old-k8s-version-216078 5.15.0-1067-aws #73~20.04.1-Ubuntu SMP Wed Jul 24 17:31:05 UTC 2024 aarch64 aarch64 aarch64 GNU/Linux
PRETTY_NAME="Ubuntu 22.04.4 LTS"
==> kindnet [136b3774b3686f0bcd42b41a696212f7023654f7c9a799d192302697dae329d1] <==
I0818 19:33:09.533638 1 main.go:299] handling current node
I0818 19:33:19.533952 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I0818 19:33:19.533989 1 main.go:299] handling current node
I0818 19:33:29.534171 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I0818 19:33:29.534206 1 main.go:299] handling current node
W0818 19:33:30.394047 1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: failed to list *v1.Namespace: namespaces is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "namespaces" in API group "" at the cluster scope
E0818 19:33:30.394083 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "namespaces" in API group "" at the cluster scope
W0818 19:33:38.194787 1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: failed to list *v1.Pod: pods is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "pods" in API group "" at the cluster scope
E0818 19:33:38.194822 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "pods" in API group "" at the cluster scope
I0818 19:33:39.534239 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I0818 19:33:39.534275 1 main.go:299] handling current node
I0818 19:33:49.535285 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I0818 19:33:49.535552 1 main.go:299] handling current node
I0818 19:33:59.535045 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I0818 19:33:59.535104 1 main.go:299] handling current node
W0818 19:34:05.677260 1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
E0818 19:34:05.677302 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: Failed to watch *v1.NetworkPolicy: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
I0818 19:34:09.534236 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I0818 19:34:09.534283 1 main.go:299] handling current node
W0818 19:34:11.006580 1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: failed to list *v1.Namespace: namespaces is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "namespaces" in API group "" at the cluster scope
E0818 19:34:11.006649 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "namespaces" in API group "" at the cluster scope
I0818 19:34:19.534387 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I0818 19:34:19.534605 1 main.go:299] handling current node
I0818 19:34:29.533612 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I0818 19:34:29.533648 1 main.go:299] handling current node
==> kindnet [80ee1e729513b71685fa053c5499a375152679a2ba2012d6cc5008ba2faab62c] <==
I0818 19:26:56.552101 1 main.go:299] handling current node
W0818 19:27:02.324712 1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
E0818 19:27:02.324752 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: Failed to watch *v1.NetworkPolicy: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
W0818 19:27:04.728615 1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: failed to list *v1.Pod: pods is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "pods" in API group "" at the cluster scope
E0818 19:27:04.728657 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "pods" in API group "" at the cluster scope
I0818 19:27:06.551947 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I0818 19:27:06.552050 1 main.go:299] handling current node
W0818 19:27:07.602526 1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: failed to list *v1.Namespace: namespaces is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "namespaces" in API group "" at the cluster scope
E0818 19:27:07.602637 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "namespaces" in API group "" at the cluster scope
I0818 19:27:16.552197 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I0818 19:27:16.552269 1 main.go:299] handling current node
I0818 19:27:26.552582 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I0818 19:27:26.552618 1 main.go:299] handling current node
I0818 19:27:36.552458 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I0818 19:27:36.552505 1 main.go:299] handling current node
W0818 19:27:37.187720 1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: failed to list *v1.Namespace: namespaces is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "namespaces" in API group "" at the cluster scope
E0818 19:27:37.187753 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "namespaces" in API group "" at the cluster scope
I0818 19:27:46.551560 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I0818 19:27:46.551594 1 main.go:299] handling current node
W0818 19:27:46.810582 1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: failed to list *v1.Pod: pods is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "pods" in API group "" at the cluster scope
E0818 19:27:46.810617 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "pods" in API group "" at the cluster scope
W0818 19:27:47.886744 1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
E0818 19:27:47.886781 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.3/tools/cache/reflector.go:232: Failed to watch *v1.NetworkPolicy: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
I0818 19:27:56.552331 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I0818 19:27:56.552365 1 main.go:299] handling current node
==> kube-apiserver [a70df47e0a4c904f4234489c4b6931a0c40e23791ebbe701bdf79b173c708054] <==
I0818 19:30:49.733499 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0818 19:30:49.733678 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0818 19:31:32.484364 1 client.go:360] parsed scheme: "passthrough"
I0818 19:31:32.484418 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0818 19:31:32.484428 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
W0818 19:31:49.734013 1 handler_proxy.go:102] no RequestInfo found in the context
E0818 19:31:49.734090 1 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I0818 19:31:49.734106 1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
I0818 19:32:10.698817 1 client.go:360] parsed scheme: "passthrough"
I0818 19:32:10.698863 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0818 19:32:10.699015 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0818 19:32:49.380346 1 client.go:360] parsed scheme: "passthrough"
I0818 19:32:49.380399 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0818 19:32:49.380435 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0818 19:33:25.741758 1 client.go:360] parsed scheme: "passthrough"
I0818 19:33:25.741973 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0818 19:33:25.741993 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
W0818 19:33:46.920931 1 handler_proxy.go:102] no RequestInfo found in the context
E0818 19:33:46.921065 1 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I0818 19:33:46.921108 1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
I0818 19:34:08.227932 1 client.go:360] parsed scheme: "passthrough"
I0818 19:34:08.227976 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0818 19:34:08.227987 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
==> kube-apiserver [a80fdd47f7301370c07df42778e346c5b3f9a5082205cddd92243b2292907316] <==
I0818 19:26:05.090538 1 controller.go:132] OpenAPI AggregationController: action for item : Nothing (removed from the queue).
I0818 19:26:05.090576 1 controller.go:132] OpenAPI AggregationController: action for item k8s_internal_local_delegation_chain_0000000000: Nothing (removed from the queue).
I0818 19:26:05.098628 1 storage_scheduling.go:132] created PriorityClass system-node-critical with value 2000001000
I0818 19:26:05.104209 1 storage_scheduling.go:132] created PriorityClass system-cluster-critical with value 2000000000
I0818 19:26:05.104235 1 storage_scheduling.go:148] all system priority classes are created successfully or already exist.
I0818 19:26:05.631417 1 controller.go:606] quota admission added evaluator for: roles.rbac.authorization.k8s.io
I0818 19:26:05.679970 1 controller.go:606] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io
W0818 19:26:05.737963 1 lease.go:233] Resetting endpoints for master service "kubernetes" to [192.168.76.2]
I0818 19:26:05.739122 1 controller.go:606] quota admission added evaluator for: endpoints
I0818 19:26:05.743247 1 controller.go:606] quota admission added evaluator for: endpointslices.discovery.k8s.io
I0818 19:26:06.787005 1 controller.go:606] quota admission added evaluator for: serviceaccounts
I0818 19:26:07.247890 1 controller.go:606] quota admission added evaluator for: deployments.apps
I0818 19:26:07.335153 1 controller.go:606] quota admission added evaluator for: daemonsets.apps
I0818 19:26:15.673948 1 controller.go:606] quota admission added evaluator for: leases.coordination.k8s.io
I0818 19:26:23.024745 1 controller.go:606] quota admission added evaluator for: replicasets.apps
I0818 19:26:23.118755 1 controller.go:606] quota admission added evaluator for: controllerrevisions.apps
I0818 19:26:39.071265 1 client.go:360] parsed scheme: "passthrough"
I0818 19:26:39.071512 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0818 19:26:39.071531 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0818 19:27:15.683422 1 client.go:360] parsed scheme: "passthrough"
I0818 19:27:15.683464 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0818 19:27:15.683473 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0818 19:28:00.059887 1 client.go:360] parsed scheme: "passthrough"
I0818 19:28:00.059942 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0818 19:28:00.059952 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
==> kube-controller-manager [00fecac5b274921d65e34f858a2d0fb18402e84618ee482b50df18739b0495ad] <==
I0818 19:26:23.176757 1 node_lifecycle_controller.go:1429] Initializing eviction metric for zone:
W0818 19:26:23.176858 1 node_lifecycle_controller.go:1044] Missing timestamp for Node old-k8s-version-216078. Assuming now as a timestamp.
I0818 19:26:23.176949 1 node_lifecycle_controller.go:1195] Controller detected that all Nodes are not-Ready. Entering master disruption mode.
I0818 19:26:23.177122 1 taint_manager.go:187] Starting NoExecuteTaintManager
I0818 19:26:23.178333 1 event.go:291] "Event occurred" object="old-k8s-version-216078" kind="Node" apiVersion="v1" type="Normal" reason="RegisteredNode" message="Node old-k8s-version-216078 event: Registered Node old-k8s-version-216078 in Controller"
I0818 19:26:23.204014 1 event.go:291] "Event occurred" object="kube-system/coredns-74ff55c5b" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-74ff55c5b-d6z7k"
I0818 19:26:23.224578 1 shared_informer.go:247] Caches are synced for attach detach
I0818 19:26:23.246256 1 shared_informer.go:247] Caches are synced for namespace
I0818 19:26:23.246382 1 event.go:291] "Event occurred" object="kube-system/kube-proxy" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kube-proxy-n9glb"
I0818 19:26:23.250975 1 event.go:291] "Event occurred" object="kube-system/kube-apiserver-old-k8s-version-216078" kind="Pod" apiVersion="v1" type="Warning" reason="NodeNotReady" message="Node is not ready"
I0818 19:26:23.251059 1 shared_informer.go:247] Caches are synced for resource quota
I0818 19:26:23.267412 1 event.go:291] "Event occurred" object="kube-system/coredns-74ff55c5b" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-74ff55c5b-vvtgz"
I0818 19:26:23.278784 1 shared_informer.go:247] Caches are synced for disruption
I0818 19:26:23.278812 1 disruption.go:339] Sending events to api server.
I0818 19:26:23.281545 1 shared_informer.go:247] Caches are synced for resource quota
I0818 19:26:23.301752 1 event.go:291] "Event occurred" object="kube-system/kindnet" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kindnet-mbxls"
I0818 19:26:23.432677 1 shared_informer.go:240] Waiting for caches to sync for garbage collector
I0818 19:26:23.681602 1 shared_informer.go:247] Caches are synced for garbage collector
I0818 19:26:23.681623 1 garbagecollector.go:151] Garbage collector: all resource monitors have synced. Proceeding to collect garbage
I0818 19:26:23.735025 1 shared_informer.go:247] Caches are synced for garbage collector
I0818 19:26:24.868252 1 event.go:291] "Event occurred" object="kube-system/coredns" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled down replica set coredns-74ff55c5b to 1"
I0818 19:26:24.938738 1 event.go:291] "Event occurred" object="kube-system/coredns-74ff55c5b" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulDelete" message="Deleted pod: coredns-74ff55c5b-d6z7k"
I0818 19:26:28.177200 1 node_lifecycle_controller.go:1222] Controller detected that some Nodes are Ready. Exiting master disruption mode.
I0818 19:28:02.375497 1 event.go:291] "Event occurred" object="kube-system/metrics-server" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set metrics-server-9975d5f86 to 1"
E0818 19:28:02.543003 1 clusterroleaggregation_controller.go:181] edit failed with : Operation cannot be fulfilled on clusterroles.rbac.authorization.k8s.io "edit": the object has been modified; please apply your changes to the latest version and try again
==> kube-controller-manager [6b77034b70c13c794e7e71994e90063cf36dd1fa6cbe8d1784b7ceee707c9aca] <==
E0818 19:30:05.767168 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0818 19:30:11.470636 1 request.go:655] Throttling request took 1.048279983s, request: GET:https://192.168.76.2:8443/apis/extensions/v1beta1?timeout=32s
W0818 19:30:12.322112 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0818 19:30:36.269003 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0818 19:30:43.972498 1 request.go:655] Throttling request took 1.048099269s, request: GET:https://192.168.76.2:8443/apis/node.k8s.io/v1beta1?timeout=32s
W0818 19:30:44.824070 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0818 19:31:06.770800 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0818 19:31:16.474537 1 request.go:655] Throttling request took 1.04839404s, request: GET:https://192.168.76.2:8443/apis/batch/v1beta1?timeout=32s
W0818 19:31:17.325961 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0818 19:31:37.273086 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0818 19:31:48.976554 1 request.go:655] Throttling request took 1.048436151s, request: GET:https://192.168.76.2:8443/apis/apiextensions.k8s.io/v1?timeout=32s
W0818 19:31:49.827893 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0818 19:32:07.800593 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0818 19:32:21.478314 1 request.go:655] Throttling request took 1.047704629s, request: GET:https://192.168.76.2:8443/apis/authorization.k8s.io/v1?timeout=32s
W0818 19:32:22.329772 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0818 19:32:38.302529 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0818 19:32:53.980296 1 request.go:655] Throttling request took 1.048489662s, request: GET:https://192.168.76.2:8443/apis/authentication.k8s.io/v1beta1?timeout=32s
W0818 19:32:54.831747 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0818 19:33:08.804274 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0818 19:33:26.482102 1 request.go:655] Throttling request took 1.048266535s, request: GET:https://192.168.76.2:8443/apis/autoscaling/v2beta2?timeout=32s
W0818 19:33:27.333594 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0818 19:33:39.306054 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0818 19:33:58.984078 1 request.go:655] Throttling request took 1.048535065s, request: GET:https://192.168.76.2:8443/apis/admissionregistration.k8s.io/v1beta1?timeout=32s
W0818 19:33:59.835462 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0818 19:34:09.807995 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
==> kube-proxy [905b265420907d5b4b8ee43b00a698a67557ffce65488b60828117b20fde26b1] <==
I0818 19:26:24.250347 1 node.go:172] Successfully retrieved node IP: 192.168.76.2
I0818 19:26:24.250436 1 server_others.go:142] kube-proxy node IP is an IPv4 address (192.168.76.2), assume IPv4 operation
W0818 19:26:24.315950 1 server_others.go:578] Unknown proxy mode "", assuming iptables proxy
I0818 19:26:24.316055 1 server_others.go:185] Using iptables Proxier.
I0818 19:26:24.316265 1 server.go:650] Version: v1.20.0
I0818 19:26:24.328423 1 config.go:315] Starting service config controller
I0818 19:26:24.328446 1 shared_informer.go:240] Waiting for caches to sync for service config
I0818 19:26:24.328472 1 config.go:224] Starting endpoint slice config controller
I0818 19:26:24.328484 1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config
I0818 19:26:24.428571 1 shared_informer.go:247] Caches are synced for endpoint slice config
I0818 19:26:24.428644 1 shared_informer.go:247] Caches are synced for service config
==> kube-proxy [d9c85aaaa043f149f3f6daad7c932a643b6619f4c4cb7755b152310052480f6f] <==
I0818 19:28:49.407693 1 node.go:172] Successfully retrieved node IP: 192.168.76.2
I0818 19:28:49.407764 1 server_others.go:142] kube-proxy node IP is an IPv4 address (192.168.76.2), assume IPv4 operation
W0818 19:28:49.469882 1 server_others.go:578] Unknown proxy mode "", assuming iptables proxy
I0818 19:28:49.470181 1 server_others.go:185] Using iptables Proxier.
I0818 19:28:49.470547 1 server.go:650] Version: v1.20.0
I0818 19:28:49.471442 1 config.go:315] Starting service config controller
I0818 19:28:49.471513 1 shared_informer.go:240] Waiting for caches to sync for service config
I0818 19:28:49.471556 1 config.go:224] Starting endpoint slice config controller
I0818 19:28:49.471595 1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config
I0818 19:28:49.571653 1 shared_informer.go:247] Caches are synced for endpoint slice config
I0818 19:28:49.571735 1 shared_informer.go:247] Caches are synced for service config
==> kube-scheduler [3f55d380c20ce8abf819eb90f1107f99b6883a3af7d8b0c875d12639b6f5a1a4] <==
I0818 19:28:37.907562 1 serving.go:331] Generated self-signed cert in-memory
W0818 19:28:45.754863 1 requestheader_controller.go:193] Unable to get configmap/extension-apiserver-authentication in kube-system. Usually fixed by 'kubectl create rolebinding -n kube-system ROLEBINDING_NAME --role=extension-apiserver-authentication-reader --serviceaccount=YOUR_NS:YOUR_SA'
W0818 19:28:45.754904 1 authentication.go:332] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"
W0818 19:28:45.754918 1 authentication.go:333] Continuing without authentication configuration. This may treat all requests as anonymous.
W0818 19:28:45.754924 1 authentication.go:334] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false
I0818 19:28:46.044587 1 secure_serving.go:197] Serving securely on 127.0.0.1:10259
I0818 19:28:46.063429 1 configmap_cafile_content.go:202] Starting client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0818 19:28:46.063447 1 shared_informer.go:240] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0818 19:28:46.063476 1 tlsconfig.go:240] Starting DynamicServingCertificateController
I0818 19:28:46.263595 1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
==> kube-scheduler [c1f327db25afffcb7632d994277e73b15d44e051118ecff71b21299a38bcbe10] <==
I0818 19:25:59.239399 1 serving.go:331] Generated self-signed cert in-memory
W0818 19:26:04.242176 1 requestheader_controller.go:193] Unable to get configmap/extension-apiserver-authentication in kube-system. Usually fixed by 'kubectl create rolebinding -n kube-system ROLEBINDING_NAME --role=extension-apiserver-authentication-reader --serviceaccount=YOUR_NS:YOUR_SA'
W0818 19:26:04.242222 1 authentication.go:332] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"
W0818 19:26:04.242232 1 authentication.go:333] Continuing without authentication configuration. This may treat all requests as anonymous.
W0818 19:26:04.242237 1 authentication.go:334] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false
I0818 19:26:04.354895 1 secure_serving.go:197] Serving securely on 127.0.0.1:10259
I0818 19:26:04.354981 1 configmap_cafile_content.go:202] Starting client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0818 19:26:04.354988 1 shared_informer.go:240] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0818 19:26:04.355009 1 tlsconfig.go:240] Starting DynamicServingCertificateController
E0818 19:26:04.384212 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
E0818 19:26:04.384454 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
E0818 19:26:04.384573 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
E0818 19:26:04.384751 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
E0818 19:26:04.384897 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1beta1.PodDisruptionBudget: failed to list *v1beta1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
E0818 19:26:04.385063 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
E0818 19:26:04.385184 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
E0818 19:26:04.385296 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
E0818 19:26:04.385378 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
E0818 19:26:04.385486 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
E0818 19:26:04.385581 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
E0818 19:26:04.398189 1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
E0818 19:26:05.312440 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
I0818 19:26:06.055187 1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
==> kubelet <==
Aug 18 19:32:58 old-k8s-version-216078 kubelet[659]: E0818 19:32:58.740474 659 pod_workers.go:191] Error syncing pod 40ad3299-8676-4f1f-a314-c139b58a3e50 ("metrics-server-9975d5f86-5k9lw_kube-system(40ad3299-8676-4f1f-a314-c139b58a3e50)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Aug 18 19:33:10 old-k8s-version-216078 kubelet[659]: I0818 19:33:10.739733 659 scope.go:95] [topologymanager] RemoveContainer - Container ID: 3b6d2b1b4ae9a754515adb79d3fa5549aad0d5f9d5b9082c3a443b893020e7d2
Aug 18 19:33:10 old-k8s-version-216078 kubelet[659]: E0818 19:33:10.740134 659 pod_workers.go:191] Error syncing pod 8c3c11f9-c5cc-46fd-af21-f01b7f474e46 ("dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"
Aug 18 19:33:12 old-k8s-version-216078 kubelet[659]: E0818 19:33:12.740523 659 pod_workers.go:191] Error syncing pod 40ad3299-8676-4f1f-a314-c139b58a3e50 ("metrics-server-9975d5f86-5k9lw_kube-system(40ad3299-8676-4f1f-a314-c139b58a3e50)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Aug 18 19:33:21 old-k8s-version-216078 kubelet[659]: I0818 19:33:21.743845 659 scope.go:95] [topologymanager] RemoveContainer - Container ID: 3b6d2b1b4ae9a754515adb79d3fa5549aad0d5f9d5b9082c3a443b893020e7d2
Aug 18 19:33:21 old-k8s-version-216078 kubelet[659]: E0818 19:33:21.744175 659 pod_workers.go:191] Error syncing pod 8c3c11f9-c5cc-46fd-af21-f01b7f474e46 ("dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"
Aug 18 19:33:26 old-k8s-version-216078 kubelet[659]: E0818 19:33:26.742186 659 pod_workers.go:191] Error syncing pod 40ad3299-8676-4f1f-a314-c139b58a3e50 ("metrics-server-9975d5f86-5k9lw_kube-system(40ad3299-8676-4f1f-a314-c139b58a3e50)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Aug 18 19:33:33 old-k8s-version-216078 kubelet[659]: I0818 19:33:33.744484 659 scope.go:95] [topologymanager] RemoveContainer - Container ID: 3b6d2b1b4ae9a754515adb79d3fa5549aad0d5f9d5b9082c3a443b893020e7d2
Aug 18 19:33:33 old-k8s-version-216078 kubelet[659]: E0818 19:33:33.745221 659 pod_workers.go:191] Error syncing pod 8c3c11f9-c5cc-46fd-af21-f01b7f474e46 ("dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"
Aug 18 19:33:37 old-k8s-version-216078 kubelet[659]: E0818 19:33:37.740667 659 pod_workers.go:191] Error syncing pod 40ad3299-8676-4f1f-a314-c139b58a3e50 ("metrics-server-9975d5f86-5k9lw_kube-system(40ad3299-8676-4f1f-a314-c139b58a3e50)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Aug 18 19:33:46 old-k8s-version-216078 kubelet[659]: I0818 19:33:46.739742 659 scope.go:95] [topologymanager] RemoveContainer - Container ID: 3b6d2b1b4ae9a754515adb79d3fa5549aad0d5f9d5b9082c3a443b893020e7d2
Aug 18 19:33:46 old-k8s-version-216078 kubelet[659]: E0818 19:33:46.740184 659 pod_workers.go:191] Error syncing pod 8c3c11f9-c5cc-46fd-af21-f01b7f474e46 ("dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"
Aug 18 19:33:48 old-k8s-version-216078 kubelet[659]: E0818 19:33:48.741619 659 pod_workers.go:191] Error syncing pod 40ad3299-8676-4f1f-a314-c139b58a3e50 ("metrics-server-9975d5f86-5k9lw_kube-system(40ad3299-8676-4f1f-a314-c139b58a3e50)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Aug 18 19:33:59 old-k8s-version-216078 kubelet[659]: I0818 19:33:59.739726 659 scope.go:95] [topologymanager] RemoveContainer - Container ID: 3b6d2b1b4ae9a754515adb79d3fa5549aad0d5f9d5b9082c3a443b893020e7d2
Aug 18 19:33:59 old-k8s-version-216078 kubelet[659]: E0818 19:33:59.740109 659 pod_workers.go:191] Error syncing pod 8c3c11f9-c5cc-46fd-af21-f01b7f474e46 ("dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"
Aug 18 19:34:02 old-k8s-version-216078 kubelet[659]: E0818 19:34:02.740456 659 pod_workers.go:191] Error syncing pod 40ad3299-8676-4f1f-a314-c139b58a3e50 ("metrics-server-9975d5f86-5k9lw_kube-system(40ad3299-8676-4f1f-a314-c139b58a3e50)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Aug 18 19:34:10 old-k8s-version-216078 kubelet[659]: I0818 19:34:10.739780 659 scope.go:95] [topologymanager] RemoveContainer - Container ID: 3b6d2b1b4ae9a754515adb79d3fa5549aad0d5f9d5b9082c3a443b893020e7d2
Aug 18 19:34:10 old-k8s-version-216078 kubelet[659]: E0818 19:34:10.740182 659 pod_workers.go:191] Error syncing pod 8c3c11f9-c5cc-46fd-af21-f01b7f474e46 ("dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"
Aug 18 19:34:15 old-k8s-version-216078 kubelet[659]: E0818 19:34:15.741175 659 pod_workers.go:191] Error syncing pod 40ad3299-8676-4f1f-a314-c139b58a3e50 ("metrics-server-9975d5f86-5k9lw_kube-system(40ad3299-8676-4f1f-a314-c139b58a3e50)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Aug 18 19:34:25 old-k8s-version-216078 kubelet[659]: I0818 19:34:25.740319 659 scope.go:95] [topologymanager] RemoveContainer - Container ID: 3b6d2b1b4ae9a754515adb79d3fa5549aad0d5f9d5b9082c3a443b893020e7d2
Aug 18 19:34:25 old-k8s-version-216078 kubelet[659]: E0818 19:34:25.740655 659 pod_workers.go:191] Error syncing pod 8c3c11f9-c5cc-46fd-af21-f01b7f474e46 ("dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-shnnv_kubernetes-dashboard(8c3c11f9-c5cc-46fd-af21-f01b7f474e46)"
Aug 18 19:34:26 old-k8s-version-216078 kubelet[659]: E0818 19:34:26.758120 659 remote_image.go:113] PullImage "fake.domain/registry.k8s.io/echoserver:1.4" from image service failed: rpc error: code = Unknown desc = failed to pull and unpack image "fake.domain/registry.k8s.io/echoserver:1.4": failed to resolve reference "fake.domain/registry.k8s.io/echoserver:1.4": failed to do request: Head "https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host
Aug 18 19:34:26 old-k8s-version-216078 kubelet[659]: E0818 19:34:26.758716 659 kuberuntime_image.go:51] Pull image "fake.domain/registry.k8s.io/echoserver:1.4" failed: rpc error: code = Unknown desc = failed to pull and unpack image "fake.domain/registry.k8s.io/echoserver:1.4": failed to resolve reference "fake.domain/registry.k8s.io/echoserver:1.4": failed to do request: Head "https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host
Aug 18 19:34:26 old-k8s-version-216078 kubelet[659]: E0818 19:34:26.759143 659 kuberuntime_manager.go:829] container &Container{Name:metrics-server,Image:fake.domain/registry.k8s.io/echoserver:1.4,Command:[],Args:[--cert-dir=/tmp --secure-port=4443 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --kubelet-use-node-status-port --metric-resolution=60s --kubelet-insecure-tls],WorkingDir:,Ports:[]ContainerPort{ContainerPort{Name:https,HostPort:0,ContainerPort:4443,Protocol:TCP,HostIP:,},},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{cpu: {{100 -3} {<nil>} 100m DecimalSI},memory: {{209715200 0} {<nil>} BinarySI},},},VolumeMounts:[]VolumeMount{VolumeMount{Name:tmp-dir,ReadOnly:false,MountPath:/tmp,SubPath:,MountPropagation:nil,SubPathExpr:,},VolumeMount{Name:metrics-server-token-lkhr7,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:&Probe{Handler:Handler{Exec
:nil,HTTPGet:&HTTPGetAction{Path:/livez,Port:{1 0 https},Host:,Scheme:HTTPS,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,},InitialDelaySeconds:0,TimeoutSeconds:1,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,},ReadinessProbe:&Probe{Handler:Handler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/readyz,Port:{1 0 https},Host:,Scheme:HTTPS,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,},InitialDelaySeconds:0,TimeoutSeconds:1,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:*1000,RunAsNonRoot:*true,ReadOnlyRootFilesystem:*true,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,} start failed in pod metrics-server-9975d5f86-5k9lw_kube-system(40ad329
9-8676-4f1f-a314-c139b58a3e50): ErrImagePull: rpc error: code = Unknown desc = failed to pull and unpack image "fake.domain/registry.k8s.io/echoserver:1.4": failed to resolve reference "fake.domain/registry.k8s.io/echoserver:1.4": failed to do request: Head "https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host
Aug 18 19:34:26 old-k8s-version-216078 kubelet[659]: E0818 19:34:26.759399 659 pod_workers.go:191] Error syncing pod 40ad3299-8676-4f1f-a314-c139b58a3e50 ("metrics-server-9975d5f86-5k9lw_kube-system(40ad3299-8676-4f1f-a314-c139b58a3e50)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
==> kubernetes-dashboard [aea462f9a5614878af08a599d3ec3ce490ef7ff8d286df3bad62c54b80d55394] <==
2024/08/18 19:29:13 Using namespace: kubernetes-dashboard
2024/08/18 19:29:13 Using in-cluster config to connect to apiserver
2024/08/18 19:29:13 Using secret token for csrf signing
2024/08/18 19:29:13 Initializing csrf token from kubernetes-dashboard-csrf secret
2024/08/18 19:29:13 Empty token. Generating and storing in a secret kubernetes-dashboard-csrf
2024/08/18 19:29:13 Successful initial request to the apiserver, version: v1.20.0
2024/08/18 19:29:13 Generating JWE encryption key
2024/08/18 19:29:13 New synchronizer has been registered: kubernetes-dashboard-key-holder-kubernetes-dashboard. Starting
2024/08/18 19:29:13 Starting secret synchronizer for kubernetes-dashboard-key-holder in namespace kubernetes-dashboard
2024/08/18 19:29:14 Initializing JWE encryption key from synchronized object
2024/08/18 19:29:14 Creating in-cluster Sidecar client
2024/08/18 19:29:14 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/08/18 19:29:14 Serving insecurely on HTTP port: 9090
2024/08/18 19:29:44 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/08/18 19:30:14 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/08/18 19:30:44 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/08/18 19:31:14 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/08/18 19:31:44 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/08/18 19:32:14 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/08/18 19:32:44 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/08/18 19:33:14 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/08/18 19:33:44 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/08/18 19:34:14 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/08/18 19:29:13 Starting overwatch
==> storage-provisioner [35e10341a264471c2a4ba4fc06d275735b1230d24e7fa77bea16c30257e91109] <==
I0818 19:29:31.880969 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
I0818 19:29:31.902654 1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
I0818 19:29:31.902701 1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
I0818 19:29:49.380506 1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
I0818 19:29:49.383515 1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_old-k8s-version-216078_2a36c6e8-8439-4cae-a5d7-b900f95315e1!
I0818 19:29:49.388312 1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"e392ce86-1657-4460-a535-f84a7aaeafb9", APIVersion:"v1", ResourceVersion:"839", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' old-k8s-version-216078_2a36c6e8-8439-4cae-a5d7-b900f95315e1 became leader
I0818 19:29:49.486344 1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_old-k8s-version-216078_2a36c6e8-8439-4cae-a5d7-b900f95315e1!
==> storage-provisioner [48b1e06eab89513ac1b65a73dd1d7880d6028031dc94ee400b4ceb77169245aa] <==
I0818 19:28:49.007807 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
F0818 19:29:19.014481 1 main.go:39] error getting server version: Get "https://10.96.0.1:443/version?timeout=32s": dial tcp 10.96.0.1:443: i/o timeout
-- /stdout --
helpers_test.go:254: (dbg) Run: out/minikube-linux-arm64 status --format={{.APIServer}} -p old-k8s-version-216078 -n old-k8s-version-216078
helpers_test.go:261: (dbg) Run: kubectl --context old-k8s-version-216078 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:272: non-running pods: metrics-server-9975d5f86-5k9lw
helpers_test.go:274: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: describe non-running pods <======
helpers_test.go:277: (dbg) Run: kubectl --context old-k8s-version-216078 describe pod metrics-server-9975d5f86-5k9lw
helpers_test.go:277: (dbg) Non-zero exit: kubectl --context old-k8s-version-216078 describe pod metrics-server-9975d5f86-5k9lw: exit status 1 (105.970258ms)
** stderr **
Error from server (NotFound): pods "metrics-server-9975d5f86-5k9lw" not found
** /stderr **
helpers_test.go:279: kubectl --context old-k8s-version-216078 describe pod metrics-server-9975d5f86-5k9lw: exit status 1
--- FAIL: TestStartStop/group/old-k8s-version/serial/SecondStart (376.68s)