=== RUN TestStartStop/group/old-k8s-version/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run: out/minikube-linux-arm64 start -p old-k8s-version-668722 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=containerd --kubernetes-version=v1.20.0
start_stop_delete_test.go:256: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p old-k8s-version-668722 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=containerd --kubernetes-version=v1.20.0: exit status 102 (6m10.199864503s)
-- stdout --
* [old-k8s-version-668722] minikube v1.33.1 on Ubuntu 20.04 (arm64)
- MINIKUBE_LOCATION=19312
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/19312-2449638/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/19312-2449638/.minikube
- MINIKUBE_BIN=out/minikube-linux-arm64
- MINIKUBE_FORCE_SYSTEMD=
* Kubernetes 1.30.3 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.30.3
* Using the docker driver based on existing profile
* Starting "old-k8s-version-668722" primary control-plane node in "old-k8s-version-668722" cluster
* Pulling base image v0.0.44-1721902582-19326 ...
* Restarting existing docker container for "old-k8s-version-668722" ...
* Preparing Kubernetes v1.20.0 on containerd 1.7.19 ...
* Verifying Kubernetes components...
- Using image gcr.io/k8s-minikube/storage-provisioner:v5
- Using image docker.io/kubernetesui/dashboard:v2.7.0
- Using image fake.domain/registry.k8s.io/echoserver:1.4
- Using image registry.k8s.io/echoserver:1.4
* Some dashboard features require the metrics-server addon. To enable all features please run:
minikube -p old-k8s-version-668722 addons enable metrics-server
* Enabled addons: default-storageclass, storage-provisioner, metrics-server, dashboard
-- /stdout --
** stderr **
I0801 02:31:38.398951 2658647 out.go:291] Setting OutFile to fd 1 ...
I0801 02:31:38.399173 2658647 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0801 02:31:38.399184 2658647 out.go:304] Setting ErrFile to fd 2...
I0801 02:31:38.399189 2658647 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0801 02:31:38.399446 2658647 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19312-2449638/.minikube/bin
I0801 02:31:38.399836 2658647 out.go:298] Setting JSON to false
I0801 02:31:38.400937 2658647 start.go:129] hostinfo: {"hostname":"ip-172-31-30-239","uptime":36835,"bootTime":1722442663,"procs":206,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1066-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"92f46a7d-c249-4c12-924a-77f64874c910"}
I0801 02:31:38.401018 2658647 start.go:139] virtualization:
I0801 02:31:38.403750 2658647 out.go:177] * [old-k8s-version-668722] minikube v1.33.1 on Ubuntu 20.04 (arm64)
I0801 02:31:38.406350 2658647 out.go:177] - MINIKUBE_LOCATION=19312
I0801 02:31:38.406425 2658647 notify.go:220] Checking for updates...
I0801 02:31:38.411582 2658647 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0801 02:31:38.413530 2658647 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/19312-2449638/kubeconfig
I0801 02:31:38.415511 2658647 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/19312-2449638/.minikube
I0801 02:31:38.417645 2658647 out.go:177] - MINIKUBE_BIN=out/minikube-linux-arm64
I0801 02:31:38.419687 2658647 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0801 02:31:38.422169 2658647 config.go:182] Loaded profile config "old-k8s-version-668722": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0
I0801 02:31:38.424420 2658647 out.go:177] * Kubernetes 1.30.3 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.30.3
I0801 02:31:38.426606 2658647 driver.go:392] Setting default libvirt URI to qemu:///system
I0801 02:31:38.448352 2658647 docker.go:123] docker version: linux-27.1.1:Docker Engine - Community
I0801 02:31:38.448484 2658647 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0801 02:31:38.511068 2658647 info.go:266] docker info: {ID:6ZPO:QZND:VNGE:LUKL:4Y3K:XELL:AAX4:2GTK:E6LM:MPRN:3ZXR:TTMR Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:39 OomKillDisable:true NGoroutines:51 SystemTime:2024-08-01 02:31:38.50099987 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1066-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aarc
h64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214900736 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-30-239 Labels:[] ExperimentalBuild:false ServerVersion:27.1.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41 Expected:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerError
s:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.16.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.1]] Warnings:<nil>}}
I0801 02:31:38.511181 2658647 docker.go:307] overlay module found
I0801 02:31:38.513589 2658647 out.go:177] * Using the docker driver based on existing profile
I0801 02:31:38.515441 2658647 start.go:297] selected driver: docker
I0801 02:31:38.515457 2658647 start.go:901] validating driver "docker" against &{Name:old-k8s-version-668722 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-668722 Namespace:default APIServerHAVIP: AP
IServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:fa
lse MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0801 02:31:38.515592 2658647 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0801 02:31:38.516229 2658647 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0801 02:31:38.578625 2658647 info.go:266] docker info: {ID:6ZPO:QZND:VNGE:LUKL:4Y3K:XELL:AAX4:2GTK:E6LM:MPRN:3ZXR:TTMR Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:39 OomKillDisable:true NGoroutines:51 SystemTime:2024-08-01 02:31:38.567150354 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1066-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214900736 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-30-239 Labels:[] ExperimentalBuild:false ServerVersion:27.1.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41 Expected:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.16.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.1]] Warnings:<nil>}}
I0801 02:31:38.579057 2658647 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0801 02:31:38.579118 2658647 cni.go:84] Creating CNI manager for ""
I0801 02:31:38.579144 2658647 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0801 02:31:38.579194 2658647 start.go:340] cluster config:
{Name:old-k8s-version-668722 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-668722 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local
ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:do
cker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0801 02:31:38.581566 2658647 out.go:177] * Starting "old-k8s-version-668722" primary control-plane node in "old-k8s-version-668722" cluster
I0801 02:31:38.583464 2658647 cache.go:121] Beginning downloading kic base image for docker with containerd
I0801 02:31:38.585460 2658647 out.go:177] * Pulling base image v0.0.44-1721902582-19326 ...
I0801 02:31:38.587162 2658647 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime containerd
I0801 02:31:38.587224 2658647 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19312-2449638/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-containerd-overlay2-arm64.tar.lz4
I0801 02:31:38.587237 2658647 cache.go:56] Caching tarball of preloaded images
I0801 02:31:38.587269 2658647 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 in local docker daemon
I0801 02:31:38.587316 2658647 preload.go:172] Found /home/jenkins/minikube-integration/19312-2449638/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-containerd-overlay2-arm64.tar.lz4 in cache, skipping download
I0801 02:31:38.587327 2658647 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on containerd
I0801 02:31:38.587440 2658647 profile.go:143] Saving config to /home/jenkins/minikube-integration/19312-2449638/.minikube/profiles/old-k8s-version-668722/config.json ...
W0801 02:31:38.610185 2658647 image.go:95] image gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 is of wrong architecture
I0801 02:31:38.610206 2658647 cache.go:149] Downloading gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 to local cache
I0801 02:31:38.610277 2658647 image.go:63] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 in local cache directory
I0801 02:31:38.610302 2658647 image.go:66] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 in local cache directory, skipping pull
I0801 02:31:38.610310 2658647 image.go:135] gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 exists in cache, skipping pull
I0801 02:31:38.610319 2658647 cache.go:152] successfully saved gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 as a tarball
I0801 02:31:38.610324 2658647 cache.go:162] Loading gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 from local cache
I0801 02:31:38.739899 2658647 cache.go:164] successfully loaded and using gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 from cached tarball
I0801 02:31:38.739936 2658647 cache.go:194] Successfully downloaded all kic artifacts
I0801 02:31:38.739995 2658647 start.go:360] acquireMachinesLock for old-k8s-version-668722: {Name:mk811c8fb450a135bde728db5caabf82a6e9b007 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0801 02:31:38.740117 2658647 start.go:364] duration metric: took 84.807µs to acquireMachinesLock for "old-k8s-version-668722"
I0801 02:31:38.740153 2658647 start.go:96] Skipping create...Using existing machine configuration
I0801 02:31:38.740168 2658647 fix.go:54] fixHost starting:
I0801 02:31:38.740615 2658647 cli_runner.go:164] Run: docker container inspect old-k8s-version-668722 --format={{.State.Status}}
I0801 02:31:38.757041 2658647 fix.go:112] recreateIfNeeded on old-k8s-version-668722: state=Stopped err=<nil>
W0801 02:31:38.757074 2658647 fix.go:138] unexpected machine state, will restart: <nil>
I0801 02:31:38.759142 2658647 out.go:177] * Restarting existing docker container for "old-k8s-version-668722" ...
I0801 02:31:38.760867 2658647 cli_runner.go:164] Run: docker start old-k8s-version-668722
I0801 02:31:39.106425 2658647 cli_runner.go:164] Run: docker container inspect old-k8s-version-668722 --format={{.State.Status}}
I0801 02:31:39.126258 2658647 kic.go:430] container "old-k8s-version-668722" state is running.
I0801 02:31:39.126675 2658647 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-668722
I0801 02:31:39.149910 2658647 profile.go:143] Saving config to /home/jenkins/minikube-integration/19312-2449638/.minikube/profiles/old-k8s-version-668722/config.json ...
I0801 02:31:39.150294 2658647 machine.go:94] provisionDockerMachine start ...
I0801 02:31:39.150371 2658647 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-668722
I0801 02:31:39.171584 2658647 main.go:141] libmachine: Using SSH client type: native
I0801 02:31:39.171846 2658647 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2cd0] 0x3e5530 <nil> [] 0s} 127.0.0.1 35724 <nil> <nil>}
I0801 02:31:39.171855 2658647 main.go:141] libmachine: About to run SSH command:
hostname
I0801 02:31:39.172582 2658647 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:37470->127.0.0.1:35724: read: connection reset by peer
I0801 02:31:42.320065 2658647 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-668722
I0801 02:31:42.320094 2658647 ubuntu.go:169] provisioning hostname "old-k8s-version-668722"
I0801 02:31:42.320220 2658647 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-668722
I0801 02:31:42.351954 2658647 main.go:141] libmachine: Using SSH client type: native
I0801 02:31:42.352221 2658647 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2cd0] 0x3e5530 <nil> [] 0s} 127.0.0.1 35724 <nil> <nil>}
I0801 02:31:42.352239 2658647 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-668722 && echo "old-k8s-version-668722" | sudo tee /etc/hostname
I0801 02:31:42.496672 2658647 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-668722
I0801 02:31:42.496751 2658647 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-668722
I0801 02:31:42.514823 2658647 main.go:141] libmachine: Using SSH client type: native
I0801 02:31:42.515077 2658647 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2cd0] 0x3e5530 <nil> [] 0s} 127.0.0.1 35724 <nil> <nil>}
I0801 02:31:42.515094 2658647 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-668722' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-668722/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-668722' | sudo tee -a /etc/hosts;
fi
fi
I0801 02:31:42.648955 2658647 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0801 02:31:42.648987 2658647 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/19312-2449638/.minikube CaCertPath:/home/jenkins/minikube-integration/19312-2449638/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19312-2449638/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19312-2449638/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19312-2449638/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19312-2449638/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19312-2449638/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19312-2449638/.minikube}
I0801 02:31:42.649019 2658647 ubuntu.go:177] setting up certificates
I0801 02:31:42.649029 2658647 provision.go:84] configureAuth start
I0801 02:31:42.649100 2658647 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-668722
I0801 02:31:42.667381 2658647 provision.go:143] copyHostCerts
I0801 02:31:42.667456 2658647 exec_runner.go:144] found /home/jenkins/minikube-integration/19312-2449638/.minikube/cert.pem, removing ...
I0801 02:31:42.667466 2658647 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19312-2449638/.minikube/cert.pem
I0801 02:31:42.667543 2658647 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19312-2449638/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19312-2449638/.minikube/cert.pem (1123 bytes)
I0801 02:31:42.667648 2658647 exec_runner.go:144] found /home/jenkins/minikube-integration/19312-2449638/.minikube/key.pem, removing ...
I0801 02:31:42.667653 2658647 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19312-2449638/.minikube/key.pem
I0801 02:31:42.667682 2658647 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19312-2449638/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19312-2449638/.minikube/key.pem (1675 bytes)
I0801 02:31:42.667745 2658647 exec_runner.go:144] found /home/jenkins/minikube-integration/19312-2449638/.minikube/ca.pem, removing ...
I0801 02:31:42.667749 2658647 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19312-2449638/.minikube/ca.pem
I0801 02:31:42.667773 2658647 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19312-2449638/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19312-2449638/.minikube/ca.pem (1082 bytes)
I0801 02:31:42.667827 2658647 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19312-2449638/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19312-2449638/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19312-2449638/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-668722 san=[127.0.0.1 192.168.85.2 localhost minikube old-k8s-version-668722]
I0801 02:31:42.826316 2658647 provision.go:177] copyRemoteCerts
I0801 02:31:42.826420 2658647 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0801 02:31:42.826486 2658647 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-668722
I0801 02:31:42.843512 2658647 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:35724 SSHKeyPath:/home/jenkins/minikube-integration/19312-2449638/.minikube/machines/old-k8s-version-668722/id_rsa Username:docker}
I0801 02:31:42.942173 2658647 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19312-2449638/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
I0801 02:31:42.968548 2658647 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19312-2449638/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0801 02:31:42.994797 2658647 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19312-2449638/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0801 02:31:43.024044 2658647 provision.go:87] duration metric: took 375.001192ms to configureAuth
I0801 02:31:43.024122 2658647 ubuntu.go:193] setting minikube options for container-runtime
I0801 02:31:43.024388 2658647 config.go:182] Loaded profile config "old-k8s-version-668722": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0
I0801 02:31:43.024402 2658647 machine.go:97] duration metric: took 3.874091477s to provisionDockerMachine
I0801 02:31:43.024412 2658647 start.go:293] postStartSetup for "old-k8s-version-668722" (driver="docker")
I0801 02:31:43.024423 2658647 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0801 02:31:43.024493 2658647 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0801 02:31:43.024537 2658647 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-668722
I0801 02:31:43.042867 2658647 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:35724 SSHKeyPath:/home/jenkins/minikube-integration/19312-2449638/.minikube/machines/old-k8s-version-668722/id_rsa Username:docker}
I0801 02:31:43.141658 2658647 ssh_runner.go:195] Run: cat /etc/os-release
I0801 02:31:43.145503 2658647 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0801 02:31:43.145583 2658647 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0801 02:31:43.145609 2658647 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0801 02:31:43.145655 2658647 info.go:137] Remote host: Ubuntu 22.04.4 LTS
I0801 02:31:43.145685 2658647 filesync.go:126] Scanning /home/jenkins/minikube-integration/19312-2449638/.minikube/addons for local assets ...
I0801 02:31:43.145775 2658647 filesync.go:126] Scanning /home/jenkins/minikube-integration/19312-2449638/.minikube/files for local assets ...
I0801 02:31:43.145913 2658647 filesync.go:149] local asset: /home/jenkins/minikube-integration/19312-2449638/.minikube/files/etc/ssl/certs/24550302.pem -> 24550302.pem in /etc/ssl/certs
I0801 02:31:43.146073 2658647 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0801 02:31:43.154988 2658647 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19312-2449638/.minikube/files/etc/ssl/certs/24550302.pem --> /etc/ssl/certs/24550302.pem (1708 bytes)
I0801 02:31:43.182438 2658647 start.go:296] duration metric: took 158.008389ms for postStartSetup
I0801 02:31:43.182593 2658647 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0801 02:31:43.182667 2658647 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-668722
I0801 02:31:43.199876 2658647 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:35724 SSHKeyPath:/home/jenkins/minikube-integration/19312-2449638/.minikube/machines/old-k8s-version-668722/id_rsa Username:docker}
I0801 02:31:43.289774 2658647 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I0801 02:31:43.294194 2658647 fix.go:56] duration metric: took 4.554024779s for fixHost
I0801 02:31:43.294217 2658647 start.go:83] releasing machines lock for "old-k8s-version-668722", held for 4.554085053s
I0801 02:31:43.294299 2658647 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-668722
I0801 02:31:43.310177 2658647 ssh_runner.go:195] Run: cat /version.json
I0801 02:31:43.310235 2658647 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-668722
I0801 02:31:43.310561 2658647 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0801 02:31:43.310625 2658647 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-668722
I0801 02:31:43.325582 2658647 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:35724 SSHKeyPath:/home/jenkins/minikube-integration/19312-2449638/.minikube/machines/old-k8s-version-668722/id_rsa Username:docker}
I0801 02:31:43.350391 2658647 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:35724 SSHKeyPath:/home/jenkins/minikube-integration/19312-2449638/.minikube/machines/old-k8s-version-668722/id_rsa Username:docker}
I0801 02:31:43.420046 2658647 ssh_runner.go:195] Run: systemctl --version
I0801 02:31:43.556484 2658647 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I0801 02:31:43.561407 2658647 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
I0801 02:31:43.579810 2658647 cni.go:230] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
I0801 02:31:43.579888 2658647 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0801 02:31:43.589365 2658647 cni.go:259] no active bridge cni configs found in "/etc/cni/net.d" - nothing to disable
I0801 02:31:43.589394 2658647 start.go:495] detecting cgroup driver to use...
I0801 02:31:43.589426 2658647 detect.go:187] detected "cgroupfs" cgroup driver on host os
I0801 02:31:43.589481 2658647 ssh_runner.go:195] Run: sudo systemctl stop -f crio
I0801 02:31:43.603595 2658647 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I0801 02:31:43.615314 2658647 docker.go:217] disabling cri-docker service (if available) ...
I0801 02:31:43.615376 2658647 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0801 02:31:43.629946 2658647 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0801 02:31:43.642675 2658647 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0801 02:31:43.727384 2658647 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0801 02:31:43.832765 2658647 docker.go:233] disabling docker service ...
I0801 02:31:43.832888 2658647 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0801 02:31:43.846379 2658647 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0801 02:31:43.858708 2658647 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0801 02:31:43.949069 2658647 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0801 02:31:44.037501 2658647 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0801 02:31:44.050175 2658647 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock
" | sudo tee /etc/crictl.yaml"
I0801 02:31:44.099199 2658647 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.2"|' /etc/containerd/config.toml"
I0801 02:31:44.110619 2658647 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
I0801 02:31:44.121876 2658647 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...
I0801 02:31:44.122006 2658647 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
I0801 02:31:44.132611 2658647 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0801 02:31:44.143790 2658647 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
I0801 02:31:44.156094 2658647 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0801 02:31:44.167946 2658647 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0801 02:31:44.178816 2658647 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
I0801 02:31:44.189544 2658647 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0801 02:31:44.198234 2658647 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0801 02:31:44.207146 2658647 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0801 02:31:44.293689 2658647 ssh_runner.go:195] Run: sudo systemctl restart containerd
I0801 02:31:44.473528 2658647 start.go:542] Will wait 60s for socket path /run/containerd/containerd.sock
I0801 02:31:44.473599 2658647 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
I0801 02:31:44.478060 2658647 start.go:563] Will wait 60s for crictl version
I0801 02:31:44.478129 2658647 ssh_runner.go:195] Run: which crictl
I0801 02:31:44.482142 2658647 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0801 02:31:44.521774 2658647 start.go:579] Version: 0.1.0
RuntimeName: containerd
RuntimeVersion: 1.7.19
RuntimeApiVersion: v1
I0801 02:31:44.521923 2658647 ssh_runner.go:195] Run: containerd --version
I0801 02:31:44.550674 2658647 ssh_runner.go:195] Run: containerd --version
I0801 02:31:44.577778 2658647 out.go:177] * Preparing Kubernetes v1.20.0 on containerd 1.7.19 ...
I0801 02:31:44.579942 2658647 cli_runner.go:164] Run: docker network inspect old-k8s-version-668722 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0801 02:31:44.602061 2658647 ssh_runner.go:195] Run: grep 192.168.85.1 host.minikube.internal$ /etc/hosts
I0801 02:31:44.605817 2658647 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.85.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0801 02:31:44.617113 2658647 kubeadm.go:883] updating cluster {Name:old-k8s-version-668722 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-668722 Namespace:default APIServerHAVIP: APIServerName:minik
ubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/
home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0801 02:31:44.617247 2658647 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime containerd
I0801 02:31:44.617313 2658647 ssh_runner.go:195] Run: sudo crictl images --output json
I0801 02:31:44.654368 2658647 containerd.go:627] all images are preloaded for containerd runtime.
I0801 02:31:44.654393 2658647 containerd.go:534] Images already preloaded, skipping extraction
I0801 02:31:44.654461 2658647 ssh_runner.go:195] Run: sudo crictl images --output json
I0801 02:31:44.696004 2658647 containerd.go:627] all images are preloaded for containerd runtime.
I0801 02:31:44.696030 2658647 cache_images.go:84] Images are preloaded, skipping loading
I0801 02:31:44.696039 2658647 kubeadm.go:934] updating node { 192.168.85.2 8443 v1.20.0 containerd true true} ...
I0801 02:31:44.696218 2658647 kubeadm.go:946] kubelet [Unit]
Wants=containerd.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///run/containerd/containerd.sock --hostname-override=old-k8s-version-668722 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.85.2
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-668722 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0801 02:31:44.696344 2658647 ssh_runner.go:195] Run: sudo crictl info
I0801 02:31:44.747174 2658647 cni.go:84] Creating CNI manager for ""
I0801 02:31:44.747203 2658647 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0801 02:31:44.747220 2658647 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0801 02:31:44.747241 2658647 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.85.2 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-668722 NodeName:old-k8s-version-668722 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.85.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.85.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt
StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0801 02:31:44.747387 2658647 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.85.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /run/containerd/containerd.sock
name: "old-k8s-version-668722"
kubeletExtraArgs:
node-ip: 192.168.85.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.85.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0801 02:31:44.747468 2658647 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0801 02:31:44.762562 2658647 binaries.go:44] Found k8s binaries, skipping transfer
I0801 02:31:44.762710 2658647 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0801 02:31:44.772161 2658647 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (442 bytes)
I0801 02:31:44.792038 2658647 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0801 02:31:44.814015 2658647 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2125 bytes)
I0801 02:31:44.832693 2658647 ssh_runner.go:195] Run: grep 192.168.85.2 control-plane.minikube.internal$ /etc/hosts
I0801 02:31:44.836133 2658647 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.85.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0801 02:31:44.847444 2658647 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0801 02:31:44.938012 2658647 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0801 02:31:44.953046 2658647 certs.go:68] Setting up /home/jenkins/minikube-integration/19312-2449638/.minikube/profiles/old-k8s-version-668722 for IP: 192.168.85.2
I0801 02:31:44.953069 2658647 certs.go:194] generating shared ca certs ...
I0801 02:31:44.953086 2658647 certs.go:226] acquiring lock for ca certs: {Name:mk4f254a7420ab7eacd0dc9e9cb7a0b2961241d3 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0801 02:31:44.953221 2658647 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19312-2449638/.minikube/ca.key
I0801 02:31:44.953267 2658647 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19312-2449638/.minikube/proxy-client-ca.key
I0801 02:31:44.953276 2658647 certs.go:256] generating profile certs ...
I0801 02:31:44.953368 2658647 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/19312-2449638/.minikube/profiles/old-k8s-version-668722/client.key
I0801 02:31:44.953445 2658647 certs.go:359] skipping valid signed profile cert regeneration for "minikube": /home/jenkins/minikube-integration/19312-2449638/.minikube/profiles/old-k8s-version-668722/apiserver.key.0b379ad4
I0801 02:31:44.953489 2658647 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/19312-2449638/.minikube/profiles/old-k8s-version-668722/proxy-client.key
I0801 02:31:44.953599 2658647 certs.go:484] found cert: /home/jenkins/minikube-integration/19312-2449638/.minikube/certs/2455030.pem (1338 bytes)
W0801 02:31:44.953632 2658647 certs.go:480] ignoring /home/jenkins/minikube-integration/19312-2449638/.minikube/certs/2455030_empty.pem, impossibly tiny 0 bytes
I0801 02:31:44.953645 2658647 certs.go:484] found cert: /home/jenkins/minikube-integration/19312-2449638/.minikube/certs/ca-key.pem (1675 bytes)
I0801 02:31:44.953675 2658647 certs.go:484] found cert: /home/jenkins/minikube-integration/19312-2449638/.minikube/certs/ca.pem (1082 bytes)
I0801 02:31:44.953710 2658647 certs.go:484] found cert: /home/jenkins/minikube-integration/19312-2449638/.minikube/certs/cert.pem (1123 bytes)
I0801 02:31:44.953737 2658647 certs.go:484] found cert: /home/jenkins/minikube-integration/19312-2449638/.minikube/certs/key.pem (1675 bytes)
I0801 02:31:44.953784 2658647 certs.go:484] found cert: /home/jenkins/minikube-integration/19312-2449638/.minikube/files/etc/ssl/certs/24550302.pem (1708 bytes)
I0801 02:31:44.954439 2658647 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19312-2449638/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0801 02:31:44.979373 2658647 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19312-2449638/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0801 02:31:45.005932 2658647 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19312-2449638/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0801 02:31:45.037666 2658647 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19312-2449638/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0801 02:31:45.070998 2658647 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19312-2449638/.minikube/profiles/old-k8s-version-668722/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0801 02:31:45.104304 2658647 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19312-2449638/.minikube/profiles/old-k8s-version-668722/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0801 02:31:45.155753 2658647 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19312-2449638/.minikube/profiles/old-k8s-version-668722/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0801 02:31:45.195118 2658647 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19312-2449638/.minikube/profiles/old-k8s-version-668722/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0801 02:31:45.230757 2658647 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19312-2449638/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0801 02:31:45.272257 2658647 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19312-2449638/.minikube/certs/2455030.pem --> /usr/share/ca-certificates/2455030.pem (1338 bytes)
I0801 02:31:45.317353 2658647 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19312-2449638/.minikube/files/etc/ssl/certs/24550302.pem --> /usr/share/ca-certificates/24550302.pem (1708 bytes)
I0801 02:31:45.357444 2658647 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0801 02:31:45.383172 2658647 ssh_runner.go:195] Run: openssl version
I0801 02:31:45.390381 2658647 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0801 02:31:45.401247 2658647 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0801 02:31:45.406210 2658647 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Aug 1 01:42 /usr/share/ca-certificates/minikubeCA.pem
I0801 02:31:45.406314 2658647 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0801 02:31:45.413834 2658647 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0801 02:31:45.423752 2658647 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/2455030.pem && ln -fs /usr/share/ca-certificates/2455030.pem /etc/ssl/certs/2455030.pem"
I0801 02:31:45.434850 2658647 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/2455030.pem
I0801 02:31:45.439305 2658647 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Aug 1 01:52 /usr/share/ca-certificates/2455030.pem
I0801 02:31:45.439421 2658647 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/2455030.pem
I0801 02:31:45.447153 2658647 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/2455030.pem /etc/ssl/certs/51391683.0"
I0801 02:31:45.458086 2658647 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/24550302.pem && ln -fs /usr/share/ca-certificates/24550302.pem /etc/ssl/certs/24550302.pem"
I0801 02:31:45.468368 2658647 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/24550302.pem
I0801 02:31:45.472224 2658647 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Aug 1 01:52 /usr/share/ca-certificates/24550302.pem
I0801 02:31:45.472344 2658647 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/24550302.pem
I0801 02:31:45.479866 2658647 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/24550302.pem /etc/ssl/certs/3ec20f2e.0"
I0801 02:31:45.489824 2658647 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0801 02:31:45.493533 2658647 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
I0801 02:31:45.501280 2658647 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
I0801 02:31:45.509672 2658647 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
I0801 02:31:45.517140 2658647 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
I0801 02:31:45.525653 2658647 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
I0801 02:31:45.533473 2658647 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
I0801 02:31:45.541572 2658647 kubeadm.go:392] StartCluster: {Name:old-k8s-version-668722 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-668722 Namespace:default APIServerHAVIP: APIServerName:minikube
CA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/hom
e/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0801 02:31:45.541683 2658647 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}
I0801 02:31:45.541746 2658647 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0801 02:31:45.586299 2658647 cri.go:89] found id: "e0b42bd7b7641ba543eee30d3bfbadad9b82d71c5d5067f3bd081d075e4d186e"
I0801 02:31:45.586327 2658647 cri.go:89] found id: "8534f47cf8644ba2520c5e57a7047375f0f63a07ea2f76ee628f0a167ae23982"
I0801 02:31:45.586334 2658647 cri.go:89] found id: "43e3e185b0193958df07ee4ed4664b81c5c692d124aba1e4be850fae0ce32f93"
I0801 02:31:45.586338 2658647 cri.go:89] found id: "f53a26dcf83dbc8267f8b697cd588a06c0d4b11ad6afc282b1d5724acea3c610"
I0801 02:31:45.586341 2658647 cri.go:89] found id: "9b5691eb39b7ad79466bc75cbcca533f2e299c32e4d727899d1a4f710c8b9aa4"
I0801 02:31:45.586345 2658647 cri.go:89] found id: "ba767bcdadef58a525bbf831d77bde21750306f86c792e4ed2d997bf87a799d2"
I0801 02:31:45.586349 2658647 cri.go:89] found id: "c5d12068ab92d7e88ca40e2835f8a915adbc82678ee2afc1d9bab5da810e290c"
I0801 02:31:45.586352 2658647 cri.go:89] found id: "db510a3dcf37764b510d7708f7b66412c65c1d1d0b3ef16a69c853489dde3eb1"
I0801 02:31:45.586355 2658647 cri.go:89] found id: ""
I0801 02:31:45.586409 2658647 ssh_runner.go:195] Run: sudo runc --root /run/containerd/runc/k8s.io list -f json
I0801 02:31:45.601408 2658647 cri.go:116] JSON = null
W0801 02:31:45.601462 2658647 kubeadm.go:399] unpause failed: list paused: list returned 0 containers, but ps returned 8
I0801 02:31:45.601543 2658647 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0801 02:31:45.611202 2658647 kubeadm.go:408] found existing configuration files, will attempt cluster restart
I0801 02:31:45.611223 2658647 kubeadm.go:593] restartPrimaryControlPlane start ...
I0801 02:31:45.611294 2658647 ssh_runner.go:195] Run: sudo test -d /data/minikube
I0801 02:31:45.620681 2658647 kubeadm.go:130] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
stdout:
stderr:
I0801 02:31:45.621330 2658647 kubeconfig.go:47] verify endpoint returned: get endpoint: "old-k8s-version-668722" does not appear in /home/jenkins/minikube-integration/19312-2449638/kubeconfig
I0801 02:31:45.621615 2658647 kubeconfig.go:62] /home/jenkins/minikube-integration/19312-2449638/kubeconfig needs updating (will repair): [kubeconfig missing "old-k8s-version-668722" cluster setting kubeconfig missing "old-k8s-version-668722" context setting]
I0801 02:31:45.622072 2658647 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19312-2449638/kubeconfig: {Name:mke6bc9d0d8db2aacef04b1481fd128177e95686 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0801 02:31:45.623469 2658647 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
I0801 02:31:45.633809 2658647 kubeadm.go:630] The running cluster does not require reconfiguration: 192.168.85.2
I0801 02:31:45.633842 2658647 kubeadm.go:597] duration metric: took 22.613207ms to restartPrimaryControlPlane
I0801 02:31:45.633852 2658647 kubeadm.go:394] duration metric: took 92.330624ms to StartCluster
I0801 02:31:45.633868 2658647 settings.go:142] acquiring lock: {Name:mk334d93198a24e0ee37ffd6471cc7d7262e375c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0801 02:31:45.633932 2658647 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/19312-2449638/kubeconfig
I0801 02:31:45.634913 2658647 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19312-2449638/kubeconfig: {Name:mke6bc9d0d8db2aacef04b1481fd128177e95686 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0801 02:31:45.635136 2658647 start.go:235] Will wait 6m0s for node &{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}
I0801 02:31:45.635419 2658647 config.go:182] Loaded profile config "old-k8s-version-668722": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0
I0801 02:31:45.635463 2658647 addons.go:507] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:true default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]
I0801 02:31:45.635555 2658647 addons.go:69] Setting storage-provisioner=true in profile "old-k8s-version-668722"
I0801 02:31:45.635578 2658647 addons.go:234] Setting addon storage-provisioner=true in "old-k8s-version-668722"
W0801 02:31:45.635591 2658647 addons.go:243] addon storage-provisioner should already be in state true
I0801 02:31:45.635613 2658647 host.go:66] Checking if "old-k8s-version-668722" exists ...
I0801 02:31:45.636235 2658647 cli_runner.go:164] Run: docker container inspect old-k8s-version-668722 --format={{.State.Status}}
I0801 02:31:45.636709 2658647 addons.go:69] Setting default-storageclass=true in profile "old-k8s-version-668722"
I0801 02:31:45.636745 2658647 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "old-k8s-version-668722"
I0801 02:31:45.637095 2658647 cli_runner.go:164] Run: docker container inspect old-k8s-version-668722 --format={{.State.Status}}
I0801 02:31:45.637658 2658647 addons.go:69] Setting dashboard=true in profile "old-k8s-version-668722"
I0801 02:31:45.637734 2658647 addons.go:234] Setting addon dashboard=true in "old-k8s-version-668722"
W0801 02:31:45.637747 2658647 addons.go:243] addon dashboard should already be in state true
I0801 02:31:45.637774 2658647 host.go:66] Checking if "old-k8s-version-668722" exists ...
I0801 02:31:45.638276 2658647 cli_runner.go:164] Run: docker container inspect old-k8s-version-668722 --format={{.State.Status}}
I0801 02:31:45.638772 2658647 addons.go:69] Setting metrics-server=true in profile "old-k8s-version-668722"
I0801 02:31:45.638810 2658647 addons.go:234] Setting addon metrics-server=true in "old-k8s-version-668722"
W0801 02:31:45.638933 2658647 addons.go:243] addon metrics-server should already be in state true
I0801 02:31:45.638971 2658647 host.go:66] Checking if "old-k8s-version-668722" exists ...
I0801 02:31:45.640152 2658647 cli_runner.go:164] Run: docker container inspect old-k8s-version-668722 --format={{.State.Status}}
I0801 02:31:45.640323 2658647 out.go:177] * Verifying Kubernetes components...
I0801 02:31:45.643192 2658647 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0801 02:31:45.685409 2658647 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0801 02:31:45.687292 2658647 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0801 02:31:45.687316 2658647 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0801 02:31:45.687384 2658647 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-668722
I0801 02:31:45.705020 2658647 addons.go:234] Setting addon default-storageclass=true in "old-k8s-version-668722"
W0801 02:31:45.705049 2658647 addons.go:243] addon default-storageclass should already be in state true
I0801 02:31:45.705078 2658647 host.go:66] Checking if "old-k8s-version-668722" exists ...
I0801 02:31:45.705484 2658647 cli_runner.go:164] Run: docker container inspect old-k8s-version-668722 --format={{.State.Status}}
I0801 02:31:45.705822 2658647 out.go:177] - Using image docker.io/kubernetesui/dashboard:v2.7.0
I0801 02:31:45.705915 2658647 out.go:177] - Using image fake.domain/registry.k8s.io/echoserver:1.4
I0801 02:31:45.707560 2658647 addons.go:431] installing /etc/kubernetes/addons/metrics-apiservice.yaml
I0801 02:31:45.707585 2658647 ssh_runner.go:362] scp metrics-server/metrics-apiservice.yaml --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
I0801 02:31:45.707657 2658647 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-668722
I0801 02:31:45.717263 2658647 out.go:177] - Using image registry.k8s.io/echoserver:1.4
I0801 02:31:45.719170 2658647 addons.go:431] installing /etc/kubernetes/addons/dashboard-ns.yaml
I0801 02:31:45.719195 2658647 ssh_runner.go:362] scp dashboard/dashboard-ns.yaml --> /etc/kubernetes/addons/dashboard-ns.yaml (759 bytes)
I0801 02:31:45.719265 2658647 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-668722
I0801 02:31:45.749027 2658647 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:35724 SSHKeyPath:/home/jenkins/minikube-integration/19312-2449638/.minikube/machines/old-k8s-version-668722/id_rsa Username:docker}
I0801 02:31:45.793595 2658647 addons.go:431] installing /etc/kubernetes/addons/storageclass.yaml
I0801 02:31:45.793617 2658647 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0801 02:31:45.793677 2658647 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-668722
I0801 02:31:45.798890 2658647 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:35724 SSHKeyPath:/home/jenkins/minikube-integration/19312-2449638/.minikube/machines/old-k8s-version-668722/id_rsa Username:docker}
I0801 02:31:45.812493 2658647 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:35724 SSHKeyPath:/home/jenkins/minikube-integration/19312-2449638/.minikube/machines/old-k8s-version-668722/id_rsa Username:docker}
I0801 02:31:45.826863 2658647 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0801 02:31:45.828212 2658647 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:35724 SSHKeyPath:/home/jenkins/minikube-integration/19312-2449638/.minikube/machines/old-k8s-version-668722/id_rsa Username:docker}
I0801 02:31:45.853249 2658647 node_ready.go:35] waiting up to 6m0s for node "old-k8s-version-668722" to be "Ready" ...
I0801 02:31:45.903357 2658647 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0801 02:31:45.954211 2658647 addons.go:431] installing /etc/kubernetes/addons/dashboard-clusterrole.yaml
I0801 02:31:45.954284 2658647 ssh_runner.go:362] scp dashboard/dashboard-clusterrole.yaml --> /etc/kubernetes/addons/dashboard-clusterrole.yaml (1001 bytes)
I0801 02:31:45.983025 2658647 addons.go:431] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
I0801 02:31:45.983103 2658647 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1825 bytes)
I0801 02:31:46.000229 2658647 addons.go:431] installing /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml
I0801 02:31:46.000323 2658647 ssh_runner.go:362] scp dashboard/dashboard-clusterrolebinding.yaml --> /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml (1018 bytes)
I0801 02:31:46.008518 2658647 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0801 02:31:46.043023 2658647 addons.go:431] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
I0801 02:31:46.043091 2658647 ssh_runner.go:362] scp metrics-server/metrics-server-rbac.yaml --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
W0801 02:31:46.064470 2658647 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0801 02:31:46.064578 2658647 retry.go:31] will retry after 148.988875ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0801 02:31:46.069304 2658647 addons.go:431] installing /etc/kubernetes/addons/dashboard-configmap.yaml
I0801 02:31:46.069378 2658647 ssh_runner.go:362] scp dashboard/dashboard-configmap.yaml --> /etc/kubernetes/addons/dashboard-configmap.yaml (837 bytes)
I0801 02:31:46.110219 2658647 addons.go:431] installing /etc/kubernetes/addons/dashboard-dp.yaml
I0801 02:31:46.110293 2658647 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-dp.yaml (4201 bytes)
I0801 02:31:46.117655 2658647 addons.go:431] installing /etc/kubernetes/addons/metrics-server-service.yaml
I0801 02:31:46.117730 2658647 ssh_runner.go:362] scp metrics-server/metrics-server-service.yaml --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
I0801 02:31:46.135062 2658647 addons.go:431] installing /etc/kubernetes/addons/dashboard-role.yaml
I0801 02:31:46.135135 2658647 ssh_runner.go:362] scp dashboard/dashboard-role.yaml --> /etc/kubernetes/addons/dashboard-role.yaml (1724 bytes)
W0801 02:31:46.140558 2658647 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0801 02:31:46.140669 2658647 retry.go:31] will retry after 233.971116ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0801 02:31:46.162615 2658647 addons.go:431] installing /etc/kubernetes/addons/dashboard-rolebinding.yaml
I0801 02:31:46.162688 2658647 ssh_runner.go:362] scp dashboard/dashboard-rolebinding.yaml --> /etc/kubernetes/addons/dashboard-rolebinding.yaml (1046 bytes)
I0801 02:31:46.163289 2658647 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0801 02:31:46.188193 2658647 addons.go:431] installing /etc/kubernetes/addons/dashboard-sa.yaml
I0801 02:31:46.188224 2658647 ssh_runner.go:362] scp dashboard/dashboard-sa.yaml --> /etc/kubernetes/addons/dashboard-sa.yaml (837 bytes)
I0801 02:31:46.214631 2658647 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I0801 02:31:46.223684 2658647 addons.go:431] installing /etc/kubernetes/addons/dashboard-secret.yaml
I0801 02:31:46.223709 2658647 ssh_runner.go:362] scp dashboard/dashboard-secret.yaml --> /etc/kubernetes/addons/dashboard-secret.yaml (1389 bytes)
W0801 02:31:46.260720 2658647 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0801 02:31:46.260754 2658647 retry.go:31] will retry after 134.997944ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0801 02:31:46.265540 2658647 addons.go:431] installing /etc/kubernetes/addons/dashboard-svc.yaml
I0801 02:31:46.265608 2658647 ssh_runner.go:362] scp dashboard/dashboard-svc.yaml --> /etc/kubernetes/addons/dashboard-svc.yaml (1294 bytes)
I0801 02:31:46.290139 2658647 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0801 02:31:46.336154 2658647 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0801 02:31:46.336190 2658647 retry.go:31] will retry after 215.381879ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0801 02:31:46.375347 2658647 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0801 02:31:46.376086 2658647 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0801 02:31:46.376112 2658647 retry.go:31] will retry after 304.558469ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0801 02:31:46.396043 2658647 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0801 02:31:46.476985 2658647 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0801 02:31:46.477093 2658647 retry.go:31] will retry after 496.273795ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0801 02:31:46.491045 2658647 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0801 02:31:46.491076 2658647 retry.go:31] will retry after 298.855904ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0801 02:31:46.552436 2658647 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0801 02:31:46.626107 2658647 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0801 02:31:46.626142 2658647 retry.go:31] will retry after 501.704096ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0801 02:31:46.681364 2658647 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0801 02:31:46.754510 2658647 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0801 02:31:46.754541 2658647 retry.go:31] will retry after 397.927488ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0801 02:31:46.790721 2658647 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0801 02:31:46.865296 2658647 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0801 02:31:46.865329 2658647 retry.go:31] will retry after 486.742786ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0801 02:31:46.974528 2658647 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0801 02:31:47.050554 2658647 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0801 02:31:47.050596 2658647 retry.go:31] will retry after 400.133491ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0801 02:31:47.128832 2658647 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I0801 02:31:47.152709 2658647 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0801 02:31:47.210128 2658647 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0801 02:31:47.210161 2658647 retry.go:31] will retry after 1.244649719s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0801 02:31:47.262588 2658647 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0801 02:31:47.262631 2658647 retry.go:31] will retry after 679.670864ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0801 02:31:47.352902 2658647 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0801 02:31:47.425833 2658647 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0801 02:31:47.425911 2658647 retry.go:31] will retry after 1.011984414s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0801 02:31:47.450970 2658647 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0801 02:31:47.525366 2658647 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0801 02:31:47.525400 2658647 retry.go:31] will retry after 480.594843ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0801 02:31:47.854055 2658647 node_ready.go:53] error getting node "old-k8s-version-668722": Get "https://192.168.85.2:8443/api/v1/nodes/old-k8s-version-668722": dial tcp 192.168.85.2:8443: connect: connection refused
I0801 02:31:47.943326 2658647 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0801 02:31:48.006732 2658647 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0801 02:31:48.038882 2658647 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0801 02:31:48.038968 2658647 retry.go:31] will retry after 468.734434ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0801 02:31:48.105429 2658647 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0801 02:31:48.105516 2658647 retry.go:31] will retry after 1.380815042s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0801 02:31:48.438699 2658647 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0801 02:31:48.455115 2658647 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I0801 02:31:48.508655 2658647 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0801 02:31:48.532778 2658647 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0801 02:31:48.532852 2658647 retry.go:31] will retry after 1.267580462s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0801 02:31:48.573361 2658647 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0801 02:31:48.573438 2658647 retry.go:31] will retry after 839.623202ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0801 02:31:48.611702 2658647 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0801 02:31:48.611745 2658647 retry.go:31] will retry after 955.818482ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0801 02:31:49.413606 2658647 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0801 02:31:49.483089 2658647 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0801 02:31:49.483120 2658647 retry.go:31] will retry after 1.280725812s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0801 02:31:49.487351 2658647 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I0801 02:31:49.568630 2658647 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0801 02:31:49.568668 2658647 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0801 02:31:49.568691 2658647 retry.go:31] will retry after 2.656415753s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0801 02:31:49.647342 2658647 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0801 02:31:49.647379 2658647 retry.go:31] will retry after 1.689565203s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0801 02:31:49.801587 2658647 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0801 02:31:49.854138 2658647 node_ready.go:53] error getting node "old-k8s-version-668722": Get "https://192.168.85.2:8443/api/v1/nodes/old-k8s-version-668722": dial tcp 192.168.85.2:8443: connect: connection refused
W0801 02:31:49.878585 2658647 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0801 02:31:49.878620 2658647 retry.go:31] will retry after 1.40745191s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0801 02:31:50.764040 2658647 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0801 02:31:50.855210 2658647 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0801 02:31:50.855245 2658647 retry.go:31] will retry after 2.439240415s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0801 02:31:51.286838 2658647 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0801 02:31:51.337248 2658647 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0801 02:31:51.379351 2658647 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0801 02:31:51.379381 2658647 retry.go:31] will retry after 2.506671467s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0801 02:31:51.473560 2658647 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0801 02:31:51.473605 2658647 retry.go:31] will retry after 2.232647223s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0801 02:31:51.854607 2658647 node_ready.go:53] error getting node "old-k8s-version-668722": Get "https://192.168.85.2:8443/api/v1/nodes/old-k8s-version-668722": dial tcp 192.168.85.2:8443: connect: connection refused
I0801 02:31:52.226204 2658647 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0801 02:31:52.327090 2658647 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0801 02:31:52.327122 2658647 retry.go:31] will retry after 1.727469338s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0801 02:31:53.295238 2658647 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0801 02:31:53.396096 2658647 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0801 02:31:53.396137 2658647 retry.go:31] will retry after 5.783332225s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0801 02:31:53.706481 2658647 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0801 02:31:53.836916 2658647 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0801 02:31:53.836947 2658647 retry.go:31] will retry after 4.918377632s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0801 02:31:53.886858 2658647 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0801 02:31:53.986057 2658647 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0801 02:31:53.986090 2658647 retry.go:31] will retry after 5.082889759s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0801 02:31:54.055339 2658647 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0801 02:31:54.344569 2658647 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0801 02:31:54.344599 2658647 retry.go:31] will retry after 3.482616682s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0801 02:31:54.354201 2658647 node_ready.go:53] error getting node "old-k8s-version-668722": Get "https://192.168.85.2:8443/api/v1/nodes/old-k8s-version-668722": dial tcp 192.168.85.2:8443: connect: connection refused
I0801 02:31:57.827412 2658647 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I0801 02:31:58.756415 2658647 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0801 02:31:59.069136 2658647 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0801 02:31:59.180646 2658647 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I0801 02:32:05.354463 2658647 node_ready.go:53] error getting node "old-k8s-version-668722": Get "https://192.168.85.2:8443/api/v1/nodes/old-k8s-version-668722": net/http: TLS handshake timeout
I0801 02:32:07.876910 2658647 node_ready.go:49] node "old-k8s-version-668722" has status "Ready":"True"
I0801 02:32:07.876937 2658647 node_ready.go:38] duration metric: took 22.023651038s for node "old-k8s-version-668722" to be "Ready" ...
I0801 02:32:07.876950 2658647 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0801 02:32:08.123227 2658647 pod_ready.go:78] waiting up to 6m0s for pod "coredns-74ff55c5b-2dx9d" in "kube-system" namespace to be "Ready" ...
I0801 02:32:08.226295 2658647 pod_ready.go:92] pod "coredns-74ff55c5b-2dx9d" in "kube-system" namespace has status "Ready":"True"
I0801 02:32:08.226362 2658647 pod_ready.go:81] duration metric: took 103.041541ms for pod "coredns-74ff55c5b-2dx9d" in "kube-system" namespace to be "Ready" ...
I0801 02:32:08.226388 2658647 pod_ready.go:78] waiting up to 6m0s for pod "etcd-old-k8s-version-668722" in "kube-system" namespace to be "Ready" ...
I0801 02:32:08.802533 2658647 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: (10.975086162s)
I0801 02:32:09.226763 2658647 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: (10.470307354s)
I0801 02:32:09.226943 2658647 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: (10.04627058s)
I0801 02:32:09.226971 2658647 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (10.157734426s)
I0801 02:32:09.227160 2658647 addons.go:475] Verifying addon metrics-server=true in "old-k8s-version-668722"
I0801 02:32:09.229136 2658647 out.go:177] * Some dashboard features require the metrics-server addon. To enable all features please run:
minikube -p old-k8s-version-668722 addons enable metrics-server
I0801 02:32:09.231629 2658647 out.go:177] * Enabled addons: default-storageclass, storage-provisioner, metrics-server, dashboard
I0801 02:32:09.234159 2658647 addons.go:510] duration metric: took 23.598688698s for enable addons: enabled=[default-storageclass storage-provisioner metrics-server dashboard]
I0801 02:32:10.235731 2658647 pod_ready.go:102] pod "etcd-old-k8s-version-668722" in "kube-system" namespace has status "Ready":"False"
I0801 02:32:12.733652 2658647 pod_ready.go:102] pod "etcd-old-k8s-version-668722" in "kube-system" namespace has status "Ready":"False"
I0801 02:32:14.738572 2658647 pod_ready.go:102] pod "etcd-old-k8s-version-668722" in "kube-system" namespace has status "Ready":"False"
I0801 02:32:17.232623 2658647 pod_ready.go:102] pod "etcd-old-k8s-version-668722" in "kube-system" namespace has status "Ready":"False"
I0801 02:32:19.237917 2658647 pod_ready.go:102] pod "etcd-old-k8s-version-668722" in "kube-system" namespace has status "Ready":"False"
I0801 02:32:21.732113 2658647 pod_ready.go:102] pod "etcd-old-k8s-version-668722" in "kube-system" namespace has status "Ready":"False"
I0801 02:32:23.732479 2658647 pod_ready.go:102] pod "etcd-old-k8s-version-668722" in "kube-system" namespace has status "Ready":"False"
I0801 02:32:25.735765 2658647 pod_ready.go:102] pod "etcd-old-k8s-version-668722" in "kube-system" namespace has status "Ready":"False"
I0801 02:32:28.233490 2658647 pod_ready.go:102] pod "etcd-old-k8s-version-668722" in "kube-system" namespace has status "Ready":"False"
I0801 02:32:30.242128 2658647 pod_ready.go:102] pod "etcd-old-k8s-version-668722" in "kube-system" namespace has status "Ready":"False"
I0801 02:32:32.249262 2658647 pod_ready.go:102] pod "etcd-old-k8s-version-668722" in "kube-system" namespace has status "Ready":"False"
I0801 02:32:34.737141 2658647 pod_ready.go:102] pod "etcd-old-k8s-version-668722" in "kube-system" namespace has status "Ready":"False"
I0801 02:32:37.272807 2658647 pod_ready.go:102] pod "etcd-old-k8s-version-668722" in "kube-system" namespace has status "Ready":"False"
I0801 02:32:39.744893 2658647 pod_ready.go:102] pod "etcd-old-k8s-version-668722" in "kube-system" namespace has status "Ready":"False"
I0801 02:32:42.237133 2658647 pod_ready.go:102] pod "etcd-old-k8s-version-668722" in "kube-system" namespace has status "Ready":"False"
I0801 02:32:44.733869 2658647 pod_ready.go:102] pod "etcd-old-k8s-version-668722" in "kube-system" namespace has status "Ready":"False"
I0801 02:32:47.235412 2658647 pod_ready.go:102] pod "etcd-old-k8s-version-668722" in "kube-system" namespace has status "Ready":"False"
I0801 02:32:49.733646 2658647 pod_ready.go:102] pod "etcd-old-k8s-version-668722" in "kube-system" namespace has status "Ready":"False"
I0801 02:32:52.233732 2658647 pod_ready.go:102] pod "etcd-old-k8s-version-668722" in "kube-system" namespace has status "Ready":"False"
I0801 02:32:54.234521 2658647 pod_ready.go:102] pod "etcd-old-k8s-version-668722" in "kube-system" namespace has status "Ready":"False"
I0801 02:32:56.732459 2658647 pod_ready.go:102] pod "etcd-old-k8s-version-668722" in "kube-system" namespace has status "Ready":"False"
I0801 02:32:58.734818 2658647 pod_ready.go:102] pod "etcd-old-k8s-version-668722" in "kube-system" namespace has status "Ready":"False"
I0801 02:33:01.233469 2658647 pod_ready.go:102] pod "etcd-old-k8s-version-668722" in "kube-system" namespace has status "Ready":"False"
I0801 02:33:03.732250 2658647 pod_ready.go:102] pod "etcd-old-k8s-version-668722" in "kube-system" namespace has status "Ready":"False"
I0801 02:33:05.733513 2658647 pod_ready.go:102] pod "etcd-old-k8s-version-668722" in "kube-system" namespace has status "Ready":"False"
I0801 02:33:08.232771 2658647 pod_ready.go:102] pod "etcd-old-k8s-version-668722" in "kube-system" namespace has status "Ready":"False"
I0801 02:33:10.233511 2658647 pod_ready.go:102] pod "etcd-old-k8s-version-668722" in "kube-system" namespace has status "Ready":"False"
I0801 02:33:12.733837 2658647 pod_ready.go:102] pod "etcd-old-k8s-version-668722" in "kube-system" namespace has status "Ready":"False"
I0801 02:33:15.242177 2658647 pod_ready.go:102] pod "etcd-old-k8s-version-668722" in "kube-system" namespace has status "Ready":"False"
I0801 02:33:17.734014 2658647 pod_ready.go:102] pod "etcd-old-k8s-version-668722" in "kube-system" namespace has status "Ready":"False"
I0801 02:33:20.232108 2658647 pod_ready.go:102] pod "etcd-old-k8s-version-668722" in "kube-system" namespace has status "Ready":"False"
I0801 02:33:22.232799 2658647 pod_ready.go:102] pod "etcd-old-k8s-version-668722" in "kube-system" namespace has status "Ready":"False"
I0801 02:33:23.733503 2658647 pod_ready.go:92] pod "etcd-old-k8s-version-668722" in "kube-system" namespace has status "Ready":"True"
I0801 02:33:23.733530 2658647 pod_ready.go:81] duration metric: took 1m15.507121814s for pod "etcd-old-k8s-version-668722" in "kube-system" namespace to be "Ready" ...
I0801 02:33:23.733544 2658647 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-old-k8s-version-668722" in "kube-system" namespace to be "Ready" ...
I0801 02:33:23.738886 2658647 pod_ready.go:92] pod "kube-apiserver-old-k8s-version-668722" in "kube-system" namespace has status "Ready":"True"
I0801 02:33:23.738915 2658647 pod_ready.go:81] duration metric: took 5.363414ms for pod "kube-apiserver-old-k8s-version-668722" in "kube-system" namespace to be "Ready" ...
I0801 02:33:23.738928 2658647 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-old-k8s-version-668722" in "kube-system" namespace to be "Ready" ...
I0801 02:33:23.743918 2658647 pod_ready.go:92] pod "kube-controller-manager-old-k8s-version-668722" in "kube-system" namespace has status "Ready":"True"
I0801 02:33:23.743945 2658647 pod_ready.go:81] duration metric: took 5.009394ms for pod "kube-controller-manager-old-k8s-version-668722" in "kube-system" namespace to be "Ready" ...
I0801 02:33:23.743957 2658647 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-gzdqf" in "kube-system" namespace to be "Ready" ...
I0801 02:33:23.748954 2658647 pod_ready.go:92] pod "kube-proxy-gzdqf" in "kube-system" namespace has status "Ready":"True"
I0801 02:33:23.748981 2658647 pod_ready.go:81] duration metric: took 5.016139ms for pod "kube-proxy-gzdqf" in "kube-system" namespace to be "Ready" ...
I0801 02:33:23.748992 2658647 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-old-k8s-version-668722" in "kube-system" namespace to be "Ready" ...
I0801 02:33:24.755036 2658647 pod_ready.go:92] pod "kube-scheduler-old-k8s-version-668722" in "kube-system" namespace has status "Ready":"True"
I0801 02:33:24.755076 2658647 pod_ready.go:81] duration metric: took 1.006072242s for pod "kube-scheduler-old-k8s-version-668722" in "kube-system" namespace to be "Ready" ...
I0801 02:33:24.755088 2658647 pod_ready.go:78] waiting up to 6m0s for pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace to be "Ready" ...
I0801 02:33:26.762270 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:33:29.266698 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:33:31.760645 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:33:33.761150 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:33:35.762058 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:33:37.762887 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:33:40.261778 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:33:42.275181 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:33:44.762221 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:33:47.261419 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:33:49.262004 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:33:51.262853 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:33:53.262966 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:33:55.764058 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:33:58.262359 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:34:00.284250 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:34:02.763391 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:34:05.262277 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:34:07.760622 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:34:09.761343 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:34:11.763660 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:34:14.262012 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:34:16.761384 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:34:18.799796 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:34:21.261627 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:34:23.261810 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:34:25.262884 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:34:27.761183 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:34:29.761460 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:34:31.761541 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:34:33.763214 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:34:36.263914 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:34:38.767494 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:34:41.262184 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:34:43.761784 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:34:45.762324 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:34:48.261709 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:34:50.262421 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:34:52.762138 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:34:54.762413 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:34:57.262773 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:34:59.762094 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:35:02.265940 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:35:04.761171 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:35:06.762340 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:35:09.262177 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:35:11.262737 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:35:13.762133 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:35:15.762808 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:35:18.262472 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:35:20.761026 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:35:22.761688 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:35:25.261921 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:35:27.761120 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:35:29.770221 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:35:32.262072 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:35:34.762392 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:35:36.762858 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:35:39.261798 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:35:41.761378 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:35:44.261842 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:35:46.761853 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:35:49.261352 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:35:51.262343 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:35:53.761495 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:35:56.261615 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:35:58.262064 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:36:00.274245 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:36:02.763548 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:36:05.261070 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:36:07.262383 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:36:09.761715 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:36:11.761776 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:36:14.261781 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:36:16.267651 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:36:18.760978 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:36:20.761957 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:36:22.762560 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:36:25.269984 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:36:27.761009 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:36:29.762073 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:36:32.267817 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:36:34.761608 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:36:37.262373 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:36:39.762421 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:36:42.276693 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:36:44.760871 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:36:47.262298 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:36:49.761359 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:36:52.266028 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:36:54.761586 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:36:56.762029 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:36:59.261898 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:37:01.262382 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:37:03.761523 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:37:06.262206 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:37:08.761966 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:37:11.262028 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:37:13.262508 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:37:15.767542 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:37:18.264890 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:37:20.761390 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:37:22.762074 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:37:24.761935 2658647 pod_ready.go:81] duration metric: took 4m0.006832001s for pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace to be "Ready" ...
E0801 02:37:24.761970 2658647 pod_ready.go:66] WaitExtra: waitPodCondition: context deadline exceeded
I0801 02:37:24.761980 2658647 pod_ready.go:38] duration metric: took 5m16.885019599s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0801 02:37:24.761995 2658647 api_server.go:52] waiting for apiserver process to appear ...
I0801 02:37:24.762025 2658647 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
I0801 02:37:24.762093 2658647 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0801 02:37:24.807860 2658647 cri.go:89] found id: "1fb60da2239ac26329521305cd88d88667a3ba0d0157d727459fdfd578a72bd7"
I0801 02:37:24.807924 2658647 cri.go:89] found id: "9b5691eb39b7ad79466bc75cbcca533f2e299c32e4d727899d1a4f710c8b9aa4"
I0801 02:37:24.807945 2658647 cri.go:89] found id: ""
I0801 02:37:24.807963 2658647 logs.go:276] 2 containers: [1fb60da2239ac26329521305cd88d88667a3ba0d0157d727459fdfd578a72bd7 9b5691eb39b7ad79466bc75cbcca533f2e299c32e4d727899d1a4f710c8b9aa4]
I0801 02:37:24.808021 2658647 ssh_runner.go:195] Run: which crictl
I0801 02:37:24.812231 2658647 ssh_runner.go:195] Run: which crictl
I0801 02:37:24.815842 2658647 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
I0801 02:37:24.815920 2658647 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0801 02:37:24.853503 2658647 cri.go:89] found id: "0972b1d679fffa594d9bfecfc9d623f3e1cce1c3738f04d58c0b015eaa306a44"
I0801 02:37:24.853527 2658647 cri.go:89] found id: "db510a3dcf37764b510d7708f7b66412c65c1d1d0b3ef16a69c853489dde3eb1"
I0801 02:37:24.853545 2658647 cri.go:89] found id: ""
I0801 02:37:24.853553 2658647 logs.go:276] 2 containers: [0972b1d679fffa594d9bfecfc9d623f3e1cce1c3738f04d58c0b015eaa306a44 db510a3dcf37764b510d7708f7b66412c65c1d1d0b3ef16a69c853489dde3eb1]
I0801 02:37:24.853619 2658647 ssh_runner.go:195] Run: which crictl
I0801 02:37:24.857262 2658647 ssh_runner.go:195] Run: which crictl
I0801 02:37:24.860970 2658647 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
I0801 02:37:24.861055 2658647 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0801 02:37:24.904620 2658647 cri.go:89] found id: "058926d1333224a21f0f91ec53151cef27b71a58daca5fb53de94619556de358"
I0801 02:37:24.904645 2658647 cri.go:89] found id: "e0b42bd7b7641ba543eee30d3bfbadad9b82d71c5d5067f3bd081d075e4d186e"
I0801 02:37:24.904651 2658647 cri.go:89] found id: ""
I0801 02:37:24.904659 2658647 logs.go:276] 2 containers: [058926d1333224a21f0f91ec53151cef27b71a58daca5fb53de94619556de358 e0b42bd7b7641ba543eee30d3bfbadad9b82d71c5d5067f3bd081d075e4d186e]
I0801 02:37:24.904719 2658647 ssh_runner.go:195] Run: which crictl
I0801 02:37:24.908613 2658647 ssh_runner.go:195] Run: which crictl
I0801 02:37:24.912222 2658647 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
I0801 02:37:24.912346 2658647 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0801 02:37:24.954867 2658647 cri.go:89] found id: "62728d8ccc17e7327a30d7c30bc56da7fe1e23e573da3a9d37b2e68bb43fe900"
I0801 02:37:24.954891 2658647 cri.go:89] found id: "ba767bcdadef58a525bbf831d77bde21750306f86c792e4ed2d997bf87a799d2"
I0801 02:37:24.954896 2658647 cri.go:89] found id: ""
I0801 02:37:24.954903 2658647 logs.go:276] 2 containers: [62728d8ccc17e7327a30d7c30bc56da7fe1e23e573da3a9d37b2e68bb43fe900 ba767bcdadef58a525bbf831d77bde21750306f86c792e4ed2d997bf87a799d2]
I0801 02:37:24.954972 2658647 ssh_runner.go:195] Run: which crictl
I0801 02:37:24.958718 2658647 ssh_runner.go:195] Run: which crictl
I0801 02:37:24.962475 2658647 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
I0801 02:37:24.962551 2658647 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0801 02:37:25.021257 2658647 cri.go:89] found id: "37f080fad4301d1b52430835d200cd6ca4e4b84de7c6ca7493ca3136cf933938"
I0801 02:37:25.021282 2658647 cri.go:89] found id: "f53a26dcf83dbc8267f8b697cd588a06c0d4b11ad6afc282b1d5724acea3c610"
I0801 02:37:25.021288 2658647 cri.go:89] found id: ""
I0801 02:37:25.021295 2658647 logs.go:276] 2 containers: [37f080fad4301d1b52430835d200cd6ca4e4b84de7c6ca7493ca3136cf933938 f53a26dcf83dbc8267f8b697cd588a06c0d4b11ad6afc282b1d5724acea3c610]
I0801 02:37:25.021384 2658647 ssh_runner.go:195] Run: which crictl
I0801 02:37:25.028885 2658647 ssh_runner.go:195] Run: which crictl
I0801 02:37:25.032863 2658647 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
I0801 02:37:25.032937 2658647 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0801 02:37:25.078153 2658647 cri.go:89] found id: "cce52c229eca0a21e0be84887b884b21bc9cbc0ecb3d4d791ad1df722ebf07ea"
I0801 02:37:25.078183 2658647 cri.go:89] found id: "c5d12068ab92d7e88ca40e2835f8a915adbc82678ee2afc1d9bab5da810e290c"
I0801 02:37:25.078189 2658647 cri.go:89] found id: ""
I0801 02:37:25.078196 2658647 logs.go:276] 2 containers: [cce52c229eca0a21e0be84887b884b21bc9cbc0ecb3d4d791ad1df722ebf07ea c5d12068ab92d7e88ca40e2835f8a915adbc82678ee2afc1d9bab5da810e290c]
I0801 02:37:25.078260 2658647 ssh_runner.go:195] Run: which crictl
I0801 02:37:25.082859 2658647 ssh_runner.go:195] Run: which crictl
I0801 02:37:25.096492 2658647 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
I0801 02:37:25.096586 2658647 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0801 02:37:25.142449 2658647 cri.go:89] found id: "6209c351b40e34d272dc1014164bbfb043a342cfc4405e1e46fd88f9092b329b"
I0801 02:37:25.142480 2658647 cri.go:89] found id: "8534f47cf8644ba2520c5e57a7047375f0f63a07ea2f76ee628f0a167ae23982"
I0801 02:37:25.142486 2658647 cri.go:89] found id: ""
I0801 02:37:25.142492 2658647 logs.go:276] 2 containers: [6209c351b40e34d272dc1014164bbfb043a342cfc4405e1e46fd88f9092b329b 8534f47cf8644ba2520c5e57a7047375f0f63a07ea2f76ee628f0a167ae23982]
I0801 02:37:25.142563 2658647 ssh_runner.go:195] Run: which crictl
I0801 02:37:25.146534 2658647 ssh_runner.go:195] Run: which crictl
I0801 02:37:25.150615 2658647 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
I0801 02:37:25.150733 2658647 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I0801 02:37:25.198557 2658647 cri.go:89] found id: "cd1c96196c6d07576a76836788287288790ee6df6007258403328244166438e7"
I0801 02:37:25.198579 2658647 cri.go:89] found id: ""
I0801 02:37:25.198588 2658647 logs.go:276] 1 containers: [cd1c96196c6d07576a76836788287288790ee6df6007258403328244166438e7]
I0801 02:37:25.198679 2658647 ssh_runner.go:195] Run: which crictl
I0801 02:37:25.202648 2658647 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
I0801 02:37:25.202727 2658647 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0801 02:37:25.242386 2658647 cri.go:89] found id: "dbaca8a1b362dbe57628482f5b8003c344440ec5a3b0df3adeff5cb5c839bc27"
I0801 02:37:25.242411 2658647 cri.go:89] found id: "d9250699e0826de2d05c6b860b9c4e9f464a045b8ba59ef5a9760a4ff035a432"
I0801 02:37:25.242415 2658647 cri.go:89] found id: ""
I0801 02:37:25.242422 2658647 logs.go:276] 2 containers: [dbaca8a1b362dbe57628482f5b8003c344440ec5a3b0df3adeff5cb5c839bc27 d9250699e0826de2d05c6b860b9c4e9f464a045b8ba59ef5a9760a4ff035a432]
I0801 02:37:25.242488 2658647 ssh_runner.go:195] Run: which crictl
I0801 02:37:25.246600 2658647 ssh_runner.go:195] Run: which crictl
I0801 02:37:25.250359 2658647 logs.go:123] Gathering logs for kube-apiserver [9b5691eb39b7ad79466bc75cbcca533f2e299c32e4d727899d1a4f710c8b9aa4] ...
I0801 02:37:25.250387 2658647 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 9b5691eb39b7ad79466bc75cbcca533f2e299c32e4d727899d1a4f710c8b9aa4"
I0801 02:37:25.311581 2658647 logs.go:123] Gathering logs for kube-scheduler [62728d8ccc17e7327a30d7c30bc56da7fe1e23e573da3a9d37b2e68bb43fe900] ...
I0801 02:37:25.311616 2658647 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 62728d8ccc17e7327a30d7c30bc56da7fe1e23e573da3a9d37b2e68bb43fe900"
I0801 02:37:25.351067 2658647 logs.go:123] Gathering logs for kube-scheduler [ba767bcdadef58a525bbf831d77bde21750306f86c792e4ed2d997bf87a799d2] ...
I0801 02:37:25.351098 2658647 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 ba767bcdadef58a525bbf831d77bde21750306f86c792e4ed2d997bf87a799d2"
I0801 02:37:25.421599 2658647 logs.go:123] Gathering logs for kube-controller-manager [cce52c229eca0a21e0be84887b884b21bc9cbc0ecb3d4d791ad1df722ebf07ea] ...
I0801 02:37:25.421627 2658647 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 cce52c229eca0a21e0be84887b884b21bc9cbc0ecb3d4d791ad1df722ebf07ea"
I0801 02:37:25.480875 2658647 logs.go:123] Gathering logs for kube-apiserver [1fb60da2239ac26329521305cd88d88667a3ba0d0157d727459fdfd578a72bd7] ...
I0801 02:37:25.480912 2658647 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 1fb60da2239ac26329521305cd88d88667a3ba0d0157d727459fdfd578a72bd7"
I0801 02:37:25.555675 2658647 logs.go:123] Gathering logs for kindnet [8534f47cf8644ba2520c5e57a7047375f0f63a07ea2f76ee628f0a167ae23982] ...
I0801 02:37:25.555716 2658647 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 8534f47cf8644ba2520c5e57a7047375f0f63a07ea2f76ee628f0a167ae23982"
I0801 02:37:25.623321 2658647 logs.go:123] Gathering logs for storage-provisioner [d9250699e0826de2d05c6b860b9c4e9f464a045b8ba59ef5a9760a4ff035a432] ...
I0801 02:37:25.623352 2658647 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 d9250699e0826de2d05c6b860b9c4e9f464a045b8ba59ef5a9760a4ff035a432"
I0801 02:37:25.665047 2658647 logs.go:123] Gathering logs for kubelet ...
I0801 02:37:25.665075 2658647 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0801 02:37:25.720109 2658647 logs.go:138] Found kubelet problem: Aug 01 02:32:07 old-k8s-version-668722 kubelet[663]: E0801 02:32:07.832716 663 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:old-k8s-version-668722" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-668722' and this object
W0801 02:37:25.720352 2658647 logs.go:138] Found kubelet problem: Aug 01 02:32:07 old-k8s-version-668722 kubelet[663]: E0801 02:32:07.832844 663 reflector.go:138] object-"default"/"default-token-tf4pj": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "default-token-tf4pj" is forbidden: User "system:node:old-k8s-version-668722" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'old-k8s-version-668722' and this object
W0801 02:37:25.720578 2658647 logs.go:138] Found kubelet problem: Aug 01 02:32:07 old-k8s-version-668722 kubelet[663]: E0801 02:32:07.832944 663 reflector.go:138] object-"kube-system"/"metrics-server-token-pxh6p": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "metrics-server-token-pxh6p" is forbidden: User "system:node:old-k8s-version-668722" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-668722' and this object
W0801 02:37:25.720792 2658647 logs.go:138] Found kubelet problem: Aug 01 02:32:07 old-k8s-version-668722 kubelet[663]: E0801 02:32:07.833004 663 reflector.go:138] object-"kube-system"/"kindnet-token-57f5t": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kindnet-token-57f5t" is forbidden: User "system:node:old-k8s-version-668722" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-668722' and this object
W0801 02:37:25.721027 2658647 logs.go:138] Found kubelet problem: Aug 01 02:32:07 old-k8s-version-668722 kubelet[663]: E0801 02:32:07.833054 663 reflector.go:138] object-"kube-system"/"coredns-token-rz9vn": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "coredns-token-rz9vn" is forbidden: User "system:node:old-k8s-version-668722" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-668722' and this object
W0801 02:37:25.721235 2658647 logs.go:138] Found kubelet problem: Aug 01 02:32:07 old-k8s-version-668722 kubelet[663]: E0801 02:32:07.833111 663 reflector.go:138] object-"kube-system"/"coredns": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:old-k8s-version-668722" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-668722' and this object
W0801 02:37:25.721454 2658647 logs.go:138] Found kubelet problem: Aug 01 02:32:07 old-k8s-version-668722 kubelet[663]: E0801 02:32:07.833179 663 reflector.go:138] object-"kube-system"/"kube-proxy-token-vjsm8": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kube-proxy-token-vjsm8" is forbidden: User "system:node:old-k8s-version-668722" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-668722' and this object
W0801 02:37:25.721685 2658647 logs.go:138] Found kubelet problem: Aug 01 02:32:07 old-k8s-version-668722 kubelet[663]: E0801 02:32:07.833236 663 reflector.go:138] object-"kube-system"/"storage-provisioner-token-h4fkg": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "storage-provisioner-token-h4fkg" is forbidden: User "system:node:old-k8s-version-668722" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-668722' and this object
W0801 02:37:25.731882 2658647 logs.go:138] Found kubelet problem: Aug 01 02:32:09 old-k8s-version-668722 kubelet[663]: E0801 02:32:09.753020 663 pod_workers.go:191] Error syncing pod 2264c40b-d62b-481e-bd07-e488b1557961 ("metrics-server-9975d5f86-62ssn_kube-system(2264c40b-d62b-481e-bd07-e488b1557961)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0801 02:37:25.732178 2658647 logs.go:138] Found kubelet problem: Aug 01 02:32:09 old-k8s-version-668722 kubelet[663]: E0801 02:32:09.997248 663 pod_workers.go:191] Error syncing pod 2264c40b-d62b-481e-bd07-e488b1557961 ("metrics-server-9975d5f86-62ssn_kube-system(2264c40b-d62b-481e-bd07-e488b1557961)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0801 02:37:25.736039 2658647 logs.go:138] Found kubelet problem: Aug 01 02:32:21 old-k8s-version-668722 kubelet[663]: E0801 02:32:21.611864 663 pod_workers.go:191] Error syncing pod 2264c40b-d62b-481e-bd07-e488b1557961 ("metrics-server-9975d5f86-62ssn_kube-system(2264c40b-d62b-481e-bd07-e488b1557961)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0801 02:37:25.737860 2658647 logs.go:138] Found kubelet problem: Aug 01 02:32:33 old-k8s-version-668722 kubelet[663]: E0801 02:32:33.601023 663 pod_workers.go:191] Error syncing pod 2264c40b-d62b-481e-bd07-e488b1557961 ("metrics-server-9975d5f86-62ssn_kube-system(2264c40b-d62b-481e-bd07-e488b1557961)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0801 02:37:25.738657 2658647 logs.go:138] Found kubelet problem: Aug 01 02:32:34 old-k8s-version-668722 kubelet[663]: E0801 02:32:34.183502 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
W0801 02:37:25.738985 2658647 logs.go:138] Found kubelet problem: Aug 01 02:32:35 old-k8s-version-668722 kubelet[663]: E0801 02:32:35.171839 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
W0801 02:37:25.739313 2658647 logs.go:138] Found kubelet problem: Aug 01 02:32:40 old-k8s-version-668722 kubelet[663]: E0801 02:32:40.106856 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
W0801 02:37:25.739752 2658647 logs.go:138] Found kubelet problem: Aug 01 02:32:41 old-k8s-version-668722 kubelet[663]: E0801 02:32:41.218597 663 pod_workers.go:191] Error syncing pod 4b798218-faff-4a2f-96ec-8970e3511d1e ("storage-provisioner_kube-system(4b798218-faff-4a2f-96ec-8970e3511d1e)"), skipping: failed to "StartContainer" for "storage-provisioner" with CrashLoopBackOff: "back-off 10s restarting failed container=storage-provisioner pod=storage-provisioner_kube-system(4b798218-faff-4a2f-96ec-8970e3511d1e)"
W0801 02:37:25.742541 2658647 logs.go:138] Found kubelet problem: Aug 01 02:32:47 old-k8s-version-668722 kubelet[663]: E0801 02:32:47.603687 663 pod_workers.go:191] Error syncing pod 2264c40b-d62b-481e-bd07-e488b1557961 ("metrics-server-9975d5f86-62ssn_kube-system(2264c40b-d62b-481e-bd07-e488b1557961)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0801 02:37:25.743262 2658647 logs.go:138] Found kubelet problem: Aug 01 02:32:55 old-k8s-version-668722 kubelet[663]: E0801 02:32:55.274254 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
W0801 02:37:25.743590 2658647 logs.go:138] Found kubelet problem: Aug 01 02:33:00 old-k8s-version-668722 kubelet[663]: E0801 02:33:00.106200 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
W0801 02:37:25.743775 2658647 logs.go:138] Found kubelet problem: Aug 01 02:33:01 old-k8s-version-668722 kubelet[663]: E0801 02:33:01.591630 663 pod_workers.go:191] Error syncing pod 2264c40b-d62b-481e-bd07-e488b1557961 ("metrics-server-9975d5f86-62ssn_kube-system(2264c40b-d62b-481e-bd07-e488b1557961)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0801 02:37:25.744090 2658647 logs.go:138] Found kubelet problem: Aug 01 02:33:15 old-k8s-version-668722 kubelet[663]: E0801 02:33:15.594149 663 pod_workers.go:191] Error syncing pod 2264c40b-d62b-481e-bd07-e488b1557961 ("metrics-server-9975d5f86-62ssn_kube-system(2264c40b-d62b-481e-bd07-e488b1557961)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0801 02:37:25.744423 2658647 logs.go:138] Found kubelet problem: Aug 01 02:33:16 old-k8s-version-668722 kubelet[663]: E0801 02:33:16.328911 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
W0801 02:37:25.744885 2658647 logs.go:138] Found kubelet problem: Aug 01 02:33:20 old-k8s-version-668722 kubelet[663]: E0801 02:33:20.105646 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
W0801 02:37:25.747499 2658647 logs.go:138] Found kubelet problem: Aug 01 02:33:30 old-k8s-version-668722 kubelet[663]: E0801 02:33:30.600004 663 pod_workers.go:191] Error syncing pod 2264c40b-d62b-481e-bd07-e488b1557961 ("metrics-server-9975d5f86-62ssn_kube-system(2264c40b-d62b-481e-bd07-e488b1557961)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0801 02:37:25.747839 2658647 logs.go:138] Found kubelet problem: Aug 01 02:33:31 old-k8s-version-668722 kubelet[663]: E0801 02:33:31.591186 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
W0801 02:37:25.748175 2658647 logs.go:138] Found kubelet problem: Aug 01 02:33:43 old-k8s-version-668722 kubelet[663]: E0801 02:33:43.591488 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
W0801 02:37:25.748384 2658647 logs.go:138] Found kubelet problem: Aug 01 02:33:45 old-k8s-version-668722 kubelet[663]: E0801 02:33:45.591636 663 pod_workers.go:191] Error syncing pod 2264c40b-d62b-481e-bd07-e488b1557961 ("metrics-server-9975d5f86-62ssn_kube-system(2264c40b-d62b-481e-bd07-e488b1557961)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0801 02:37:25.748724 2658647 logs.go:138] Found kubelet problem: Aug 01 02:33:54 old-k8s-version-668722 kubelet[663]: E0801 02:33:54.592353 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
W0801 02:37:25.748912 2658647 logs.go:138] Found kubelet problem: Aug 01 02:34:00 old-k8s-version-668722 kubelet[663]: E0801 02:34:00.591405 663 pod_workers.go:191] Error syncing pod 2264c40b-d62b-481e-bd07-e488b1557961 ("metrics-server-9975d5f86-62ssn_kube-system(2264c40b-d62b-481e-bd07-e488b1557961)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0801 02:37:25.749510 2658647 logs.go:138] Found kubelet problem: Aug 01 02:34:09 old-k8s-version-668722 kubelet[663]: E0801 02:34:09.494609 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
W0801 02:37:25.749839 2658647 logs.go:138] Found kubelet problem: Aug 01 02:34:10 old-k8s-version-668722 kubelet[663]: E0801 02:34:10.498469 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
W0801 02:37:25.750025 2658647 logs.go:138] Found kubelet problem: Aug 01 02:34:12 old-k8s-version-668722 kubelet[663]: E0801 02:34:12.591240 663 pod_workers.go:191] Error syncing pod 2264c40b-d62b-481e-bd07-e488b1557961 ("metrics-server-9975d5f86-62ssn_kube-system(2264c40b-d62b-481e-bd07-e488b1557961)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0801 02:37:25.750353 2658647 logs.go:138] Found kubelet problem: Aug 01 02:34:25 old-k8s-version-668722 kubelet[663]: E0801 02:34:25.590929 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
W0801 02:37:25.750541 2658647 logs.go:138] Found kubelet problem: Aug 01 02:34:26 old-k8s-version-668722 kubelet[663]: E0801 02:34:26.591461 663 pod_workers.go:191] Error syncing pod 2264c40b-d62b-481e-bd07-e488b1557961 ("metrics-server-9975d5f86-62ssn_kube-system(2264c40b-d62b-481e-bd07-e488b1557961)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0801 02:37:25.750871 2658647 logs.go:138] Found kubelet problem: Aug 01 02:34:38 old-k8s-version-668722 kubelet[663]: E0801 02:34:38.596624 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
W0801 02:37:25.751057 2658647 logs.go:138] Found kubelet problem: Aug 01 02:34:38 old-k8s-version-668722 kubelet[663]: E0801 02:34:38.598150 663 pod_workers.go:191] Error syncing pod 2264c40b-d62b-481e-bd07-e488b1557961 ("metrics-server-9975d5f86-62ssn_kube-system(2264c40b-d62b-481e-bd07-e488b1557961)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0801 02:37:25.753554 2658647 logs.go:138] Found kubelet problem: Aug 01 02:34:51 old-k8s-version-668722 kubelet[663]: E0801 02:34:51.601483 663 pod_workers.go:191] Error syncing pod 2264c40b-d62b-481e-bd07-e488b1557961 ("metrics-server-9975d5f86-62ssn_kube-system(2264c40b-d62b-481e-bd07-e488b1557961)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0801 02:37:25.753895 2658647 logs.go:138] Found kubelet problem: Aug 01 02:34:53 old-k8s-version-668722 kubelet[663]: E0801 02:34:53.596675 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
W0801 02:37:25.754226 2658647 logs.go:138] Found kubelet problem: Aug 01 02:35:06 old-k8s-version-668722 kubelet[663]: E0801 02:35:06.590933 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
W0801 02:37:25.754411 2658647 logs.go:138] Found kubelet problem: Aug 01 02:35:06 old-k8s-version-668722 kubelet[663]: E0801 02:35:06.592173 663 pod_workers.go:191] Error syncing pod 2264c40b-d62b-481e-bd07-e488b1557961 ("metrics-server-9975d5f86-62ssn_kube-system(2264c40b-d62b-481e-bd07-e488b1557961)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0801 02:37:25.754600 2658647 logs.go:138] Found kubelet problem: Aug 01 02:35:17 old-k8s-version-668722 kubelet[663]: E0801 02:35:17.591565 663 pod_workers.go:191] Error syncing pod 2264c40b-d62b-481e-bd07-e488b1557961 ("metrics-server-9975d5f86-62ssn_kube-system(2264c40b-d62b-481e-bd07-e488b1557961)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0801 02:37:25.754930 2658647 logs.go:138] Found kubelet problem: Aug 01 02:35:18 old-k8s-version-668722 kubelet[663]: E0801 02:35:18.590935 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
W0801 02:37:25.755519 2658647 logs.go:138] Found kubelet problem: Aug 01 02:35:30 old-k8s-version-668722 kubelet[663]: E0801 02:35:30.726631 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
W0801 02:37:25.755724 2658647 logs.go:138] Found kubelet problem: Aug 01 02:35:31 old-k8s-version-668722 kubelet[663]: E0801 02:35:31.592499 663 pod_workers.go:191] Error syncing pod 2264c40b-d62b-481e-bd07-e488b1557961 ("metrics-server-9975d5f86-62ssn_kube-system(2264c40b-d62b-481e-bd07-e488b1557961)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0801 02:37:25.756054 2658647 logs.go:138] Found kubelet problem: Aug 01 02:35:40 old-k8s-version-668722 kubelet[663]: E0801 02:35:40.105230 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
W0801 02:37:25.756237 2658647 logs.go:138] Found kubelet problem: Aug 01 02:35:46 old-k8s-version-668722 kubelet[663]: E0801 02:35:46.591237 663 pod_workers.go:191] Error syncing pod 2264c40b-d62b-481e-bd07-e488b1557961 ("metrics-server-9975d5f86-62ssn_kube-system(2264c40b-d62b-481e-bd07-e488b1557961)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0801 02:37:25.756573 2658647 logs.go:138] Found kubelet problem: Aug 01 02:35:52 old-k8s-version-668722 kubelet[663]: E0801 02:35:52.590978 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
W0801 02:37:25.756761 2658647 logs.go:138] Found kubelet problem: Aug 01 02:35:57 old-k8s-version-668722 kubelet[663]: E0801 02:35:57.591547 663 pod_workers.go:191] Error syncing pod 2264c40b-d62b-481e-bd07-e488b1557961 ("metrics-server-9975d5f86-62ssn_kube-system(2264c40b-d62b-481e-bd07-e488b1557961)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0801 02:37:25.757093 2658647 logs.go:138] Found kubelet problem: Aug 01 02:36:06 old-k8s-version-668722 kubelet[663]: E0801 02:36:06.590922 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
W0801 02:37:25.757280 2658647 logs.go:138] Found kubelet problem: Aug 01 02:36:10 old-k8s-version-668722 kubelet[663]: E0801 02:36:10.591342 663 pod_workers.go:191] Error syncing pod 2264c40b-d62b-481e-bd07-e488b1557961 ("metrics-server-9975d5f86-62ssn_kube-system(2264c40b-d62b-481e-bd07-e488b1557961)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0801 02:37:25.757606 2658647 logs.go:138] Found kubelet problem: Aug 01 02:36:19 old-k8s-version-668722 kubelet[663]: E0801 02:36:19.591496 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
W0801 02:37:25.757789 2658647 logs.go:138] Found kubelet problem: Aug 01 02:36:25 old-k8s-version-668722 kubelet[663]: E0801 02:36:25.594086 663 pod_workers.go:191] Error syncing pod 2264c40b-d62b-481e-bd07-e488b1557961 ("metrics-server-9975d5f86-62ssn_kube-system(2264c40b-d62b-481e-bd07-e488b1557961)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0801 02:37:25.758117 2658647 logs.go:138] Found kubelet problem: Aug 01 02:36:34 old-k8s-version-668722 kubelet[663]: E0801 02:36:34.591017 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
W0801 02:37:25.758302 2658647 logs.go:138] Found kubelet problem: Aug 01 02:36:37 old-k8s-version-668722 kubelet[663]: E0801 02:36:37.591337 663 pod_workers.go:191] Error syncing pod 2264c40b-d62b-481e-bd07-e488b1557961 ("metrics-server-9975d5f86-62ssn_kube-system(2264c40b-d62b-481e-bd07-e488b1557961)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0801 02:37:25.758629 2658647 logs.go:138] Found kubelet problem: Aug 01 02:36:45 old-k8s-version-668722 kubelet[663]: E0801 02:36:45.591178 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
W0801 02:37:25.758817 2658647 logs.go:138] Found kubelet problem: Aug 01 02:36:50 old-k8s-version-668722 kubelet[663]: E0801 02:36:50.591590 663 pod_workers.go:191] Error syncing pod 2264c40b-d62b-481e-bd07-e488b1557961 ("metrics-server-9975d5f86-62ssn_kube-system(2264c40b-d62b-481e-bd07-e488b1557961)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0801 02:37:25.759143 2658647 logs.go:138] Found kubelet problem: Aug 01 02:36:57 old-k8s-version-668722 kubelet[663]: E0801 02:36:57.590939 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
W0801 02:37:25.759327 2658647 logs.go:138] Found kubelet problem: Aug 01 02:37:04 old-k8s-version-668722 kubelet[663]: E0801 02:37:04.591285 663 pod_workers.go:191] Error syncing pod 2264c40b-d62b-481e-bd07-e488b1557961 ("metrics-server-9975d5f86-62ssn_kube-system(2264c40b-d62b-481e-bd07-e488b1557961)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0801 02:37:25.759653 2658647 logs.go:138] Found kubelet problem: Aug 01 02:37:10 old-k8s-version-668722 kubelet[663]: E0801 02:37:10.591892 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
W0801 02:37:25.759836 2658647 logs.go:138] Found kubelet problem: Aug 01 02:37:19 old-k8s-version-668722 kubelet[663]: E0801 02:37:19.591351 663 pod_workers.go:191] Error syncing pod 2264c40b-d62b-481e-bd07-e488b1557961 ("metrics-server-9975d5f86-62ssn_kube-system(2264c40b-d62b-481e-bd07-e488b1557961)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0801 02:37:25.760162 2658647 logs.go:138] Found kubelet problem: Aug 01 02:37:21 old-k8s-version-668722 kubelet[663]: E0801 02:37:21.596896 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
I0801 02:37:25.760173 2658647 logs.go:123] Gathering logs for etcd [0972b1d679fffa594d9bfecfc9d623f3e1cce1c3738f04d58c0b015eaa306a44] ...
I0801 02:37:25.760188 2658647 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 0972b1d679fffa594d9bfecfc9d623f3e1cce1c3738f04d58c0b015eaa306a44"
I0801 02:37:25.815698 2658647 logs.go:123] Gathering logs for coredns [058926d1333224a21f0f91ec53151cef27b71a58daca5fb53de94619556de358] ...
I0801 02:37:25.815731 2658647 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 058926d1333224a21f0f91ec53151cef27b71a58daca5fb53de94619556de358"
I0801 02:37:25.859531 2658647 logs.go:123] Gathering logs for kube-controller-manager [c5d12068ab92d7e88ca40e2835f8a915adbc82678ee2afc1d9bab5da810e290c] ...
I0801 02:37:25.859614 2658647 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 c5d12068ab92d7e88ca40e2835f8a915adbc82678ee2afc1d9bab5da810e290c"
I0801 02:37:25.915331 2658647 logs.go:123] Gathering logs for storage-provisioner [dbaca8a1b362dbe57628482f5b8003c344440ec5a3b0df3adeff5cb5c839bc27] ...
I0801 02:37:25.915369 2658647 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 dbaca8a1b362dbe57628482f5b8003c344440ec5a3b0df3adeff5cb5c839bc27"
I0801 02:37:25.955726 2658647 logs.go:123] Gathering logs for kubernetes-dashboard [cd1c96196c6d07576a76836788287288790ee6df6007258403328244166438e7] ...
I0801 02:37:25.955758 2658647 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 cd1c96196c6d07576a76836788287288790ee6df6007258403328244166438e7"
I0801 02:37:25.993600 2658647 logs.go:123] Gathering logs for dmesg ...
I0801 02:37:25.993628 2658647 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0801 02:37:26.019748 2658647 logs.go:123] Gathering logs for describe nodes ...
I0801 02:37:26.019910 2658647 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0801 02:37:26.229676 2658647 logs.go:123] Gathering logs for etcd [db510a3dcf37764b510d7708f7b66412c65c1d1d0b3ef16a69c853489dde3eb1] ...
I0801 02:37:26.229705 2658647 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 db510a3dcf37764b510d7708f7b66412c65c1d1d0b3ef16a69c853489dde3eb1"
I0801 02:37:26.293004 2658647 logs.go:123] Gathering logs for coredns [e0b42bd7b7641ba543eee30d3bfbadad9b82d71c5d5067f3bd081d075e4d186e] ...
I0801 02:37:26.293084 2658647 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e0b42bd7b7641ba543eee30d3bfbadad9b82d71c5d5067f3bd081d075e4d186e"
I0801 02:37:26.333617 2658647 logs.go:123] Gathering logs for kube-proxy [37f080fad4301d1b52430835d200cd6ca4e4b84de7c6ca7493ca3136cf933938] ...
I0801 02:37:26.333646 2658647 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 37f080fad4301d1b52430835d200cd6ca4e4b84de7c6ca7493ca3136cf933938"
I0801 02:37:26.378497 2658647 logs.go:123] Gathering logs for kube-proxy [f53a26dcf83dbc8267f8b697cd588a06c0d4b11ad6afc282b1d5724acea3c610] ...
I0801 02:37:26.378525 2658647 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 f53a26dcf83dbc8267f8b697cd588a06c0d4b11ad6afc282b1d5724acea3c610"
I0801 02:37:26.434621 2658647 logs.go:123] Gathering logs for kindnet [6209c351b40e34d272dc1014164bbfb043a342cfc4405e1e46fd88f9092b329b] ...
I0801 02:37:26.434649 2658647 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 6209c351b40e34d272dc1014164bbfb043a342cfc4405e1e46fd88f9092b329b"
I0801 02:37:26.495793 2658647 logs.go:123] Gathering logs for containerd ...
I0801 02:37:26.495831 2658647 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
I0801 02:37:26.571868 2658647 logs.go:123] Gathering logs for container status ...
I0801 02:37:26.571915 2658647 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0801 02:37:26.618093 2658647 out.go:304] Setting ErrFile to fd 2...
I0801 02:37:26.618120 2658647 out.go:338] TERM=,COLORTERM=, which probably does not support color
W0801 02:37:26.618224 2658647 out.go:239] X Problems detected in kubelet:
X Problems detected in kubelet:
W0801 02:37:26.618238 2658647 out.go:239] Aug 01 02:36:57 old-k8s-version-668722 kubelet[663]: E0801 02:36:57.590939 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
Aug 01 02:36:57 old-k8s-version-668722 kubelet[663]: E0801 02:36:57.590939 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
W0801 02:37:26.618246 2658647 out.go:239] Aug 01 02:37:04 old-k8s-version-668722 kubelet[663]: E0801 02:37:04.591285 663 pod_workers.go:191] Error syncing pod 2264c40b-d62b-481e-bd07-e488b1557961 ("metrics-server-9975d5f86-62ssn_kube-system(2264c40b-d62b-481e-bd07-e488b1557961)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Aug 01 02:37:04 old-k8s-version-668722 kubelet[663]: E0801 02:37:04.591285 663 pod_workers.go:191] Error syncing pod 2264c40b-d62b-481e-bd07-e488b1557961 ("metrics-server-9975d5f86-62ssn_kube-system(2264c40b-d62b-481e-bd07-e488b1557961)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0801 02:37:26.618285 2658647 out.go:239] Aug 01 02:37:10 old-k8s-version-668722 kubelet[663]: E0801 02:37:10.591892 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
Aug 01 02:37:10 old-k8s-version-668722 kubelet[663]: E0801 02:37:10.591892 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
W0801 02:37:26.618292 2658647 out.go:239] Aug 01 02:37:19 old-k8s-version-668722 kubelet[663]: E0801 02:37:19.591351 663 pod_workers.go:191] Error syncing pod 2264c40b-d62b-481e-bd07-e488b1557961 ("metrics-server-9975d5f86-62ssn_kube-system(2264c40b-d62b-481e-bd07-e488b1557961)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Aug 01 02:37:19 old-k8s-version-668722 kubelet[663]: E0801 02:37:19.591351 663 pod_workers.go:191] Error syncing pod 2264c40b-d62b-481e-bd07-e488b1557961 ("metrics-server-9975d5f86-62ssn_kube-system(2264c40b-d62b-481e-bd07-e488b1557961)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0801 02:37:26.618298 2658647 out.go:239] Aug 01 02:37:21 old-k8s-version-668722 kubelet[663]: E0801 02:37:21.596896 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
Aug 01 02:37:21 old-k8s-version-668722 kubelet[663]: E0801 02:37:21.596896 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
I0801 02:37:26.618306 2658647 out.go:304] Setting ErrFile to fd 2...
I0801 02:37:26.618313 2658647 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0801 02:37:36.619314 2658647 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0801 02:37:36.631809 2658647 api_server.go:72] duration metric: took 5m50.996639068s to wait for apiserver process to appear ...
I0801 02:37:36.631849 2658647 api_server.go:88] waiting for apiserver healthz status ...
I0801 02:37:36.631891 2658647 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
I0801 02:37:36.631960 2658647 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0801 02:37:36.677831 2658647 cri.go:89] found id: "1fb60da2239ac26329521305cd88d88667a3ba0d0157d727459fdfd578a72bd7"
I0801 02:37:36.677856 2658647 cri.go:89] found id: "9b5691eb39b7ad79466bc75cbcca533f2e299c32e4d727899d1a4f710c8b9aa4"
I0801 02:37:36.677861 2658647 cri.go:89] found id: ""
I0801 02:37:36.677869 2658647 logs.go:276] 2 containers: [1fb60da2239ac26329521305cd88d88667a3ba0d0157d727459fdfd578a72bd7 9b5691eb39b7ad79466bc75cbcca533f2e299c32e4d727899d1a4f710c8b9aa4]
I0801 02:37:36.677931 2658647 ssh_runner.go:195] Run: which crictl
I0801 02:37:36.681714 2658647 ssh_runner.go:195] Run: which crictl
I0801 02:37:36.685060 2658647 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
I0801 02:37:36.685135 2658647 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0801 02:37:36.730628 2658647 cri.go:89] found id: "0972b1d679fffa594d9bfecfc9d623f3e1cce1c3738f04d58c0b015eaa306a44"
I0801 02:37:36.730647 2658647 cri.go:89] found id: "db510a3dcf37764b510d7708f7b66412c65c1d1d0b3ef16a69c853489dde3eb1"
I0801 02:37:36.730653 2658647 cri.go:89] found id: ""
I0801 02:37:36.730660 2658647 logs.go:276] 2 containers: [0972b1d679fffa594d9bfecfc9d623f3e1cce1c3738f04d58c0b015eaa306a44 db510a3dcf37764b510d7708f7b66412c65c1d1d0b3ef16a69c853489dde3eb1]
I0801 02:37:36.730719 2658647 ssh_runner.go:195] Run: which crictl
I0801 02:37:36.734529 2658647 ssh_runner.go:195] Run: which crictl
I0801 02:37:36.738225 2658647 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
I0801 02:37:36.738311 2658647 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0801 02:37:36.790744 2658647 cri.go:89] found id: "058926d1333224a21f0f91ec53151cef27b71a58daca5fb53de94619556de358"
I0801 02:37:36.790767 2658647 cri.go:89] found id: "e0b42bd7b7641ba543eee30d3bfbadad9b82d71c5d5067f3bd081d075e4d186e"
I0801 02:37:36.790772 2658647 cri.go:89] found id: ""
I0801 02:37:36.790780 2658647 logs.go:276] 2 containers: [058926d1333224a21f0f91ec53151cef27b71a58daca5fb53de94619556de358 e0b42bd7b7641ba543eee30d3bfbadad9b82d71c5d5067f3bd081d075e4d186e]
I0801 02:37:36.790838 2658647 ssh_runner.go:195] Run: which crictl
I0801 02:37:36.794633 2658647 ssh_runner.go:195] Run: which crictl
I0801 02:37:36.797862 2658647 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
I0801 02:37:36.797937 2658647 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0801 02:37:36.861717 2658647 cri.go:89] found id: "62728d8ccc17e7327a30d7c30bc56da7fe1e23e573da3a9d37b2e68bb43fe900"
I0801 02:37:36.861736 2658647 cri.go:89] found id: "ba767bcdadef58a525bbf831d77bde21750306f86c792e4ed2d997bf87a799d2"
I0801 02:37:36.861741 2658647 cri.go:89] found id: ""
I0801 02:37:36.861748 2658647 logs.go:276] 2 containers: [62728d8ccc17e7327a30d7c30bc56da7fe1e23e573da3a9d37b2e68bb43fe900 ba767bcdadef58a525bbf831d77bde21750306f86c792e4ed2d997bf87a799d2]
I0801 02:37:36.861808 2658647 ssh_runner.go:195] Run: which crictl
I0801 02:37:36.865296 2658647 ssh_runner.go:195] Run: which crictl
I0801 02:37:36.868853 2658647 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
I0801 02:37:36.868924 2658647 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0801 02:37:36.914143 2658647 cri.go:89] found id: "37f080fad4301d1b52430835d200cd6ca4e4b84de7c6ca7493ca3136cf933938"
I0801 02:37:36.914164 2658647 cri.go:89] found id: "f53a26dcf83dbc8267f8b697cd588a06c0d4b11ad6afc282b1d5724acea3c610"
I0801 02:37:36.914169 2658647 cri.go:89] found id: ""
I0801 02:37:36.914176 2658647 logs.go:276] 2 containers: [37f080fad4301d1b52430835d200cd6ca4e4b84de7c6ca7493ca3136cf933938 f53a26dcf83dbc8267f8b697cd588a06c0d4b11ad6afc282b1d5724acea3c610]
I0801 02:37:36.914234 2658647 ssh_runner.go:195] Run: which crictl
I0801 02:37:36.917797 2658647 ssh_runner.go:195] Run: which crictl
I0801 02:37:36.921351 2658647 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
I0801 02:37:36.921430 2658647 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0801 02:37:36.959321 2658647 cri.go:89] found id: "cce52c229eca0a21e0be84887b884b21bc9cbc0ecb3d4d791ad1df722ebf07ea"
I0801 02:37:36.959341 2658647 cri.go:89] found id: "c5d12068ab92d7e88ca40e2835f8a915adbc82678ee2afc1d9bab5da810e290c"
I0801 02:37:36.959346 2658647 cri.go:89] found id: ""
I0801 02:37:36.959354 2658647 logs.go:276] 2 containers: [cce52c229eca0a21e0be84887b884b21bc9cbc0ecb3d4d791ad1df722ebf07ea c5d12068ab92d7e88ca40e2835f8a915adbc82678ee2afc1d9bab5da810e290c]
I0801 02:37:36.959418 2658647 ssh_runner.go:195] Run: which crictl
I0801 02:37:36.963727 2658647 ssh_runner.go:195] Run: which crictl
I0801 02:37:36.967468 2658647 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
I0801 02:37:36.967569 2658647 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0801 02:37:37.012148 2658647 cri.go:89] found id: "6209c351b40e34d272dc1014164bbfb043a342cfc4405e1e46fd88f9092b329b"
I0801 02:37:37.012178 2658647 cri.go:89] found id: "8534f47cf8644ba2520c5e57a7047375f0f63a07ea2f76ee628f0a167ae23982"
I0801 02:37:37.012184 2658647 cri.go:89] found id: ""
I0801 02:37:37.012192 2658647 logs.go:276] 2 containers: [6209c351b40e34d272dc1014164bbfb043a342cfc4405e1e46fd88f9092b329b 8534f47cf8644ba2520c5e57a7047375f0f63a07ea2f76ee628f0a167ae23982]
I0801 02:37:37.012389 2658647 ssh_runner.go:195] Run: which crictl
I0801 02:37:37.017436 2658647 ssh_runner.go:195] Run: which crictl
I0801 02:37:37.023245 2658647 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
I0801 02:37:37.023386 2658647 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I0801 02:37:37.068137 2658647 cri.go:89] found id: "cd1c96196c6d07576a76836788287288790ee6df6007258403328244166438e7"
I0801 02:37:37.068161 2658647 cri.go:89] found id: ""
I0801 02:37:37.068170 2658647 logs.go:276] 1 containers: [cd1c96196c6d07576a76836788287288790ee6df6007258403328244166438e7]
I0801 02:37:37.068268 2658647 ssh_runner.go:195] Run: which crictl
I0801 02:37:37.072429 2658647 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
I0801 02:37:37.072544 2658647 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0801 02:37:37.116225 2658647 cri.go:89] found id: "dbaca8a1b362dbe57628482f5b8003c344440ec5a3b0df3adeff5cb5c839bc27"
I0801 02:37:37.116246 2658647 cri.go:89] found id: "d9250699e0826de2d05c6b860b9c4e9f464a045b8ba59ef5a9760a4ff035a432"
I0801 02:37:37.116252 2658647 cri.go:89] found id: ""
I0801 02:37:37.116258 2658647 logs.go:276] 2 containers: [dbaca8a1b362dbe57628482f5b8003c344440ec5a3b0df3adeff5cb5c839bc27 d9250699e0826de2d05c6b860b9c4e9f464a045b8ba59ef5a9760a4ff035a432]
I0801 02:37:37.116382 2658647 ssh_runner.go:195] Run: which crictl
I0801 02:37:37.120219 2658647 ssh_runner.go:195] Run: which crictl
I0801 02:37:37.123835 2658647 logs.go:123] Gathering logs for kubernetes-dashboard [cd1c96196c6d07576a76836788287288790ee6df6007258403328244166438e7] ...
I0801 02:37:37.123861 2658647 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 cd1c96196c6d07576a76836788287288790ee6df6007258403328244166438e7"
I0801 02:37:37.180568 2658647 logs.go:123] Gathering logs for storage-provisioner [dbaca8a1b362dbe57628482f5b8003c344440ec5a3b0df3adeff5cb5c839bc27] ...
I0801 02:37:37.180650 2658647 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 dbaca8a1b362dbe57628482f5b8003c344440ec5a3b0df3adeff5cb5c839bc27"
I0801 02:37:37.230430 2658647 logs.go:123] Gathering logs for kubelet ...
I0801 02:37:37.230460 2658647 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0801 02:37:37.284328 2658647 logs.go:138] Found kubelet problem: Aug 01 02:32:07 old-k8s-version-668722 kubelet[663]: E0801 02:32:07.832716 663 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:old-k8s-version-668722" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-668722' and this object
W0801 02:37:37.284590 2658647 logs.go:138] Found kubelet problem: Aug 01 02:32:07 old-k8s-version-668722 kubelet[663]: E0801 02:32:07.832844 663 reflector.go:138] object-"default"/"default-token-tf4pj": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "default-token-tf4pj" is forbidden: User "system:node:old-k8s-version-668722" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'old-k8s-version-668722' and this object
W0801 02:37:37.284821 2658647 logs.go:138] Found kubelet problem: Aug 01 02:32:07 old-k8s-version-668722 kubelet[663]: E0801 02:32:07.832944 663 reflector.go:138] object-"kube-system"/"metrics-server-token-pxh6p": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "metrics-server-token-pxh6p" is forbidden: User "system:node:old-k8s-version-668722" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-668722' and this object
W0801 02:37:37.285040 2658647 logs.go:138] Found kubelet problem: Aug 01 02:32:07 old-k8s-version-668722 kubelet[663]: E0801 02:32:07.833004 663 reflector.go:138] object-"kube-system"/"kindnet-token-57f5t": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kindnet-token-57f5t" is forbidden: User "system:node:old-k8s-version-668722" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-668722' and this object
W0801 02:37:37.285257 2658647 logs.go:138] Found kubelet problem: Aug 01 02:32:07 old-k8s-version-668722 kubelet[663]: E0801 02:32:07.833054 663 reflector.go:138] object-"kube-system"/"coredns-token-rz9vn": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "coredns-token-rz9vn" is forbidden: User "system:node:old-k8s-version-668722" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-668722' and this object
W0801 02:37:37.285481 2658647 logs.go:138] Found kubelet problem: Aug 01 02:32:07 old-k8s-version-668722 kubelet[663]: E0801 02:32:07.833111 663 reflector.go:138] object-"kube-system"/"coredns": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:old-k8s-version-668722" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-668722' and this object
W0801 02:37:37.285704 2658647 logs.go:138] Found kubelet problem: Aug 01 02:32:07 old-k8s-version-668722 kubelet[663]: E0801 02:32:07.833179 663 reflector.go:138] object-"kube-system"/"kube-proxy-token-vjsm8": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kube-proxy-token-vjsm8" is forbidden: User "system:node:old-k8s-version-668722" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-668722' and this object
W0801 02:37:37.285935 2658647 logs.go:138] Found kubelet problem: Aug 01 02:32:07 old-k8s-version-668722 kubelet[663]: E0801 02:32:07.833236 663 reflector.go:138] object-"kube-system"/"storage-provisioner-token-h4fkg": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "storage-provisioner-token-h4fkg" is forbidden: User "system:node:old-k8s-version-668722" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-668722' and this object
W0801 02:37:37.296118 2658647 logs.go:138] Found kubelet problem: Aug 01 02:32:09 old-k8s-version-668722 kubelet[663]: E0801 02:32:09.753020 663 pod_workers.go:191] Error syncing pod 2264c40b-d62b-481e-bd07-e488b1557961 ("metrics-server-9975d5f86-62ssn_kube-system(2264c40b-d62b-481e-bd07-e488b1557961)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0801 02:37:37.296421 2658647 logs.go:138] Found kubelet problem: Aug 01 02:32:09 old-k8s-version-668722 kubelet[663]: E0801 02:32:09.997248 663 pod_workers.go:191] Error syncing pod 2264c40b-d62b-481e-bd07-e488b1557961 ("metrics-server-9975d5f86-62ssn_kube-system(2264c40b-d62b-481e-bd07-e488b1557961)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0801 02:37:37.300197 2658647 logs.go:138] Found kubelet problem: Aug 01 02:32:21 old-k8s-version-668722 kubelet[663]: E0801 02:32:21.611864 663 pod_workers.go:191] Error syncing pod 2264c40b-d62b-481e-bd07-e488b1557961 ("metrics-server-9975d5f86-62ssn_kube-system(2264c40b-d62b-481e-bd07-e488b1557961)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0801 02:37:37.302113 2658647 logs.go:138] Found kubelet problem: Aug 01 02:32:33 old-k8s-version-668722 kubelet[663]: E0801 02:32:33.601023 663 pod_workers.go:191] Error syncing pod 2264c40b-d62b-481e-bd07-e488b1557961 ("metrics-server-9975d5f86-62ssn_kube-system(2264c40b-d62b-481e-bd07-e488b1557961)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0801 02:37:37.302915 2658647 logs.go:138] Found kubelet problem: Aug 01 02:32:34 old-k8s-version-668722 kubelet[663]: E0801 02:32:34.183502 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
W0801 02:37:37.303249 2658647 logs.go:138] Found kubelet problem: Aug 01 02:32:35 old-k8s-version-668722 kubelet[663]: E0801 02:32:35.171839 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
W0801 02:37:37.303579 2658647 logs.go:138] Found kubelet problem: Aug 01 02:32:40 old-k8s-version-668722 kubelet[663]: E0801 02:32:40.106856 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
W0801 02:37:37.304044 2658647 logs.go:138] Found kubelet problem: Aug 01 02:32:41 old-k8s-version-668722 kubelet[663]: E0801 02:32:41.218597 663 pod_workers.go:191] Error syncing pod 4b798218-faff-4a2f-96ec-8970e3511d1e ("storage-provisioner_kube-system(4b798218-faff-4a2f-96ec-8970e3511d1e)"), skipping: failed to "StartContainer" for "storage-provisioner" with CrashLoopBackOff: "back-off 10s restarting failed container=storage-provisioner pod=storage-provisioner_kube-system(4b798218-faff-4a2f-96ec-8970e3511d1e)"
W0801 02:37:37.306884 2658647 logs.go:138] Found kubelet problem: Aug 01 02:32:47 old-k8s-version-668722 kubelet[663]: E0801 02:32:47.603687 663 pod_workers.go:191] Error syncing pod 2264c40b-d62b-481e-bd07-e488b1557961 ("metrics-server-9975d5f86-62ssn_kube-system(2264c40b-d62b-481e-bd07-e488b1557961)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0801 02:37:37.307611 2658647 logs.go:138] Found kubelet problem: Aug 01 02:32:55 old-k8s-version-668722 kubelet[663]: E0801 02:32:55.274254 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
W0801 02:37:37.307941 2658647 logs.go:138] Found kubelet problem: Aug 01 02:33:00 old-k8s-version-668722 kubelet[663]: E0801 02:33:00.106200 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
W0801 02:37:37.308126 2658647 logs.go:138] Found kubelet problem: Aug 01 02:33:01 old-k8s-version-668722 kubelet[663]: E0801 02:33:01.591630 663 pod_workers.go:191] Error syncing pod 2264c40b-d62b-481e-bd07-e488b1557961 ("metrics-server-9975d5f86-62ssn_kube-system(2264c40b-d62b-481e-bd07-e488b1557961)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0801 02:37:37.308449 2658647 logs.go:138] Found kubelet problem: Aug 01 02:33:15 old-k8s-version-668722 kubelet[663]: E0801 02:33:15.594149 663 pod_workers.go:191] Error syncing pod 2264c40b-d62b-481e-bd07-e488b1557961 ("metrics-server-9975d5f86-62ssn_kube-system(2264c40b-d62b-481e-bd07-e488b1557961)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0801 02:37:37.308782 2658647 logs.go:138] Found kubelet problem: Aug 01 02:33:16 old-k8s-version-668722 kubelet[663]: E0801 02:33:16.328911 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
W0801 02:37:37.309247 2658647 logs.go:138] Found kubelet problem: Aug 01 02:33:20 old-k8s-version-668722 kubelet[663]: E0801 02:33:20.105646 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
W0801 02:37:37.311760 2658647 logs.go:138] Found kubelet problem: Aug 01 02:33:30 old-k8s-version-668722 kubelet[663]: E0801 02:33:30.600004 663 pod_workers.go:191] Error syncing pod 2264c40b-d62b-481e-bd07-e488b1557961 ("metrics-server-9975d5f86-62ssn_kube-system(2264c40b-d62b-481e-bd07-e488b1557961)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0801 02:37:37.312096 2658647 logs.go:138] Found kubelet problem: Aug 01 02:33:31 old-k8s-version-668722 kubelet[663]: E0801 02:33:31.591186 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
W0801 02:37:37.312441 2658647 logs.go:138] Found kubelet problem: Aug 01 02:33:43 old-k8s-version-668722 kubelet[663]: E0801 02:33:43.591488 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
W0801 02:37:37.312647 2658647 logs.go:138] Found kubelet problem: Aug 01 02:33:45 old-k8s-version-668722 kubelet[663]: E0801 02:33:45.591636 663 pod_workers.go:191] Error syncing pod 2264c40b-d62b-481e-bd07-e488b1557961 ("metrics-server-9975d5f86-62ssn_kube-system(2264c40b-d62b-481e-bd07-e488b1557961)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0801 02:37:37.313968 2658647 logs.go:138] Found kubelet problem: Aug 01 02:33:54 old-k8s-version-668722 kubelet[663]: E0801 02:33:54.592353 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
W0801 02:37:37.314160 2658647 logs.go:138] Found kubelet problem: Aug 01 02:34:00 old-k8s-version-668722 kubelet[663]: E0801 02:34:00.591405 663 pod_workers.go:191] Error syncing pod 2264c40b-d62b-481e-bd07-e488b1557961 ("metrics-server-9975d5f86-62ssn_kube-system(2264c40b-d62b-481e-bd07-e488b1557961)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0801 02:37:37.314756 2658647 logs.go:138] Found kubelet problem: Aug 01 02:34:09 old-k8s-version-668722 kubelet[663]: E0801 02:34:09.494609 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
W0801 02:37:37.315089 2658647 logs.go:138] Found kubelet problem: Aug 01 02:34:10 old-k8s-version-668722 kubelet[663]: E0801 02:34:10.498469 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
W0801 02:37:37.315277 2658647 logs.go:138] Found kubelet problem: Aug 01 02:34:12 old-k8s-version-668722 kubelet[663]: E0801 02:34:12.591240 663 pod_workers.go:191] Error syncing pod 2264c40b-d62b-481e-bd07-e488b1557961 ("metrics-server-9975d5f86-62ssn_kube-system(2264c40b-d62b-481e-bd07-e488b1557961)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0801 02:37:37.315606 2658647 logs.go:138] Found kubelet problem: Aug 01 02:34:25 old-k8s-version-668722 kubelet[663]: E0801 02:34:25.590929 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
W0801 02:37:37.315792 2658647 logs.go:138] Found kubelet problem: Aug 01 02:34:26 old-k8s-version-668722 kubelet[663]: E0801 02:34:26.591461 663 pod_workers.go:191] Error syncing pod 2264c40b-d62b-481e-bd07-e488b1557961 ("metrics-server-9975d5f86-62ssn_kube-system(2264c40b-d62b-481e-bd07-e488b1557961)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0801 02:37:37.316123 2658647 logs.go:138] Found kubelet problem: Aug 01 02:34:38 old-k8s-version-668722 kubelet[663]: E0801 02:34:38.596624 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
W0801 02:37:37.316316 2658647 logs.go:138] Found kubelet problem: Aug 01 02:34:38 old-k8s-version-668722 kubelet[663]: E0801 02:34:38.598150 663 pod_workers.go:191] Error syncing pod 2264c40b-d62b-481e-bd07-e488b1557961 ("metrics-server-9975d5f86-62ssn_kube-system(2264c40b-d62b-481e-bd07-e488b1557961)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0801 02:37:37.318774 2658647 logs.go:138] Found kubelet problem: Aug 01 02:34:51 old-k8s-version-668722 kubelet[663]: E0801 02:34:51.601483 663 pod_workers.go:191] Error syncing pod 2264c40b-d62b-481e-bd07-e488b1557961 ("metrics-server-9975d5f86-62ssn_kube-system(2264c40b-d62b-481e-bd07-e488b1557961)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0801 02:37:37.319105 2658647 logs.go:138] Found kubelet problem: Aug 01 02:34:53 old-k8s-version-668722 kubelet[663]: E0801 02:34:53.596675 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
W0801 02:37:37.319436 2658647 logs.go:138] Found kubelet problem: Aug 01 02:35:06 old-k8s-version-668722 kubelet[663]: E0801 02:35:06.590933 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
W0801 02:37:37.319620 2658647 logs.go:138] Found kubelet problem: Aug 01 02:35:06 old-k8s-version-668722 kubelet[663]: E0801 02:35:06.592173 663 pod_workers.go:191] Error syncing pod 2264c40b-d62b-481e-bd07-e488b1557961 ("metrics-server-9975d5f86-62ssn_kube-system(2264c40b-d62b-481e-bd07-e488b1557961)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0801 02:37:37.319803 2658647 logs.go:138] Found kubelet problem: Aug 01 02:35:17 old-k8s-version-668722 kubelet[663]: E0801 02:35:17.591565 663 pod_workers.go:191] Error syncing pod 2264c40b-d62b-481e-bd07-e488b1557961 ("metrics-server-9975d5f86-62ssn_kube-system(2264c40b-d62b-481e-bd07-e488b1557961)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0801 02:37:37.320132 2658647 logs.go:138] Found kubelet problem: Aug 01 02:35:18 old-k8s-version-668722 kubelet[663]: E0801 02:35:18.590935 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
W0801 02:37:37.320725 2658647 logs.go:138] Found kubelet problem: Aug 01 02:35:30 old-k8s-version-668722 kubelet[663]: E0801 02:35:30.726631 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
W0801 02:37:37.320909 2658647 logs.go:138] Found kubelet problem: Aug 01 02:35:31 old-k8s-version-668722 kubelet[663]: E0801 02:35:31.592499 663 pod_workers.go:191] Error syncing pod 2264c40b-d62b-481e-bd07-e488b1557961 ("metrics-server-9975d5f86-62ssn_kube-system(2264c40b-d62b-481e-bd07-e488b1557961)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0801 02:37:37.321243 2658647 logs.go:138] Found kubelet problem: Aug 01 02:35:40 old-k8s-version-668722 kubelet[663]: E0801 02:35:40.105230 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
W0801 02:37:37.321428 2658647 logs.go:138] Found kubelet problem: Aug 01 02:35:46 old-k8s-version-668722 kubelet[663]: E0801 02:35:46.591237 663 pod_workers.go:191] Error syncing pod 2264c40b-d62b-481e-bd07-e488b1557961 ("metrics-server-9975d5f86-62ssn_kube-system(2264c40b-d62b-481e-bd07-e488b1557961)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0801 02:37:37.321763 2658647 logs.go:138] Found kubelet problem: Aug 01 02:35:52 old-k8s-version-668722 kubelet[663]: E0801 02:35:52.590978 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
W0801 02:37:37.321951 2658647 logs.go:138] Found kubelet problem: Aug 01 02:35:57 old-k8s-version-668722 kubelet[663]: E0801 02:35:57.591547 663 pod_workers.go:191] Error syncing pod 2264c40b-d62b-481e-bd07-e488b1557961 ("metrics-server-9975d5f86-62ssn_kube-system(2264c40b-d62b-481e-bd07-e488b1557961)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0801 02:37:37.322281 2658647 logs.go:138] Found kubelet problem: Aug 01 02:36:06 old-k8s-version-668722 kubelet[663]: E0801 02:36:06.590922 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
W0801 02:37:37.322465 2658647 logs.go:138] Found kubelet problem: Aug 01 02:36:10 old-k8s-version-668722 kubelet[663]: E0801 02:36:10.591342 663 pod_workers.go:191] Error syncing pod 2264c40b-d62b-481e-bd07-e488b1557961 ("metrics-server-9975d5f86-62ssn_kube-system(2264c40b-d62b-481e-bd07-e488b1557961)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0801 02:37:37.322793 2658647 logs.go:138] Found kubelet problem: Aug 01 02:36:19 old-k8s-version-668722 kubelet[663]: E0801 02:36:19.591496 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
W0801 02:37:37.322977 2658647 logs.go:138] Found kubelet problem: Aug 01 02:36:25 old-k8s-version-668722 kubelet[663]: E0801 02:36:25.594086 663 pod_workers.go:191] Error syncing pod 2264c40b-d62b-481e-bd07-e488b1557961 ("metrics-server-9975d5f86-62ssn_kube-system(2264c40b-d62b-481e-bd07-e488b1557961)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0801 02:37:37.323304 2658647 logs.go:138] Found kubelet problem: Aug 01 02:36:34 old-k8s-version-668722 kubelet[663]: E0801 02:36:34.591017 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
W0801 02:37:37.323488 2658647 logs.go:138] Found kubelet problem: Aug 01 02:36:37 old-k8s-version-668722 kubelet[663]: E0801 02:36:37.591337 663 pod_workers.go:191] Error syncing pod 2264c40b-d62b-481e-bd07-e488b1557961 ("metrics-server-9975d5f86-62ssn_kube-system(2264c40b-d62b-481e-bd07-e488b1557961)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0801 02:37:37.323816 2658647 logs.go:138] Found kubelet problem: Aug 01 02:36:45 old-k8s-version-668722 kubelet[663]: E0801 02:36:45.591178 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
W0801 02:37:37.324004 2658647 logs.go:138] Found kubelet problem: Aug 01 02:36:50 old-k8s-version-668722 kubelet[663]: E0801 02:36:50.591590 663 pod_workers.go:191] Error syncing pod 2264c40b-d62b-481e-bd07-e488b1557961 ("metrics-server-9975d5f86-62ssn_kube-system(2264c40b-d62b-481e-bd07-e488b1557961)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0801 02:37:37.324339 2658647 logs.go:138] Found kubelet problem: Aug 01 02:36:57 old-k8s-version-668722 kubelet[663]: E0801 02:36:57.590939 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
W0801 02:37:37.324522 2658647 logs.go:138] Found kubelet problem: Aug 01 02:37:04 old-k8s-version-668722 kubelet[663]: E0801 02:37:04.591285 663 pod_workers.go:191] Error syncing pod 2264c40b-d62b-481e-bd07-e488b1557961 ("metrics-server-9975d5f86-62ssn_kube-system(2264c40b-d62b-481e-bd07-e488b1557961)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0801 02:37:37.324878 2658647 logs.go:138] Found kubelet problem: Aug 01 02:37:10 old-k8s-version-668722 kubelet[663]: E0801 02:37:10.591892 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
W0801 02:37:37.325065 2658647 logs.go:138] Found kubelet problem: Aug 01 02:37:19 old-k8s-version-668722 kubelet[663]: E0801 02:37:19.591351 663 pod_workers.go:191] Error syncing pod 2264c40b-d62b-481e-bd07-e488b1557961 ("metrics-server-9975d5f86-62ssn_kube-system(2264c40b-d62b-481e-bd07-e488b1557961)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0801 02:37:37.325397 2658647 logs.go:138] Found kubelet problem: Aug 01 02:37:21 old-k8s-version-668722 kubelet[663]: E0801 02:37:21.596896 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
W0801 02:37:37.325749 2658647 logs.go:138] Found kubelet problem: Aug 01 02:37:33 old-k8s-version-668722 kubelet[663]: E0801 02:37:33.595779 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
W0801 02:37:37.328201 2658647 logs.go:138] Found kubelet problem: Aug 01 02:37:33 old-k8s-version-668722 kubelet[663]: E0801 02:37:33.607076 663 pod_workers.go:191] Error syncing pod 2264c40b-d62b-481e-bd07-e488b1557961 ("metrics-server-9975d5f86-62ssn_kube-system(2264c40b-d62b-481e-bd07-e488b1557961)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
I0801 02:37:37.328213 2658647 logs.go:123] Gathering logs for etcd [0972b1d679fffa594d9bfecfc9d623f3e1cce1c3738f04d58c0b015eaa306a44] ...
I0801 02:37:37.328229 2658647 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 0972b1d679fffa594d9bfecfc9d623f3e1cce1c3738f04d58c0b015eaa306a44"
I0801 02:37:37.371289 2658647 logs.go:123] Gathering logs for kube-proxy [f53a26dcf83dbc8267f8b697cd588a06c0d4b11ad6afc282b1d5724acea3c610] ...
I0801 02:37:37.371319 2658647 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 f53a26dcf83dbc8267f8b697cd588a06c0d4b11ad6afc282b1d5724acea3c610"
I0801 02:37:37.426756 2658647 logs.go:123] Gathering logs for coredns [058926d1333224a21f0f91ec53151cef27b71a58daca5fb53de94619556de358] ...
I0801 02:37:37.426781 2658647 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 058926d1333224a21f0f91ec53151cef27b71a58daca5fb53de94619556de358"
I0801 02:37:37.472504 2658647 logs.go:123] Gathering logs for coredns [e0b42bd7b7641ba543eee30d3bfbadad9b82d71c5d5067f3bd081d075e4d186e] ...
I0801 02:37:37.472533 2658647 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e0b42bd7b7641ba543eee30d3bfbadad9b82d71c5d5067f3bd081d075e4d186e"
I0801 02:37:37.518373 2658647 logs.go:123] Gathering logs for kube-scheduler [62728d8ccc17e7327a30d7c30bc56da7fe1e23e573da3a9d37b2e68bb43fe900] ...
I0801 02:37:37.518406 2658647 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 62728d8ccc17e7327a30d7c30bc56da7fe1e23e573da3a9d37b2e68bb43fe900"
I0801 02:37:37.563018 2658647 logs.go:123] Gathering logs for kube-scheduler [ba767bcdadef58a525bbf831d77bde21750306f86c792e4ed2d997bf87a799d2] ...
I0801 02:37:37.563066 2658647 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 ba767bcdadef58a525bbf831d77bde21750306f86c792e4ed2d997bf87a799d2"
I0801 02:37:37.618603 2658647 logs.go:123] Gathering logs for storage-provisioner [d9250699e0826de2d05c6b860b9c4e9f464a045b8ba59ef5a9760a4ff035a432] ...
I0801 02:37:37.618642 2658647 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 d9250699e0826de2d05c6b860b9c4e9f464a045b8ba59ef5a9760a4ff035a432"
I0801 02:37:37.659882 2658647 logs.go:123] Gathering logs for dmesg ...
I0801 02:37:37.659919 2658647 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0801 02:37:37.679520 2658647 logs.go:123] Gathering logs for kube-apiserver [1fb60da2239ac26329521305cd88d88667a3ba0d0157d727459fdfd578a72bd7] ...
I0801 02:37:37.679552 2658647 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 1fb60da2239ac26329521305cd88d88667a3ba0d0157d727459fdfd578a72bd7"
I0801 02:37:37.760472 2658647 logs.go:123] Gathering logs for etcd [db510a3dcf37764b510d7708f7b66412c65c1d1d0b3ef16a69c853489dde3eb1] ...
I0801 02:37:37.760510 2658647 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 db510a3dcf37764b510d7708f7b66412c65c1d1d0b3ef16a69c853489dde3eb1"
I0801 02:37:37.815912 2658647 logs.go:123] Gathering logs for kindnet [6209c351b40e34d272dc1014164bbfb043a342cfc4405e1e46fd88f9092b329b] ...
I0801 02:37:37.815943 2658647 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 6209c351b40e34d272dc1014164bbfb043a342cfc4405e1e46fd88f9092b329b"
I0801 02:37:37.897447 2658647 logs.go:123] Gathering logs for kindnet [8534f47cf8644ba2520c5e57a7047375f0f63a07ea2f76ee628f0a167ae23982] ...
I0801 02:37:37.897527 2658647 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 8534f47cf8644ba2520c5e57a7047375f0f63a07ea2f76ee628f0a167ae23982"
I0801 02:37:37.964890 2658647 logs.go:123] Gathering logs for describe nodes ...
I0801 02:37:37.964923 2658647 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0801 02:37:38.120008 2658647 logs.go:123] Gathering logs for kube-apiserver [9b5691eb39b7ad79466bc75cbcca533f2e299c32e4d727899d1a4f710c8b9aa4] ...
I0801 02:37:38.120038 2658647 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 9b5691eb39b7ad79466bc75cbcca533f2e299c32e4d727899d1a4f710c8b9aa4"
I0801 02:37:38.174065 2658647 logs.go:123] Gathering logs for kube-controller-manager [cce52c229eca0a21e0be84887b884b21bc9cbc0ecb3d4d791ad1df722ebf07ea] ...
I0801 02:37:38.174100 2658647 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 cce52c229eca0a21e0be84887b884b21bc9cbc0ecb3d4d791ad1df722ebf07ea"
I0801 02:37:38.247816 2658647 logs.go:123] Gathering logs for container status ...
I0801 02:37:38.254975 2658647 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0801 02:37:38.307918 2658647 logs.go:123] Gathering logs for kube-proxy [37f080fad4301d1b52430835d200cd6ca4e4b84de7c6ca7493ca3136cf933938] ...
I0801 02:37:38.307949 2658647 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 37f080fad4301d1b52430835d200cd6ca4e4b84de7c6ca7493ca3136cf933938"
I0801 02:37:38.348112 2658647 logs.go:123] Gathering logs for kube-controller-manager [c5d12068ab92d7e88ca40e2835f8a915adbc82678ee2afc1d9bab5da810e290c] ...
I0801 02:37:38.348202 2658647 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 c5d12068ab92d7e88ca40e2835f8a915adbc82678ee2afc1d9bab5da810e290c"
I0801 02:37:38.429924 2658647 logs.go:123] Gathering logs for containerd ...
I0801 02:37:38.429961 2658647 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
I0801 02:37:38.515158 2658647 out.go:304] Setting ErrFile to fd 2...
I0801 02:37:38.515204 2658647 out.go:338] TERM=,COLORTERM=, which probably does not support color
W0801 02:37:38.515296 2658647 out.go:239] X Problems detected in kubelet:
X Problems detected in kubelet:
W0801 02:37:38.515311 2658647 out.go:239] Aug 01 02:37:10 old-k8s-version-668722 kubelet[663]: E0801 02:37:10.591892 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
Aug 01 02:37:10 old-k8s-version-668722 kubelet[663]: E0801 02:37:10.591892 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
W0801 02:37:38.515321 2658647 out.go:239] Aug 01 02:37:19 old-k8s-version-668722 kubelet[663]: E0801 02:37:19.591351 663 pod_workers.go:191] Error syncing pod 2264c40b-d62b-481e-bd07-e488b1557961 ("metrics-server-9975d5f86-62ssn_kube-system(2264c40b-d62b-481e-bd07-e488b1557961)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Aug 01 02:37:19 old-k8s-version-668722 kubelet[663]: E0801 02:37:19.591351 663 pod_workers.go:191] Error syncing pod 2264c40b-d62b-481e-bd07-e488b1557961 ("metrics-server-9975d5f86-62ssn_kube-system(2264c40b-d62b-481e-bd07-e488b1557961)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0801 02:37:38.515333 2658647 out.go:239] Aug 01 02:37:21 old-k8s-version-668722 kubelet[663]: E0801 02:37:21.596896 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
Aug 01 02:37:21 old-k8s-version-668722 kubelet[663]: E0801 02:37:21.596896 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
W0801 02:37:38.515342 2658647 out.go:239] Aug 01 02:37:33 old-k8s-version-668722 kubelet[663]: E0801 02:37:33.595779 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
Aug 01 02:37:33 old-k8s-version-668722 kubelet[663]: E0801 02:37:33.595779 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
W0801 02:37:38.515362 2658647 out.go:239] Aug 01 02:37:33 old-k8s-version-668722 kubelet[663]: E0801 02:37:33.607076 663 pod_workers.go:191] Error syncing pod 2264c40b-d62b-481e-bd07-e488b1557961 ("metrics-server-9975d5f86-62ssn_kube-system(2264c40b-d62b-481e-bd07-e488b1557961)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
Aug 01 02:37:33 old-k8s-version-668722 kubelet[663]: E0801 02:37:33.607076 663 pod_workers.go:191] Error syncing pod 2264c40b-d62b-481e-bd07-e488b1557961 ("metrics-server-9975d5f86-62ssn_kube-system(2264c40b-d62b-481e-bd07-e488b1557961)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
I0801 02:37:38.515373 2658647 out.go:304] Setting ErrFile to fd 2...
I0801 02:37:38.515379 2658647 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0801 02:37:48.516657 2658647 api_server.go:253] Checking apiserver healthz at https://192.168.85.2:8443/healthz ...
I0801 02:37:48.527781 2658647 api_server.go:279] https://192.168.85.2:8443/healthz returned 200:
ok
I0801 02:37:48.530131 2658647 out.go:177]
W0801 02:37:48.532482 2658647 out.go:239] X Exiting due to K8S_UNHEALTHY_CONTROL_PLANE: wait 6m0s for node: wait for healthy API server: controlPlane never updated to v1.20.0
X Exiting due to K8S_UNHEALTHY_CONTROL_PLANE: wait 6m0s for node: wait for healthy API server: controlPlane never updated to v1.20.0
W0801 02:37:48.532531 2658647 out.go:239] * Suggestion: Control Plane could not update, try minikube delete --all --purge
* Suggestion: Control Plane could not update, try minikube delete --all --purge
W0801 02:37:48.532550 2658647 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/11417
* Related issue: https://github.com/kubernetes/minikube/issues/11417
W0801 02:37:48.532560 2658647 out.go:239] *
*
W0801 02:37:48.533435 2658647 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0801 02:37:48.536556 2658647 out.go:177]
** /stderr **
start_stop_delete_test.go:259: failed to start minikube post-stop. args "out/minikube-linux-arm64 start -p old-k8s-version-668722 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=containerd --kubernetes-version=v1.20.0": exit status 102
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: docker inspect <======
helpers_test.go:231: (dbg) Run: docker inspect old-k8s-version-668722
helpers_test.go:235: (dbg) docker inspect old-k8s-version-668722:
-- stdout --
[
{
"Id": "f53986999a1b9596d37ea305fec6af438b21d9e062878888d57c3d07db411fff",
"Created": "2024-08-01T02:29:11.909163472Z",
"Path": "/usr/local/bin/entrypoint",
"Args": [
"/sbin/init"
],
"State": {
"Status": "running",
"Running": true,
"Paused": false,
"Restarting": false,
"OOMKilled": false,
"Dead": false,
"Pid": 2658852,
"ExitCode": 0,
"Error": "",
"StartedAt": "2024-08-01T02:31:38.903445746Z",
"FinishedAt": "2024-08-01T02:31:37.882863027Z"
},
"Image": "sha256:2cd84ab2172023a68162f38a55db46353562cea41552fd8e8bdec97b31b2c495",
"ResolvConfPath": "/var/lib/docker/containers/f53986999a1b9596d37ea305fec6af438b21d9e062878888d57c3d07db411fff/resolv.conf",
"HostnamePath": "/var/lib/docker/containers/f53986999a1b9596d37ea305fec6af438b21d9e062878888d57c3d07db411fff/hostname",
"HostsPath": "/var/lib/docker/containers/f53986999a1b9596d37ea305fec6af438b21d9e062878888d57c3d07db411fff/hosts",
"LogPath": "/var/lib/docker/containers/f53986999a1b9596d37ea305fec6af438b21d9e062878888d57c3d07db411fff/f53986999a1b9596d37ea305fec6af438b21d9e062878888d57c3d07db411fff-json.log",
"Name": "/old-k8s-version-668722",
"RestartCount": 0,
"Driver": "overlay2",
"Platform": "linux",
"MountLabel": "",
"ProcessLabel": "",
"AppArmorProfile": "unconfined",
"ExecIDs": null,
"HostConfig": {
"Binds": [
"/lib/modules:/lib/modules:ro",
"old-k8s-version-668722:/var"
],
"ContainerIDFile": "",
"LogConfig": {
"Type": "json-file",
"Config": {}
},
"NetworkMode": "old-k8s-version-668722",
"PortBindings": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
]
},
"RestartPolicy": {
"Name": "no",
"MaximumRetryCount": 0
},
"AutoRemove": false,
"VolumeDriver": "",
"VolumesFrom": null,
"ConsoleSize": [
0,
0
],
"CapAdd": null,
"CapDrop": null,
"CgroupnsMode": "host",
"Dns": [],
"DnsOptions": [],
"DnsSearch": [],
"ExtraHosts": null,
"GroupAdd": null,
"IpcMode": "private",
"Cgroup": "",
"Links": null,
"OomScoreAdj": 0,
"PidMode": "",
"Privileged": true,
"PublishAllPorts": false,
"ReadonlyRootfs": false,
"SecurityOpt": [
"seccomp=unconfined",
"apparmor=unconfined",
"label=disable"
],
"Tmpfs": {
"/run": "",
"/tmp": ""
},
"UTSMode": "",
"UsernsMode": "",
"ShmSize": 67108864,
"Runtime": "runc",
"Isolation": "",
"CpuShares": 0,
"Memory": 2306867200,
"NanoCpus": 2000000000,
"CgroupParent": "",
"BlkioWeight": 0,
"BlkioWeightDevice": [],
"BlkioDeviceReadBps": [],
"BlkioDeviceWriteBps": [],
"BlkioDeviceReadIOps": [],
"BlkioDeviceWriteIOps": [],
"CpuPeriod": 0,
"CpuQuota": 0,
"CpuRealtimePeriod": 0,
"CpuRealtimeRuntime": 0,
"CpusetCpus": "",
"CpusetMems": "",
"Devices": [],
"DeviceCgroupRules": null,
"DeviceRequests": null,
"MemoryReservation": 0,
"MemorySwap": 4613734400,
"MemorySwappiness": null,
"OomKillDisable": false,
"PidsLimit": null,
"Ulimits": [],
"CpuCount": 0,
"CpuPercent": 0,
"IOMaximumIOps": 0,
"IOMaximumBandwidth": 0,
"MaskedPaths": null,
"ReadonlyPaths": null
},
"GraphDriver": {
"Data": {
"LowerDir": "/var/lib/docker/overlay2/ca32955508531fd174c7cb7a578a7285133759373c233a6a563d5252e8ac3bec-init/diff:/var/lib/docker/overlay2/0f9c1859b6891442c6f9b64de421f35304277b5fc77d9cd279d1451eb0c39255/diff",
"MergedDir": "/var/lib/docker/overlay2/ca32955508531fd174c7cb7a578a7285133759373c233a6a563d5252e8ac3bec/merged",
"UpperDir": "/var/lib/docker/overlay2/ca32955508531fd174c7cb7a578a7285133759373c233a6a563d5252e8ac3bec/diff",
"WorkDir": "/var/lib/docker/overlay2/ca32955508531fd174c7cb7a578a7285133759373c233a6a563d5252e8ac3bec/work"
},
"Name": "overlay2"
},
"Mounts": [
{
"Type": "bind",
"Source": "/lib/modules",
"Destination": "/lib/modules",
"Mode": "ro",
"RW": false,
"Propagation": "rprivate"
},
{
"Type": "volume",
"Name": "old-k8s-version-668722",
"Source": "/var/lib/docker/volumes/old-k8s-version-668722/_data",
"Destination": "/var",
"Driver": "local",
"Mode": "z",
"RW": true,
"Propagation": ""
}
],
"Config": {
"Hostname": "old-k8s-version-668722",
"Domainname": "",
"User": "",
"AttachStdin": false,
"AttachStdout": false,
"AttachStderr": false,
"ExposedPorts": {
"22/tcp": {},
"2376/tcp": {},
"32443/tcp": {},
"5000/tcp": {},
"8443/tcp": {}
},
"Tty": true,
"OpenStdin": false,
"StdinOnce": false,
"Env": [
"container=docker",
"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
],
"Cmd": null,
"Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7",
"Volumes": null,
"WorkingDir": "/",
"Entrypoint": [
"/usr/local/bin/entrypoint",
"/sbin/init"
],
"OnBuild": null,
"Labels": {
"created_by.minikube.sigs.k8s.io": "true",
"mode.minikube.sigs.k8s.io": "old-k8s-version-668722",
"name.minikube.sigs.k8s.io": "old-k8s-version-668722",
"role.minikube.sigs.k8s.io": ""
},
"StopSignal": "SIGRTMIN+3"
},
"NetworkSettings": {
"Bridge": "",
"SandboxID": "9b0fab619ce2e9cf395494ca26951d4c5e7bcaf4e8c46f66ac7f1a60d80c6039",
"SandboxKey": "/var/run/docker/netns/9b0fab619ce2",
"Ports": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "35724"
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "35725"
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "35728"
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "35726"
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "35727"
}
]
},
"HairpinMode": false,
"LinkLocalIPv6Address": "",
"LinkLocalIPv6PrefixLen": 0,
"SecondaryIPAddresses": null,
"SecondaryIPv6Addresses": null,
"EndpointID": "",
"Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"IPAddress": "",
"IPPrefixLen": 0,
"IPv6Gateway": "",
"MacAddress": "",
"Networks": {
"old-k8s-version-668722": {
"IPAMConfig": {
"IPv4Address": "192.168.85.2"
},
"Links": null,
"Aliases": null,
"MacAddress": "02:42:c0:a8:55:02",
"DriverOpts": null,
"NetworkID": "f1b36f726bb2592408d931cf7834151a5ef6451cc2b5b2622fb5cd9c478d0262",
"EndpointID": "31556c838390563e65243807f0d16453adf722f77914340000c23c09f6e47cbb",
"Gateway": "192.168.85.1",
"IPAddress": "192.168.85.2",
"IPPrefixLen": 24,
"IPv6Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"DNSNames": [
"old-k8s-version-668722",
"f53986999a1b"
]
}
}
}
}
]
-- /stdout --
helpers_test.go:239: (dbg) Run: out/minikube-linux-arm64 status --format={{.Host}} -p old-k8s-version-668722 -n old-k8s-version-668722
helpers_test.go:244: <<< TestStartStop/group/old-k8s-version/serial/SecondStart FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: minikube logs <======
helpers_test.go:247: (dbg) Run: out/minikube-linux-arm64 -p old-k8s-version-668722 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-arm64 -p old-k8s-version-668722 logs -n 25: (2.066074344s)
helpers_test.go:252: TestStartStop/group/old-k8s-version/serial/SecondStart logs:
-- stdout --
==> Audit <==
|---------|--------------------------------------------------------|---------------------------|---------|---------|---------------------|---------------------|
| Command | Args | Profile | User | Version | Start Time | End Time |
|---------|--------------------------------------------------------|---------------------------|---------|---------|---------------------|---------------------|
| ssh | -p cilium-815528 sudo find | cilium-815528 | jenkins | v1.33.1 | 01 Aug 24 02:27 UTC | |
| | /etc/crio -type f -exec sh -c | | | | | |
| | 'echo {}; cat {}' \; | | | | | |
| ssh | -p cilium-815528 sudo crio | cilium-815528 | jenkins | v1.33.1 | 01 Aug 24 02:27 UTC | |
| | config | | | | | |
| delete | -p cilium-815528 | cilium-815528 | jenkins | v1.33.1 | 01 Aug 24 02:27 UTC | 01 Aug 24 02:27 UTC |
| start | -p cert-options-468505 | cert-options-468505 | jenkins | v1.33.1 | 01 Aug 24 02:27 UTC | 01 Aug 24 02:28 UTC |
| | --memory=2048 | | | | | |
| | --apiserver-ips=127.0.0.1 | | | | | |
| | --apiserver-ips=192.168.15.15 | | | | | |
| | --apiserver-names=localhost | | | | | |
| | --apiserver-names=www.google.com | | | | | |
| | --apiserver-port=8555 | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| ssh | force-systemd-env-195947 | force-systemd-env-195947 | jenkins | v1.33.1 | 01 Aug 24 02:28 UTC | 01 Aug 24 02:28 UTC |
| | ssh cat | | | | | |
| | /etc/containerd/config.toml | | | | | |
| delete | -p force-systemd-env-195947 | force-systemd-env-195947 | jenkins | v1.33.1 | 01 Aug 24 02:28 UTC | 01 Aug 24 02:28 UTC |
| start | -p cert-expiration-921745 | cert-expiration-921745 | jenkins | v1.33.1 | 01 Aug 24 02:28 UTC | 01 Aug 24 02:28 UTC |
| | --memory=2048 | | | | | |
| | --cert-expiration=3m | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| ssh | cert-options-468505 ssh | cert-options-468505 | jenkins | v1.33.1 | 01 Aug 24 02:28 UTC | 01 Aug 24 02:28 UTC |
| | openssl x509 -text -noout -in | | | | | |
| | /var/lib/minikube/certs/apiserver.crt | | | | | |
| ssh | -p cert-options-468505 -- sudo | cert-options-468505 | jenkins | v1.33.1 | 01 Aug 24 02:28 UTC | 01 Aug 24 02:28 UTC |
| | cat /etc/kubernetes/admin.conf | | | | | |
| delete | -p cert-options-468505 | cert-options-468505 | jenkins | v1.33.1 | 01 Aug 24 02:28 UTC | 01 Aug 24 02:28 UTC |
| start | -p force-systemd-flag-337132 | force-systemd-flag-337132 | jenkins | v1.33.1 | 01 Aug 24 02:28 UTC | 01 Aug 24 02:29 UTC |
| | --memory=2048 --force-systemd | | | | | |
| | --alsologtostderr | | | | | |
| | -v=5 --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| ssh | force-systemd-flag-337132 | force-systemd-flag-337132 | jenkins | v1.33.1 | 01 Aug 24 02:29 UTC | 01 Aug 24 02:29 UTC |
| | ssh cat | | | | | |
| | /etc/containerd/config.toml | | | | | |
| delete | -p force-systemd-flag-337132 | force-systemd-flag-337132 | jenkins | v1.33.1 | 01 Aug 24 02:29 UTC | 01 Aug 24 02:29 UTC |
| start | -p old-k8s-version-668722 | old-k8s-version-668722 | jenkins | v1.33.1 | 01 Aug 24 02:29 UTC | 01 Aug 24 02:31 UTC |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --kvm-network=default | | | | | |
| | --kvm-qemu-uri=qemu:///system | | | | | |
| | --disable-driver-mounts | | | | | |
| | --keep-context=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --kubernetes-version=v1.20.0 | | | | | |
| addons | enable metrics-server -p old-k8s-version-668722 | old-k8s-version-668722 | jenkins | v1.33.1 | 01 Aug 24 02:31 UTC | 01 Aug 24 02:31 UTC |
| | --images=MetricsServer=registry.k8s.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| stop | -p old-k8s-version-668722 | old-k8s-version-668722 | jenkins | v1.33.1 | 01 Aug 24 02:31 UTC | 01 Aug 24 02:31 UTC |
| | --alsologtostderr -v=3 | | | | | |
| addons | enable dashboard -p old-k8s-version-668722 | old-k8s-version-668722 | jenkins | v1.33.1 | 01 Aug 24 02:31 UTC | 01 Aug 24 02:31 UTC |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| start | -p old-k8s-version-668722 | old-k8s-version-668722 | jenkins | v1.33.1 | 01 Aug 24 02:31 UTC | |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --kvm-network=default | | | | | |
| | --kvm-qemu-uri=qemu:///system | | | | | |
| | --disable-driver-mounts | | | | | |
| | --keep-context=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --kubernetes-version=v1.20.0 | | | | | |
| start | -p cert-expiration-921745 | cert-expiration-921745 | jenkins | v1.33.1 | 01 Aug 24 02:31 UTC | 01 Aug 24 02:31 UTC |
| | --memory=2048 | | | | | |
| | --cert-expiration=8760h | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| delete | -p cert-expiration-921745 | cert-expiration-921745 | jenkins | v1.33.1 | 01 Aug 24 02:31 UTC | 01 Aug 24 02:32 UTC |
| start | -p no-preload-969386 --memory=2200 | no-preload-969386 | jenkins | v1.33.1 | 01 Aug 24 02:32 UTC | 01 Aug 24 02:33 UTC |
| | --alsologtostderr --wait=true | | | | | |
| | --preload=false --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --kubernetes-version=v1.31.0-beta.0 | | | | | |
| addons | enable metrics-server -p no-preload-969386 | no-preload-969386 | jenkins | v1.33.1 | 01 Aug 24 02:33 UTC | 01 Aug 24 02:33 UTC |
| | --images=MetricsServer=registry.k8s.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| stop | -p no-preload-969386 | no-preload-969386 | jenkins | v1.33.1 | 01 Aug 24 02:33 UTC | 01 Aug 24 02:33 UTC |
| | --alsologtostderr -v=3 | | | | | |
| addons | enable dashboard -p no-preload-969386 | no-preload-969386 | jenkins | v1.33.1 | 01 Aug 24 02:33 UTC | 01 Aug 24 02:33 UTC |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| start | -p no-preload-969386 --memory=2200 | no-preload-969386 | jenkins | v1.33.1 | 01 Aug 24 02:33 UTC | |
| | --alsologtostderr --wait=true | | | | | |
| | --preload=false --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --kubernetes-version=v1.31.0-beta.0 | | | | | |
|---------|--------------------------------------------------------|---------------------------|---------|---------|---------------------|---------------------|
==> Last Start <==
Log file created at: 2024/08/01 02:33:37
Running on machine: ip-172-31-30-239
Binary: Built with gc go1.22.5 for linux/arm64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I0801 02:33:37.920757 2667272 out.go:291] Setting OutFile to fd 1 ...
I0801 02:33:37.920907 2667272 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0801 02:33:37.920919 2667272 out.go:304] Setting ErrFile to fd 2...
I0801 02:33:37.920925 2667272 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0801 02:33:37.921188 2667272 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19312-2449638/.minikube/bin
I0801 02:33:37.921592 2667272 out.go:298] Setting JSON to false
I0801 02:33:37.922708 2667272 start.go:129] hostinfo: {"hostname":"ip-172-31-30-239","uptime":36955,"bootTime":1722442663,"procs":238,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1066-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"92f46a7d-c249-4c12-924a-77f64874c910"}
I0801 02:33:37.922784 2667272 start.go:139] virtualization:
I0801 02:33:37.925484 2667272 out.go:177] * [no-preload-969386] minikube v1.33.1 on Ubuntu 20.04 (arm64)
I0801 02:33:37.928079 2667272 out.go:177] - MINIKUBE_LOCATION=19312
I0801 02:33:37.928267 2667272 notify.go:220] Checking for updates...
I0801 02:33:37.931769 2667272 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0801 02:33:37.933676 2667272 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/19312-2449638/kubeconfig
I0801 02:33:37.935483 2667272 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/19312-2449638/.minikube
I0801 02:33:37.937477 2667272 out.go:177] - MINIKUBE_BIN=out/minikube-linux-arm64
I0801 02:33:37.939501 2667272 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0801 02:33:37.941918 2667272 config.go:182] Loaded profile config "no-preload-969386": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.31.0-beta.0
I0801 02:33:37.942530 2667272 driver.go:392] Setting default libvirt URI to qemu:///system
I0801 02:33:37.965635 2667272 docker.go:123] docker version: linux-27.1.1:Docker Engine - Community
I0801 02:33:37.965770 2667272 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0801 02:33:38.050909 2667272 info.go:266] docker info: {ID:6ZPO:QZND:VNGE:LUKL:4Y3K:XELL:AAX4:2GTK:E6LM:MPRN:3ZXR:TTMR Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:40 OomKillDisable:true NGoroutines:53 SystemTime:2024-08-01 02:33:38.038392956 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1066-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214900736 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-30-239 Labels:[] ExperimentalBuild:false ServerVersion:27.1.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41 Expected:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.16.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.1]] Warnings:<nil>}}
I0801 02:33:38.051033 2667272 docker.go:307] overlay module found
I0801 02:33:38.053301 2667272 out.go:177] * Using the docker driver based on existing profile
I0801 02:33:38.055126 2667272 start.go:297] selected driver: docker
I0801 02:33:38.055151 2667272 start.go:901] validating driver "docker" against &{Name:no-preload-969386 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0-beta.0 ClusterName:no-preload-969386 Namespace:default APIServerHAVIP: APIS
erverName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.31.0-beta.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mou
nt:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0801 02:33:38.055293 2667272 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0801 02:33:38.056069 2667272 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0801 02:33:38.121243 2667272 info.go:266] docker info: {ID:6ZPO:QZND:VNGE:LUKL:4Y3K:XELL:AAX4:2GTK:E6LM:MPRN:3ZXR:TTMR Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:40 OomKillDisable:true NGoroutines:53 SystemTime:2024-08-01 02:33:38.111147434 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1066-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214900736 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-30-239 Labels:[] ExperimentalBuild:false ServerVersion:27.1.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41 Expected:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.16.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.1]] Warnings:<nil>}}
I0801 02:33:38.121602 2667272 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0801 02:33:38.121632 2667272 cni.go:84] Creating CNI manager for ""
I0801 02:33:38.121641 2667272 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0801 02:33:38.121701 2667272 start.go:340] cluster config:
{Name:no-preload-969386 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0-beta.0 ClusterName:no-preload-969386 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local C
ontainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.31.0-beta.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountG
ID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0801 02:33:38.123724 2667272 out.go:177] * Starting "no-preload-969386" primary control-plane node in "no-preload-969386" cluster
I0801 02:33:38.125839 2667272 cache.go:121] Beginning downloading kic base image for docker with containerd
I0801 02:33:38.127688 2667272 out.go:177] * Pulling base image v0.0.44-1721902582-19326 ...
I0801 02:33:38.129462 2667272 preload.go:131] Checking if preload exists for k8s version v1.31.0-beta.0 and runtime containerd
I0801 02:33:38.129546 2667272 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 in local docker daemon
I0801 02:33:38.129613 2667272 profile.go:143] Saving config to /home/jenkins/minikube-integration/19312-2449638/.minikube/profiles/no-preload-969386/config.json ...
I0801 02:33:38.129922 2667272 cache.go:107] acquiring lock: {Name:mk87494c25061b8088de365ee74e3371558c6fa0 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0801 02:33:38.130000 2667272 cache.go:115] /home/jenkins/minikube-integration/19312-2449638/.minikube/cache/images/arm64/gcr.io/k8s-minikube/storage-provisioner_v5 exists
I0801 02:33:38.130010 2667272 cache.go:96] cache image "gcr.io/k8s-minikube/storage-provisioner:v5" -> "/home/jenkins/minikube-integration/19312-2449638/.minikube/cache/images/arm64/gcr.io/k8s-minikube/storage-provisioner_v5" took 93.331µs
I0801 02:33:38.130019 2667272 cache.go:80] save to tar file gcr.io/k8s-minikube/storage-provisioner:v5 -> /home/jenkins/minikube-integration/19312-2449638/.minikube/cache/images/arm64/gcr.io/k8s-minikube/storage-provisioner_v5 succeeded
I0801 02:33:38.130106 2667272 cache.go:107] acquiring lock: {Name:mk2d6e7a5da42c08128897a6b7dbf5709b27e5be Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0801 02:33:38.130177 2667272 cache.go:115] /home/jenkins/minikube-integration/19312-2449638/.minikube/cache/images/arm64/registry.k8s.io/kube-apiserver_v1.31.0-beta.0 exists
I0801 02:33:38.130203 2667272 cache.go:96] cache image "registry.k8s.io/kube-apiserver:v1.31.0-beta.0" -> "/home/jenkins/minikube-integration/19312-2449638/.minikube/cache/images/arm64/registry.k8s.io/kube-apiserver_v1.31.0-beta.0" took 103.038µs
I0801 02:33:38.130222 2667272 cache.go:107] acquiring lock: {Name:mk8378c0c00510c11ea7c95a3cdb0c6af93aadd6 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0801 02:33:38.130203 2667272 cache.go:107] acquiring lock: {Name:mk542cc8f2ee26e59f721dea8dd105032e7f98c7 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0801 02:33:38.130290 2667272 cache.go:115] /home/jenkins/minikube-integration/19312-2449638/.minikube/cache/images/arm64/registry.k8s.io/kube-scheduler_v1.31.0-beta.0 exists
I0801 02:33:38.130305 2667272 cache.go:96] cache image "registry.k8s.io/kube-scheduler:v1.31.0-beta.0" -> "/home/jenkins/minikube-integration/19312-2449638/.minikube/cache/images/arm64/registry.k8s.io/kube-scheduler_v1.31.0-beta.0" took 83.42µs
I0801 02:33:38.130315 2667272 cache.go:80] save to tar file registry.k8s.io/kube-scheduler:v1.31.0-beta.0 -> /home/jenkins/minikube-integration/19312-2449638/.minikube/cache/images/arm64/registry.k8s.io/kube-scheduler_v1.31.0-beta.0 succeeded
I0801 02:33:38.130241 2667272 cache.go:80] save to tar file registry.k8s.io/kube-apiserver:v1.31.0-beta.0 -> /home/jenkins/minikube-integration/19312-2449638/.minikube/cache/images/arm64/registry.k8s.io/kube-apiserver_v1.31.0-beta.0 succeeded
I0801 02:33:38.130330 2667272 cache.go:107] acquiring lock: {Name:mkeb65c8bfe89cac163662c39e1a548880b52dcb Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0801 02:33:38.130360 2667272 cache.go:115] /home/jenkins/minikube-integration/19312-2449638/.minikube/cache/images/arm64/registry.k8s.io/etcd_3.5.14-0 exists
I0801 02:33:38.130366 2667272 cache.go:96] cache image "registry.k8s.io/etcd:3.5.14-0" -> "/home/jenkins/minikube-integration/19312-2449638/.minikube/cache/images/arm64/registry.k8s.io/etcd_3.5.14-0" took 37.373µs
I0801 02:33:38.130372 2667272 cache.go:80] save to tar file registry.k8s.io/etcd:3.5.14-0 -> /home/jenkins/minikube-integration/19312-2449638/.minikube/cache/images/arm64/registry.k8s.io/etcd_3.5.14-0 succeeded
I0801 02:33:38.130381 2667272 cache.go:107] acquiring lock: {Name:mk3221fa4202a742aa1a81b75f18438399533586 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0801 02:33:38.130407 2667272 cache.go:115] /home/jenkins/minikube-integration/19312-2449638/.minikube/cache/images/arm64/registry.k8s.io/pause_3.10 exists
I0801 02:33:38.130411 2667272 cache.go:96] cache image "registry.k8s.io/pause:3.10" -> "/home/jenkins/minikube-integration/19312-2449638/.minikube/cache/images/arm64/registry.k8s.io/pause_3.10" took 31.351µs
I0801 02:33:38.130417 2667272 cache.go:80] save to tar file registry.k8s.io/pause:3.10 -> /home/jenkins/minikube-integration/19312-2449638/.minikube/cache/images/arm64/registry.k8s.io/pause_3.10 succeeded
I0801 02:33:38.130427 2667272 cache.go:107] acquiring lock: {Name:mkcb192ddd5cf779b0a85d6b57f6d8cade78c941 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0801 02:33:38.130455 2667272 cache.go:115] /home/jenkins/minikube-integration/19312-2449638/.minikube/cache/images/arm64/registry.k8s.io/kube-controller-manager_v1.31.0-beta.0 exists
I0801 02:33:38.130503 2667272 cache.go:96] cache image "registry.k8s.io/kube-controller-manager:v1.31.0-beta.0" -> "/home/jenkins/minikube-integration/19312-2449638/.minikube/cache/images/arm64/registry.k8s.io/kube-controller-manager_v1.31.0-beta.0" took 301.056µs
I0801 02:33:38.130530 2667272 cache.go:80] save to tar file registry.k8s.io/kube-controller-manager:v1.31.0-beta.0 -> /home/jenkins/minikube-integration/19312-2449638/.minikube/cache/images/arm64/registry.k8s.io/kube-controller-manager_v1.31.0-beta.0 succeeded
I0801 02:33:38.130460 2667272 cache.go:115] /home/jenkins/minikube-integration/19312-2449638/.minikube/cache/images/arm64/registry.k8s.io/coredns/coredns_v1.11.1 exists
I0801 02:33:38.130584 2667272 cache.go:96] cache image "registry.k8s.io/coredns/coredns:v1.11.1" -> "/home/jenkins/minikube-integration/19312-2449638/.minikube/cache/images/arm64/registry.k8s.io/coredns/coredns_v1.11.1" took 157.059µs
I0801 02:33:38.130611 2667272 cache.go:80] save to tar file registry.k8s.io/coredns/coredns:v1.11.1 -> /home/jenkins/minikube-integration/19312-2449638/.minikube/cache/images/arm64/registry.k8s.io/coredns/coredns_v1.11.1 succeeded
I0801 02:33:38.130165 2667272 cache.go:107] acquiring lock: {Name:mk5ce2fcb4ec0dd7121b3d60faa69e51a4770a3e Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0801 02:33:38.130700 2667272 cache.go:115] /home/jenkins/minikube-integration/19312-2449638/.minikube/cache/images/arm64/registry.k8s.io/kube-proxy_v1.31.0-beta.0 exists
I0801 02:33:38.130758 2667272 cache.go:96] cache image "registry.k8s.io/kube-proxy:v1.31.0-beta.0" -> "/home/jenkins/minikube-integration/19312-2449638/.minikube/cache/images/arm64/registry.k8s.io/kube-proxy_v1.31.0-beta.0" took 601.244µs
I0801 02:33:38.130780 2667272 cache.go:80] save to tar file registry.k8s.io/kube-proxy:v1.31.0-beta.0 -> /home/jenkins/minikube-integration/19312-2449638/.minikube/cache/images/arm64/registry.k8s.io/kube-proxy_v1.31.0-beta.0 succeeded
I0801 02:33:38.130803 2667272 cache.go:87] Successfully saved all images to host disk.
W0801 02:33:38.150619 2667272 image.go:95] image gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 is of wrong architecture
I0801 02:33:38.150640 2667272 cache.go:149] Downloading gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 to local cache
I0801 02:33:38.150717 2667272 image.go:63] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 in local cache directory
I0801 02:33:38.150743 2667272 image.go:66] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 in local cache directory, skipping pull
I0801 02:33:38.150753 2667272 image.go:135] gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 exists in cache, skipping pull
I0801 02:33:38.150767 2667272 cache.go:152] successfully saved gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 as a tarball
I0801 02:33:38.150779 2667272 cache.go:162] Loading gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 from local cache
I0801 02:33:38.294683 2667272 cache.go:164] successfully loaded and using gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 from cached tarball
I0801 02:33:38.294718 2667272 cache.go:194] Successfully downloaded all kic artifacts
I0801 02:33:38.294748 2667272 start.go:360] acquireMachinesLock for no-preload-969386: {Name:mkc45997e7ac08e30c40209b61392822729959bc Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0801 02:33:38.294842 2667272 start.go:364] duration metric: took 75.42µs to acquireMachinesLock for "no-preload-969386"
I0801 02:33:38.294865 2667272 start.go:96] Skipping create...Using existing machine configuration
I0801 02:33:38.294871 2667272 fix.go:54] fixHost starting:
I0801 02:33:38.295152 2667272 cli_runner.go:164] Run: docker container inspect no-preload-969386 --format={{.State.Status}}
I0801 02:33:38.313475 2667272 fix.go:112] recreateIfNeeded on no-preload-969386: state=Stopped err=<nil>
W0801 02:33:38.313504 2667272 fix.go:138] unexpected machine state, will restart: <nil>
I0801 02:33:38.315560 2667272 out.go:177] * Restarting existing docker container for "no-preload-969386" ...
I0801 02:33:33.761150 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:33:35.762058 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:33:37.762887 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:33:38.317393 2667272 cli_runner.go:164] Run: docker start no-preload-969386
I0801 02:33:38.707519 2667272 cli_runner.go:164] Run: docker container inspect no-preload-969386 --format={{.State.Status}}
I0801 02:33:38.731209 2667272 kic.go:430] container "no-preload-969386" state is running.
I0801 02:33:38.731624 2667272 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" no-preload-969386
I0801 02:33:38.752448 2667272 profile.go:143] Saving config to /home/jenkins/minikube-integration/19312-2449638/.minikube/profiles/no-preload-969386/config.json ...
I0801 02:33:38.752684 2667272 machine.go:94] provisionDockerMachine start ...
I0801 02:33:38.752741 2667272 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-969386
I0801 02:33:38.773997 2667272 main.go:141] libmachine: Using SSH client type: native
I0801 02:33:38.774262 2667272 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2cd0] 0x3e5530 <nil> [] 0s} 127.0.0.1 35734 <nil> <nil>}
I0801 02:33:38.774271 2667272 main.go:141] libmachine: About to run SSH command:
hostname
I0801 02:33:38.774876 2667272 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:45908->127.0.0.1:35734: read: connection reset by peer
I0801 02:33:41.907855 2667272 main.go:141] libmachine: SSH cmd err, output: <nil>: no-preload-969386
I0801 02:33:41.907880 2667272 ubuntu.go:169] provisioning hostname "no-preload-969386"
I0801 02:33:41.907945 2667272 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-969386
I0801 02:33:41.925303 2667272 main.go:141] libmachine: Using SSH client type: native
I0801 02:33:41.925566 2667272 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2cd0] 0x3e5530 <nil> [] 0s} 127.0.0.1 35734 <nil> <nil>}
I0801 02:33:41.925583 2667272 main.go:141] libmachine: About to run SSH command:
sudo hostname no-preload-969386 && echo "no-preload-969386" | sudo tee /etc/hostname
I0801 02:33:42.090131 2667272 main.go:141] libmachine: SSH cmd err, output: <nil>: no-preload-969386
I0801 02:33:42.090240 2667272 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-969386
I0801 02:33:42.115877 2667272 main.go:141] libmachine: Using SSH client type: native
I0801 02:33:42.116202 2667272 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2cd0] 0x3e5530 <nil> [] 0s} 127.0.0.1 35734 <nil> <nil>}
I0801 02:33:42.116239 2667272 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sno-preload-969386' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 no-preload-969386/g' /etc/hosts;
else
echo '127.0.1.1 no-preload-969386' | sudo tee -a /etc/hosts;
fi
fi
I0801 02:33:42.264214 2667272 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0801 02:33:42.264270 2667272 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/19312-2449638/.minikube CaCertPath:/home/jenkins/minikube-integration/19312-2449638/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19312-2449638/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19312-2449638/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19312-2449638/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19312-2449638/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19312-2449638/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19312-2449638/.minikube}
I0801 02:33:42.264365 2667272 ubuntu.go:177] setting up certificates
I0801 02:33:42.264378 2667272 provision.go:84] configureAuth start
I0801 02:33:42.264499 2667272 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" no-preload-969386
I0801 02:33:42.284658 2667272 provision.go:143] copyHostCerts
I0801 02:33:42.284785 2667272 exec_runner.go:144] found /home/jenkins/minikube-integration/19312-2449638/.minikube/ca.pem, removing ...
I0801 02:33:42.284802 2667272 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19312-2449638/.minikube/ca.pem
I0801 02:33:42.284883 2667272 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19312-2449638/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19312-2449638/.minikube/ca.pem (1082 bytes)
I0801 02:33:42.285007 2667272 exec_runner.go:144] found /home/jenkins/minikube-integration/19312-2449638/.minikube/cert.pem, removing ...
I0801 02:33:42.285019 2667272 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19312-2449638/.minikube/cert.pem
I0801 02:33:42.285047 2667272 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19312-2449638/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19312-2449638/.minikube/cert.pem (1123 bytes)
I0801 02:33:42.285125 2667272 exec_runner.go:144] found /home/jenkins/minikube-integration/19312-2449638/.minikube/key.pem, removing ...
I0801 02:33:42.285136 2667272 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19312-2449638/.minikube/key.pem
I0801 02:33:42.285162 2667272 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19312-2449638/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19312-2449638/.minikube/key.pem (1675 bytes)
I0801 02:33:42.285222 2667272 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19312-2449638/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19312-2449638/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19312-2449638/.minikube/certs/ca-key.pem org=jenkins.no-preload-969386 san=[127.0.0.1 192.168.76.2 localhost minikube no-preload-969386]
I0801 02:33:40.261778 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:33:42.275181 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:33:43.028626 2667272 provision.go:177] copyRemoteCerts
I0801 02:33:43.028746 2667272 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0801 02:33:43.028806 2667272 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-969386
I0801 02:33:43.045404 2667272 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:35734 SSHKeyPath:/home/jenkins/minikube-integration/19312-2449638/.minikube/machines/no-preload-969386/id_rsa Username:docker}
I0801 02:33:43.141435 2667272 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19312-2449638/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
I0801 02:33:43.167427 2667272 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19312-2449638/.minikube/machines/server.pem --> /etc/docker/server.pem (1220 bytes)
I0801 02:33:43.195599 2667272 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19312-2449638/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0801 02:33:43.223357 2667272 provision.go:87] duration metric: took 958.960359ms to configureAuth
I0801 02:33:43.223382 2667272 ubuntu.go:193] setting minikube options for container-runtime
I0801 02:33:43.223599 2667272 config.go:182] Loaded profile config "no-preload-969386": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.31.0-beta.0
I0801 02:33:43.223606 2667272 machine.go:97] duration metric: took 4.470913949s to provisionDockerMachine
I0801 02:33:43.223614 2667272 start.go:293] postStartSetup for "no-preload-969386" (driver="docker")
I0801 02:33:43.223626 2667272 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0801 02:33:43.223676 2667272 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0801 02:33:43.223718 2667272 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-969386
I0801 02:33:43.241728 2667272 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:35734 SSHKeyPath:/home/jenkins/minikube-integration/19312-2449638/.minikube/machines/no-preload-969386/id_rsa Username:docker}
I0801 02:33:43.341439 2667272 ssh_runner.go:195] Run: cat /etc/os-release
I0801 02:33:43.344938 2667272 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0801 02:33:43.344976 2667272 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0801 02:33:43.344987 2667272 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0801 02:33:43.344994 2667272 info.go:137] Remote host: Ubuntu 22.04.4 LTS
I0801 02:33:43.345005 2667272 filesync.go:126] Scanning /home/jenkins/minikube-integration/19312-2449638/.minikube/addons for local assets ...
I0801 02:33:43.345069 2667272 filesync.go:126] Scanning /home/jenkins/minikube-integration/19312-2449638/.minikube/files for local assets ...
I0801 02:33:43.345160 2667272 filesync.go:149] local asset: /home/jenkins/minikube-integration/19312-2449638/.minikube/files/etc/ssl/certs/24550302.pem -> 24550302.pem in /etc/ssl/certs
I0801 02:33:43.345274 2667272 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0801 02:33:43.354091 2667272 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19312-2449638/.minikube/files/etc/ssl/certs/24550302.pem --> /etc/ssl/certs/24550302.pem (1708 bytes)
I0801 02:33:43.380999 2667272 start.go:296] duration metric: took 157.37073ms for postStartSetup
I0801 02:33:43.381145 2667272 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0801 02:33:43.381208 2667272 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-969386
I0801 02:33:43.398226 2667272 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:35734 SSHKeyPath:/home/jenkins/minikube-integration/19312-2449638/.minikube/machines/no-preload-969386/id_rsa Username:docker}
I0801 02:33:43.501113 2667272 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I0801 02:33:43.506177 2667272 fix.go:56] duration metric: took 5.211297435s for fixHost
I0801 02:33:43.506204 2667272 start.go:83] releasing machines lock for "no-preload-969386", held for 5.211353032s
I0801 02:33:43.506281 2667272 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" no-preload-969386
I0801 02:33:43.524538 2667272 ssh_runner.go:195] Run: cat /version.json
I0801 02:33:43.524581 2667272 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0801 02:33:43.524591 2667272 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-969386
I0801 02:33:43.524644 2667272 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-969386
I0801 02:33:43.552473 2667272 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:35734 SSHKeyPath:/home/jenkins/minikube-integration/19312-2449638/.minikube/machines/no-preload-969386/id_rsa Username:docker}
I0801 02:33:43.553009 2667272 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:35734 SSHKeyPath:/home/jenkins/minikube-integration/19312-2449638/.minikube/machines/no-preload-969386/id_rsa Username:docker}
I0801 02:33:43.647694 2667272 ssh_runner.go:195] Run: systemctl --version
I0801 02:33:43.804583 2667272 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I0801 02:33:43.809727 2667272 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
I0801 02:33:43.829019 2667272 cni.go:230] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
I0801 02:33:43.829162 2667272 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0801 02:33:43.838396 2667272 cni.go:259] no active bridge cni configs found in "/etc/cni/net.d" - nothing to disable
I0801 02:33:43.838472 2667272 start.go:495] detecting cgroup driver to use...
I0801 02:33:43.838520 2667272 detect.go:187] detected "cgroupfs" cgroup driver on host os
I0801 02:33:43.838606 2667272 ssh_runner.go:195] Run: sudo systemctl stop -f crio
I0801 02:33:43.853447 2667272 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I0801 02:33:43.865918 2667272 docker.go:217] disabling cri-docker service (if available) ...
I0801 02:33:43.865985 2667272 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0801 02:33:43.880271 2667272 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0801 02:33:43.892772 2667272 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0801 02:33:43.988395 2667272 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0801 02:33:44.079056 2667272 docker.go:233] disabling docker service ...
I0801 02:33:44.079152 2667272 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0801 02:33:44.094640 2667272 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0801 02:33:44.106545 2667272 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0801 02:33:44.193297 2667272 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0801 02:33:44.290073 2667272 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0801 02:33:44.302341 2667272 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///run/containerd/containerd.sock
" | sudo tee /etc/crictl.yaml"
I0801 02:33:44.321704 2667272 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.10"|' /etc/containerd/config.toml"
I0801 02:33:44.333715 2667272 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
I0801 02:33:44.345092 2667272 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...
I0801 02:33:44.345207 2667272 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
I0801 02:33:44.355974 2667272 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0801 02:33:44.366810 2667272 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
I0801 02:33:44.378060 2667272 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0801 02:33:44.389633 2667272 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0801 02:33:44.400904 2667272 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
I0801 02:33:44.416437 2667272 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *enable_unprivileged_ports = .*/d' /etc/containerd/config.toml"
I0801 02:33:44.428679 2667272 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)\[plugins."io.containerd.grpc.v1.cri"\]|&\n\1 enable_unprivileged_ports = true|' /etc/containerd/config.toml"
I0801 02:33:44.440516 2667272 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0801 02:33:44.457575 2667272 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0801 02:33:44.468379 2667272 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0801 02:33:44.586799 2667272 ssh_runner.go:195] Run: sudo systemctl restart containerd
I0801 02:33:44.738150 2667272 start.go:542] Will wait 60s for socket path /run/containerd/containerd.sock
I0801 02:33:44.738226 2667272 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
I0801 02:33:44.742523 2667272 start.go:563] Will wait 60s for crictl version
I0801 02:33:44.742590 2667272 ssh_runner.go:195] Run: which crictl
I0801 02:33:44.746633 2667272 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0801 02:33:44.789483 2667272 start.go:579] Version: 0.1.0
RuntimeName: containerd
RuntimeVersion: 1.7.19
RuntimeApiVersion: v1
I0801 02:33:44.789564 2667272 ssh_runner.go:195] Run: containerd --version
I0801 02:33:44.816008 2667272 ssh_runner.go:195] Run: containerd --version
I0801 02:33:44.846420 2667272 out.go:177] * Preparing Kubernetes v1.31.0-beta.0 on containerd 1.7.19 ...
I0801 02:33:44.848230 2667272 cli_runner.go:164] Run: docker network inspect no-preload-969386 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0801 02:33:44.865140 2667272 ssh_runner.go:195] Run: grep 192.168.76.1 host.minikube.internal$ /etc/hosts
I0801 02:33:44.869214 2667272 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.76.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0801 02:33:44.880864 2667272 kubeadm.go:883] updating cluster {Name:no-preload-969386 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0-beta.0 ClusterName:no-preload-969386 Namespace:default APIServerHAVIP: APIServerName:minikub
eCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.31.0-beta.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountStr
ing:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0801 02:33:44.880999 2667272 preload.go:131] Checking if preload exists for k8s version v1.31.0-beta.0 and runtime containerd
I0801 02:33:44.881044 2667272 ssh_runner.go:195] Run: sudo crictl images --output json
I0801 02:33:44.917589 2667272 containerd.go:627] all images are preloaded for containerd runtime.
I0801 02:33:44.917614 2667272 cache_images.go:84] Images are preloaded, skipping loading
I0801 02:33:44.917623 2667272 kubeadm.go:934] updating node { 192.168.76.2 8443 v1.31.0-beta.0 containerd true true} ...
I0801 02:33:44.917735 2667272 kubeadm.go:946] kubelet [Unit]
Wants=containerd.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.31.0-beta.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=no-preload-969386 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.76.2
[Install]
config:
{KubernetesVersion:v1.31.0-beta.0 ClusterName:no-preload-969386 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0801 02:33:44.917806 2667272 ssh_runner.go:195] Run: sudo crictl info
I0801 02:33:44.963237 2667272 cni.go:84] Creating CNI manager for ""
I0801 02:33:44.963265 2667272 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0801 02:33:44.963277 2667272 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0801 02:33:44.963341 2667272 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.76.2 APIServerPort:8443 KubernetesVersion:v1.31.0-beta.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:no-preload-969386 NodeName:no-preload-969386 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.76.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.76.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt Sta
ticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///run/containerd/containerd.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I0801 02:33:44.963508 2667272 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta3
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.76.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///run/containerd/containerd.sock
name: "no-preload-969386"
kubeletExtraArgs:
node-ip: 192.168.76.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta3
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.76.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.31.0-beta.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
containerRuntimeEndpoint: unix:///run/containerd/containerd.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%!"(MISSING)
nodefs.inodesFree: "0%!"(MISSING)
imagefs.available: "0%!"(MISSING)
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0801 02:33:44.963582 2667272 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.31.0-beta.0
I0801 02:33:44.973233 2667272 binaries.go:44] Found k8s binaries, skipping transfer
I0801 02:33:44.973309 2667272 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0801 02:33:44.982732 2667272 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (328 bytes)
I0801 02:33:45.001945 2667272 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (359 bytes)
I0801 02:33:45.065680 2667272 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2178 bytes)
I0801 02:33:45.091275 2667272 ssh_runner.go:195] Run: grep 192.168.76.2 control-plane.minikube.internal$ /etc/hosts
I0801 02:33:45.096413 2667272 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.76.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0801 02:33:45.116260 2667272 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0801 02:33:45.266679 2667272 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0801 02:33:45.289003 2667272 certs.go:68] Setting up /home/jenkins/minikube-integration/19312-2449638/.minikube/profiles/no-preload-969386 for IP: 192.168.76.2
I0801 02:33:45.289025 2667272 certs.go:194] generating shared ca certs ...
I0801 02:33:45.289044 2667272 certs.go:226] acquiring lock for ca certs: {Name:mk4f254a7420ab7eacd0dc9e9cb7a0b2961241d3 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0801 02:33:45.289201 2667272 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19312-2449638/.minikube/ca.key
I0801 02:33:45.289279 2667272 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19312-2449638/.minikube/proxy-client-ca.key
I0801 02:33:45.289289 2667272 certs.go:256] generating profile certs ...
I0801 02:33:45.289386 2667272 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/19312-2449638/.minikube/profiles/no-preload-969386/client.key
I0801 02:33:45.289456 2667272 certs.go:359] skipping valid signed profile cert regeneration for "minikube": /home/jenkins/minikube-integration/19312-2449638/.minikube/profiles/no-preload-969386/apiserver.key.b9f981ca
I0801 02:33:45.289498 2667272 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/19312-2449638/.minikube/profiles/no-preload-969386/proxy-client.key
I0801 02:33:45.289620 2667272 certs.go:484] found cert: /home/jenkins/minikube-integration/19312-2449638/.minikube/certs/2455030.pem (1338 bytes)
W0801 02:33:45.289649 2667272 certs.go:480] ignoring /home/jenkins/minikube-integration/19312-2449638/.minikube/certs/2455030_empty.pem, impossibly tiny 0 bytes
I0801 02:33:45.289658 2667272 certs.go:484] found cert: /home/jenkins/minikube-integration/19312-2449638/.minikube/certs/ca-key.pem (1675 bytes)
I0801 02:33:45.289682 2667272 certs.go:484] found cert: /home/jenkins/minikube-integration/19312-2449638/.minikube/certs/ca.pem (1082 bytes)
I0801 02:33:45.289706 2667272 certs.go:484] found cert: /home/jenkins/minikube-integration/19312-2449638/.minikube/certs/cert.pem (1123 bytes)
I0801 02:33:45.289727 2667272 certs.go:484] found cert: /home/jenkins/minikube-integration/19312-2449638/.minikube/certs/key.pem (1675 bytes)
I0801 02:33:45.289772 2667272 certs.go:484] found cert: /home/jenkins/minikube-integration/19312-2449638/.minikube/files/etc/ssl/certs/24550302.pem (1708 bytes)
I0801 02:33:45.290525 2667272 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19312-2449638/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0801 02:33:45.334715 2667272 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19312-2449638/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0801 02:33:45.371711 2667272 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19312-2449638/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0801 02:33:45.406622 2667272 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19312-2449638/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0801 02:33:45.443923 2667272 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19312-2449638/.minikube/profiles/no-preload-969386/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1424 bytes)
I0801 02:33:45.481473 2667272 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19312-2449638/.minikube/profiles/no-preload-969386/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0801 02:33:45.513288 2667272 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19312-2449638/.minikube/profiles/no-preload-969386/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0801 02:33:45.553102 2667272 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19312-2449638/.minikube/profiles/no-preload-969386/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0801 02:33:45.580802 2667272 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19312-2449638/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0801 02:33:45.610919 2667272 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19312-2449638/.minikube/certs/2455030.pem --> /usr/share/ca-certificates/2455030.pem (1338 bytes)
I0801 02:33:45.645193 2667272 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19312-2449638/.minikube/files/etc/ssl/certs/24550302.pem --> /usr/share/ca-certificates/24550302.pem (1708 bytes)
I0801 02:33:45.675759 2667272 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0801 02:33:45.697653 2667272 ssh_runner.go:195] Run: openssl version
I0801 02:33:45.703807 2667272 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/24550302.pem && ln -fs /usr/share/ca-certificates/24550302.pem /etc/ssl/certs/24550302.pem"
I0801 02:33:45.715080 2667272 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/24550302.pem
I0801 02:33:45.718942 2667272 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Aug 1 01:52 /usr/share/ca-certificates/24550302.pem
I0801 02:33:45.719041 2667272 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/24550302.pem
I0801 02:33:45.726481 2667272 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/24550302.pem /etc/ssl/certs/3ec20f2e.0"
I0801 02:33:45.736096 2667272 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0801 02:33:45.746025 2667272 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0801 02:33:45.749614 2667272 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Aug 1 01:42 /usr/share/ca-certificates/minikubeCA.pem
I0801 02:33:45.749698 2667272 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0801 02:33:45.757252 2667272 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0801 02:33:45.771026 2667272 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/2455030.pem && ln -fs /usr/share/ca-certificates/2455030.pem /etc/ssl/certs/2455030.pem"
I0801 02:33:45.781346 2667272 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/2455030.pem
I0801 02:33:45.785575 2667272 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Aug 1 01:52 /usr/share/ca-certificates/2455030.pem
I0801 02:33:45.785643 2667272 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/2455030.pem
I0801 02:33:45.793251 2667272 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/2455030.pem /etc/ssl/certs/51391683.0"
I0801 02:33:45.803476 2667272 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0801 02:33:45.807574 2667272 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
I0801 02:33:45.815363 2667272 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
I0801 02:33:45.822645 2667272 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
I0801 02:33:45.829734 2667272 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
I0801 02:33:45.836930 2667272 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
I0801 02:33:45.844214 2667272 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
I0801 02:33:45.851494 2667272 kubeadm.go:392] StartCluster: {Name:no-preload-969386 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0-beta.0 ClusterName:no-preload-969386 Namespace:default APIServerHAVIP: APIServerName:minikubeCA
APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.31.0-beta.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString
:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0801 02:33:45.851593 2667272 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}
I0801 02:33:45.851676 2667272 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0801 02:33:45.905209 2667272 cri.go:89] found id: "80f7affb1ef24552586a0b5d59c93cf17641bf7ecedc9b6855979c0c8cac38ad"
I0801 02:33:45.905284 2667272 cri.go:89] found id: "5cdaae6c3763811569c351eb86c02f8235f0c9c15891d5c0987665ddc45ff88a"
I0801 02:33:45.905319 2667272 cri.go:89] found id: "5d6ba9eb442ca0381d075e115e800c50673e6e7cb45cfaa6f19fa29e768af1a1"
I0801 02:33:45.905334 2667272 cri.go:89] found id: "4e879fae830defa0dd5c0fb47e27f868f75427770a997f1ffbe35f3d657987d0"
I0801 02:33:45.905338 2667272 cri.go:89] found id: "fb3ffa95466976487c688fc8f8265b2a0440746f0caaaf3d72a8364f83cb6c72"
I0801 02:33:45.905342 2667272 cri.go:89] found id: "61ea8ba30980181aedb58fb32830004779c1e77c49cae2438c28d5b8f73edf1d"
I0801 02:33:45.905345 2667272 cri.go:89] found id: "32c1534b2e481a5d9f1ed8f44676c0fde1ce99c2f5bdf91d03cd07938f6e0bea"
I0801 02:33:45.905348 2667272 cri.go:89] found id: "9606b40060c77114dcbba65aceb4f7b33d2c486aa7c9e8fd700712f12a19ebd0"
I0801 02:33:45.905351 2667272 cri.go:89] found id: ""
I0801 02:33:45.905413 2667272 ssh_runner.go:195] Run: sudo runc --root /run/containerd/runc/k8s.io list -f json
I0801 02:33:45.919166 2667272 cri.go:116] JSON = null
W0801 02:33:45.919226 2667272 kubeadm.go:399] unpause failed: list paused: list returned 0 containers, but ps returned 8
I0801 02:33:45.919307 2667272 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0801 02:33:45.930023 2667272 kubeadm.go:408] found existing configuration files, will attempt cluster restart
I0801 02:33:45.930042 2667272 kubeadm.go:593] restartPrimaryControlPlane start ...
I0801 02:33:45.930096 2667272 ssh_runner.go:195] Run: sudo test -d /data/minikube
I0801 02:33:45.943212 2667272 kubeadm.go:130] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
stdout:
stderr:
I0801 02:33:45.943801 2667272 kubeconfig.go:47] verify endpoint returned: get endpoint: "no-preload-969386" does not appear in /home/jenkins/minikube-integration/19312-2449638/kubeconfig
I0801 02:33:45.944068 2667272 kubeconfig.go:62] /home/jenkins/minikube-integration/19312-2449638/kubeconfig needs updating (will repair): [kubeconfig missing "no-preload-969386" cluster setting kubeconfig missing "no-preload-969386" context setting]
I0801 02:33:45.944582 2667272 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19312-2449638/kubeconfig: {Name:mke6bc9d0d8db2aacef04b1481fd128177e95686 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0801 02:33:45.945984 2667272 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
I0801 02:33:45.962010 2667272 kubeadm.go:630] The running cluster does not require reconfiguration: 192.168.76.2
I0801 02:33:45.962043 2667272 kubeadm.go:597] duration metric: took 31.995236ms to restartPrimaryControlPlane
I0801 02:33:45.962052 2667272 kubeadm.go:394] duration metric: took 110.586182ms to StartCluster
I0801 02:33:45.962068 2667272 settings.go:142] acquiring lock: {Name:mk334d93198a24e0ee37ffd6471cc7d7262e375c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0801 02:33:45.962127 2667272 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/19312-2449638/kubeconfig
I0801 02:33:45.963162 2667272 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19312-2449638/kubeconfig: {Name:mke6bc9d0d8db2aacef04b1481fd128177e95686 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0801 02:33:45.963368 2667272 start.go:235] Will wait 6m0s for node &{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.31.0-beta.0 ContainerRuntime:containerd ControlPlane:true Worker:true}
I0801 02:33:45.963644 2667272 config.go:182] Loaded profile config "no-preload-969386": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.31.0-beta.0
I0801 02:33:45.963687 2667272 addons.go:507] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:true default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]
I0801 02:33:45.963754 2667272 addons.go:69] Setting storage-provisioner=true in profile "no-preload-969386"
I0801 02:33:45.963782 2667272 addons.go:234] Setting addon storage-provisioner=true in "no-preload-969386"
W0801 02:33:45.963788 2667272 addons.go:243] addon storage-provisioner should already be in state true
I0801 02:33:45.963813 2667272 host.go:66] Checking if "no-preload-969386" exists ...
I0801 02:33:45.964258 2667272 cli_runner.go:164] Run: docker container inspect no-preload-969386 --format={{.State.Status}}
I0801 02:33:45.964728 2667272 addons.go:69] Setting default-storageclass=true in profile "no-preload-969386"
I0801 02:33:45.964764 2667272 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "no-preload-969386"
I0801 02:33:45.965037 2667272 cli_runner.go:164] Run: docker container inspect no-preload-969386 --format={{.State.Status}}
I0801 02:33:45.968410 2667272 addons.go:69] Setting metrics-server=true in profile "no-preload-969386"
I0801 02:33:45.968452 2667272 addons.go:234] Setting addon metrics-server=true in "no-preload-969386"
W0801 02:33:45.968459 2667272 addons.go:243] addon metrics-server should already be in state true
I0801 02:33:45.968490 2667272 host.go:66] Checking if "no-preload-969386" exists ...
I0801 02:33:45.968986 2667272 cli_runner.go:164] Run: docker container inspect no-preload-969386 --format={{.State.Status}}
I0801 02:33:45.969140 2667272 addons.go:69] Setting dashboard=true in profile "no-preload-969386"
I0801 02:33:45.969162 2667272 addons.go:234] Setting addon dashboard=true in "no-preload-969386"
W0801 02:33:45.969168 2667272 addons.go:243] addon dashboard should already be in state true
I0801 02:33:45.969190 2667272 host.go:66] Checking if "no-preload-969386" exists ...
I0801 02:33:45.969542 2667272 cli_runner.go:164] Run: docker container inspect no-preload-969386 --format={{.State.Status}}
I0801 02:33:45.970676 2667272 out.go:177] * Verifying Kubernetes components...
I0801 02:33:45.972781 2667272 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0801 02:33:46.006552 2667272 addons.go:234] Setting addon default-storageclass=true in "no-preload-969386"
W0801 02:33:46.006580 2667272 addons.go:243] addon default-storageclass should already be in state true
I0801 02:33:46.006609 2667272 host.go:66] Checking if "no-preload-969386" exists ...
I0801 02:33:46.009890 2667272 cli_runner.go:164] Run: docker container inspect no-preload-969386 --format={{.State.Status}}
I0801 02:33:46.044176 2667272 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0801 02:33:46.045993 2667272 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0801 02:33:46.046022 2667272 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0801 02:33:46.046093 2667272 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-969386
I0801 02:33:46.065031 2667272 out.go:177] - Using image fake.domain/registry.k8s.io/echoserver:1.4
I0801 02:33:46.069485 2667272 out.go:177] - Using image docker.io/kubernetesui/dashboard:v2.7.0
I0801 02:33:46.069549 2667272 addons.go:431] installing /etc/kubernetes/addons/metrics-apiservice.yaml
I0801 02:33:46.069578 2667272 ssh_runner.go:362] scp metrics-server/metrics-apiservice.yaml --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
I0801 02:33:46.069646 2667272 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-969386
I0801 02:33:46.081310 2667272 addons.go:431] installing /etc/kubernetes/addons/storageclass.yaml
I0801 02:33:46.081332 2667272 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0801 02:33:46.081393 2667272 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-969386
I0801 02:33:46.085419 2667272 out.go:177] - Using image registry.k8s.io/echoserver:1.4
I0801 02:33:46.089237 2667272 addons.go:431] installing /etc/kubernetes/addons/dashboard-ns.yaml
I0801 02:33:46.089269 2667272 ssh_runner.go:362] scp dashboard/dashboard-ns.yaml --> /etc/kubernetes/addons/dashboard-ns.yaml (759 bytes)
I0801 02:33:46.089338 2667272 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-969386
I0801 02:33:46.126691 2667272 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:35734 SSHKeyPath:/home/jenkins/minikube-integration/19312-2449638/.minikube/machines/no-preload-969386/id_rsa Username:docker}
I0801 02:33:46.132428 2667272 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:35734 SSHKeyPath:/home/jenkins/minikube-integration/19312-2449638/.minikube/machines/no-preload-969386/id_rsa Username:docker}
I0801 02:33:46.155447 2667272 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:35734 SSHKeyPath:/home/jenkins/minikube-integration/19312-2449638/.minikube/machines/no-preload-969386/id_rsa Username:docker}
I0801 02:33:46.157435 2667272 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:35734 SSHKeyPath:/home/jenkins/minikube-integration/19312-2449638/.minikube/machines/no-preload-969386/id_rsa Username:docker}
I0801 02:33:46.206124 2667272 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0801 02:33:46.325552 2667272 node_ready.go:35] waiting up to 6m0s for node "no-preload-969386" to be "Ready" ...
I0801 02:33:46.398777 2667272 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0-beta.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0801 02:33:46.445338 2667272 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0-beta.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0801 02:33:46.492754 2667272 addons.go:431] installing /etc/kubernetes/addons/dashboard-clusterrole.yaml
I0801 02:33:46.492818 2667272 ssh_runner.go:362] scp dashboard/dashboard-clusterrole.yaml --> /etc/kubernetes/addons/dashboard-clusterrole.yaml (1001 bytes)
I0801 02:33:46.524928 2667272 addons.go:431] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
I0801 02:33:46.524991 2667272 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1825 bytes)
I0801 02:33:46.604960 2667272 addons.go:431] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
I0801 02:33:46.605034 2667272 ssh_runner.go:362] scp metrics-server/metrics-server-rbac.yaml --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
I0801 02:33:46.790533 2667272 addons.go:431] installing /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml
I0801 02:33:46.790611 2667272 ssh_runner.go:362] scp dashboard/dashboard-clusterrolebinding.yaml --> /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml (1018 bytes)
I0801 02:33:46.846369 2667272 addons.go:431] installing /etc/kubernetes/addons/metrics-server-service.yaml
I0801 02:33:46.846439 2667272 ssh_runner.go:362] scp metrics-server/metrics-server-service.yaml --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
I0801 02:33:46.984860 2667272 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0-beta.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0801 02:33:47.030289 2667272 addons.go:431] installing /etc/kubernetes/addons/dashboard-configmap.yaml
I0801 02:33:47.030366 2667272 ssh_runner.go:362] scp dashboard/dashboard-configmap.yaml --> /etc/kubernetes/addons/dashboard-configmap.yaml (837 bytes)
I0801 02:33:47.112635 2667272 addons.go:431] installing /etc/kubernetes/addons/dashboard-dp.yaml
I0801 02:33:47.112720 2667272 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-dp.yaml (4201 bytes)
I0801 02:33:47.217882 2667272 addons.go:431] installing /etc/kubernetes/addons/dashboard-role.yaml
I0801 02:33:47.217952 2667272 ssh_runner.go:362] scp dashboard/dashboard-role.yaml --> /etc/kubernetes/addons/dashboard-role.yaml (1724 bytes)
I0801 02:33:47.299244 2667272 addons.go:431] installing /etc/kubernetes/addons/dashboard-rolebinding.yaml
I0801 02:33:47.299314 2667272 ssh_runner.go:362] scp dashboard/dashboard-rolebinding.yaml --> /etc/kubernetes/addons/dashboard-rolebinding.yaml (1046 bytes)
I0801 02:33:47.371199 2667272 addons.go:431] installing /etc/kubernetes/addons/dashboard-sa.yaml
I0801 02:33:47.371269 2667272 ssh_runner.go:362] scp dashboard/dashboard-sa.yaml --> /etc/kubernetes/addons/dashboard-sa.yaml (837 bytes)
I0801 02:33:47.421883 2667272 addons.go:431] installing /etc/kubernetes/addons/dashboard-secret.yaml
I0801 02:33:47.421951 2667272 ssh_runner.go:362] scp dashboard/dashboard-secret.yaml --> /etc/kubernetes/addons/dashboard-secret.yaml (1389 bytes)
I0801 02:33:47.466698 2667272 addons.go:431] installing /etc/kubernetes/addons/dashboard-svc.yaml
I0801 02:33:47.466767 2667272 ssh_runner.go:362] scp dashboard/dashboard-svc.yaml --> /etc/kubernetes/addons/dashboard-svc.yaml (1294 bytes)
I0801 02:33:47.515367 2667272 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0-beta.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0801 02:33:44.762221 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:33:47.261419 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:33:51.272347 2667272 node_ready.go:49] node "no-preload-969386" has status "Ready":"True"
I0801 02:33:51.272371 2667272 node_ready.go:38] duration metric: took 4.946736237s for node "no-preload-969386" to be "Ready" ...
I0801 02:33:51.272381 2667272 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0801 02:33:51.332200 2667272 pod_ready.go:78] waiting up to 6m0s for pod "coredns-5cfdc65f69-kf9g5" in "kube-system" namespace to be "Ready" ...
I0801 02:33:51.369304 2667272 pod_ready.go:92] pod "coredns-5cfdc65f69-kf9g5" in "kube-system" namespace has status "Ready":"True"
I0801 02:33:51.369368 2667272 pod_ready.go:81] duration metric: took 37.061514ms for pod "coredns-5cfdc65f69-kf9g5" in "kube-system" namespace to be "Ready" ...
I0801 02:33:51.369395 2667272 pod_ready.go:78] waiting up to 6m0s for pod "etcd-no-preload-969386" in "kube-system" namespace to be "Ready" ...
I0801 02:33:51.415610 2667272 pod_ready.go:92] pod "etcd-no-preload-969386" in "kube-system" namespace has status "Ready":"True"
I0801 02:33:51.415689 2667272 pod_ready.go:81] duration metric: took 46.27253ms for pod "etcd-no-preload-969386" in "kube-system" namespace to be "Ready" ...
I0801 02:33:51.415720 2667272 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-no-preload-969386" in "kube-system" namespace to be "Ready" ...
I0801 02:33:51.466808 2667272 pod_ready.go:92] pod "kube-apiserver-no-preload-969386" in "kube-system" namespace has status "Ready":"True"
I0801 02:33:51.466886 2667272 pod_ready.go:81] duration metric: took 51.144655ms for pod "kube-apiserver-no-preload-969386" in "kube-system" namespace to be "Ready" ...
I0801 02:33:51.466912 2667272 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-no-preload-969386" in "kube-system" namespace to be "Ready" ...
I0801 02:33:51.523635 2667272 pod_ready.go:92] pod "kube-controller-manager-no-preload-969386" in "kube-system" namespace has status "Ready":"True"
I0801 02:33:51.523739 2667272 pod_ready.go:81] duration metric: took 56.805539ms for pod "kube-controller-manager-no-preload-969386" in "kube-system" namespace to be "Ready" ...
I0801 02:33:51.523777 2667272 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-6tmqx" in "kube-system" namespace to be "Ready" ...
I0801 02:33:51.561808 2667272 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0-beta.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (5.162951341s)
I0801 02:33:51.562304 2667272 pod_ready.go:92] pod "kube-proxy-6tmqx" in "kube-system" namespace has status "Ready":"True"
I0801 02:33:51.562536 2667272 pod_ready.go:81] duration metric: took 38.725292ms for pod "kube-proxy-6tmqx" in "kube-system" namespace to be "Ready" ...
I0801 02:33:51.562565 2667272 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-no-preload-969386" in "kube-system" namespace to be "Ready" ...
I0801 02:33:51.877426 2667272 pod_ready.go:92] pod "kube-scheduler-no-preload-969386" in "kube-system" namespace has status "Ready":"True"
I0801 02:33:51.877493 2667272 pod_ready.go:81] duration metric: took 314.894797ms for pod "kube-scheduler-no-preload-969386" in "kube-system" namespace to be "Ready" ...
I0801 02:33:51.877520 2667272 pod_ready.go:78] waiting up to 6m0s for pod "metrics-server-78fcd8795b-r5j99" in "kube-system" namespace to be "Ready" ...
I0801 02:33:49.262004 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:33:51.262853 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:33:53.262966 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:33:53.895814 2667272 pod_ready.go:102] pod "metrics-server-78fcd8795b-r5j99" in "kube-system" namespace has status "Ready":"False"
I0801 02:33:54.723501 2667272 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0-beta.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (8.278090063s)
I0801 02:33:54.723620 2667272 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0-beta.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (7.738693689s)
I0801 02:33:54.723727 2667272 addons.go:475] Verifying addon metrics-server=true in "no-preload-969386"
I0801 02:33:54.807368 2667272 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0-beta.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: (7.29190911s)
I0801 02:33:54.810023 2667272 out.go:177] * Some dashboard features require the metrics-server addon. To enable all features please run:
minikube -p no-preload-969386 addons enable metrics-server
I0801 02:33:54.812478 2667272 out.go:177] * Enabled addons: default-storageclass, storage-provisioner, metrics-server, dashboard
I0801 02:33:54.814479 2667272 addons.go:510] duration metric: took 8.850781827s for enable addons: enabled=[default-storageclass storage-provisioner metrics-server dashboard]
I0801 02:33:56.384028 2667272 pod_ready.go:102] pod "metrics-server-78fcd8795b-r5j99" in "kube-system" namespace has status "Ready":"False"
I0801 02:33:55.764058 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:33:58.262359 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:33:58.884458 2667272 pod_ready.go:102] pod "metrics-server-78fcd8795b-r5j99" in "kube-system" namespace has status "Ready":"False"
I0801 02:34:00.884676 2667272 pod_ready.go:102] pod "metrics-server-78fcd8795b-r5j99" in "kube-system" namespace has status "Ready":"False"
I0801 02:34:02.886141 2667272 pod_ready.go:102] pod "metrics-server-78fcd8795b-r5j99" in "kube-system" namespace has status "Ready":"False"
I0801 02:34:00.284250 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:34:02.763391 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:34:05.383670 2667272 pod_ready.go:102] pod "metrics-server-78fcd8795b-r5j99" in "kube-system" namespace has status "Ready":"False"
I0801 02:34:07.383878 2667272 pod_ready.go:102] pod "metrics-server-78fcd8795b-r5j99" in "kube-system" namespace has status "Ready":"False"
I0801 02:34:05.262277 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:34:07.760622 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:34:09.383982 2667272 pod_ready.go:102] pod "metrics-server-78fcd8795b-r5j99" in "kube-system" namespace has status "Ready":"False"
I0801 02:34:11.384743 2667272 pod_ready.go:102] pod "metrics-server-78fcd8795b-r5j99" in "kube-system" namespace has status "Ready":"False"
I0801 02:34:09.761343 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:34:11.763660 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:34:13.884415 2667272 pod_ready.go:102] pod "metrics-server-78fcd8795b-r5j99" in "kube-system" namespace has status "Ready":"False"
I0801 02:34:16.384363 2667272 pod_ready.go:102] pod "metrics-server-78fcd8795b-r5j99" in "kube-system" namespace has status "Ready":"False"
I0801 02:34:14.262012 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:34:16.761384 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:34:18.384507 2667272 pod_ready.go:102] pod "metrics-server-78fcd8795b-r5j99" in "kube-system" namespace has status "Ready":"False"
I0801 02:34:20.884017 2667272 pod_ready.go:102] pod "metrics-server-78fcd8795b-r5j99" in "kube-system" namespace has status "Ready":"False"
I0801 02:34:18.799796 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:34:21.261627 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:34:23.261810 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:34:23.383391 2667272 pod_ready.go:102] pod "metrics-server-78fcd8795b-r5j99" in "kube-system" namespace has status "Ready":"False"
I0801 02:34:25.383765 2667272 pod_ready.go:102] pod "metrics-server-78fcd8795b-r5j99" in "kube-system" namespace has status "Ready":"False"
I0801 02:34:27.883930 2667272 pod_ready.go:102] pod "metrics-server-78fcd8795b-r5j99" in "kube-system" namespace has status "Ready":"False"
I0801 02:34:25.262884 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:34:27.761183 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:34:30.384390 2667272 pod_ready.go:102] pod "metrics-server-78fcd8795b-r5j99" in "kube-system" namespace has status "Ready":"False"
I0801 02:34:32.884378 2667272 pod_ready.go:102] pod "metrics-server-78fcd8795b-r5j99" in "kube-system" namespace has status "Ready":"False"
I0801 02:34:29.761460 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:34:31.761541 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:34:34.885274 2667272 pod_ready.go:102] pod "metrics-server-78fcd8795b-r5j99" in "kube-system" namespace has status "Ready":"False"
I0801 02:34:37.383489 2667272 pod_ready.go:102] pod "metrics-server-78fcd8795b-r5j99" in "kube-system" namespace has status "Ready":"False"
I0801 02:34:33.763214 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:34:36.263914 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:34:39.383874 2667272 pod_ready.go:102] pod "metrics-server-78fcd8795b-r5j99" in "kube-system" namespace has status "Ready":"False"
I0801 02:34:41.384485 2667272 pod_ready.go:102] pod "metrics-server-78fcd8795b-r5j99" in "kube-system" namespace has status "Ready":"False"
I0801 02:34:38.767494 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:34:41.262184 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:34:43.885332 2667272 pod_ready.go:102] pod "metrics-server-78fcd8795b-r5j99" in "kube-system" namespace has status "Ready":"False"
I0801 02:34:46.384504 2667272 pod_ready.go:102] pod "metrics-server-78fcd8795b-r5j99" in "kube-system" namespace has status "Ready":"False"
I0801 02:34:43.761784 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:34:45.762324 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:34:48.261709 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:34:48.384803 2667272 pod_ready.go:102] pod "metrics-server-78fcd8795b-r5j99" in "kube-system" namespace has status "Ready":"False"
I0801 02:34:50.884629 2667272 pod_ready.go:102] pod "metrics-server-78fcd8795b-r5j99" in "kube-system" namespace has status "Ready":"False"
I0801 02:34:50.262421 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:34:52.762138 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:34:53.385049 2667272 pod_ready.go:102] pod "metrics-server-78fcd8795b-r5j99" in "kube-system" namespace has status "Ready":"False"
I0801 02:34:55.883941 2667272 pod_ready.go:102] pod "metrics-server-78fcd8795b-r5j99" in "kube-system" namespace has status "Ready":"False"
I0801 02:34:57.885349 2667272 pod_ready.go:102] pod "metrics-server-78fcd8795b-r5j99" in "kube-system" namespace has status "Ready":"False"
I0801 02:34:54.762413 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:34:57.262773 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:35:00.416377 2667272 pod_ready.go:102] pod "metrics-server-78fcd8795b-r5j99" in "kube-system" namespace has status "Ready":"False"
I0801 02:35:02.884257 2667272 pod_ready.go:102] pod "metrics-server-78fcd8795b-r5j99" in "kube-system" namespace has status "Ready":"False"
I0801 02:34:59.762094 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:35:02.265940 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:35:04.885197 2667272 pod_ready.go:102] pod "metrics-server-78fcd8795b-r5j99" in "kube-system" namespace has status "Ready":"False"
I0801 02:35:07.384215 2667272 pod_ready.go:102] pod "metrics-server-78fcd8795b-r5j99" in "kube-system" namespace has status "Ready":"False"
I0801 02:35:04.761171 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:35:06.762340 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:35:09.883124 2667272 pod_ready.go:102] pod "metrics-server-78fcd8795b-r5j99" in "kube-system" namespace has status "Ready":"False"
I0801 02:35:11.884434 2667272 pod_ready.go:102] pod "metrics-server-78fcd8795b-r5j99" in "kube-system" namespace has status "Ready":"False"
I0801 02:35:09.262177 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:35:11.262737 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:35:13.886216 2667272 pod_ready.go:102] pod "metrics-server-78fcd8795b-r5j99" in "kube-system" namespace has status "Ready":"False"
I0801 02:35:16.384888 2667272 pod_ready.go:102] pod "metrics-server-78fcd8795b-r5j99" in "kube-system" namespace has status "Ready":"False"
I0801 02:35:13.762133 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:35:15.762808 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:35:18.262472 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:35:18.385781 2667272 pod_ready.go:102] pod "metrics-server-78fcd8795b-r5j99" in "kube-system" namespace has status "Ready":"False"
I0801 02:35:20.883265 2667272 pod_ready.go:102] pod "metrics-server-78fcd8795b-r5j99" in "kube-system" namespace has status "Ready":"False"
I0801 02:35:22.884644 2667272 pod_ready.go:102] pod "metrics-server-78fcd8795b-r5j99" in "kube-system" namespace has status "Ready":"False"
I0801 02:35:20.761026 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:35:22.761688 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:35:25.383889 2667272 pod_ready.go:102] pod "metrics-server-78fcd8795b-r5j99" in "kube-system" namespace has status "Ready":"False"
I0801 02:35:27.383967 2667272 pod_ready.go:102] pod "metrics-server-78fcd8795b-r5j99" in "kube-system" namespace has status "Ready":"False"
I0801 02:35:25.261921 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:35:27.761120 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:35:29.883613 2667272 pod_ready.go:102] pod "metrics-server-78fcd8795b-r5j99" in "kube-system" namespace has status "Ready":"False"
I0801 02:35:31.884813 2667272 pod_ready.go:102] pod "metrics-server-78fcd8795b-r5j99" in "kube-system" namespace has status "Ready":"False"
I0801 02:35:29.770221 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:35:32.262072 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:35:34.383526 2667272 pod_ready.go:102] pod "metrics-server-78fcd8795b-r5j99" in "kube-system" namespace has status "Ready":"False"
I0801 02:35:36.383954 2667272 pod_ready.go:102] pod "metrics-server-78fcd8795b-r5j99" in "kube-system" namespace has status "Ready":"False"
I0801 02:35:34.762392 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:35:36.762858 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:35:38.384537 2667272 pod_ready.go:102] pod "metrics-server-78fcd8795b-r5j99" in "kube-system" namespace has status "Ready":"False"
I0801 02:35:40.885071 2667272 pod_ready.go:102] pod "metrics-server-78fcd8795b-r5j99" in "kube-system" namespace has status "Ready":"False"
I0801 02:35:39.261798 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:35:41.761378 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:35:43.383879 2667272 pod_ready.go:102] pod "metrics-server-78fcd8795b-r5j99" in "kube-system" namespace has status "Ready":"False"
I0801 02:35:45.387991 2667272 pod_ready.go:102] pod "metrics-server-78fcd8795b-r5j99" in "kube-system" namespace has status "Ready":"False"
I0801 02:35:47.884115 2667272 pod_ready.go:102] pod "metrics-server-78fcd8795b-r5j99" in "kube-system" namespace has status "Ready":"False"
I0801 02:35:44.261842 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:35:46.761853 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:35:49.884511 2667272 pod_ready.go:102] pod "metrics-server-78fcd8795b-r5j99" in "kube-system" namespace has status "Ready":"False"
I0801 02:35:52.385384 2667272 pod_ready.go:102] pod "metrics-server-78fcd8795b-r5j99" in "kube-system" namespace has status "Ready":"False"
I0801 02:35:49.261352 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:35:51.262343 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:35:54.885087 2667272 pod_ready.go:102] pod "metrics-server-78fcd8795b-r5j99" in "kube-system" namespace has status "Ready":"False"
I0801 02:35:57.383397 2667272 pod_ready.go:102] pod "metrics-server-78fcd8795b-r5j99" in "kube-system" namespace has status "Ready":"False"
I0801 02:35:53.761495 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:35:56.261615 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:35:58.262064 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:35:59.884194 2667272 pod_ready.go:102] pod "metrics-server-78fcd8795b-r5j99" in "kube-system" namespace has status "Ready":"False"
I0801 02:36:02.384122 2667272 pod_ready.go:102] pod "metrics-server-78fcd8795b-r5j99" in "kube-system" namespace has status "Ready":"False"
I0801 02:36:00.274245 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:36:02.763548 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:36:04.883848 2667272 pod_ready.go:102] pod "metrics-server-78fcd8795b-r5j99" in "kube-system" namespace has status "Ready":"False"
I0801 02:36:07.384573 2667272 pod_ready.go:102] pod "metrics-server-78fcd8795b-r5j99" in "kube-system" namespace has status "Ready":"False"
I0801 02:36:05.261070 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:36:07.262383 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:36:09.884186 2667272 pod_ready.go:102] pod "metrics-server-78fcd8795b-r5j99" in "kube-system" namespace has status "Ready":"False"
I0801 02:36:11.884810 2667272 pod_ready.go:102] pod "metrics-server-78fcd8795b-r5j99" in "kube-system" namespace has status "Ready":"False"
I0801 02:36:09.761715 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:36:11.761776 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:36:13.885399 2667272 pod_ready.go:102] pod "metrics-server-78fcd8795b-r5j99" in "kube-system" namespace has status "Ready":"False"
I0801 02:36:16.383933 2667272 pod_ready.go:102] pod "metrics-server-78fcd8795b-r5j99" in "kube-system" namespace has status "Ready":"False"
I0801 02:36:14.261781 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:36:16.267651 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:36:18.384518 2667272 pod_ready.go:102] pod "metrics-server-78fcd8795b-r5j99" in "kube-system" namespace has status "Ready":"False"
I0801 02:36:20.884738 2667272 pod_ready.go:102] pod "metrics-server-78fcd8795b-r5j99" in "kube-system" namespace has status "Ready":"False"
I0801 02:36:18.760978 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:36:20.761957 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:36:22.762560 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:36:23.385214 2667272 pod_ready.go:102] pod "metrics-server-78fcd8795b-r5j99" in "kube-system" namespace has status "Ready":"False"
I0801 02:36:25.883821 2667272 pod_ready.go:102] pod "metrics-server-78fcd8795b-r5j99" in "kube-system" namespace has status "Ready":"False"
I0801 02:36:27.883873 2667272 pod_ready.go:102] pod "metrics-server-78fcd8795b-r5j99" in "kube-system" namespace has status "Ready":"False"
I0801 02:36:25.269984 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:36:27.761009 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:36:29.885851 2667272 pod_ready.go:102] pod "metrics-server-78fcd8795b-r5j99" in "kube-system" namespace has status "Ready":"False"
I0801 02:36:32.383790 2667272 pod_ready.go:102] pod "metrics-server-78fcd8795b-r5j99" in "kube-system" namespace has status "Ready":"False"
I0801 02:36:29.762073 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:36:32.267817 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:36:34.384211 2667272 pod_ready.go:102] pod "metrics-server-78fcd8795b-r5j99" in "kube-system" namespace has status "Ready":"False"
I0801 02:36:36.883347 2667272 pod_ready.go:102] pod "metrics-server-78fcd8795b-r5j99" in "kube-system" namespace has status "Ready":"False"
I0801 02:36:34.761608 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:36:37.262373 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:36:39.386526 2667272 pod_ready.go:102] pod "metrics-server-78fcd8795b-r5j99" in "kube-system" namespace has status "Ready":"False"
I0801 02:36:41.883533 2667272 pod_ready.go:102] pod "metrics-server-78fcd8795b-r5j99" in "kube-system" namespace has status "Ready":"False"
I0801 02:36:39.762421 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:36:42.276693 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:36:43.884554 2667272 pod_ready.go:102] pod "metrics-server-78fcd8795b-r5j99" in "kube-system" namespace has status "Ready":"False"
I0801 02:36:46.384493 2667272 pod_ready.go:102] pod "metrics-server-78fcd8795b-r5j99" in "kube-system" namespace has status "Ready":"False"
I0801 02:36:44.760871 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:36:47.262298 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:36:48.884214 2667272 pod_ready.go:102] pod "metrics-server-78fcd8795b-r5j99" in "kube-system" namespace has status "Ready":"False"
I0801 02:36:51.384121 2667272 pod_ready.go:102] pod "metrics-server-78fcd8795b-r5j99" in "kube-system" namespace has status "Ready":"False"
I0801 02:36:49.761359 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:36:52.266028 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:36:53.384464 2667272 pod_ready.go:102] pod "metrics-server-78fcd8795b-r5j99" in "kube-system" namespace has status "Ready":"False"
I0801 02:36:55.888391 2667272 pod_ready.go:102] pod "metrics-server-78fcd8795b-r5j99" in "kube-system" namespace has status "Ready":"False"
I0801 02:36:54.761586 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:36:56.762029 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:36:58.384438 2667272 pod_ready.go:102] pod "metrics-server-78fcd8795b-r5j99" in "kube-system" namespace has status "Ready":"False"
I0801 02:37:00.390518 2667272 pod_ready.go:102] pod "metrics-server-78fcd8795b-r5j99" in "kube-system" namespace has status "Ready":"False"
I0801 02:37:02.884566 2667272 pod_ready.go:102] pod "metrics-server-78fcd8795b-r5j99" in "kube-system" namespace has status "Ready":"False"
I0801 02:36:59.261898 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:37:01.262382 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:37:05.383689 2667272 pod_ready.go:102] pod "metrics-server-78fcd8795b-r5j99" in "kube-system" namespace has status "Ready":"False"
I0801 02:37:07.884375 2667272 pod_ready.go:102] pod "metrics-server-78fcd8795b-r5j99" in "kube-system" namespace has status "Ready":"False"
I0801 02:37:03.761523 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:37:06.262206 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:37:10.385951 2667272 pod_ready.go:102] pod "metrics-server-78fcd8795b-r5j99" in "kube-system" namespace has status "Ready":"False"
I0801 02:37:12.884729 2667272 pod_ready.go:102] pod "metrics-server-78fcd8795b-r5j99" in "kube-system" namespace has status "Ready":"False"
I0801 02:37:08.761966 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:37:11.262028 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:37:13.262508 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:37:15.384781 2667272 pod_ready.go:102] pod "metrics-server-78fcd8795b-r5j99" in "kube-system" namespace has status "Ready":"False"
I0801 02:37:17.884191 2667272 pod_ready.go:102] pod "metrics-server-78fcd8795b-r5j99" in "kube-system" namespace has status "Ready":"False"
I0801 02:37:15.767542 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:37:18.264890 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:37:19.884258 2667272 pod_ready.go:102] pod "metrics-server-78fcd8795b-r5j99" in "kube-system" namespace has status "Ready":"False"
I0801 02:37:21.884884 2667272 pod_ready.go:102] pod "metrics-server-78fcd8795b-r5j99" in "kube-system" namespace has status "Ready":"False"
I0801 02:37:20.761390 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:37:22.762074 2658647 pod_ready.go:102] pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace has status "Ready":"False"
I0801 02:37:23.885106 2667272 pod_ready.go:102] pod "metrics-server-78fcd8795b-r5j99" in "kube-system" namespace has status "Ready":"False"
I0801 02:37:25.885285 2667272 pod_ready.go:102] pod "metrics-server-78fcd8795b-r5j99" in "kube-system" namespace has status "Ready":"False"
I0801 02:37:24.761935 2658647 pod_ready.go:81] duration metric: took 4m0.006832001s for pod "metrics-server-9975d5f86-62ssn" in "kube-system" namespace to be "Ready" ...
E0801 02:37:24.761970 2658647 pod_ready.go:66] WaitExtra: waitPodCondition: context deadline exceeded
I0801 02:37:24.761980 2658647 pod_ready.go:38] duration metric: took 5m16.885019599s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0801 02:37:24.761995 2658647 api_server.go:52] waiting for apiserver process to appear ...
I0801 02:37:24.762025 2658647 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
I0801 02:37:24.762093 2658647 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0801 02:37:24.807860 2658647 cri.go:89] found id: "1fb60da2239ac26329521305cd88d88667a3ba0d0157d727459fdfd578a72bd7"
I0801 02:37:24.807924 2658647 cri.go:89] found id: "9b5691eb39b7ad79466bc75cbcca533f2e299c32e4d727899d1a4f710c8b9aa4"
I0801 02:37:24.807945 2658647 cri.go:89] found id: ""
I0801 02:37:24.807963 2658647 logs.go:276] 2 containers: [1fb60da2239ac26329521305cd88d88667a3ba0d0157d727459fdfd578a72bd7 9b5691eb39b7ad79466bc75cbcca533f2e299c32e4d727899d1a4f710c8b9aa4]
I0801 02:37:24.808021 2658647 ssh_runner.go:195] Run: which crictl
I0801 02:37:24.812231 2658647 ssh_runner.go:195] Run: which crictl
I0801 02:37:24.815842 2658647 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
I0801 02:37:24.815920 2658647 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0801 02:37:24.853503 2658647 cri.go:89] found id: "0972b1d679fffa594d9bfecfc9d623f3e1cce1c3738f04d58c0b015eaa306a44"
I0801 02:37:24.853527 2658647 cri.go:89] found id: "db510a3dcf37764b510d7708f7b66412c65c1d1d0b3ef16a69c853489dde3eb1"
I0801 02:37:24.853545 2658647 cri.go:89] found id: ""
I0801 02:37:24.853553 2658647 logs.go:276] 2 containers: [0972b1d679fffa594d9bfecfc9d623f3e1cce1c3738f04d58c0b015eaa306a44 db510a3dcf37764b510d7708f7b66412c65c1d1d0b3ef16a69c853489dde3eb1]
I0801 02:37:24.853619 2658647 ssh_runner.go:195] Run: which crictl
I0801 02:37:24.857262 2658647 ssh_runner.go:195] Run: which crictl
I0801 02:37:24.860970 2658647 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
I0801 02:37:24.861055 2658647 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0801 02:37:24.904620 2658647 cri.go:89] found id: "058926d1333224a21f0f91ec53151cef27b71a58daca5fb53de94619556de358"
I0801 02:37:24.904645 2658647 cri.go:89] found id: "e0b42bd7b7641ba543eee30d3bfbadad9b82d71c5d5067f3bd081d075e4d186e"
I0801 02:37:24.904651 2658647 cri.go:89] found id: ""
I0801 02:37:24.904659 2658647 logs.go:276] 2 containers: [058926d1333224a21f0f91ec53151cef27b71a58daca5fb53de94619556de358 e0b42bd7b7641ba543eee30d3bfbadad9b82d71c5d5067f3bd081d075e4d186e]
I0801 02:37:24.904719 2658647 ssh_runner.go:195] Run: which crictl
I0801 02:37:24.908613 2658647 ssh_runner.go:195] Run: which crictl
I0801 02:37:24.912222 2658647 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
I0801 02:37:24.912346 2658647 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0801 02:37:24.954867 2658647 cri.go:89] found id: "62728d8ccc17e7327a30d7c30bc56da7fe1e23e573da3a9d37b2e68bb43fe900"
I0801 02:37:24.954891 2658647 cri.go:89] found id: "ba767bcdadef58a525bbf831d77bde21750306f86c792e4ed2d997bf87a799d2"
I0801 02:37:24.954896 2658647 cri.go:89] found id: ""
I0801 02:37:24.954903 2658647 logs.go:276] 2 containers: [62728d8ccc17e7327a30d7c30bc56da7fe1e23e573da3a9d37b2e68bb43fe900 ba767bcdadef58a525bbf831d77bde21750306f86c792e4ed2d997bf87a799d2]
I0801 02:37:24.954972 2658647 ssh_runner.go:195] Run: which crictl
I0801 02:37:24.958718 2658647 ssh_runner.go:195] Run: which crictl
I0801 02:37:24.962475 2658647 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
I0801 02:37:24.962551 2658647 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0801 02:37:25.021257 2658647 cri.go:89] found id: "37f080fad4301d1b52430835d200cd6ca4e4b84de7c6ca7493ca3136cf933938"
I0801 02:37:25.021282 2658647 cri.go:89] found id: "f53a26dcf83dbc8267f8b697cd588a06c0d4b11ad6afc282b1d5724acea3c610"
I0801 02:37:25.021288 2658647 cri.go:89] found id: ""
I0801 02:37:25.021295 2658647 logs.go:276] 2 containers: [37f080fad4301d1b52430835d200cd6ca4e4b84de7c6ca7493ca3136cf933938 f53a26dcf83dbc8267f8b697cd588a06c0d4b11ad6afc282b1d5724acea3c610]
I0801 02:37:25.021384 2658647 ssh_runner.go:195] Run: which crictl
I0801 02:37:25.028885 2658647 ssh_runner.go:195] Run: which crictl
I0801 02:37:25.032863 2658647 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
I0801 02:37:25.032937 2658647 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0801 02:37:25.078153 2658647 cri.go:89] found id: "cce52c229eca0a21e0be84887b884b21bc9cbc0ecb3d4d791ad1df722ebf07ea"
I0801 02:37:25.078183 2658647 cri.go:89] found id: "c5d12068ab92d7e88ca40e2835f8a915adbc82678ee2afc1d9bab5da810e290c"
I0801 02:37:25.078189 2658647 cri.go:89] found id: ""
I0801 02:37:25.078196 2658647 logs.go:276] 2 containers: [cce52c229eca0a21e0be84887b884b21bc9cbc0ecb3d4d791ad1df722ebf07ea c5d12068ab92d7e88ca40e2835f8a915adbc82678ee2afc1d9bab5da810e290c]
I0801 02:37:25.078260 2658647 ssh_runner.go:195] Run: which crictl
I0801 02:37:25.082859 2658647 ssh_runner.go:195] Run: which crictl
I0801 02:37:25.096492 2658647 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
I0801 02:37:25.096586 2658647 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0801 02:37:25.142449 2658647 cri.go:89] found id: "6209c351b40e34d272dc1014164bbfb043a342cfc4405e1e46fd88f9092b329b"
I0801 02:37:25.142480 2658647 cri.go:89] found id: "8534f47cf8644ba2520c5e57a7047375f0f63a07ea2f76ee628f0a167ae23982"
I0801 02:37:25.142486 2658647 cri.go:89] found id: ""
I0801 02:37:25.142492 2658647 logs.go:276] 2 containers: [6209c351b40e34d272dc1014164bbfb043a342cfc4405e1e46fd88f9092b329b 8534f47cf8644ba2520c5e57a7047375f0f63a07ea2f76ee628f0a167ae23982]
I0801 02:37:25.142563 2658647 ssh_runner.go:195] Run: which crictl
I0801 02:37:25.146534 2658647 ssh_runner.go:195] Run: which crictl
I0801 02:37:25.150615 2658647 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
I0801 02:37:25.150733 2658647 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I0801 02:37:25.198557 2658647 cri.go:89] found id: "cd1c96196c6d07576a76836788287288790ee6df6007258403328244166438e7"
I0801 02:37:25.198579 2658647 cri.go:89] found id: ""
I0801 02:37:25.198588 2658647 logs.go:276] 1 containers: [cd1c96196c6d07576a76836788287288790ee6df6007258403328244166438e7]
I0801 02:37:25.198679 2658647 ssh_runner.go:195] Run: which crictl
I0801 02:37:25.202648 2658647 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
I0801 02:37:25.202727 2658647 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0801 02:37:25.242386 2658647 cri.go:89] found id: "dbaca8a1b362dbe57628482f5b8003c344440ec5a3b0df3adeff5cb5c839bc27"
I0801 02:37:25.242411 2658647 cri.go:89] found id: "d9250699e0826de2d05c6b860b9c4e9f464a045b8ba59ef5a9760a4ff035a432"
I0801 02:37:25.242415 2658647 cri.go:89] found id: ""
I0801 02:37:25.242422 2658647 logs.go:276] 2 containers: [dbaca8a1b362dbe57628482f5b8003c344440ec5a3b0df3adeff5cb5c839bc27 d9250699e0826de2d05c6b860b9c4e9f464a045b8ba59ef5a9760a4ff035a432]
I0801 02:37:25.242488 2658647 ssh_runner.go:195] Run: which crictl
I0801 02:37:25.246600 2658647 ssh_runner.go:195] Run: which crictl
I0801 02:37:25.250359 2658647 logs.go:123] Gathering logs for kube-apiserver [9b5691eb39b7ad79466bc75cbcca533f2e299c32e4d727899d1a4f710c8b9aa4] ...
I0801 02:37:25.250387 2658647 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 9b5691eb39b7ad79466bc75cbcca533f2e299c32e4d727899d1a4f710c8b9aa4"
I0801 02:37:25.311581 2658647 logs.go:123] Gathering logs for kube-scheduler [62728d8ccc17e7327a30d7c30bc56da7fe1e23e573da3a9d37b2e68bb43fe900] ...
I0801 02:37:25.311616 2658647 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 62728d8ccc17e7327a30d7c30bc56da7fe1e23e573da3a9d37b2e68bb43fe900"
I0801 02:37:25.351067 2658647 logs.go:123] Gathering logs for kube-scheduler [ba767bcdadef58a525bbf831d77bde21750306f86c792e4ed2d997bf87a799d2] ...
I0801 02:37:25.351098 2658647 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 ba767bcdadef58a525bbf831d77bde21750306f86c792e4ed2d997bf87a799d2"
I0801 02:37:25.421599 2658647 logs.go:123] Gathering logs for kube-controller-manager [cce52c229eca0a21e0be84887b884b21bc9cbc0ecb3d4d791ad1df722ebf07ea] ...
I0801 02:37:25.421627 2658647 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 cce52c229eca0a21e0be84887b884b21bc9cbc0ecb3d4d791ad1df722ebf07ea"
I0801 02:37:25.480875 2658647 logs.go:123] Gathering logs for kube-apiserver [1fb60da2239ac26329521305cd88d88667a3ba0d0157d727459fdfd578a72bd7] ...
I0801 02:37:25.480912 2658647 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 1fb60da2239ac26329521305cd88d88667a3ba0d0157d727459fdfd578a72bd7"
I0801 02:37:25.555675 2658647 logs.go:123] Gathering logs for kindnet [8534f47cf8644ba2520c5e57a7047375f0f63a07ea2f76ee628f0a167ae23982] ...
I0801 02:37:25.555716 2658647 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 8534f47cf8644ba2520c5e57a7047375f0f63a07ea2f76ee628f0a167ae23982"
I0801 02:37:25.623321 2658647 logs.go:123] Gathering logs for storage-provisioner [d9250699e0826de2d05c6b860b9c4e9f464a045b8ba59ef5a9760a4ff035a432] ...
I0801 02:37:25.623352 2658647 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 d9250699e0826de2d05c6b860b9c4e9f464a045b8ba59ef5a9760a4ff035a432"
I0801 02:37:25.665047 2658647 logs.go:123] Gathering logs for kubelet ...
I0801 02:37:25.665075 2658647 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0801 02:37:25.720109 2658647 logs.go:138] Found kubelet problem: Aug 01 02:32:07 old-k8s-version-668722 kubelet[663]: E0801 02:32:07.832716 663 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:old-k8s-version-668722" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-668722' and this object
W0801 02:37:25.720352 2658647 logs.go:138] Found kubelet problem: Aug 01 02:32:07 old-k8s-version-668722 kubelet[663]: E0801 02:32:07.832844 663 reflector.go:138] object-"default"/"default-token-tf4pj": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "default-token-tf4pj" is forbidden: User "system:node:old-k8s-version-668722" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'old-k8s-version-668722' and this object
W0801 02:37:25.720578 2658647 logs.go:138] Found kubelet problem: Aug 01 02:32:07 old-k8s-version-668722 kubelet[663]: E0801 02:32:07.832944 663 reflector.go:138] object-"kube-system"/"metrics-server-token-pxh6p": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "metrics-server-token-pxh6p" is forbidden: User "system:node:old-k8s-version-668722" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-668722' and this object
W0801 02:37:25.720792 2658647 logs.go:138] Found kubelet problem: Aug 01 02:32:07 old-k8s-version-668722 kubelet[663]: E0801 02:32:07.833004 663 reflector.go:138] object-"kube-system"/"kindnet-token-57f5t": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kindnet-token-57f5t" is forbidden: User "system:node:old-k8s-version-668722" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-668722' and this object
W0801 02:37:25.721027 2658647 logs.go:138] Found kubelet problem: Aug 01 02:32:07 old-k8s-version-668722 kubelet[663]: E0801 02:32:07.833054 663 reflector.go:138] object-"kube-system"/"coredns-token-rz9vn": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "coredns-token-rz9vn" is forbidden: User "system:node:old-k8s-version-668722" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-668722' and this object
W0801 02:37:25.721235 2658647 logs.go:138] Found kubelet problem: Aug 01 02:32:07 old-k8s-version-668722 kubelet[663]: E0801 02:32:07.833111 663 reflector.go:138] object-"kube-system"/"coredns": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:old-k8s-version-668722" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-668722' and this object
W0801 02:37:25.721454 2658647 logs.go:138] Found kubelet problem: Aug 01 02:32:07 old-k8s-version-668722 kubelet[663]: E0801 02:32:07.833179 663 reflector.go:138] object-"kube-system"/"kube-proxy-token-vjsm8": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kube-proxy-token-vjsm8" is forbidden: User "system:node:old-k8s-version-668722" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-668722' and this object
W0801 02:37:25.721685 2658647 logs.go:138] Found kubelet problem: Aug 01 02:32:07 old-k8s-version-668722 kubelet[663]: E0801 02:32:07.833236 663 reflector.go:138] object-"kube-system"/"storage-provisioner-token-h4fkg": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "storage-provisioner-token-h4fkg" is forbidden: User "system:node:old-k8s-version-668722" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-668722' and this object
W0801 02:37:25.731882 2658647 logs.go:138] Found kubelet problem: Aug 01 02:32:09 old-k8s-version-668722 kubelet[663]: E0801 02:32:09.753020 663 pod_workers.go:191] Error syncing pod 2264c40b-d62b-481e-bd07-e488b1557961 ("metrics-server-9975d5f86-62ssn_kube-system(2264c40b-d62b-481e-bd07-e488b1557961)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0801 02:37:25.732178 2658647 logs.go:138] Found kubelet problem: Aug 01 02:32:09 old-k8s-version-668722 kubelet[663]: E0801 02:32:09.997248 663 pod_workers.go:191] Error syncing pod 2264c40b-d62b-481e-bd07-e488b1557961 ("metrics-server-9975d5f86-62ssn_kube-system(2264c40b-d62b-481e-bd07-e488b1557961)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0801 02:37:25.736039 2658647 logs.go:138] Found kubelet problem: Aug 01 02:32:21 old-k8s-version-668722 kubelet[663]: E0801 02:32:21.611864 663 pod_workers.go:191] Error syncing pod 2264c40b-d62b-481e-bd07-e488b1557961 ("metrics-server-9975d5f86-62ssn_kube-system(2264c40b-d62b-481e-bd07-e488b1557961)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0801 02:37:25.737860 2658647 logs.go:138] Found kubelet problem: Aug 01 02:32:33 old-k8s-version-668722 kubelet[663]: E0801 02:32:33.601023 663 pod_workers.go:191] Error syncing pod 2264c40b-d62b-481e-bd07-e488b1557961 ("metrics-server-9975d5f86-62ssn_kube-system(2264c40b-d62b-481e-bd07-e488b1557961)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0801 02:37:25.738657 2658647 logs.go:138] Found kubelet problem: Aug 01 02:32:34 old-k8s-version-668722 kubelet[663]: E0801 02:32:34.183502 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
W0801 02:37:25.738985 2658647 logs.go:138] Found kubelet problem: Aug 01 02:32:35 old-k8s-version-668722 kubelet[663]: E0801 02:32:35.171839 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
W0801 02:37:25.739313 2658647 logs.go:138] Found kubelet problem: Aug 01 02:32:40 old-k8s-version-668722 kubelet[663]: E0801 02:32:40.106856 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
W0801 02:37:25.739752 2658647 logs.go:138] Found kubelet problem: Aug 01 02:32:41 old-k8s-version-668722 kubelet[663]: E0801 02:32:41.218597 663 pod_workers.go:191] Error syncing pod 4b798218-faff-4a2f-96ec-8970e3511d1e ("storage-provisioner_kube-system(4b798218-faff-4a2f-96ec-8970e3511d1e)"), skipping: failed to "StartContainer" for "storage-provisioner" with CrashLoopBackOff: "back-off 10s restarting failed container=storage-provisioner pod=storage-provisioner_kube-system(4b798218-faff-4a2f-96ec-8970e3511d1e)"
W0801 02:37:25.742541 2658647 logs.go:138] Found kubelet problem: Aug 01 02:32:47 old-k8s-version-668722 kubelet[663]: E0801 02:32:47.603687 663 pod_workers.go:191] Error syncing pod 2264c40b-d62b-481e-bd07-e488b1557961 ("metrics-server-9975d5f86-62ssn_kube-system(2264c40b-d62b-481e-bd07-e488b1557961)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0801 02:37:25.743262 2658647 logs.go:138] Found kubelet problem: Aug 01 02:32:55 old-k8s-version-668722 kubelet[663]: E0801 02:32:55.274254 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
W0801 02:37:25.743590 2658647 logs.go:138] Found kubelet problem: Aug 01 02:33:00 old-k8s-version-668722 kubelet[663]: E0801 02:33:00.106200 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
W0801 02:37:25.743775 2658647 logs.go:138] Found kubelet problem: Aug 01 02:33:01 old-k8s-version-668722 kubelet[663]: E0801 02:33:01.591630 663 pod_workers.go:191] Error syncing pod 2264c40b-d62b-481e-bd07-e488b1557961 ("metrics-server-9975d5f86-62ssn_kube-system(2264c40b-d62b-481e-bd07-e488b1557961)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0801 02:37:25.744090 2658647 logs.go:138] Found kubelet problem: Aug 01 02:33:15 old-k8s-version-668722 kubelet[663]: E0801 02:33:15.594149 663 pod_workers.go:191] Error syncing pod 2264c40b-d62b-481e-bd07-e488b1557961 ("metrics-server-9975d5f86-62ssn_kube-system(2264c40b-d62b-481e-bd07-e488b1557961)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0801 02:37:25.744423 2658647 logs.go:138] Found kubelet problem: Aug 01 02:33:16 old-k8s-version-668722 kubelet[663]: E0801 02:33:16.328911 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
W0801 02:37:25.744885 2658647 logs.go:138] Found kubelet problem: Aug 01 02:33:20 old-k8s-version-668722 kubelet[663]: E0801 02:33:20.105646 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
W0801 02:37:25.747499 2658647 logs.go:138] Found kubelet problem: Aug 01 02:33:30 old-k8s-version-668722 kubelet[663]: E0801 02:33:30.600004 663 pod_workers.go:191] Error syncing pod 2264c40b-d62b-481e-bd07-e488b1557961 ("metrics-server-9975d5f86-62ssn_kube-system(2264c40b-d62b-481e-bd07-e488b1557961)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0801 02:37:25.747839 2658647 logs.go:138] Found kubelet problem: Aug 01 02:33:31 old-k8s-version-668722 kubelet[663]: E0801 02:33:31.591186 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
W0801 02:37:25.748175 2658647 logs.go:138] Found kubelet problem: Aug 01 02:33:43 old-k8s-version-668722 kubelet[663]: E0801 02:33:43.591488 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
W0801 02:37:25.748384 2658647 logs.go:138] Found kubelet problem: Aug 01 02:33:45 old-k8s-version-668722 kubelet[663]: E0801 02:33:45.591636 663 pod_workers.go:191] Error syncing pod 2264c40b-d62b-481e-bd07-e488b1557961 ("metrics-server-9975d5f86-62ssn_kube-system(2264c40b-d62b-481e-bd07-e488b1557961)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0801 02:37:25.748724 2658647 logs.go:138] Found kubelet problem: Aug 01 02:33:54 old-k8s-version-668722 kubelet[663]: E0801 02:33:54.592353 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
W0801 02:37:25.748912 2658647 logs.go:138] Found kubelet problem: Aug 01 02:34:00 old-k8s-version-668722 kubelet[663]: E0801 02:34:00.591405 663 pod_workers.go:191] Error syncing pod 2264c40b-d62b-481e-bd07-e488b1557961 ("metrics-server-9975d5f86-62ssn_kube-system(2264c40b-d62b-481e-bd07-e488b1557961)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0801 02:37:25.749510 2658647 logs.go:138] Found kubelet problem: Aug 01 02:34:09 old-k8s-version-668722 kubelet[663]: E0801 02:34:09.494609 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
W0801 02:37:25.749839 2658647 logs.go:138] Found kubelet problem: Aug 01 02:34:10 old-k8s-version-668722 kubelet[663]: E0801 02:34:10.498469 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
W0801 02:37:25.750025 2658647 logs.go:138] Found kubelet problem: Aug 01 02:34:12 old-k8s-version-668722 kubelet[663]: E0801 02:34:12.591240 663 pod_workers.go:191] Error syncing pod 2264c40b-d62b-481e-bd07-e488b1557961 ("metrics-server-9975d5f86-62ssn_kube-system(2264c40b-d62b-481e-bd07-e488b1557961)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0801 02:37:25.750353 2658647 logs.go:138] Found kubelet problem: Aug 01 02:34:25 old-k8s-version-668722 kubelet[663]: E0801 02:34:25.590929 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
W0801 02:37:25.750541 2658647 logs.go:138] Found kubelet problem: Aug 01 02:34:26 old-k8s-version-668722 kubelet[663]: E0801 02:34:26.591461 663 pod_workers.go:191] Error syncing pod 2264c40b-d62b-481e-bd07-e488b1557961 ("metrics-server-9975d5f86-62ssn_kube-system(2264c40b-d62b-481e-bd07-e488b1557961)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0801 02:37:25.750871 2658647 logs.go:138] Found kubelet problem: Aug 01 02:34:38 old-k8s-version-668722 kubelet[663]: E0801 02:34:38.596624 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
W0801 02:37:25.751057 2658647 logs.go:138] Found kubelet problem: Aug 01 02:34:38 old-k8s-version-668722 kubelet[663]: E0801 02:34:38.598150 663 pod_workers.go:191] Error syncing pod 2264c40b-d62b-481e-bd07-e488b1557961 ("metrics-server-9975d5f86-62ssn_kube-system(2264c40b-d62b-481e-bd07-e488b1557961)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0801 02:37:25.753554 2658647 logs.go:138] Found kubelet problem: Aug 01 02:34:51 old-k8s-version-668722 kubelet[663]: E0801 02:34:51.601483 663 pod_workers.go:191] Error syncing pod 2264c40b-d62b-481e-bd07-e488b1557961 ("metrics-server-9975d5f86-62ssn_kube-system(2264c40b-d62b-481e-bd07-e488b1557961)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0801 02:37:25.753895 2658647 logs.go:138] Found kubelet problem: Aug 01 02:34:53 old-k8s-version-668722 kubelet[663]: E0801 02:34:53.596675 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
W0801 02:37:25.754226 2658647 logs.go:138] Found kubelet problem: Aug 01 02:35:06 old-k8s-version-668722 kubelet[663]: E0801 02:35:06.590933 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
W0801 02:37:25.754411 2658647 logs.go:138] Found kubelet problem: Aug 01 02:35:06 old-k8s-version-668722 kubelet[663]: E0801 02:35:06.592173 663 pod_workers.go:191] Error syncing pod 2264c40b-d62b-481e-bd07-e488b1557961 ("metrics-server-9975d5f86-62ssn_kube-system(2264c40b-d62b-481e-bd07-e488b1557961)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0801 02:37:25.754600 2658647 logs.go:138] Found kubelet problem: Aug 01 02:35:17 old-k8s-version-668722 kubelet[663]: E0801 02:35:17.591565 663 pod_workers.go:191] Error syncing pod 2264c40b-d62b-481e-bd07-e488b1557961 ("metrics-server-9975d5f86-62ssn_kube-system(2264c40b-d62b-481e-bd07-e488b1557961)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0801 02:37:25.754930 2658647 logs.go:138] Found kubelet problem: Aug 01 02:35:18 old-k8s-version-668722 kubelet[663]: E0801 02:35:18.590935 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
W0801 02:37:25.755519 2658647 logs.go:138] Found kubelet problem: Aug 01 02:35:30 old-k8s-version-668722 kubelet[663]: E0801 02:35:30.726631 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
W0801 02:37:25.755724 2658647 logs.go:138] Found kubelet problem: Aug 01 02:35:31 old-k8s-version-668722 kubelet[663]: E0801 02:35:31.592499 663 pod_workers.go:191] Error syncing pod 2264c40b-d62b-481e-bd07-e488b1557961 ("metrics-server-9975d5f86-62ssn_kube-system(2264c40b-d62b-481e-bd07-e488b1557961)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0801 02:37:25.756054 2658647 logs.go:138] Found kubelet problem: Aug 01 02:35:40 old-k8s-version-668722 kubelet[663]: E0801 02:35:40.105230 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
W0801 02:37:25.756237 2658647 logs.go:138] Found kubelet problem: Aug 01 02:35:46 old-k8s-version-668722 kubelet[663]: E0801 02:35:46.591237 663 pod_workers.go:191] Error syncing pod 2264c40b-d62b-481e-bd07-e488b1557961 ("metrics-server-9975d5f86-62ssn_kube-system(2264c40b-d62b-481e-bd07-e488b1557961)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0801 02:37:25.756573 2658647 logs.go:138] Found kubelet problem: Aug 01 02:35:52 old-k8s-version-668722 kubelet[663]: E0801 02:35:52.590978 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
W0801 02:37:25.756761 2658647 logs.go:138] Found kubelet problem: Aug 01 02:35:57 old-k8s-version-668722 kubelet[663]: E0801 02:35:57.591547 663 pod_workers.go:191] Error syncing pod 2264c40b-d62b-481e-bd07-e488b1557961 ("metrics-server-9975d5f86-62ssn_kube-system(2264c40b-d62b-481e-bd07-e488b1557961)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0801 02:37:25.757093 2658647 logs.go:138] Found kubelet problem: Aug 01 02:36:06 old-k8s-version-668722 kubelet[663]: E0801 02:36:06.590922 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
W0801 02:37:25.757280 2658647 logs.go:138] Found kubelet problem: Aug 01 02:36:10 old-k8s-version-668722 kubelet[663]: E0801 02:36:10.591342 663 pod_workers.go:191] Error syncing pod 2264c40b-d62b-481e-bd07-e488b1557961 ("metrics-server-9975d5f86-62ssn_kube-system(2264c40b-d62b-481e-bd07-e488b1557961)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0801 02:37:25.757606 2658647 logs.go:138] Found kubelet problem: Aug 01 02:36:19 old-k8s-version-668722 kubelet[663]: E0801 02:36:19.591496 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
W0801 02:37:25.757789 2658647 logs.go:138] Found kubelet problem: Aug 01 02:36:25 old-k8s-version-668722 kubelet[663]: E0801 02:36:25.594086 663 pod_workers.go:191] Error syncing pod 2264c40b-d62b-481e-bd07-e488b1557961 ("metrics-server-9975d5f86-62ssn_kube-system(2264c40b-d62b-481e-bd07-e488b1557961)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0801 02:37:25.758117 2658647 logs.go:138] Found kubelet problem: Aug 01 02:36:34 old-k8s-version-668722 kubelet[663]: E0801 02:36:34.591017 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
W0801 02:37:25.758302 2658647 logs.go:138] Found kubelet problem: Aug 01 02:36:37 old-k8s-version-668722 kubelet[663]: E0801 02:36:37.591337 663 pod_workers.go:191] Error syncing pod 2264c40b-d62b-481e-bd07-e488b1557961 ("metrics-server-9975d5f86-62ssn_kube-system(2264c40b-d62b-481e-bd07-e488b1557961)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0801 02:37:25.758629 2658647 logs.go:138] Found kubelet problem: Aug 01 02:36:45 old-k8s-version-668722 kubelet[663]: E0801 02:36:45.591178 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
W0801 02:37:25.758817 2658647 logs.go:138] Found kubelet problem: Aug 01 02:36:50 old-k8s-version-668722 kubelet[663]: E0801 02:36:50.591590 663 pod_workers.go:191] Error syncing pod 2264c40b-d62b-481e-bd07-e488b1557961 ("metrics-server-9975d5f86-62ssn_kube-system(2264c40b-d62b-481e-bd07-e488b1557961)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0801 02:37:25.759143 2658647 logs.go:138] Found kubelet problem: Aug 01 02:36:57 old-k8s-version-668722 kubelet[663]: E0801 02:36:57.590939 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
W0801 02:37:25.759327 2658647 logs.go:138] Found kubelet problem: Aug 01 02:37:04 old-k8s-version-668722 kubelet[663]: E0801 02:37:04.591285 663 pod_workers.go:191] Error syncing pod 2264c40b-d62b-481e-bd07-e488b1557961 ("metrics-server-9975d5f86-62ssn_kube-system(2264c40b-d62b-481e-bd07-e488b1557961)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0801 02:37:25.759653 2658647 logs.go:138] Found kubelet problem: Aug 01 02:37:10 old-k8s-version-668722 kubelet[663]: E0801 02:37:10.591892 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
W0801 02:37:25.759836 2658647 logs.go:138] Found kubelet problem: Aug 01 02:37:19 old-k8s-version-668722 kubelet[663]: E0801 02:37:19.591351 663 pod_workers.go:191] Error syncing pod 2264c40b-d62b-481e-bd07-e488b1557961 ("metrics-server-9975d5f86-62ssn_kube-system(2264c40b-d62b-481e-bd07-e488b1557961)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0801 02:37:25.760162 2658647 logs.go:138] Found kubelet problem: Aug 01 02:37:21 old-k8s-version-668722 kubelet[663]: E0801 02:37:21.596896 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
I0801 02:37:25.760173 2658647 logs.go:123] Gathering logs for etcd [0972b1d679fffa594d9bfecfc9d623f3e1cce1c3738f04d58c0b015eaa306a44] ...
I0801 02:37:25.760188 2658647 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 0972b1d679fffa594d9bfecfc9d623f3e1cce1c3738f04d58c0b015eaa306a44"
I0801 02:37:25.815698 2658647 logs.go:123] Gathering logs for coredns [058926d1333224a21f0f91ec53151cef27b71a58daca5fb53de94619556de358] ...
I0801 02:37:25.815731 2658647 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 058926d1333224a21f0f91ec53151cef27b71a58daca5fb53de94619556de358"
I0801 02:37:25.859531 2658647 logs.go:123] Gathering logs for kube-controller-manager [c5d12068ab92d7e88ca40e2835f8a915adbc82678ee2afc1d9bab5da810e290c] ...
I0801 02:37:25.859614 2658647 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 c5d12068ab92d7e88ca40e2835f8a915adbc82678ee2afc1d9bab5da810e290c"
I0801 02:37:25.915331 2658647 logs.go:123] Gathering logs for storage-provisioner [dbaca8a1b362dbe57628482f5b8003c344440ec5a3b0df3adeff5cb5c839bc27] ...
I0801 02:37:25.915369 2658647 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 dbaca8a1b362dbe57628482f5b8003c344440ec5a3b0df3adeff5cb5c839bc27"
I0801 02:37:25.955726 2658647 logs.go:123] Gathering logs for kubernetes-dashboard [cd1c96196c6d07576a76836788287288790ee6df6007258403328244166438e7] ...
I0801 02:37:25.955758 2658647 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 cd1c96196c6d07576a76836788287288790ee6df6007258403328244166438e7"
I0801 02:37:25.993600 2658647 logs.go:123] Gathering logs for dmesg ...
I0801 02:37:25.993628 2658647 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0801 02:37:26.019748 2658647 logs.go:123] Gathering logs for describe nodes ...
I0801 02:37:26.019910 2658647 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0801 02:37:26.229676 2658647 logs.go:123] Gathering logs for etcd [db510a3dcf37764b510d7708f7b66412c65c1d1d0b3ef16a69c853489dde3eb1] ...
I0801 02:37:26.229705 2658647 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 db510a3dcf37764b510d7708f7b66412c65c1d1d0b3ef16a69c853489dde3eb1"
I0801 02:37:26.293004 2658647 logs.go:123] Gathering logs for coredns [e0b42bd7b7641ba543eee30d3bfbadad9b82d71c5d5067f3bd081d075e4d186e] ...
I0801 02:37:26.293084 2658647 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e0b42bd7b7641ba543eee30d3bfbadad9b82d71c5d5067f3bd081d075e4d186e"
I0801 02:37:26.333617 2658647 logs.go:123] Gathering logs for kube-proxy [37f080fad4301d1b52430835d200cd6ca4e4b84de7c6ca7493ca3136cf933938] ...
I0801 02:37:26.333646 2658647 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 37f080fad4301d1b52430835d200cd6ca4e4b84de7c6ca7493ca3136cf933938"
I0801 02:37:26.378497 2658647 logs.go:123] Gathering logs for kube-proxy [f53a26dcf83dbc8267f8b697cd588a06c0d4b11ad6afc282b1d5724acea3c610] ...
I0801 02:37:26.378525 2658647 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 f53a26dcf83dbc8267f8b697cd588a06c0d4b11ad6afc282b1d5724acea3c610"
I0801 02:37:26.434621 2658647 logs.go:123] Gathering logs for kindnet [6209c351b40e34d272dc1014164bbfb043a342cfc4405e1e46fd88f9092b329b] ...
I0801 02:37:26.434649 2658647 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 6209c351b40e34d272dc1014164bbfb043a342cfc4405e1e46fd88f9092b329b"
I0801 02:37:26.495793 2658647 logs.go:123] Gathering logs for containerd ...
I0801 02:37:26.495831 2658647 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
I0801 02:37:26.571868 2658647 logs.go:123] Gathering logs for container status ...
I0801 02:37:26.571915 2658647 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0801 02:37:26.618093 2658647 out.go:304] Setting ErrFile to fd 2...
I0801 02:37:26.618120 2658647 out.go:338] TERM=,COLORTERM=, which probably does not support color
W0801 02:37:26.618224 2658647 out.go:239] X Problems detected in kubelet:
W0801 02:37:26.618238 2658647 out.go:239] Aug 01 02:36:57 old-k8s-version-668722 kubelet[663]: E0801 02:36:57.590939 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
W0801 02:37:26.618246 2658647 out.go:239] Aug 01 02:37:04 old-k8s-version-668722 kubelet[663]: E0801 02:37:04.591285 663 pod_workers.go:191] Error syncing pod 2264c40b-d62b-481e-bd07-e488b1557961 ("metrics-server-9975d5f86-62ssn_kube-system(2264c40b-d62b-481e-bd07-e488b1557961)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0801 02:37:26.618285 2658647 out.go:239] Aug 01 02:37:10 old-k8s-version-668722 kubelet[663]: E0801 02:37:10.591892 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
W0801 02:37:26.618292 2658647 out.go:239] Aug 01 02:37:19 old-k8s-version-668722 kubelet[663]: E0801 02:37:19.591351 663 pod_workers.go:191] Error syncing pod 2264c40b-d62b-481e-bd07-e488b1557961 ("metrics-server-9975d5f86-62ssn_kube-system(2264c40b-d62b-481e-bd07-e488b1557961)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0801 02:37:26.618298 2658647 out.go:239] Aug 01 02:37:21 old-k8s-version-668722 kubelet[663]: E0801 02:37:21.596896 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
I0801 02:37:26.618306 2658647 out.go:304] Setting ErrFile to fd 2...
I0801 02:37:26.618313 2658647 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0801 02:37:28.384895 2667272 pod_ready.go:102] pod "metrics-server-78fcd8795b-r5j99" in "kube-system" namespace has status "Ready":"False"
I0801 02:37:30.884565 2667272 pod_ready.go:102] pod "metrics-server-78fcd8795b-r5j99" in "kube-system" namespace has status "Ready":"False"
I0801 02:37:33.384613 2667272 pod_ready.go:102] pod "metrics-server-78fcd8795b-r5j99" in "kube-system" namespace has status "Ready":"False"
I0801 02:37:35.884898 2667272 pod_ready.go:102] pod "metrics-server-78fcd8795b-r5j99" in "kube-system" namespace has status "Ready":"False"
I0801 02:37:37.885238 2667272 pod_ready.go:102] pod "metrics-server-78fcd8795b-r5j99" in "kube-system" namespace has status "Ready":"False"
I0801 02:37:36.619314 2658647 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0801 02:37:36.631809 2658647 api_server.go:72] duration metric: took 5m50.996639068s to wait for apiserver process to appear ...
I0801 02:37:36.631849 2658647 api_server.go:88] waiting for apiserver healthz status ...
I0801 02:37:36.631891 2658647 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
I0801 02:37:36.631960 2658647 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0801 02:37:36.677831 2658647 cri.go:89] found id: "1fb60da2239ac26329521305cd88d88667a3ba0d0157d727459fdfd578a72bd7"
I0801 02:37:36.677856 2658647 cri.go:89] found id: "9b5691eb39b7ad79466bc75cbcca533f2e299c32e4d727899d1a4f710c8b9aa4"
I0801 02:37:36.677861 2658647 cri.go:89] found id: ""
I0801 02:37:36.677869 2658647 logs.go:276] 2 containers: [1fb60da2239ac26329521305cd88d88667a3ba0d0157d727459fdfd578a72bd7 9b5691eb39b7ad79466bc75cbcca533f2e299c32e4d727899d1a4f710c8b9aa4]
I0801 02:37:36.677931 2658647 ssh_runner.go:195] Run: which crictl
I0801 02:37:36.681714 2658647 ssh_runner.go:195] Run: which crictl
I0801 02:37:36.685060 2658647 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
I0801 02:37:36.685135 2658647 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0801 02:37:36.730628 2658647 cri.go:89] found id: "0972b1d679fffa594d9bfecfc9d623f3e1cce1c3738f04d58c0b015eaa306a44"
I0801 02:37:36.730647 2658647 cri.go:89] found id: "db510a3dcf37764b510d7708f7b66412c65c1d1d0b3ef16a69c853489dde3eb1"
I0801 02:37:36.730653 2658647 cri.go:89] found id: ""
I0801 02:37:36.730660 2658647 logs.go:276] 2 containers: [0972b1d679fffa594d9bfecfc9d623f3e1cce1c3738f04d58c0b015eaa306a44 db510a3dcf37764b510d7708f7b66412c65c1d1d0b3ef16a69c853489dde3eb1]
I0801 02:37:36.730719 2658647 ssh_runner.go:195] Run: which crictl
I0801 02:37:36.734529 2658647 ssh_runner.go:195] Run: which crictl
I0801 02:37:36.738225 2658647 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
I0801 02:37:36.738311 2658647 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0801 02:37:36.790744 2658647 cri.go:89] found id: "058926d1333224a21f0f91ec53151cef27b71a58daca5fb53de94619556de358"
I0801 02:37:36.790767 2658647 cri.go:89] found id: "e0b42bd7b7641ba543eee30d3bfbadad9b82d71c5d5067f3bd081d075e4d186e"
I0801 02:37:36.790772 2658647 cri.go:89] found id: ""
I0801 02:37:36.790780 2658647 logs.go:276] 2 containers: [058926d1333224a21f0f91ec53151cef27b71a58daca5fb53de94619556de358 e0b42bd7b7641ba543eee30d3bfbadad9b82d71c5d5067f3bd081d075e4d186e]
I0801 02:37:36.790838 2658647 ssh_runner.go:195] Run: which crictl
I0801 02:37:36.794633 2658647 ssh_runner.go:195] Run: which crictl
I0801 02:37:36.797862 2658647 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
I0801 02:37:36.797937 2658647 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0801 02:37:36.861717 2658647 cri.go:89] found id: "62728d8ccc17e7327a30d7c30bc56da7fe1e23e573da3a9d37b2e68bb43fe900"
I0801 02:37:36.861736 2658647 cri.go:89] found id: "ba767bcdadef58a525bbf831d77bde21750306f86c792e4ed2d997bf87a799d2"
I0801 02:37:36.861741 2658647 cri.go:89] found id: ""
I0801 02:37:36.861748 2658647 logs.go:276] 2 containers: [62728d8ccc17e7327a30d7c30bc56da7fe1e23e573da3a9d37b2e68bb43fe900 ba767bcdadef58a525bbf831d77bde21750306f86c792e4ed2d997bf87a799d2]
I0801 02:37:36.861808 2658647 ssh_runner.go:195] Run: which crictl
I0801 02:37:36.865296 2658647 ssh_runner.go:195] Run: which crictl
I0801 02:37:36.868853 2658647 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
I0801 02:37:36.868924 2658647 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0801 02:37:36.914143 2658647 cri.go:89] found id: "37f080fad4301d1b52430835d200cd6ca4e4b84de7c6ca7493ca3136cf933938"
I0801 02:37:36.914164 2658647 cri.go:89] found id: "f53a26dcf83dbc8267f8b697cd588a06c0d4b11ad6afc282b1d5724acea3c610"
I0801 02:37:36.914169 2658647 cri.go:89] found id: ""
I0801 02:37:36.914176 2658647 logs.go:276] 2 containers: [37f080fad4301d1b52430835d200cd6ca4e4b84de7c6ca7493ca3136cf933938 f53a26dcf83dbc8267f8b697cd588a06c0d4b11ad6afc282b1d5724acea3c610]
I0801 02:37:36.914234 2658647 ssh_runner.go:195] Run: which crictl
I0801 02:37:36.917797 2658647 ssh_runner.go:195] Run: which crictl
I0801 02:37:36.921351 2658647 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
I0801 02:37:36.921430 2658647 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0801 02:37:36.959321 2658647 cri.go:89] found id: "cce52c229eca0a21e0be84887b884b21bc9cbc0ecb3d4d791ad1df722ebf07ea"
I0801 02:37:36.959341 2658647 cri.go:89] found id: "c5d12068ab92d7e88ca40e2835f8a915adbc82678ee2afc1d9bab5da810e290c"
I0801 02:37:36.959346 2658647 cri.go:89] found id: ""
I0801 02:37:36.959354 2658647 logs.go:276] 2 containers: [cce52c229eca0a21e0be84887b884b21bc9cbc0ecb3d4d791ad1df722ebf07ea c5d12068ab92d7e88ca40e2835f8a915adbc82678ee2afc1d9bab5da810e290c]
I0801 02:37:36.959418 2658647 ssh_runner.go:195] Run: which crictl
I0801 02:37:36.963727 2658647 ssh_runner.go:195] Run: which crictl
I0801 02:37:36.967468 2658647 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
I0801 02:37:36.967569 2658647 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0801 02:37:37.012148 2658647 cri.go:89] found id: "6209c351b40e34d272dc1014164bbfb043a342cfc4405e1e46fd88f9092b329b"
I0801 02:37:37.012178 2658647 cri.go:89] found id: "8534f47cf8644ba2520c5e57a7047375f0f63a07ea2f76ee628f0a167ae23982"
I0801 02:37:37.012184 2658647 cri.go:89] found id: ""
I0801 02:37:37.012192 2658647 logs.go:276] 2 containers: [6209c351b40e34d272dc1014164bbfb043a342cfc4405e1e46fd88f9092b329b 8534f47cf8644ba2520c5e57a7047375f0f63a07ea2f76ee628f0a167ae23982]
I0801 02:37:37.012389 2658647 ssh_runner.go:195] Run: which crictl
I0801 02:37:37.017436 2658647 ssh_runner.go:195] Run: which crictl
I0801 02:37:37.023245 2658647 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
I0801 02:37:37.023386 2658647 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I0801 02:37:37.068137 2658647 cri.go:89] found id: "cd1c96196c6d07576a76836788287288790ee6df6007258403328244166438e7"
I0801 02:37:37.068161 2658647 cri.go:89] found id: ""
I0801 02:37:37.068170 2658647 logs.go:276] 1 containers: [cd1c96196c6d07576a76836788287288790ee6df6007258403328244166438e7]
I0801 02:37:37.068268 2658647 ssh_runner.go:195] Run: which crictl
I0801 02:37:37.072429 2658647 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
I0801 02:37:37.072544 2658647 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0801 02:37:37.116225 2658647 cri.go:89] found id: "dbaca8a1b362dbe57628482f5b8003c344440ec5a3b0df3adeff5cb5c839bc27"
I0801 02:37:37.116246 2658647 cri.go:89] found id: "d9250699e0826de2d05c6b860b9c4e9f464a045b8ba59ef5a9760a4ff035a432"
I0801 02:37:37.116252 2658647 cri.go:89] found id: ""
I0801 02:37:37.116258 2658647 logs.go:276] 2 containers: [dbaca8a1b362dbe57628482f5b8003c344440ec5a3b0df3adeff5cb5c839bc27 d9250699e0826de2d05c6b860b9c4e9f464a045b8ba59ef5a9760a4ff035a432]
I0801 02:37:37.116382 2658647 ssh_runner.go:195] Run: which crictl
I0801 02:37:37.120219 2658647 ssh_runner.go:195] Run: which crictl
I0801 02:37:37.123835 2658647 logs.go:123] Gathering logs for kubernetes-dashboard [cd1c96196c6d07576a76836788287288790ee6df6007258403328244166438e7] ...
I0801 02:37:37.123861 2658647 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 cd1c96196c6d07576a76836788287288790ee6df6007258403328244166438e7"
I0801 02:37:37.180568 2658647 logs.go:123] Gathering logs for storage-provisioner [dbaca8a1b362dbe57628482f5b8003c344440ec5a3b0df3adeff5cb5c839bc27] ...
I0801 02:37:37.180650 2658647 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 dbaca8a1b362dbe57628482f5b8003c344440ec5a3b0df3adeff5cb5c839bc27"
I0801 02:37:37.230430 2658647 logs.go:123] Gathering logs for kubelet ...
I0801 02:37:37.230460 2658647 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0801 02:37:37.284328 2658647 logs.go:138] Found kubelet problem: Aug 01 02:32:07 old-k8s-version-668722 kubelet[663]: E0801 02:32:07.832716 663 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:old-k8s-version-668722" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-668722' and this object
W0801 02:37:37.284590 2658647 logs.go:138] Found kubelet problem: Aug 01 02:32:07 old-k8s-version-668722 kubelet[663]: E0801 02:32:07.832844 663 reflector.go:138] object-"default"/"default-token-tf4pj": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "default-token-tf4pj" is forbidden: User "system:node:old-k8s-version-668722" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'old-k8s-version-668722' and this object
W0801 02:37:37.284821 2658647 logs.go:138] Found kubelet problem: Aug 01 02:32:07 old-k8s-version-668722 kubelet[663]: E0801 02:32:07.832944 663 reflector.go:138] object-"kube-system"/"metrics-server-token-pxh6p": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "metrics-server-token-pxh6p" is forbidden: User "system:node:old-k8s-version-668722" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-668722' and this object
W0801 02:37:37.285040 2658647 logs.go:138] Found kubelet problem: Aug 01 02:32:07 old-k8s-version-668722 kubelet[663]: E0801 02:32:07.833004 663 reflector.go:138] object-"kube-system"/"kindnet-token-57f5t": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kindnet-token-57f5t" is forbidden: User "system:node:old-k8s-version-668722" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-668722' and this object
W0801 02:37:37.285257 2658647 logs.go:138] Found kubelet problem: Aug 01 02:32:07 old-k8s-version-668722 kubelet[663]: E0801 02:32:07.833054 663 reflector.go:138] object-"kube-system"/"coredns-token-rz9vn": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "coredns-token-rz9vn" is forbidden: User "system:node:old-k8s-version-668722" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-668722' and this object
W0801 02:37:37.285481 2658647 logs.go:138] Found kubelet problem: Aug 01 02:32:07 old-k8s-version-668722 kubelet[663]: E0801 02:32:07.833111 663 reflector.go:138] object-"kube-system"/"coredns": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:old-k8s-version-668722" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-668722' and this object
W0801 02:37:37.285704 2658647 logs.go:138] Found kubelet problem: Aug 01 02:32:07 old-k8s-version-668722 kubelet[663]: E0801 02:32:07.833179 663 reflector.go:138] object-"kube-system"/"kube-proxy-token-vjsm8": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kube-proxy-token-vjsm8" is forbidden: User "system:node:old-k8s-version-668722" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-668722' and this object
W0801 02:37:37.285935 2658647 logs.go:138] Found kubelet problem: Aug 01 02:32:07 old-k8s-version-668722 kubelet[663]: E0801 02:32:07.833236 663 reflector.go:138] object-"kube-system"/"storage-provisioner-token-h4fkg": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "storage-provisioner-token-h4fkg" is forbidden: User "system:node:old-k8s-version-668722" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-668722' and this object
W0801 02:37:37.296118 2658647 logs.go:138] Found kubelet problem: Aug 01 02:32:09 old-k8s-version-668722 kubelet[663]: E0801 02:32:09.753020 663 pod_workers.go:191] Error syncing pod 2264c40b-d62b-481e-bd07-e488b1557961 ("metrics-server-9975d5f86-62ssn_kube-system(2264c40b-d62b-481e-bd07-e488b1557961)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0801 02:37:37.296421 2658647 logs.go:138] Found kubelet problem: Aug 01 02:32:09 old-k8s-version-668722 kubelet[663]: E0801 02:32:09.997248 663 pod_workers.go:191] Error syncing pod 2264c40b-d62b-481e-bd07-e488b1557961 ("metrics-server-9975d5f86-62ssn_kube-system(2264c40b-d62b-481e-bd07-e488b1557961)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0801 02:37:37.300197 2658647 logs.go:138] Found kubelet problem: Aug 01 02:32:21 old-k8s-version-668722 kubelet[663]: E0801 02:32:21.611864 663 pod_workers.go:191] Error syncing pod 2264c40b-d62b-481e-bd07-e488b1557961 ("metrics-server-9975d5f86-62ssn_kube-system(2264c40b-d62b-481e-bd07-e488b1557961)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0801 02:37:37.302113 2658647 logs.go:138] Found kubelet problem: Aug 01 02:32:33 old-k8s-version-668722 kubelet[663]: E0801 02:32:33.601023 663 pod_workers.go:191] Error syncing pod 2264c40b-d62b-481e-bd07-e488b1557961 ("metrics-server-9975d5f86-62ssn_kube-system(2264c40b-d62b-481e-bd07-e488b1557961)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0801 02:37:37.302915 2658647 logs.go:138] Found kubelet problem: Aug 01 02:32:34 old-k8s-version-668722 kubelet[663]: E0801 02:32:34.183502 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
W0801 02:37:37.303249 2658647 logs.go:138] Found kubelet problem: Aug 01 02:32:35 old-k8s-version-668722 kubelet[663]: E0801 02:32:35.171839 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
W0801 02:37:37.303579 2658647 logs.go:138] Found kubelet problem: Aug 01 02:32:40 old-k8s-version-668722 kubelet[663]: E0801 02:32:40.106856 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
W0801 02:37:37.304044 2658647 logs.go:138] Found kubelet problem: Aug 01 02:32:41 old-k8s-version-668722 kubelet[663]: E0801 02:32:41.218597 663 pod_workers.go:191] Error syncing pod 4b798218-faff-4a2f-96ec-8970e3511d1e ("storage-provisioner_kube-system(4b798218-faff-4a2f-96ec-8970e3511d1e)"), skipping: failed to "StartContainer" for "storage-provisioner" with CrashLoopBackOff: "back-off 10s restarting failed container=storage-provisioner pod=storage-provisioner_kube-system(4b798218-faff-4a2f-96ec-8970e3511d1e)"
W0801 02:37:37.306884 2658647 logs.go:138] Found kubelet problem: Aug 01 02:32:47 old-k8s-version-668722 kubelet[663]: E0801 02:32:47.603687 663 pod_workers.go:191] Error syncing pod 2264c40b-d62b-481e-bd07-e488b1557961 ("metrics-server-9975d5f86-62ssn_kube-system(2264c40b-d62b-481e-bd07-e488b1557961)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0801 02:37:37.307611 2658647 logs.go:138] Found kubelet problem: Aug 01 02:32:55 old-k8s-version-668722 kubelet[663]: E0801 02:32:55.274254 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
W0801 02:37:37.307941 2658647 logs.go:138] Found kubelet problem: Aug 01 02:33:00 old-k8s-version-668722 kubelet[663]: E0801 02:33:00.106200 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
W0801 02:37:37.308126 2658647 logs.go:138] Found kubelet problem: Aug 01 02:33:01 old-k8s-version-668722 kubelet[663]: E0801 02:33:01.591630 663 pod_workers.go:191] Error syncing pod 2264c40b-d62b-481e-bd07-e488b1557961 ("metrics-server-9975d5f86-62ssn_kube-system(2264c40b-d62b-481e-bd07-e488b1557961)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0801 02:37:37.308449 2658647 logs.go:138] Found kubelet problem: Aug 01 02:33:15 old-k8s-version-668722 kubelet[663]: E0801 02:33:15.594149 663 pod_workers.go:191] Error syncing pod 2264c40b-d62b-481e-bd07-e488b1557961 ("metrics-server-9975d5f86-62ssn_kube-system(2264c40b-d62b-481e-bd07-e488b1557961)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0801 02:37:37.308782 2658647 logs.go:138] Found kubelet problem: Aug 01 02:33:16 old-k8s-version-668722 kubelet[663]: E0801 02:33:16.328911 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
W0801 02:37:37.309247 2658647 logs.go:138] Found kubelet problem: Aug 01 02:33:20 old-k8s-version-668722 kubelet[663]: E0801 02:33:20.105646 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
W0801 02:37:37.311760 2658647 logs.go:138] Found kubelet problem: Aug 01 02:33:30 old-k8s-version-668722 kubelet[663]: E0801 02:33:30.600004 663 pod_workers.go:191] Error syncing pod 2264c40b-d62b-481e-bd07-e488b1557961 ("metrics-server-9975d5f86-62ssn_kube-system(2264c40b-d62b-481e-bd07-e488b1557961)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0801 02:37:37.312096 2658647 logs.go:138] Found kubelet problem: Aug 01 02:33:31 old-k8s-version-668722 kubelet[663]: E0801 02:33:31.591186 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
W0801 02:37:37.312441 2658647 logs.go:138] Found kubelet problem: Aug 01 02:33:43 old-k8s-version-668722 kubelet[663]: E0801 02:33:43.591488 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
W0801 02:37:37.312647 2658647 logs.go:138] Found kubelet problem: Aug 01 02:33:45 old-k8s-version-668722 kubelet[663]: E0801 02:33:45.591636 663 pod_workers.go:191] Error syncing pod 2264c40b-d62b-481e-bd07-e488b1557961 ("metrics-server-9975d5f86-62ssn_kube-system(2264c40b-d62b-481e-bd07-e488b1557961)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0801 02:37:37.313968 2658647 logs.go:138] Found kubelet problem: Aug 01 02:33:54 old-k8s-version-668722 kubelet[663]: E0801 02:33:54.592353 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
W0801 02:37:37.314160 2658647 logs.go:138] Found kubelet problem: Aug 01 02:34:00 old-k8s-version-668722 kubelet[663]: E0801 02:34:00.591405 663 pod_workers.go:191] Error syncing pod 2264c40b-d62b-481e-bd07-e488b1557961 ("metrics-server-9975d5f86-62ssn_kube-system(2264c40b-d62b-481e-bd07-e488b1557961)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0801 02:37:37.314756 2658647 logs.go:138] Found kubelet problem: Aug 01 02:34:09 old-k8s-version-668722 kubelet[663]: E0801 02:34:09.494609 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
W0801 02:37:37.315089 2658647 logs.go:138] Found kubelet problem: Aug 01 02:34:10 old-k8s-version-668722 kubelet[663]: E0801 02:34:10.498469 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
W0801 02:37:37.315277 2658647 logs.go:138] Found kubelet problem: Aug 01 02:34:12 old-k8s-version-668722 kubelet[663]: E0801 02:34:12.591240 663 pod_workers.go:191] Error syncing pod 2264c40b-d62b-481e-bd07-e488b1557961 ("metrics-server-9975d5f86-62ssn_kube-system(2264c40b-d62b-481e-bd07-e488b1557961)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0801 02:37:37.315606 2658647 logs.go:138] Found kubelet problem: Aug 01 02:34:25 old-k8s-version-668722 kubelet[663]: E0801 02:34:25.590929 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
W0801 02:37:37.315792 2658647 logs.go:138] Found kubelet problem: Aug 01 02:34:26 old-k8s-version-668722 kubelet[663]: E0801 02:34:26.591461 663 pod_workers.go:191] Error syncing pod 2264c40b-d62b-481e-bd07-e488b1557961 ("metrics-server-9975d5f86-62ssn_kube-system(2264c40b-d62b-481e-bd07-e488b1557961)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0801 02:37:37.316123 2658647 logs.go:138] Found kubelet problem: Aug 01 02:34:38 old-k8s-version-668722 kubelet[663]: E0801 02:34:38.596624 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
W0801 02:37:37.316316 2658647 logs.go:138] Found kubelet problem: Aug 01 02:34:38 old-k8s-version-668722 kubelet[663]: E0801 02:34:38.598150 663 pod_workers.go:191] Error syncing pod 2264c40b-d62b-481e-bd07-e488b1557961 ("metrics-server-9975d5f86-62ssn_kube-system(2264c40b-d62b-481e-bd07-e488b1557961)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0801 02:37:37.318774 2658647 logs.go:138] Found kubelet problem: Aug 01 02:34:51 old-k8s-version-668722 kubelet[663]: E0801 02:34:51.601483 663 pod_workers.go:191] Error syncing pod 2264c40b-d62b-481e-bd07-e488b1557961 ("metrics-server-9975d5f86-62ssn_kube-system(2264c40b-d62b-481e-bd07-e488b1557961)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
W0801 02:37:37.319105 2658647 logs.go:138] Found kubelet problem: Aug 01 02:34:53 old-k8s-version-668722 kubelet[663]: E0801 02:34:53.596675 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
W0801 02:37:37.319436 2658647 logs.go:138] Found kubelet problem: Aug 01 02:35:06 old-k8s-version-668722 kubelet[663]: E0801 02:35:06.590933 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
W0801 02:37:37.319620 2658647 logs.go:138] Found kubelet problem: Aug 01 02:35:06 old-k8s-version-668722 kubelet[663]: E0801 02:35:06.592173 663 pod_workers.go:191] Error syncing pod 2264c40b-d62b-481e-bd07-e488b1557961 ("metrics-server-9975d5f86-62ssn_kube-system(2264c40b-d62b-481e-bd07-e488b1557961)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0801 02:37:37.319803 2658647 logs.go:138] Found kubelet problem: Aug 01 02:35:17 old-k8s-version-668722 kubelet[663]: E0801 02:35:17.591565 663 pod_workers.go:191] Error syncing pod 2264c40b-d62b-481e-bd07-e488b1557961 ("metrics-server-9975d5f86-62ssn_kube-system(2264c40b-d62b-481e-bd07-e488b1557961)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0801 02:37:37.320132 2658647 logs.go:138] Found kubelet problem: Aug 01 02:35:18 old-k8s-version-668722 kubelet[663]: E0801 02:35:18.590935 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
W0801 02:37:37.320725 2658647 logs.go:138] Found kubelet problem: Aug 01 02:35:30 old-k8s-version-668722 kubelet[663]: E0801 02:35:30.726631 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
W0801 02:37:37.320909 2658647 logs.go:138] Found kubelet problem: Aug 01 02:35:31 old-k8s-version-668722 kubelet[663]: E0801 02:35:31.592499 663 pod_workers.go:191] Error syncing pod 2264c40b-d62b-481e-bd07-e488b1557961 ("metrics-server-9975d5f86-62ssn_kube-system(2264c40b-d62b-481e-bd07-e488b1557961)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0801 02:37:37.321243 2658647 logs.go:138] Found kubelet problem: Aug 01 02:35:40 old-k8s-version-668722 kubelet[663]: E0801 02:35:40.105230 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
W0801 02:37:37.321428 2658647 logs.go:138] Found kubelet problem: Aug 01 02:35:46 old-k8s-version-668722 kubelet[663]: E0801 02:35:46.591237 663 pod_workers.go:191] Error syncing pod 2264c40b-d62b-481e-bd07-e488b1557961 ("metrics-server-9975d5f86-62ssn_kube-system(2264c40b-d62b-481e-bd07-e488b1557961)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0801 02:37:37.321763 2658647 logs.go:138] Found kubelet problem: Aug 01 02:35:52 old-k8s-version-668722 kubelet[663]: E0801 02:35:52.590978 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
W0801 02:37:37.321951 2658647 logs.go:138] Found kubelet problem: Aug 01 02:35:57 old-k8s-version-668722 kubelet[663]: E0801 02:35:57.591547 663 pod_workers.go:191] Error syncing pod 2264c40b-d62b-481e-bd07-e488b1557961 ("metrics-server-9975d5f86-62ssn_kube-system(2264c40b-d62b-481e-bd07-e488b1557961)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0801 02:37:37.322281 2658647 logs.go:138] Found kubelet problem: Aug 01 02:36:06 old-k8s-version-668722 kubelet[663]: E0801 02:36:06.590922 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
W0801 02:37:37.322465 2658647 logs.go:138] Found kubelet problem: Aug 01 02:36:10 old-k8s-version-668722 kubelet[663]: E0801 02:36:10.591342 663 pod_workers.go:191] Error syncing pod 2264c40b-d62b-481e-bd07-e488b1557961 ("metrics-server-9975d5f86-62ssn_kube-system(2264c40b-d62b-481e-bd07-e488b1557961)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0801 02:37:37.322793 2658647 logs.go:138] Found kubelet problem: Aug 01 02:36:19 old-k8s-version-668722 kubelet[663]: E0801 02:36:19.591496 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
W0801 02:37:37.322977 2658647 logs.go:138] Found kubelet problem: Aug 01 02:36:25 old-k8s-version-668722 kubelet[663]: E0801 02:36:25.594086 663 pod_workers.go:191] Error syncing pod 2264c40b-d62b-481e-bd07-e488b1557961 ("metrics-server-9975d5f86-62ssn_kube-system(2264c40b-d62b-481e-bd07-e488b1557961)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0801 02:37:37.323304 2658647 logs.go:138] Found kubelet problem: Aug 01 02:36:34 old-k8s-version-668722 kubelet[663]: E0801 02:36:34.591017 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
W0801 02:37:37.323488 2658647 logs.go:138] Found kubelet problem: Aug 01 02:36:37 old-k8s-version-668722 kubelet[663]: E0801 02:36:37.591337 663 pod_workers.go:191] Error syncing pod 2264c40b-d62b-481e-bd07-e488b1557961 ("metrics-server-9975d5f86-62ssn_kube-system(2264c40b-d62b-481e-bd07-e488b1557961)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0801 02:37:37.323816 2658647 logs.go:138] Found kubelet problem: Aug 01 02:36:45 old-k8s-version-668722 kubelet[663]: E0801 02:36:45.591178 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
W0801 02:37:37.324004 2658647 logs.go:138] Found kubelet problem: Aug 01 02:36:50 old-k8s-version-668722 kubelet[663]: E0801 02:36:50.591590 663 pod_workers.go:191] Error syncing pod 2264c40b-d62b-481e-bd07-e488b1557961 ("metrics-server-9975d5f86-62ssn_kube-system(2264c40b-d62b-481e-bd07-e488b1557961)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0801 02:37:37.324339 2658647 logs.go:138] Found kubelet problem: Aug 01 02:36:57 old-k8s-version-668722 kubelet[663]: E0801 02:36:57.590939 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
W0801 02:37:37.324522 2658647 logs.go:138] Found kubelet problem: Aug 01 02:37:04 old-k8s-version-668722 kubelet[663]: E0801 02:37:04.591285 663 pod_workers.go:191] Error syncing pod 2264c40b-d62b-481e-bd07-e488b1557961 ("metrics-server-9975d5f86-62ssn_kube-system(2264c40b-d62b-481e-bd07-e488b1557961)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0801 02:37:37.324878 2658647 logs.go:138] Found kubelet problem: Aug 01 02:37:10 old-k8s-version-668722 kubelet[663]: E0801 02:37:10.591892 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
W0801 02:37:37.325065 2658647 logs.go:138] Found kubelet problem: Aug 01 02:37:19 old-k8s-version-668722 kubelet[663]: E0801 02:37:19.591351 663 pod_workers.go:191] Error syncing pod 2264c40b-d62b-481e-bd07-e488b1557961 ("metrics-server-9975d5f86-62ssn_kube-system(2264c40b-d62b-481e-bd07-e488b1557961)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0801 02:37:37.325397 2658647 logs.go:138] Found kubelet problem: Aug 01 02:37:21 old-k8s-version-668722 kubelet[663]: E0801 02:37:21.596896 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
W0801 02:37:37.325749 2658647 logs.go:138] Found kubelet problem: Aug 01 02:37:33 old-k8s-version-668722 kubelet[663]: E0801 02:37:33.595779 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
W0801 02:37:37.328201 2658647 logs.go:138] Found kubelet problem: Aug 01 02:37:33 old-k8s-version-668722 kubelet[663]: E0801 02:37:33.607076 663 pod_workers.go:191] Error syncing pod 2264c40b-d62b-481e-bd07-e488b1557961 ("metrics-server-9975d5f86-62ssn_kube-system(2264c40b-d62b-481e-bd07-e488b1557961)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
I0801 02:37:37.328213 2658647 logs.go:123] Gathering logs for etcd [0972b1d679fffa594d9bfecfc9d623f3e1cce1c3738f04d58c0b015eaa306a44] ...
I0801 02:37:37.328229 2658647 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 0972b1d679fffa594d9bfecfc9d623f3e1cce1c3738f04d58c0b015eaa306a44"
I0801 02:37:37.371289 2658647 logs.go:123] Gathering logs for kube-proxy [f53a26dcf83dbc8267f8b697cd588a06c0d4b11ad6afc282b1d5724acea3c610] ...
I0801 02:37:37.371319 2658647 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 f53a26dcf83dbc8267f8b697cd588a06c0d4b11ad6afc282b1d5724acea3c610"
I0801 02:37:37.426756 2658647 logs.go:123] Gathering logs for coredns [058926d1333224a21f0f91ec53151cef27b71a58daca5fb53de94619556de358] ...
I0801 02:37:37.426781 2658647 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 058926d1333224a21f0f91ec53151cef27b71a58daca5fb53de94619556de358"
I0801 02:37:37.472504 2658647 logs.go:123] Gathering logs for coredns [e0b42bd7b7641ba543eee30d3bfbadad9b82d71c5d5067f3bd081d075e4d186e] ...
I0801 02:37:37.472533 2658647 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e0b42bd7b7641ba543eee30d3bfbadad9b82d71c5d5067f3bd081d075e4d186e"
I0801 02:37:37.518373 2658647 logs.go:123] Gathering logs for kube-scheduler [62728d8ccc17e7327a30d7c30bc56da7fe1e23e573da3a9d37b2e68bb43fe900] ...
I0801 02:37:37.518406 2658647 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 62728d8ccc17e7327a30d7c30bc56da7fe1e23e573da3a9d37b2e68bb43fe900"
I0801 02:37:37.563018 2658647 logs.go:123] Gathering logs for kube-scheduler [ba767bcdadef58a525bbf831d77bde21750306f86c792e4ed2d997bf87a799d2] ...
I0801 02:37:37.563066 2658647 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 ba767bcdadef58a525bbf831d77bde21750306f86c792e4ed2d997bf87a799d2"
I0801 02:37:37.618603 2658647 logs.go:123] Gathering logs for storage-provisioner [d9250699e0826de2d05c6b860b9c4e9f464a045b8ba59ef5a9760a4ff035a432] ...
I0801 02:37:37.618642 2658647 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 d9250699e0826de2d05c6b860b9c4e9f464a045b8ba59ef5a9760a4ff035a432"
I0801 02:37:37.659882 2658647 logs.go:123] Gathering logs for dmesg ...
I0801 02:37:37.659919 2658647 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0801 02:37:37.679520 2658647 logs.go:123] Gathering logs for kube-apiserver [1fb60da2239ac26329521305cd88d88667a3ba0d0157d727459fdfd578a72bd7] ...
I0801 02:37:37.679552 2658647 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 1fb60da2239ac26329521305cd88d88667a3ba0d0157d727459fdfd578a72bd7"
I0801 02:37:37.760472 2658647 logs.go:123] Gathering logs for etcd [db510a3dcf37764b510d7708f7b66412c65c1d1d0b3ef16a69c853489dde3eb1] ...
I0801 02:37:37.760510 2658647 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 db510a3dcf37764b510d7708f7b66412c65c1d1d0b3ef16a69c853489dde3eb1"
I0801 02:37:37.815912 2658647 logs.go:123] Gathering logs for kindnet [6209c351b40e34d272dc1014164bbfb043a342cfc4405e1e46fd88f9092b329b] ...
I0801 02:37:37.815943 2658647 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 6209c351b40e34d272dc1014164bbfb043a342cfc4405e1e46fd88f9092b329b"
I0801 02:37:37.897447 2658647 logs.go:123] Gathering logs for kindnet [8534f47cf8644ba2520c5e57a7047375f0f63a07ea2f76ee628f0a167ae23982] ...
I0801 02:37:37.897527 2658647 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 8534f47cf8644ba2520c5e57a7047375f0f63a07ea2f76ee628f0a167ae23982"
I0801 02:37:37.964890 2658647 logs.go:123] Gathering logs for describe nodes ...
I0801 02:37:37.964923 2658647 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0801 02:37:38.120008 2658647 logs.go:123] Gathering logs for kube-apiserver [9b5691eb39b7ad79466bc75cbcca533f2e299c32e4d727899d1a4f710c8b9aa4] ...
I0801 02:37:38.120038 2658647 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 9b5691eb39b7ad79466bc75cbcca533f2e299c32e4d727899d1a4f710c8b9aa4"
I0801 02:37:38.174065 2658647 logs.go:123] Gathering logs for kube-controller-manager [cce52c229eca0a21e0be84887b884b21bc9cbc0ecb3d4d791ad1df722ebf07ea] ...
I0801 02:37:38.174100 2658647 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 cce52c229eca0a21e0be84887b884b21bc9cbc0ecb3d4d791ad1df722ebf07ea"
I0801 02:37:38.247816 2658647 logs.go:123] Gathering logs for container status ...
I0801 02:37:38.254975 2658647 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0801 02:37:38.307918 2658647 logs.go:123] Gathering logs for kube-proxy [37f080fad4301d1b52430835d200cd6ca4e4b84de7c6ca7493ca3136cf933938] ...
I0801 02:37:38.307949 2658647 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 37f080fad4301d1b52430835d200cd6ca4e4b84de7c6ca7493ca3136cf933938"
I0801 02:37:38.348112 2658647 logs.go:123] Gathering logs for kube-controller-manager [c5d12068ab92d7e88ca40e2835f8a915adbc82678ee2afc1d9bab5da810e290c] ...
I0801 02:37:38.348202 2658647 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 c5d12068ab92d7e88ca40e2835f8a915adbc82678ee2afc1d9bab5da810e290c"
I0801 02:37:40.384388 2667272 pod_ready.go:102] pod "metrics-server-78fcd8795b-r5j99" in "kube-system" namespace has status "Ready":"False"
I0801 02:37:42.884004 2667272 pod_ready.go:102] pod "metrics-server-78fcd8795b-r5j99" in "kube-system" namespace has status "Ready":"False"
I0801 02:37:38.429924 2658647 logs.go:123] Gathering logs for containerd ...
I0801 02:37:38.429961 2658647 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
I0801 02:37:38.515158 2658647 out.go:304] Setting ErrFile to fd 2...
I0801 02:37:38.515204 2658647 out.go:338] TERM=,COLORTERM=, which probably does not support color
W0801 02:37:38.515296 2658647 out.go:239] X Problems detected in kubelet:
W0801 02:37:38.515311 2658647 out.go:239] Aug 01 02:37:10 old-k8s-version-668722 kubelet[663]: E0801 02:37:10.591892 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
W0801 02:37:38.515321 2658647 out.go:239] Aug 01 02:37:19 old-k8s-version-668722 kubelet[663]: E0801 02:37:19.591351 663 pod_workers.go:191] Error syncing pod 2264c40b-d62b-481e-bd07-e488b1557961 ("metrics-server-9975d5f86-62ssn_kube-system(2264c40b-d62b-481e-bd07-e488b1557961)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0801 02:37:38.515333 2658647 out.go:239] Aug 01 02:37:21 old-k8s-version-668722 kubelet[663]: E0801 02:37:21.596896 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
W0801 02:37:38.515342 2658647 out.go:239] Aug 01 02:37:33 old-k8s-version-668722 kubelet[663]: E0801 02:37:33.595779 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
W0801 02:37:38.515362 2658647 out.go:239] Aug 01 02:37:33 old-k8s-version-668722 kubelet[663]: E0801 02:37:33.607076 663 pod_workers.go:191] Error syncing pod 2264c40b-d62b-481e-bd07-e488b1557961 ("metrics-server-9975d5f86-62ssn_kube-system(2264c40b-d62b-481e-bd07-e488b1557961)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
I0801 02:37:38.515373 2658647 out.go:304] Setting ErrFile to fd 2...
I0801 02:37:38.515379 2658647 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0801 02:37:44.884769 2667272 pod_ready.go:102] pod "metrics-server-78fcd8795b-r5j99" in "kube-system" namespace has status "Ready":"False"
I0801 02:37:47.383524 2667272 pod_ready.go:102] pod "metrics-server-78fcd8795b-r5j99" in "kube-system" namespace has status "Ready":"False"
I0801 02:37:48.516657 2658647 api_server.go:253] Checking apiserver healthz at https://192.168.85.2:8443/healthz ...
I0801 02:37:48.527781 2658647 api_server.go:279] https://192.168.85.2:8443/healthz returned 200:
ok
I0801 02:37:48.530131 2658647 out.go:177]
W0801 02:37:48.532482 2658647 out.go:239] X Exiting due to K8S_UNHEALTHY_CONTROL_PLANE: wait 6m0s for node: wait for healthy API server: controlPlane never updated to v1.20.0
W0801 02:37:48.532531 2658647 out.go:239] * Suggestion: Control Plane could not update, try minikube delete --all --purge
W0801 02:37:48.532550 2658647 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/11417
W0801 02:37:48.532560 2658647 out.go:239] *
W0801 02:37:48.533435 2658647 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0801 02:37:48.536556 2658647 out.go:177]
==> container status <==
CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID POD
5fa610d5bd903 523cad1a4df73 2 minutes ago Exited dashboard-metrics-scraper 5 906d4bcb42f48 dashboard-metrics-scraper-8d5bb5db8-2x8bf
dbaca8a1b362d ba04bb24b9575 4 minutes ago Running storage-provisioner 2 c0a9f1d40b401 storage-provisioner
cd1c96196c6d0 20b332c9a70d8 5 minutes ago Running kubernetes-dashboard 0 ac8eded2ddc34 kubernetes-dashboard-cd95d586-6ps6r
37f080fad4301 25a5233254979 5 minutes ago Running kube-proxy 1 fc64a5f981bfa kube-proxy-gzdqf
058926d133322 db91994f4ee8f 5 minutes ago Running coredns 1 76eb0f280ffc0 coredns-74ff55c5b-2dx9d
6209c351b40e3 f42786f8afd22 5 minutes ago Running kindnet-cni 1 127d173015a7f kindnet-ljqcf
d9250699e0826 ba04bb24b9575 5 minutes ago Exited storage-provisioner 1 c0a9f1d40b401 storage-provisioner
68f6033e39704 1611cd07b61d5 5 minutes ago Running busybox 1 75f384ded6516 busybox
0972b1d679fff 05b738aa1bc63 5 minutes ago Running etcd 1 66d6df6c57bad etcd-old-k8s-version-668722
62728d8ccc17e e7605f88f17d6 5 minutes ago Running kube-scheduler 1 bed2e5cdadd0c kube-scheduler-old-k8s-version-668722
1fb60da2239ac 2c08bbbc02d3a 5 minutes ago Running kube-apiserver 1 ff3f833291129 kube-apiserver-old-k8s-version-668722
cce52c229eca0 1df8a2b116bd1 5 minutes ago Running kube-controller-manager 1 78d48771ac050 kube-controller-manager-old-k8s-version-668722
8a880380aec09 1611cd07b61d5 6 minutes ago Exited busybox 0 94a05635ba2f8 busybox
e0b42bd7b7641 db91994f4ee8f 7 minutes ago Exited coredns 0 5c097d5503f0e coredns-74ff55c5b-2dx9d
8534f47cf8644 f42786f8afd22 7 minutes ago Exited kindnet-cni 0 b153d0066aff4 kindnet-ljqcf
f53a26dcf83db 25a5233254979 7 minutes ago Exited kube-proxy 0 7b9bc43b93aa1 kube-proxy-gzdqf
9b5691eb39b7a 2c08bbbc02d3a 8 minutes ago Exited kube-apiserver 0 cdbc591129bec kube-apiserver-old-k8s-version-668722
ba767bcdadef5 e7605f88f17d6 8 minutes ago Exited kube-scheduler 0 65c239609f3b0 kube-scheduler-old-k8s-version-668722
c5d12068ab92d 1df8a2b116bd1 8 minutes ago Exited kube-controller-manager 0 4c0b2a24d9be5 kube-controller-manager-old-k8s-version-668722
db510a3dcf377 05b738aa1bc63 8 minutes ago Exited etcd 0 a84857718c203 etcd-old-k8s-version-668722
==> containerd <==
Aug 01 02:34:08 old-k8s-version-668722 containerd[572]: time="2024-08-01T02:34:08.613700088Z" level=info msg="StartContainer for \"e7eb2dcc450d5f01991cf7f1801f4183e09e066274dae476c7f02fb9700329dc\""
Aug 01 02:34:08 old-k8s-version-668722 containerd[572]: time="2024-08-01T02:34:08.721103018Z" level=info msg="StartContainer for \"e7eb2dcc450d5f01991cf7f1801f4183e09e066274dae476c7f02fb9700329dc\" returns successfully"
Aug 01 02:34:08 old-k8s-version-668722 containerd[572]: time="2024-08-01T02:34:08.749507939Z" level=info msg="shim disconnected" id=e7eb2dcc450d5f01991cf7f1801f4183e09e066274dae476c7f02fb9700329dc namespace=k8s.io
Aug 01 02:34:08 old-k8s-version-668722 containerd[572]: time="2024-08-01T02:34:08.749570100Z" level=warning msg="cleaning up after shim disconnected" id=e7eb2dcc450d5f01991cf7f1801f4183e09e066274dae476c7f02fb9700329dc namespace=k8s.io
Aug 01 02:34:08 old-k8s-version-668722 containerd[572]: time="2024-08-01T02:34:08.749582251Z" level=info msg="cleaning up dead shim" namespace=k8s.io
Aug 01 02:34:09 old-k8s-version-668722 containerd[572]: time="2024-08-01T02:34:09.498118558Z" level=info msg="RemoveContainer for \"004fcd0a83f72212e5a0374edbbbbd8d98071fb26e96f1cf558838b82a168645\""
Aug 01 02:34:09 old-k8s-version-668722 containerd[572]: time="2024-08-01T02:34:09.512148710Z" level=info msg="RemoveContainer for \"004fcd0a83f72212e5a0374edbbbbd8d98071fb26e96f1cf558838b82a168645\" returns successfully"
Aug 01 02:34:51 old-k8s-version-668722 containerd[572]: time="2024-08-01T02:34:51.591971477Z" level=info msg="PullImage \"fake.domain/registry.k8s.io/echoserver:1.4\""
Aug 01 02:34:51 old-k8s-version-668722 containerd[572]: time="2024-08-01T02:34:51.598448040Z" level=info msg="trying next host" error="failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host" host=fake.domain
Aug 01 02:34:51 old-k8s-version-668722 containerd[572]: time="2024-08-01T02:34:51.600235384Z" level=error msg="PullImage \"fake.domain/registry.k8s.io/echoserver:1.4\" failed" error="failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
Aug 01 02:34:51 old-k8s-version-668722 containerd[572]: time="2024-08-01T02:34:51.600349146Z" level=info msg="stop pulling image fake.domain/registry.k8s.io/echoserver:1.4: active requests=0, bytes read=0"
Aug 01 02:35:29 old-k8s-version-668722 containerd[572]: time="2024-08-01T02:35:29.593278639Z" level=info msg="CreateContainer within sandbox \"906d4bcb42f48180cd5495e8a9e7229bddcc150128948be96ed94dbe5dadd1bc\" for container name:\"dashboard-metrics-scraper\" attempt:5"
Aug 01 02:35:29 old-k8s-version-668722 containerd[572]: time="2024-08-01T02:35:29.607890657Z" level=info msg="CreateContainer within sandbox \"906d4bcb42f48180cd5495e8a9e7229bddcc150128948be96ed94dbe5dadd1bc\" for name:\"dashboard-metrics-scraper\" attempt:5 returns container id \"5fa610d5bd9034152b4dbf9e6928f74aca10bd2f1d51257022c97a44b9ce0283\""
Aug 01 02:35:29 old-k8s-version-668722 containerd[572]: time="2024-08-01T02:35:29.608616238Z" level=info msg="StartContainer for \"5fa610d5bd9034152b4dbf9e6928f74aca10bd2f1d51257022c97a44b9ce0283\""
Aug 01 02:35:29 old-k8s-version-668722 containerd[572]: time="2024-08-01T02:35:29.677295642Z" level=info msg="StartContainer for \"5fa610d5bd9034152b4dbf9e6928f74aca10bd2f1d51257022c97a44b9ce0283\" returns successfully"
Aug 01 02:35:29 old-k8s-version-668722 containerd[572]: time="2024-08-01T02:35:29.699751973Z" level=info msg="shim disconnected" id=5fa610d5bd9034152b4dbf9e6928f74aca10bd2f1d51257022c97a44b9ce0283 namespace=k8s.io
Aug 01 02:35:29 old-k8s-version-668722 containerd[572]: time="2024-08-01T02:35:29.700027159Z" level=warning msg="cleaning up after shim disconnected" id=5fa610d5bd9034152b4dbf9e6928f74aca10bd2f1d51257022c97a44b9ce0283 namespace=k8s.io
Aug 01 02:35:29 old-k8s-version-668722 containerd[572]: time="2024-08-01T02:35:29.700108306Z" level=info msg="cleaning up dead shim" namespace=k8s.io
Aug 01 02:35:29 old-k8s-version-668722 containerd[572]: time="2024-08-01T02:35:29.761136174Z" level=warning msg="cleanup warnings time=\"2024-08-01T02:35:29Z\" level=warning msg=\"failed to remove runc container\" error=\"runc did not terminate successfully: exit status 255: \" runtime=io.containerd.runc.v2\n" namespace=k8s.io
Aug 01 02:35:30 old-k8s-version-668722 containerd[572]: time="2024-08-01T02:35:30.730722296Z" level=info msg="RemoveContainer for \"e7eb2dcc450d5f01991cf7f1801f4183e09e066274dae476c7f02fb9700329dc\""
Aug 01 02:35:30 old-k8s-version-668722 containerd[572]: time="2024-08-01T02:35:30.736841548Z" level=info msg="RemoveContainer for \"e7eb2dcc450d5f01991cf7f1801f4183e09e066274dae476c7f02fb9700329dc\" returns successfully"
Aug 01 02:37:33 old-k8s-version-668722 containerd[572]: time="2024-08-01T02:37:33.592813257Z" level=info msg="PullImage \"fake.domain/registry.k8s.io/echoserver:1.4\""
Aug 01 02:37:33 old-k8s-version-668722 containerd[572]: time="2024-08-01T02:37:33.600702520Z" level=info msg="trying next host" error="failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host" host=fake.domain
Aug 01 02:37:33 old-k8s-version-668722 containerd[572]: time="2024-08-01T02:37:33.602243632Z" level=error msg="PullImage \"fake.domain/registry.k8s.io/echoserver:1.4\" failed" error="failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
Aug 01 02:37:33 old-k8s-version-668722 containerd[572]: time="2024-08-01T02:37:33.602448945Z" level=info msg="stop pulling image fake.domain/registry.k8s.io/echoserver:1.4: active requests=0, bytes read=0"
==> coredns [058926d1333224a21f0f91ec53151cef27b71a58daca5fb53de94619556de358] <==
.:53
[INFO] plugin/reload: Running configuration MD5 = 093a0bf1423dd8c4eee62372bb216168
CoreDNS-1.7.0
linux/arm64, go1.14.4, f59c03d
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] 127.0.0.1:52707 - 1733 "HINFO IN 5492674303875405596.3076625074910493936. udp 57 false 512" NXDOMAIN qr,rd,ra 57 0.023165087s
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/ready: Still waiting on: "kubernetes"
I0801 02:32:41.048722 1 trace.go:116] Trace[2019727887]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125 (started: 2024-08-01 02:32:11.048087314 +0000 UTC m=+0.045621376) (total time: 30.000539621s):
Trace[2019727887]: [30.000539621s] [30.000539621s] END
E0801 02:32:41.048776 1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to list *v1.Namespace: Get "https://10.96.0.1:443/api/v1/namespaces?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
I0801 02:32:41.049398 1 trace.go:116] Trace[939984059]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125 (started: 2024-08-01 02:32:11.049137529 +0000 UTC m=+0.046671591) (total time: 30.00024467s):
Trace[939984059]: [30.00024467s] [30.00024467s] END
E0801 02:32:41.049418 1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to list *v1.Service: Get "https://10.96.0.1:443/api/v1/services?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
I0801 02:32:41.049747 1 trace.go:116] Trace[911902081]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125 (started: 2024-08-01 02:32:11.049516097 +0000 UTC m=+0.047050167) (total time: 30.000218308s):
Trace[911902081]: [30.000218308s] [30.000218308s] END
E0801 02:32:41.049790 1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to list *v1.Endpoints: Get "https://10.96.0.1:443/api/v1/endpoints?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
==> coredns [e0b42bd7b7641ba543eee30d3bfbadad9b82d71c5d5067f3bd081d075e4d186e] <==
.:53
[INFO] plugin/reload: Running configuration MD5 = 093a0bf1423dd8c4eee62372bb216168
CoreDNS-1.7.0
linux/arm64, go1.14.4, f59c03d
[INFO] 127.0.0.1:44726 - 52703 "HINFO IN 1947200008015829096.7592553107353171747. udp 57 false 512" NXDOMAIN qr,rd,ra 57 0.013234345s
==> describe nodes <==
Name: old-k8s-version-668722
Roles: control-plane,master
Labels: beta.kubernetes.io/arch=arm64
beta.kubernetes.io/os=linux
kubernetes.io/arch=arm64
kubernetes.io/hostname=old-k8s-version-668722
kubernetes.io/os=linux
minikube.k8s.io/commit=ad0431a8b539d85eadcca9b60d2c335055e9353c
minikube.k8s.io/name=old-k8s-version-668722
minikube.k8s.io/primary=true
minikube.k8s.io/updated_at=2024_08_01T02_29_48_0700
minikube.k8s.io/version=v1.33.1
node-role.kubernetes.io/control-plane=
node-role.kubernetes.io/master=
Annotations: kubeadm.alpha.kubernetes.io/cri-socket: /run/containerd/containerd.sock
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Thu, 01 Aug 2024 02:29:44 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: old-k8s-version-668722
AcquireTime: <unset>
RenewTime: Thu, 01 Aug 2024 02:37:40 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Thu, 01 Aug 2024 02:33:01 +0000 Thu, 01 Aug 2024 02:29:37 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Thu, 01 Aug 2024 02:33:01 +0000 Thu, 01 Aug 2024 02:29:37 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Thu, 01 Aug 2024 02:33:01 +0000 Thu, 01 Aug 2024 02:29:37 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Thu, 01 Aug 2024 02:33:01 +0000 Thu, 01 Aug 2024 02:30:03 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.85.2
Hostname: old-k8s-version-668722
Capacity:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022364Ki
pods: 110
Allocatable:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022364Ki
pods: 110
System Info:
Machine ID: 5addd1f9b3514cd19c32f12197b55920
System UUID: 1df0539d-4e75-49ab-998a-5469a447464f
Boot ID: 8ff7d84a-f9de-4b5b-b208-4cbb585d74db
Kernel Version: 5.15.0-1066-aws
OS Image: Ubuntu 22.04.4 LTS
Operating System: linux
Architecture: arm64
Container Runtime Version: containerd://1.7.19
Kubelet Version: v1.20.0
Kube-Proxy Version: v1.20.0
PodCIDR: 10.244.0.0/24
PodCIDRs: 10.244.0.0/24
Non-terminated Pods: (12 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits AGE
--------- ---- ------------ ---------- --------------- ------------- ---
default busybox 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 6m34s
kube-system coredns-74ff55c5b-2dx9d 100m (5%!)(MISSING) 0 (0%!)(MISSING) 70Mi (0%!)(MISSING) 170Mi (2%!)(MISSING) 7m47s
kube-system etcd-old-k8s-version-668722 100m (5%!)(MISSING) 0 (0%!)(MISSING) 100Mi (1%!)(MISSING) 0 (0%!)(MISSING) 7m54s
kube-system kindnet-ljqcf 100m (5%!)(MISSING) 100m (5%!)(MISSING) 50Mi (0%!)(MISSING) 50Mi (0%!)(MISSING) 7m47s
kube-system kube-apiserver-old-k8s-version-668722 250m (12%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 7m54s
kube-system kube-controller-manager-old-k8s-version-668722 200m (10%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 7m54s
kube-system kube-proxy-gzdqf 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 7m47s
kube-system kube-scheduler-old-k8s-version-668722 100m (5%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 7m54s
kube-system metrics-server-9975d5f86-62ssn 100m (5%!)(MISSING) 0 (0%!)(MISSING) 200Mi (2%!)(MISSING) 0 (0%!)(MISSING) 6m24s
kube-system storage-provisioner 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 7m45s
kubernetes-dashboard dashboard-metrics-scraper-8d5bb5db8-2x8bf 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 5m24s
kubernetes-dashboard kubernetes-dashboard-cd95d586-6ps6r 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 5m24s
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 950m (47%!)(MISSING) 100m (5%!)(MISSING)
memory 420Mi (5%!)(MISSING) 220Mi (2%!)(MISSING)
ephemeral-storage 100Mi (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-1Gi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-2Mi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-32Mi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-64Ki 0 (0%!)(MISSING) 0 (0%!)(MISSING)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal NodeHasSufficientMemory 8m15s (x5 over 8m15s) kubelet Node old-k8s-version-668722 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 8m15s (x5 over 8m15s) kubelet Node old-k8s-version-668722 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 8m15s (x4 over 8m15s) kubelet Node old-k8s-version-668722 status is now: NodeHasSufficientPID
Normal Starting 7m55s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 7m54s kubelet Node old-k8s-version-668722 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 7m54s kubelet Node old-k8s-version-668722 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 7m54s kubelet Node old-k8s-version-668722 status is now: NodeHasSufficientPID
Normal NodeAllocatableEnforced 7m54s kubelet Updated Node Allocatable limit across pods
Normal NodeReady 7m47s kubelet Node old-k8s-version-668722 status is now: NodeReady
Normal Starting 7m46s kube-proxy Starting kube-proxy.
Normal Starting 5m57s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 5m57s (x8 over 5m57s) kubelet Node old-k8s-version-668722 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 5m57s (x8 over 5m57s) kubelet Node old-k8s-version-668722 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 5m57s (x7 over 5m57s) kubelet Node old-k8s-version-668722 status is now: NodeHasSufficientPID
Normal NodeAllocatableEnforced 5m57s kubelet Updated Node Allocatable limit across pods
Normal Starting 5m38s kube-proxy Starting kube-proxy.
==> dmesg <==
[ +0.001020] FS-Cache: O-key=[8] '267bed0000000000'
[ +0.000653] FS-Cache: N-cookie c=0000008a [p=00000081 fl=2 nc=0 na=1]
[ +0.000861] FS-Cache: N-cookie d=0000000009801291{9p.inode} n=00000000d167e35a
[ +0.001003] FS-Cache: N-key=[8] '267bed0000000000'
[ +0.002773] FS-Cache: Duplicate cookie detected
[ +0.000651] FS-Cache: O-cookie c=00000084 [p=00000081 fl=226 nc=0 na=1]
[ +0.000923] FS-Cache: O-cookie d=0000000009801291{9p.inode} n=00000000bf833221
[ +0.000972] FS-Cache: O-key=[8] '267bed0000000000'
[ +0.000656] FS-Cache: N-cookie c=0000008b [p=00000081 fl=2 nc=0 na=1]
[ +0.000867] FS-Cache: N-cookie d=0000000009801291{9p.inode} n=00000000291b645a
[ +0.000964] FS-Cache: N-key=[8] '267bed0000000000'
[ +2.557032] FS-Cache: Duplicate cookie detected
[ +0.000702] FS-Cache: O-cookie c=00000082 [p=00000081 fl=226 nc=0 na=1]
[ +0.000902] FS-Cache: O-cookie d=0000000009801291{9p.inode} n=00000000e0152047
[ +0.000991] FS-Cache: O-key=[8] '257bed0000000000'
[ +0.000661] FS-Cache: N-cookie c=0000008d [p=00000081 fl=2 nc=0 na=1]
[ +0.000925] FS-Cache: N-cookie d=0000000009801291{9p.inode} n=00000000d167e35a
[ +0.001009] FS-Cache: N-key=[8] '257bed0000000000'
[ +0.324166] FS-Cache: Duplicate cookie detected
[ +0.000661] FS-Cache: O-cookie c=00000087 [p=00000081 fl=226 nc=0 na=1]
[ +0.000904] FS-Cache: O-cookie d=0000000009801291{9p.inode} n=000000008df1bf5b
[ +0.001006] FS-Cache: O-key=[8] '2b7bed0000000000'
[ +0.000865] FS-Cache: N-cookie c=0000008e [p=00000081 fl=2 nc=0 na=1]
[ +0.000891] FS-Cache: N-cookie d=0000000009801291{9p.inode} n=00000000364cea37
[ +0.000980] FS-Cache: N-key=[8] '2b7bed0000000000'
==> etcd [0972b1d679fffa594d9bfecfc9d623f3e1cce1c3738f04d58c0b015eaa306a44] <==
2024-08-01 02:33:44.975214 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-01 02:33:54.975184 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-01 02:34:04.975955 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-01 02:34:14.975139 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-01 02:34:24.975350 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-01 02:34:34.975147 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-01 02:34:44.975213 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-01 02:34:54.975117 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-01 02:35:04.975167 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-01 02:35:14.975050 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-01 02:35:24.975042 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-01 02:35:34.975051 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-01 02:35:44.975136 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-01 02:35:54.975337 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-01 02:36:04.975050 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-01 02:36:14.975001 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-01 02:36:24.975174 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-01 02:36:34.975123 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-01 02:36:44.975175 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-01 02:36:54.975312 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-01 02:37:04.975447 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-01 02:37:14.975121 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-01 02:37:24.975243 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-01 02:37:34.975538 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-01 02:37:44.975035 I | etcdserver/api/etcdhttp: /health OK (status code 200)
==> etcd [db510a3dcf37764b510d7708f7b66412c65c1d1d0b3ef16a69c853489dde3eb1] <==
raft2024/08/01 02:29:36 INFO: 9f0758e1c58a86ed switched to configuration voters=(11459225503572592365)
2024-08-01 02:29:36.392656 I | etcdserver/membership: added member 9f0758e1c58a86ed [https://192.168.85.2:2380] to cluster 68eaea490fab4e05
2024-08-01 02:29:36.392708 I | embed: listening for peers on 192.168.85.2:2380
raft2024/08/01 02:29:36 INFO: 9f0758e1c58a86ed is starting a new election at term 1
raft2024/08/01 02:29:36 INFO: 9f0758e1c58a86ed became candidate at term 2
raft2024/08/01 02:29:36 INFO: 9f0758e1c58a86ed received MsgVoteResp from 9f0758e1c58a86ed at term 2
raft2024/08/01 02:29:36 INFO: 9f0758e1c58a86ed became leader at term 2
raft2024/08/01 02:29:36 INFO: raft.node: 9f0758e1c58a86ed elected leader 9f0758e1c58a86ed at term 2
2024-08-01 02:29:36.683890 I | etcdserver: setting up the initial cluster version to 3.4
2024-08-01 02:29:36.684417 N | etcdserver/membership: set the initial cluster version to 3.4
2024-08-01 02:29:36.684630 I | etcdserver/api: enabled capabilities for version 3.4
2024-08-01 02:29:36.684812 I | etcdserver: published {Name:old-k8s-version-668722 ClientURLs:[https://192.168.85.2:2379]} to cluster 68eaea490fab4e05
2024-08-01 02:29:36.686830 I | embed: ready to serve client requests
2024-08-01 02:29:36.688491 I | embed: serving client requests on 192.168.85.2:2379
2024-08-01 02:29:36.726365 I | embed: ready to serve client requests
2024-08-01 02:29:36.744971 I | embed: serving client requests on 127.0.0.1:2379
2024-08-01 02:30:03.798139 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-01 02:30:08.136941 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-01 02:30:18.139054 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-01 02:30:28.137106 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-01 02:30:38.136828 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-01 02:30:48.136962 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-01 02:30:58.136889 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-01 02:31:08.136802 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-08-01 02:31:18.137013 I | etcdserver/api/etcdhttp: /health OK (status code 200)
==> kernel <==
02:37:50 up 10:20, 0 users, load average: 0.58, 1.82, 2.46
Linux old-k8s-version-668722 5.15.0-1066-aws #72~20.04.1-Ubuntu SMP Sat Jul 20 07:44:07 UTC 2024 aarch64 aarch64 aarch64 GNU/Linux
PRETTY_NAME="Ubuntu 22.04.4 LTS"
==> kindnet [6209c351b40e34d272dc1014164bbfb043a342cfc4405e1e46fd88f9092b329b] <==
I0801 02:36:40.909019 1 main.go:299] handling current node
W0801 02:36:44.942461 1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
E0801 02:36:44.942552 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: Failed to watch *v1.NetworkPolicy: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
I0801 02:36:50.909338 1 main.go:295] Handling node with IPs: map[192.168.85.2:{}]
I0801 02:36:50.909377 1 main.go:299] handling current node
W0801 02:36:52.271464 1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: failed to list *v1.Pod: pods is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "pods" in API group "" at the cluster scope
E0801 02:36:52.271503 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "pods" in API group "" at the cluster scope
I0801 02:37:00.908952 1 main.go:295] Handling node with IPs: map[192.168.85.2:{}]
I0801 02:37:00.908995 1 main.go:299] handling current node
W0801 02:37:07.652672 1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: failed to list *v1.Namespace: namespaces is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "namespaces" in API group "" at the cluster scope
E0801 02:37:07.652712 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "namespaces" in API group "" at the cluster scope
I0801 02:37:10.910022 1 main.go:295] Handling node with IPs: map[192.168.85.2:{}]
I0801 02:37:10.910062 1 main.go:299] handling current node
I0801 02:37:20.909828 1 main.go:295] Handling node with IPs: map[192.168.85.2:{}]
I0801 02:37:20.909869 1 main.go:299] handling current node
I0801 02:37:30.909338 1 main.go:295] Handling node with IPs: map[192.168.85.2:{}]
I0801 02:37:30.909377 1 main.go:299] handling current node
W0801 02:37:35.440407 1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
E0801 02:37:35.440447 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: Failed to watch *v1.NetworkPolicy: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
W0801 02:37:38.586521 1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: failed to list *v1.Namespace: namespaces is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "namespaces" in API group "" at the cluster scope
E0801 02:37:38.586559 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "namespaces" in API group "" at the cluster scope
W0801 02:37:39.571500 1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: failed to list *v1.Pod: pods is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "pods" in API group "" at the cluster scope
E0801 02:37:39.571554 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "pods" in API group "" at the cluster scope
I0801 02:37:40.909139 1 main.go:295] Handling node with IPs: map[192.168.85.2:{}]
I0801 02:37:40.909178 1 main.go:299] handling current node
==> kindnet [8534f47cf8644ba2520c5e57a7047375f0f63a07ea2f76ee628f0a167ae23982] <==
I0801 02:30:27.210351 1 main.go:299] handling current node
W0801 02:30:27.502734 1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: failed to list *v1.Namespace: namespaces is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "namespaces" in API group "" at the cluster scope
E0801 02:30:27.502775 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "namespaces" in API group "" at the cluster scope
I0801 02:30:37.210394 1 main.go:295] Handling node with IPs: map[192.168.85.2:{}]
I0801 02:30:37.210439 1 main.go:299] handling current node
W0801 02:30:43.614318 1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
E0801 02:30:43.614376 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: Failed to watch *v1.NetworkPolicy: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
W0801 02:30:46.551805 1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: failed to list *v1.Pod: pods is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "pods" in API group "" at the cluster scope
E0801 02:30:46.551857 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "pods" in API group "" at the cluster scope
I0801 02:30:47.210192 1 main.go:295] Handling node with IPs: map[192.168.85.2:{}]
I0801 02:30:47.210227 1 main.go:299] handling current node
W0801 02:30:50.560056 1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: failed to list *v1.Namespace: namespaces is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "namespaces" in API group "" at the cluster scope
E0801 02:30:50.560099 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "namespaces" in API group "" at the cluster scope
I0801 02:30:57.209802 1 main.go:295] Handling node with IPs: map[192.168.85.2:{}]
I0801 02:30:57.209836 1 main.go:299] handling current node
I0801 02:31:07.209679 1 main.go:295] Handling node with IPs: map[192.168.85.2:{}]
I0801 02:31:07.209714 1 main.go:299] handling current node
I0801 02:31:17.210083 1 main.go:295] Handling node with IPs: map[192.168.85.2:{}]
I0801 02:31:17.210120 1 main.go:299] handling current node
W0801 02:31:18.130669 1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: failed to list *v1.Pod: pods is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "pods" in API group "" at the cluster scope
E0801 02:31:18.130707 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "pods" in API group "" at the cluster scope
W0801 02:31:21.604043 1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
E0801 02:31:21.604116 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: Failed to watch *v1.NetworkPolicy: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
W0801 02:31:23.737592 1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: failed to list *v1.Namespace: namespaces is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "namespaces" in API group "" at the cluster scope
E0801 02:31:23.737629 1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "namespaces" in API group "" at the cluster scope
==> kube-apiserver [1fb60da2239ac26329521305cd88d88667a3ba0d0157d727459fdfd578a72bd7] <==
I0801 02:34:33.018289 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0801 02:34:33.018309 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0801 02:35:07.638567 1 client.go:360] parsed scheme: "passthrough"
I0801 02:35:07.638636 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0801 02:35:07.638792 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
W0801 02:35:10.452433 1 handler_proxy.go:102] no RequestInfo found in the context
E0801 02:35:10.452636 1 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I0801 02:35:10.452654 1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
I0801 02:35:46.449122 1 client.go:360] parsed scheme: "passthrough"
I0801 02:35:46.449169 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0801 02:35:46.449180 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0801 02:36:30.787439 1 client.go:360] parsed scheme: "passthrough"
I0801 02:36:30.787483 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0801 02:36:30.787492 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
W0801 02:37:08.868866 1 handler_proxy.go:102] no RequestInfo found in the context
E0801 02:37:08.868943 1 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I0801 02:37:08.869083 1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
I0801 02:37:11.176089 1 client.go:360] parsed scheme: "passthrough"
I0801 02:37:11.176219 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0801 02:37:11.176254 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0801 02:37:42.724521 1 client.go:360] parsed scheme: "passthrough"
I0801 02:37:42.724566 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0801 02:37:42.724575 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
==> kube-apiserver [9b5691eb39b7ad79466bc75cbcca533f2e299c32e4d727899d1a4f710c8b9aa4] <==
I0801 02:29:44.437754 1 apf_controller.go:253] Running API Priority and Fairness config worker
I0801 02:29:44.438694 1 shared_informer.go:247] Caches are synced for cluster_authentication_trust_controller
I0801 02:29:44.471812 1 controller.go:606] quota admission added evaluator for: namespaces
I0801 02:29:45.115664 1 controller.go:132] OpenAPI AggregationController: action for item : Nothing (removed from the queue).
I0801 02:29:45.115708 1 controller.go:132] OpenAPI AggregationController: action for item k8s_internal_local_delegation_chain_0000000000: Nothing (removed from the queue).
I0801 02:29:45.149116 1 storage_scheduling.go:132] created PriorityClass system-node-critical with value 2000001000
I0801 02:29:45.177107 1 storage_scheduling.go:132] created PriorityClass system-cluster-critical with value 2000000000
I0801 02:29:45.177254 1 storage_scheduling.go:148] all system priority classes are created successfully or already exist.
I0801 02:29:45.834188 1 controller.go:606] quota admission added evaluator for: roles.rbac.authorization.k8s.io
I0801 02:29:45.883905 1 controller.go:606] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io
W0801 02:29:46.018041 1 lease.go:233] Resetting endpoints for master service "kubernetes" to [192.168.85.2]
I0801 02:29:46.019366 1 controller.go:606] quota admission added evaluator for: endpoints
I0801 02:29:46.024605 1 controller.go:606] quota admission added evaluator for: endpointslices.discovery.k8s.io
I0801 02:29:46.068971 1 controller.go:606] quota admission added evaluator for: leases.coordination.k8s.io
I0801 02:29:46.751418 1 controller.go:606] quota admission added evaluator for: serviceaccounts
I0801 02:29:47.538926 1 controller.go:606] quota admission added evaluator for: deployments.apps
I0801 02:29:47.640087 1 controller.go:606] quota admission added evaluator for: daemonsets.apps
I0801 02:30:03.205045 1 controller.go:606] quota admission added evaluator for: replicasets.apps
I0801 02:30:03.277877 1 controller.go:606] quota admission added evaluator for: controllerrevisions.apps
I0801 02:30:21.153284 1 client.go:360] parsed scheme: "passthrough"
I0801 02:30:21.153328 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0801 02:30:21.153336 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0801 02:31:04.592930 1 client.go:360] parsed scheme: "passthrough"
I0801 02:31:04.592975 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0801 02:31:04.592984 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
==> kube-controller-manager [c5d12068ab92d7e88ca40e2835f8a915adbc82678ee2afc1d9bab5da810e290c] <==
I0801 02:30:03.299620 1 shared_informer.go:247] Caches are synced for stateful set
I0801 02:30:03.303994 1 shared_informer.go:247] Caches are synced for taint
I0801 02:30:03.304236 1 node_lifecycle_controller.go:1429] Initializing eviction metric for zone:
W0801 02:30:03.304813 1 node_lifecycle_controller.go:1044] Missing timestamp for Node old-k8s-version-668722. Assuming now as a timestamp.
I0801 02:30:03.304983 1 node_lifecycle_controller.go:1195] Controller detected that all Nodes are not-Ready. Entering master disruption mode.
I0801 02:30:03.304839 1 event.go:291] "Event occurred" object="old-k8s-version-668722" kind="Node" apiVersion="v1" type="Normal" reason="RegisteredNode" message="Node old-k8s-version-668722 event: Registered Node old-k8s-version-668722 in Controller"
I0801 02:30:03.304719 1 taint_manager.go:187] Starting NoExecuteTaintManager
I0801 02:30:03.304662 1 event.go:291] "Event occurred" object="kube-system/coredns-74ff55c5b" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-74ff55c5b-2dx9d"
I0801 02:30:03.319084 1 shared_informer.go:247] Caches are synced for GC
I0801 02:30:03.328670 1 range_allocator.go:373] Set node old-k8s-version-668722 PodCIDR to [10.244.0.0/24]
I0801 02:30:03.345780 1 event.go:291] "Event occurred" object="kube-system/kube-proxy" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kube-proxy-gzdqf"
I0801 02:30:03.348765 1 shared_informer.go:247] Caches are synced for expand
I0801 02:30:03.349349 1 shared_informer.go:247] Caches are synced for persistent volume
I0801 02:30:03.349554 1 shared_informer.go:247] Caches are synced for PVC protection
I0801 02:30:03.350773 1 shared_informer.go:247] Caches are synced for resource quota
I0801 02:30:03.354009 1 event.go:291] "Event occurred" object="kube-system/kindnet" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kindnet-ljqcf"
I0801 02:30:03.377353 1 shared_informer.go:247] Caches are synced for resource quota
I0801 02:30:03.861492 1 shared_informer.go:240] Waiting for caches to sync for garbage collector
I0801 02:30:03.937349 1 shared_informer.go:247] Caches are synced for garbage collector
I0801 02:30:03.937371 1 garbagecollector.go:151] Garbage collector: all resource monitors have synced. Proceeding to collect garbage
I0801 02:30:03.961689 1 shared_informer.go:247] Caches are synced for garbage collector
I0801 02:30:05.137734 1 event.go:291] "Event occurred" object="kube-system/coredns" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled down replica set coredns-74ff55c5b to 1"
I0801 02:30:05.185060 1 event.go:291] "Event occurred" object="kube-system/coredns-74ff55c5b" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulDelete" message="Deleted pod: coredns-74ff55c5b-d9mpw"
I0801 02:30:08.305337 1 node_lifecycle_controller.go:1222] Controller detected that some Nodes are Ready. Exiting master disruption mode.
I0801 02:31:25.593212 1 event.go:291] "Event occurred" object="kube-system/metrics-server" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set metrics-server-9975d5f86 to 1"
==> kube-controller-manager [cce52c229eca0a21e0be84887b884b21bc9cbc0ecb3d4d791ad1df722ebf07ea] <==
E0801 02:33:29.045990 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0801 02:33:31.004937 1 request.go:655] Throttling request took 1.048540209s, request: GET:https://192.168.85.2:8443/apis/apiextensions.k8s.io/v1?timeout=32s
W0801 02:33:31.856350 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0801 02:33:59.548471 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0801 02:34:03.506846 1 request.go:655] Throttling request took 1.047997554s, request: GET:https://192.168.85.2:8443/apis/extensions/v1beta1?timeout=32s
W0801 02:34:04.358529 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0801 02:34:30.053342 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0801 02:34:36.012469 1 request.go:655] Throttling request took 1.051673763s, request: GET:https://192.168.85.2:8443/apis/extensions/v1beta1?timeout=32s
W0801 02:34:36.860408 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0801 02:35:00.563664 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0801 02:35:08.510950 1 request.go:655] Throttling request took 1.04817114s, request: GET:https://192.168.85.2:8443/apis/extensions/v1beta1?timeout=32s
W0801 02:35:09.362488 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0801 02:35:31.065678 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0801 02:35:41.013012 1 request.go:655] Throttling request took 1.04822907s, request: GET:https://192.168.85.2:8443/apis/extensions/v1beta1?timeout=32s
W0801 02:35:41.864602 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0801 02:36:01.567921 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0801 02:36:13.515010 1 request.go:655] Throttling request took 1.048516443s, request: GET:https://192.168.85.2:8443/apis/scheduling.k8s.io/v1beta1?timeout=32s
W0801 02:36:14.366548 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0801 02:36:32.069875 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0801 02:36:46.017010 1 request.go:655] Throttling request took 1.048558876s, request: GET:https://192.168.85.2:8443/apis/apiextensions.k8s.io/v1?timeout=32s
W0801 02:36:46.868441 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0801 02:37:02.571744 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0801 02:37:18.519017 1 request.go:655] Throttling request took 1.04836644s, request: GET:https://192.168.85.2:8443/apis/authorization.k8s.io/v1?timeout=32s
W0801 02:37:19.370344 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0801 02:37:33.073904 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
==> kube-proxy [37f080fad4301d1b52430835d200cd6ca4e4b84de7c6ca7493ca3136cf933938] <==
I0801 02:32:11.974460 1 node.go:172] Successfully retrieved node IP: 192.168.85.2
I0801 02:32:11.974767 1 server_others.go:142] kube-proxy node IP is an IPv4 address (192.168.85.2), assume IPv4 operation
W0801 02:32:12.013249 1 server_others.go:578] Unknown proxy mode "", assuming iptables proxy
I0801 02:32:12.013557 1 server_others.go:185] Using iptables Proxier.
I0801 02:32:12.013957 1 server.go:650] Version: v1.20.0
I0801 02:32:12.014882 1 config.go:315] Starting service config controller
I0801 02:32:12.015071 1 shared_informer.go:240] Waiting for caches to sync for service config
I0801 02:32:12.016347 1 config.go:224] Starting endpoint slice config controller
I0801 02:32:12.017319 1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config
I0801 02:32:12.117660 1 shared_informer.go:247] Caches are synced for endpoint slice config
I0801 02:32:12.117682 1 shared_informer.go:247] Caches are synced for service config
==> kube-proxy [f53a26dcf83dbc8267f8b697cd588a06c0d4b11ad6afc282b1d5724acea3c610] <==
I0801 02:30:04.286580 1 node.go:172] Successfully retrieved node IP: 192.168.85.2
I0801 02:30:04.286674 1 server_others.go:142] kube-proxy node IP is an IPv4 address (192.168.85.2), assume IPv4 operation
W0801 02:30:04.362519 1 server_others.go:578] Unknown proxy mode "", assuming iptables proxy
I0801 02:30:04.362648 1 server_others.go:185] Using iptables Proxier.
I0801 02:30:04.371635 1 server.go:650] Version: v1.20.0
I0801 02:30:04.407012 1 config.go:315] Starting service config controller
I0801 02:30:04.407036 1 shared_informer.go:240] Waiting for caches to sync for service config
I0801 02:30:04.407069 1 config.go:224] Starting endpoint slice config controller
I0801 02:30:04.421261 1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config
I0801 02:30:04.513621 1 shared_informer.go:247] Caches are synced for service config
I0801 02:30:04.527601 1 shared_informer.go:247] Caches are synced for endpoint slice config
==> kube-scheduler [62728d8ccc17e7327a30d7c30bc56da7fe1e23e573da3a9d37b2e68bb43fe900] <==
I0801 02:32:01.504687 1 serving.go:331] Generated self-signed cert in-memory
W0801 02:32:07.733595 1 requestheader_controller.go:193] Unable to get configmap/extension-apiserver-authentication in kube-system. Usually fixed by 'kubectl create rolebinding -n kube-system ROLEBINDING_NAME --role=extension-apiserver-authentication-reader --serviceaccount=YOUR_NS:YOUR_SA'
W0801 02:32:07.733630 1 authentication.go:332] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"
W0801 02:32:07.733652 1 authentication.go:333] Continuing without authentication configuration. This may treat all requests as anonymous.
W0801 02:32:07.733659 1 authentication.go:334] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false
I0801 02:32:08.042274 1 secure_serving.go:197] Serving securely on 127.0.0.1:10259
I0801 02:32:08.043682 1 configmap_cafile_content.go:202] Starting client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0801 02:32:08.043716 1 shared_informer.go:240] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0801 02:32:08.043733 1 tlsconfig.go:240] Starting DynamicServingCertificateController
I0801 02:32:08.148452 1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
==> kube-scheduler [ba767bcdadef58a525bbf831d77bde21750306f86c792e4ed2d997bf87a799d2] <==
W0801 02:29:44.261389 1 authentication.go:334] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false
I0801 02:29:44.336785 1 secure_serving.go:197] Serving securely on 127.0.0.1:10259
I0801 02:29:44.337180 1 configmap_cafile_content.go:202] Starting client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0801 02:29:44.337269 1 shared_informer.go:240] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0801 02:29:44.337374 1 tlsconfig.go:240] Starting DynamicServingCertificateController
E0801 02:29:44.367592 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
E0801 02:29:44.374862 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
E0801 02:29:44.375282 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
E0801 02:29:44.377935 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
E0801 02:29:44.378304 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1beta1.PodDisruptionBudget: failed to list *v1beta1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
E0801 02:29:44.380549 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
E0801 02:29:44.380866 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
E0801 02:29:44.381124 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
E0801 02:29:44.381340 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
E0801 02:29:44.381569 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
E0801 02:29:44.381982 1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
E0801 02:29:44.382328 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
E0801 02:29:45.250734 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
E0801 02:29:45.459945 1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
E0801 02:29:45.473346 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
E0801 02:29:45.520700 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
E0801 02:29:45.557142 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1beta1.PodDisruptionBudget: failed to list *v1beta1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
E0801 02:29:45.557430 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
E0801 02:29:45.612589 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
I0801 02:29:47.437452 1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
==> kubelet <==
Aug 01 02:36:19 old-k8s-version-668722 kubelet[663]: E0801 02:36:19.591496 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
Aug 01 02:36:25 old-k8s-version-668722 kubelet[663]: E0801 02:36:25.594086 663 pod_workers.go:191] Error syncing pod 2264c40b-d62b-481e-bd07-e488b1557961 ("metrics-server-9975d5f86-62ssn_kube-system(2264c40b-d62b-481e-bd07-e488b1557961)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Aug 01 02:36:34 old-k8s-version-668722 kubelet[663]: I0801 02:36:34.590640 663 scope.go:95] [topologymanager] RemoveContainer - Container ID: 5fa610d5bd9034152b4dbf9e6928f74aca10bd2f1d51257022c97a44b9ce0283
Aug 01 02:36:34 old-k8s-version-668722 kubelet[663]: E0801 02:36:34.591017 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
Aug 01 02:36:37 old-k8s-version-668722 kubelet[663]: E0801 02:36:37.591337 663 pod_workers.go:191] Error syncing pod 2264c40b-d62b-481e-bd07-e488b1557961 ("metrics-server-9975d5f86-62ssn_kube-system(2264c40b-d62b-481e-bd07-e488b1557961)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Aug 01 02:36:45 old-k8s-version-668722 kubelet[663]: I0801 02:36:45.590745 663 scope.go:95] [topologymanager] RemoveContainer - Container ID: 5fa610d5bd9034152b4dbf9e6928f74aca10bd2f1d51257022c97a44b9ce0283
Aug 01 02:36:45 old-k8s-version-668722 kubelet[663]: E0801 02:36:45.591178 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
Aug 01 02:36:50 old-k8s-version-668722 kubelet[663]: E0801 02:36:50.591590 663 pod_workers.go:191] Error syncing pod 2264c40b-d62b-481e-bd07-e488b1557961 ("metrics-server-9975d5f86-62ssn_kube-system(2264c40b-d62b-481e-bd07-e488b1557961)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Aug 01 02:36:57 old-k8s-version-668722 kubelet[663]: I0801 02:36:57.590612 663 scope.go:95] [topologymanager] RemoveContainer - Container ID: 5fa610d5bd9034152b4dbf9e6928f74aca10bd2f1d51257022c97a44b9ce0283
Aug 01 02:36:57 old-k8s-version-668722 kubelet[663]: E0801 02:36:57.590939 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
Aug 01 02:37:04 old-k8s-version-668722 kubelet[663]: E0801 02:37:04.591285 663 pod_workers.go:191] Error syncing pod 2264c40b-d62b-481e-bd07-e488b1557961 ("metrics-server-9975d5f86-62ssn_kube-system(2264c40b-d62b-481e-bd07-e488b1557961)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Aug 01 02:37:10 old-k8s-version-668722 kubelet[663]: I0801 02:37:10.591076 663 scope.go:95] [topologymanager] RemoveContainer - Container ID: 5fa610d5bd9034152b4dbf9e6928f74aca10bd2f1d51257022c97a44b9ce0283
Aug 01 02:37:10 old-k8s-version-668722 kubelet[663]: E0801 02:37:10.591892 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
Aug 01 02:37:19 old-k8s-version-668722 kubelet[663]: E0801 02:37:19.591351 663 pod_workers.go:191] Error syncing pod 2264c40b-d62b-481e-bd07-e488b1557961 ("metrics-server-9975d5f86-62ssn_kube-system(2264c40b-d62b-481e-bd07-e488b1557961)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Aug 01 02:37:21 old-k8s-version-668722 kubelet[663]: I0801 02:37:21.592687 663 scope.go:95] [topologymanager] RemoveContainer - Container ID: 5fa610d5bd9034152b4dbf9e6928f74aca10bd2f1d51257022c97a44b9ce0283
Aug 01 02:37:21 old-k8s-version-668722 kubelet[663]: E0801 02:37:21.596896 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
Aug 01 02:37:33 old-k8s-version-668722 kubelet[663]: I0801 02:37:33.593950 663 scope.go:95] [topologymanager] RemoveContainer - Container ID: 5fa610d5bd9034152b4dbf9e6928f74aca10bd2f1d51257022c97a44b9ce0283
Aug 01 02:37:33 old-k8s-version-668722 kubelet[663]: E0801 02:37:33.595779 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
Aug 01 02:37:33 old-k8s-version-668722 kubelet[663]: E0801 02:37:33.606841 663 remote_image.go:113] PullImage "fake.domain/registry.k8s.io/echoserver:1.4" from image service failed: rpc error: code = Unknown desc = failed to pull and unpack image "fake.domain/registry.k8s.io/echoserver:1.4": failed to resolve reference "fake.domain/registry.k8s.io/echoserver:1.4": failed to do request: Head "https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host
Aug 01 02:37:33 old-k8s-version-668722 kubelet[663]: E0801 02:37:33.606901 663 kuberuntime_image.go:51] Pull image "fake.domain/registry.k8s.io/echoserver:1.4" failed: rpc error: code = Unknown desc = failed to pull and unpack image "fake.domain/registry.k8s.io/echoserver:1.4": failed to resolve reference "fake.domain/registry.k8s.io/echoserver:1.4": failed to do request: Head "https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host
Aug 01 02:37:33 old-k8s-version-668722 kubelet[663]: E0801 02:37:33.607038 663 kuberuntime_manager.go:829] container &Container{Name:metrics-server,Image:fake.domain/registry.k8s.io/echoserver:1.4,Command:[],Args:[--cert-dir=/tmp --secure-port=4443 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --kubelet-use-node-status-port --metric-resolution=60s --kubelet-insecure-tls],WorkingDir:,Ports:[]ContainerPort{ContainerPort{Name:https,HostPort:0,ContainerPort:4443,Protocol:TCP,HostIP:,},},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{cpu: {{100 -3} {<nil>} 100m DecimalSI},memory: {{209715200 0} {<nil>} BinarySI},},},VolumeMounts:[]VolumeMount{VolumeMount{Name:tmp-dir,ReadOnly:false,MountPath:/tmp,SubPath:,MountPropagation:nil,SubPathExpr:,},VolumeMount{Name:metrics-server-token-pxh6p,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:&Probe{Handler:Handler{Exec
:nil,HTTPGet:&HTTPGetAction{Path:/livez,Port:{1 0 https},Host:,Scheme:HTTPS,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,},InitialDelaySeconds:0,TimeoutSeconds:1,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,},ReadinessProbe:&Probe{Handler:Handler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/readyz,Port:{1 0 https},Host:,Scheme:HTTPS,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,},InitialDelaySeconds:0,TimeoutSeconds:1,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:*1000,RunAsNonRoot:*true,ReadOnlyRootFilesystem:*true,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,} start failed in pod metrics-server-9975d5f86-62ssn_kube-system(2264c40
b-d62b-481e-bd07-e488b1557961): ErrImagePull: rpc error: code = Unknown desc = failed to pull and unpack image "fake.domain/registry.k8s.io/echoserver:1.4": failed to resolve reference "fake.domain/registry.k8s.io/echoserver:1.4": failed to do request: Head "https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host
Aug 01 02:37:33 old-k8s-version-668722 kubelet[663]: E0801 02:37:33.607076 663 pod_workers.go:191] Error syncing pod 2264c40b-d62b-481e-bd07-e488b1557961 ("metrics-server-9975d5f86-62ssn_kube-system(2264c40b-d62b-481e-bd07-e488b1557961)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"
Aug 01 02:37:45 old-k8s-version-668722 kubelet[663]: I0801 02:37:45.590625 663 scope.go:95] [topologymanager] RemoveContainer - Container ID: 5fa610d5bd9034152b4dbf9e6928f74aca10bd2f1d51257022c97a44b9ce0283
Aug 01 02:37:45 old-k8s-version-668722 kubelet[663]: E0801 02:37:45.591044 663 pod_workers.go:191] Error syncing pod 6619221d-1d84-4e3d-b0a4-abcc5439c032 ("dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2x8bf_kubernetes-dashboard(6619221d-1d84-4e3d-b0a4-abcc5439c032)"
Aug 01 02:37:47 old-k8s-version-668722 kubelet[663]: E0801 02:37:47.592610 663 pod_workers.go:191] Error syncing pod 2264c40b-d62b-481e-bd07-e488b1557961 ("metrics-server-9975d5f86-62ssn_kube-system(2264c40b-d62b-481e-bd07-e488b1557961)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
==> kubernetes-dashboard [cd1c96196c6d07576a76836788287288790ee6df6007258403328244166438e7] <==
2024/08/01 02:32:37 Using namespace: kubernetes-dashboard
2024/08/01 02:32:37 Using in-cluster config to connect to apiserver
2024/08/01 02:32:37 Using secret token for csrf signing
2024/08/01 02:32:37 Initializing csrf token from kubernetes-dashboard-csrf secret
2024/08/01 02:32:37 Empty token. Generating and storing in a secret kubernetes-dashboard-csrf
2024/08/01 02:32:37 Successful initial request to the apiserver, version: v1.20.0
2024/08/01 02:32:37 Generating JWE encryption key
2024/08/01 02:32:37 New synchronizer has been registered: kubernetes-dashboard-key-holder-kubernetes-dashboard. Starting
2024/08/01 02:32:37 Starting secret synchronizer for kubernetes-dashboard-key-holder in namespace kubernetes-dashboard
2024/08/01 02:32:37 Initializing JWE encryption key from synchronized object
2024/08/01 02:32:37 Creating in-cluster Sidecar client
2024/08/01 02:32:37 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/08/01 02:32:37 Serving insecurely on HTTP port: 9090
2024/08/01 02:33:07 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/08/01 02:33:37 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/08/01 02:34:07 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/08/01 02:34:37 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/08/01 02:35:07 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/08/01 02:35:37 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/08/01 02:36:07 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/08/01 02:36:37 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/08/01 02:37:07 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/08/01 02:37:37 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/08/01 02:32:37 Starting overwatch
==> storage-provisioner [d9250699e0826de2d05c6b860b9c4e9f464a045b8ba59ef5a9760a4ff035a432] <==
I0801 02:32:09.798795 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
F0801 02:32:39.800866 1 main.go:39] error getting server version: Get "https://10.96.0.1:443/version?timeout=32s": dial tcp 10.96.0.1:443: i/o timeout
==> storage-provisioner [dbaca8a1b362dbe57628482f5b8003c344440ec5a3b0df3adeff5cb5c839bc27] <==
I0801 02:32:53.818468 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
I0801 02:32:53.859733 1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
I0801 02:32:53.859819 1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
I0801 02:33:11.337523 1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
I0801 02:33:11.337866 1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_old-k8s-version-668722_8da15de2-aeca-4795-95c8-dbe72c7dd187!
I0801 02:33:11.346871 1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"e8254a38-99e6-4903-a633-881f51818a4a", APIVersion:"v1", ResourceVersion:"830", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' old-k8s-version-668722_8da15de2-aeca-4795-95c8-dbe72c7dd187 became leader
I0801 02:33:11.438775 1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_old-k8s-version-668722_8da15de2-aeca-4795-95c8-dbe72c7dd187!
-- /stdout --
helpers_test.go:254: (dbg) Run: out/minikube-linux-arm64 status --format={{.APIServer}} -p old-k8s-version-668722 -n old-k8s-version-668722
helpers_test.go:261: (dbg) Run: kubectl --context old-k8s-version-668722 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:272: non-running pods: metrics-server-9975d5f86-62ssn
helpers_test.go:274: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: describe non-running pods <======
helpers_test.go:277: (dbg) Run: kubectl --context old-k8s-version-668722 describe pod metrics-server-9975d5f86-62ssn
helpers_test.go:277: (dbg) Non-zero exit: kubectl --context old-k8s-version-668722 describe pod metrics-server-9975d5f86-62ssn: exit status 1 (95.209037ms)
** stderr **
Error from server (NotFound): pods "metrics-server-9975d5f86-62ssn" not found
** /stderr **
helpers_test.go:279: kubectl --context old-k8s-version-668722 describe pod metrics-server-9975d5f86-62ssn: exit status 1
--- FAIL: TestStartStop/group/old-k8s-version/serial/SecondStart (373.54s)