=== RUN TestStartStop/group/old-k8s-version/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run: out/minikube-linux-arm64 start -p old-k8s-version-506981 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=containerd --kubernetes-version=v1.20.0
start_stop_delete_test.go:256: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p old-k8s-version-506981 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=containerd --kubernetes-version=v1.20.0: exit status 102 (6m17.53186612s)
-- stdout --
* [old-k8s-version-506981] minikube v1.33.1 on Ubuntu 20.04 (arm64)
- MINIKUBE_LOCATION=19011
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/19011-937109/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/19011-937109/.minikube
- MINIKUBE_BIN=out/minikube-linux-arm64
- MINIKUBE_FORCE_SYSTEMD=
* Kubernetes 1.30.1 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.30.1
* Using the docker driver based on existing profile
* Starting "old-k8s-version-506981" primary control-plane node in "old-k8s-version-506981" cluster
* Pulling base image v0.0.44-1716228441-18934 ...
* Restarting existing docker container for "old-k8s-version-506981" ...
* Preparing Kubernetes v1.20.0 on containerd 1.6.31 ...
* Verifying Kubernetes components...
- Using image gcr.io/k8s-minikube/storage-provisioner:v5
- Using image docker.io/kubernetesui/dashboard:v2.7.0
- Using image registry.k8s.io/echoserver:1.4
- Using image fake.domain/registry.k8s.io/echoserver:1.4
* Some dashboard features require the metrics-server addon. To enable all features please run:
minikube -p old-k8s-version-506981 addons enable metrics-server
* Enabled addons: storage-provisioner, metrics-server, dashboard, default-storageclass
-- /stdout --
** stderr **
I0603 14:05:45.786671 1131020 out.go:291] Setting OutFile to fd 1 ...
I0603 14:05:45.786871 1131020 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0603 14:05:45.786885 1131020 out.go:304] Setting ErrFile to fd 2...
I0603 14:05:45.786891 1131020 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0603 14:05:45.787114 1131020 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19011-937109/.minikube/bin
I0603 14:05:45.787513 1131020 out.go:298] Setting JSON to false
I0603 14:05:45.788482 1131020 start.go:129] hostinfo: {"hostname":"ip-172-31-21-244","uptime":17290,"bootTime":1717406256,"procs":213,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1062-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"da8ac1fd-6236-412a-a346-95873c98230d"}
I0603 14:05:45.788551 1131020 start.go:139] virtualization:
I0603 14:05:45.791040 1131020 out.go:177] * [old-k8s-version-506981] minikube v1.33.1 on Ubuntu 20.04 (arm64)
I0603 14:05:45.794087 1131020 out.go:177] - MINIKUBE_LOCATION=19011
I0603 14:05:45.796121 1131020 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0603 14:05:45.794061 1131020 notify.go:220] Checking for updates...
I0603 14:05:45.799792 1131020 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/19011-937109/kubeconfig
I0603 14:05:45.801767 1131020 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/19011-937109/.minikube
I0603 14:05:45.803657 1131020 out.go:177] - MINIKUBE_BIN=out/minikube-linux-arm64
I0603 14:05:45.805466 1131020 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0603 14:05:45.807934 1131020 config.go:182] Loaded profile config "old-k8s-version-506981": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0
I0603 14:05:45.810391 1131020 out.go:177] * Kubernetes 1.30.1 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.30.1
I0603 14:05:45.812608 1131020 driver.go:392] Setting default libvirt URI to qemu:///system
I0603 14:05:45.836776 1131020 docker.go:122] docker version: linux-26.1.3:Docker Engine - Community
I0603 14:05:45.836895 1131020 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0603 14:05:45.924942 1131020 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:54 OomKillDisable:true NGoroutines:67 SystemTime:2024-06-03 14:05:45.911761297 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1062-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214970368 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:26.1.3 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:8b3b7ca2e5ce38e8f31a34f35b2b68ceb8470d89 Expected:8b3b7ca2e5ce38e8f31a34f35b2b68ceb8470d89} RuncCommit:{ID:v1.1.12-0-g51d5e94 Expected:v1.1.12-0-g51d5e94} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.14.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.27.0]] Warnings:<nil>}}
I0603 14:05:45.925051 1131020 docker.go:295] overlay module found
I0603 14:05:45.927207 1131020 out.go:177] * Using the docker driver based on existing profile
I0603 14:05:45.928884 1131020 start.go:297] selected driver: docker
I0603 14:05:45.928898 1131020 start.go:901] validating driver "docker" against &{Name:old-k8s-version-506981 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1716228441-18934@sha256:628b3f20803bc9c4302fd048087dd36cf2ff5dc9ab0ded395ec3288e2f1d0862 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-506981 Namespace:default APIServerHAVIP: AP
IServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:fa
lse MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0603 14:05:45.929015 1131020 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0603 14:05:45.929598 1131020 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0603 14:05:46.021900 1131020 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:54 OomKillDisable:true NGoroutines:67 SystemTime:2024-06-03 14:05:46.007256842 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1062-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214970368 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:26.1.3 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:8b3b7ca2e5ce38e8f31a34f35b2b68ceb8470d89 Expected:8b3b7ca2e5ce38e8f31a34f35b2b68ceb8470d89} RuncCommit:{ID:v1.1.12-0-g51d5e94 Expected:v1.1.12-0-g51d5e94} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.14.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.27.0]] Warnings:<nil>}}
I0603 14:05:46.022271 1131020 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0603 14:05:46.022302 1131020 cni.go:84] Creating CNI manager for ""
I0603 14:05:46.022310 1131020 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0603 14:05:46.022348 1131020 start.go:340] cluster config:
{Name:old-k8s-version-506981 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1716228441-18934@sha256:628b3f20803bc9c4302fd048087dd36cf2ff5dc9ab0ded395ec3288e2f1d0862 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-506981 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local
ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:do
cker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0603 14:05:46.028760 1131020 out.go:177] * Starting "old-k8s-version-506981" primary control-plane node in "old-k8s-version-506981" cluster
I0603 14:05:46.030525 1131020 cache.go:121] Beginning downloading kic base image for docker with containerd
I0603 14:05:46.032565 1131020 out.go:177] * Pulling base image v0.0.44-1716228441-18934 ...
I0603 14:05:46.034354 1131020 preload.go:132] Checking if preload exists for k8s version v1.20.0 and runtime containerd
I0603 14:05:46.034424 1131020 preload.go:147] Found local preload: /home/jenkins/minikube-integration/19011-937109/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-containerd-overlay2-arm64.tar.lz4
I0603 14:05:46.034439 1131020 cache.go:56] Caching tarball of preloaded images
I0603 14:05:46.034525 1131020 preload.go:173] Found /home/jenkins/minikube-integration/19011-937109/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-containerd-overlay2-arm64.tar.lz4 in cache, skipping download
I0603 14:05:46.034540 1131020 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on containerd
I0603 14:05:46.034657 1131020 profile.go:143] Saving config to /home/jenkins/minikube-integration/19011-937109/.minikube/profiles/old-k8s-version-506981/config.json ...
I0603 14:05:46.034884 1131020 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1716228441-18934@sha256:628b3f20803bc9c4302fd048087dd36cf2ff5dc9ab0ded395ec3288e2f1d0862 in local docker daemon
I0603 14:05:46.050055 1131020 image.go:83] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1716228441-18934@sha256:628b3f20803bc9c4302fd048087dd36cf2ff5dc9ab0ded395ec3288e2f1d0862 in local docker daemon, skipping pull
I0603 14:05:46.050082 1131020 cache.go:144] gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1716228441-18934@sha256:628b3f20803bc9c4302fd048087dd36cf2ff5dc9ab0ded395ec3288e2f1d0862 exists in daemon, skipping load
I0603 14:05:46.050101 1131020 cache.go:194] Successfully downloaded all kic artifacts
I0603 14:05:46.050130 1131020 start.go:360] acquireMachinesLock for old-k8s-version-506981: {Name:mk07ab62c57078bf890f52f0b4b64c87a52e5b4b Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0603 14:05:46.050216 1131020 start.go:364] duration metric: took 50.263µs to acquireMachinesLock for "old-k8s-version-506981"
I0603 14:05:46.050243 1131020 start.go:96] Skipping create...Using existing machine configuration
I0603 14:05:46.050253 1131020 fix.go:54] fixHost starting:
I0603 14:05:46.050523 1131020 cli_runner.go:164] Run: docker container inspect old-k8s-version-506981 --format={{.State.Status}}
I0603 14:05:46.066676 1131020 fix.go:112] recreateIfNeeded on old-k8s-version-506981: state=Stopped err=<nil>
W0603 14:05:46.066710 1131020 fix.go:138] unexpected machine state, will restart: <nil>
I0603 14:05:46.068969 1131020 out.go:177] * Restarting existing docker container for "old-k8s-version-506981" ...
I0603 14:05:46.070928 1131020 cli_runner.go:164] Run: docker start old-k8s-version-506981
I0603 14:05:46.465016 1131020 cli_runner.go:164] Run: docker container inspect old-k8s-version-506981 --format={{.State.Status}}
I0603 14:05:46.492415 1131020 kic.go:430] container "old-k8s-version-506981" state is running.
I0603 14:05:46.492824 1131020 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-506981
I0603 14:05:46.522739 1131020 profile.go:143] Saving config to /home/jenkins/minikube-integration/19011-937109/.minikube/profiles/old-k8s-version-506981/config.json ...
I0603 14:05:46.523339 1131020 machine.go:94] provisionDockerMachine start ...
I0603 14:05:46.523551 1131020 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-506981
I0603 14:05:46.548047 1131020 main.go:141] libmachine: Using SSH client type: native
I0603 14:05:46.548315 1131020 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2b30] 0x3e5390 <nil> [] 0s} 127.0.0.1 34194 <nil> <nil>}
I0603 14:05:46.548323 1131020 main.go:141] libmachine: About to run SSH command:
hostname
I0603 14:05:46.549911 1131020 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: EOF
I0603 14:05:49.680211 1131020 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-506981
I0603 14:05:49.680239 1131020 ubuntu.go:169] provisioning hostname "old-k8s-version-506981"
I0603 14:05:49.680301 1131020 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-506981
I0603 14:05:49.708537 1131020 main.go:141] libmachine: Using SSH client type: native
I0603 14:05:49.708808 1131020 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2b30] 0x3e5390 <nil> [] 0s} 127.0.0.1 34194 <nil> <nil>}
I0603 14:05:49.708825 1131020 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-506981 && echo "old-k8s-version-506981" | sudo tee /etc/hostname
I0603 14:05:49.863688 1131020 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-506981
I0603 14:05:49.863782 1131020 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-506981
I0603 14:05:49.891176 1131020 main.go:141] libmachine: Using SSH client type: native
I0603 14:05:49.891481 1131020 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2b30] 0x3e5390 <nil> [] 0s} 127.0.0.1 34194 <nil> <nil>}
I0603 14:05:49.891510 1131020 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-506981' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-506981/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-506981' | sudo tee -a /etc/hosts;
fi
fi
I0603 14:05:50.029807 1131020 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0603 14:05:50.029840 1131020 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/19011-937109/.minikube CaCertPath:/home/jenkins/minikube-integration/19011-937109/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19011-937109/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19011-937109/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19011-937109/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19011-937109/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19011-937109/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19011-937109/.minikube}
I0603 14:05:50.029873 1131020 ubuntu.go:177] setting up certificates
I0603 14:05:50.029885 1131020 provision.go:84] configureAuth start
I0603 14:05:50.029956 1131020 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-506981
I0603 14:05:50.052990 1131020 provision.go:143] copyHostCerts
I0603 14:05:50.053108 1131020 exec_runner.go:144] found /home/jenkins/minikube-integration/19011-937109/.minikube/cert.pem, removing ...
I0603 14:05:50.053125 1131020 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19011-937109/.minikube/cert.pem
I0603 14:05:50.053214 1131020 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19011-937109/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19011-937109/.minikube/cert.pem (1123 bytes)
I0603 14:05:50.053330 1131020 exec_runner.go:144] found /home/jenkins/minikube-integration/19011-937109/.minikube/key.pem, removing ...
I0603 14:05:50.053342 1131020 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19011-937109/.minikube/key.pem
I0603 14:05:50.053374 1131020 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19011-937109/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19011-937109/.minikube/key.pem (1675 bytes)
I0603 14:05:50.053440 1131020 exec_runner.go:144] found /home/jenkins/minikube-integration/19011-937109/.minikube/ca.pem, removing ...
I0603 14:05:50.053451 1131020 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19011-937109/.minikube/ca.pem
I0603 14:05:50.053484 1131020 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19011-937109/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19011-937109/.minikube/ca.pem (1082 bytes)
I0603 14:05:50.053546 1131020 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19011-937109/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19011-937109/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19011-937109/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-506981 san=[127.0.0.1 192.168.76.2 localhost minikube old-k8s-version-506981]
I0603 14:05:50.437634 1131020 provision.go:177] copyRemoteCerts
I0603 14:05:50.437711 1131020 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0603 14:05:50.437758 1131020 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-506981
I0603 14:05:50.456753 1131020 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34194 SSHKeyPath:/home/jenkins/minikube-integration/19011-937109/.minikube/machines/old-k8s-version-506981/id_rsa Username:docker}
I0603 14:05:50.556678 1131020 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19011-937109/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0603 14:05:50.586899 1131020 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19011-937109/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
I0603 14:05:50.612367 1131020 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19011-937109/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0603 14:05:50.637834 1131020 provision.go:87] duration metric: took 607.9304ms to configureAuth
I0603 14:05:50.637870 1131020 ubuntu.go:193] setting minikube options for container-runtime
I0603 14:05:50.638071 1131020 config.go:182] Loaded profile config "old-k8s-version-506981": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0
I0603 14:05:50.638083 1131020 machine.go:97] duration metric: took 4.114732426s to provisionDockerMachine
I0603 14:05:50.638099 1131020 start.go:293] postStartSetup for "old-k8s-version-506981" (driver="docker")
I0603 14:05:50.638114 1131020 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0603 14:05:50.638182 1131020 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0603 14:05:50.638230 1131020 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-506981
I0603 14:05:50.658616 1131020 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34194 SSHKeyPath:/home/jenkins/minikube-integration/19011-937109/.minikube/machines/old-k8s-version-506981/id_rsa Username:docker}
I0603 14:05:50.750919 1131020 ssh_runner.go:195] Run: cat /etc/os-release
I0603 14:05:50.754672 1131020 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0603 14:05:50.754711 1131020 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0603 14:05:50.754726 1131020 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0603 14:05:50.754733 1131020 info.go:137] Remote host: Ubuntu 22.04.4 LTS
I0603 14:05:50.754752 1131020 filesync.go:126] Scanning /home/jenkins/minikube-integration/19011-937109/.minikube/addons for local assets ...
I0603 14:05:50.754808 1131020 filesync.go:126] Scanning /home/jenkins/minikube-integration/19011-937109/.minikube/files for local assets ...
I0603 14:05:50.754891 1131020 filesync.go:149] local asset: /home/jenkins/minikube-integration/19011-937109/.minikube/files/etc/ssl/certs/9425412.pem -> 9425412.pem in /etc/ssl/certs
I0603 14:05:50.755004 1131020 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0603 14:05:50.763890 1131020 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19011-937109/.minikube/files/etc/ssl/certs/9425412.pem --> /etc/ssl/certs/9425412.pem (1708 bytes)
I0603 14:05:50.791136 1131020 start.go:296] duration metric: took 153.016131ms for postStartSetup
I0603 14:05:50.791238 1131020 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0603 14:05:50.791285 1131020 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-506981
I0603 14:05:50.817772 1131020 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34194 SSHKeyPath:/home/jenkins/minikube-integration/19011-937109/.minikube/machines/old-k8s-version-506981/id_rsa Username:docker}
I0603 14:05:50.915133 1131020 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I0603 14:05:50.922859 1131020 fix.go:56] duration metric: took 4.872587932s for fixHost
I0603 14:05:50.922881 1131020 start.go:83] releasing machines lock for "old-k8s-version-506981", held for 4.872651208s
I0603 14:05:50.922969 1131020 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-506981
I0603 14:05:50.941642 1131020 ssh_runner.go:195] Run: cat /version.json
I0603 14:05:50.941696 1131020 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-506981
I0603 14:05:50.941932 1131020 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0603 14:05:50.941994 1131020 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-506981
I0603 14:05:50.974180 1131020 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34194 SSHKeyPath:/home/jenkins/minikube-integration/19011-937109/.minikube/machines/old-k8s-version-506981/id_rsa Username:docker}
I0603 14:05:50.975291 1131020 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34194 SSHKeyPath:/home/jenkins/minikube-integration/19011-937109/.minikube/machines/old-k8s-version-506981/id_rsa Username:docker}
I0603 14:05:51.072883 1131020 ssh_runner.go:195] Run: systemctl --version
I0603 14:05:51.205224 1131020 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I0603 14:05:51.209562 1131020 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
I0603 14:05:51.227677 1131020 cni.go:230] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
I0603 14:05:51.227764 1131020 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0603 14:05:51.237265 1131020 cni.go:259] no active bridge cni configs found in "/etc/cni/net.d" - nothing to disable
I0603 14:05:51.237289 1131020 start.go:494] detecting cgroup driver to use...
I0603 14:05:51.237330 1131020 detect.go:196] detected "cgroupfs" cgroup driver on host os
I0603 14:05:51.237399 1131020 ssh_runner.go:195] Run: sudo systemctl stop -f crio
I0603 14:05:51.252292 1131020 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I0603 14:05:51.265357 1131020 docker.go:217] disabling cri-docker service (if available) ...
I0603 14:05:51.265456 1131020 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0603 14:05:51.279302 1131020 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0603 14:05:51.291292 1131020 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0603 14:05:51.399159 1131020 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0603 14:05:51.505566 1131020 docker.go:233] disabling docker service ...
I0603 14:05:51.505684 1131020 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0603 14:05:51.519843 1131020 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0603 14:05:51.531594 1131020 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0603 14:05:51.636875 1131020 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0603 14:05:51.742876 1131020 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0603 14:05:51.754618 1131020 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock
" | sudo tee /etc/crictl.yaml"
I0603 14:05:51.769782 1131020 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.2"|' /etc/containerd/config.toml"
I0603 14:05:51.780400 1131020 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
I0603 14:05:51.790017 1131020 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...
I0603 14:05:51.790100 1131020 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
I0603 14:05:51.799924 1131020 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0603 14:05:51.809842 1131020 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
I0603 14:05:51.819190 1131020 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0603 14:05:51.828701 1131020 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0603 14:05:51.842051 1131020 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
I0603 14:05:51.851743 1131020 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0603 14:05:51.859938 1131020 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0603 14:05:51.868185 1131020 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0603 14:05:51.973302 1131020 ssh_runner.go:195] Run: sudo systemctl restart containerd
I0603 14:05:52.176862 1131020 start.go:541] Will wait 60s for socket path /run/containerd/containerd.sock
I0603 14:05:52.176943 1131020 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
I0603 14:05:52.180800 1131020 start.go:562] Will wait 60s for crictl version
I0603 14:05:52.180897 1131020 ssh_runner.go:195] Run: which crictl
I0603 14:05:52.184369 1131020 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0603 14:05:52.229691 1131020 start.go:578] Version: 0.1.0
RuntimeName: containerd
RuntimeVersion: 1.6.31
RuntimeApiVersion: v1
I0603 14:05:52.229797 1131020 ssh_runner.go:195] Run: containerd --version
I0603 14:05:52.252067 1131020 ssh_runner.go:195] Run: containerd --version
I0603 14:05:52.279971 1131020 out.go:177] * Preparing Kubernetes v1.20.0 on containerd 1.6.31 ...
I0603 14:05:52.282480 1131020 cli_runner.go:164] Run: docker network inspect old-k8s-version-506981 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0603 14:05:52.296476 1131020 ssh_runner.go:195] Run: grep 192.168.76.1 host.minikube.internal$ /etc/hosts
I0603 14:05:52.300370 1131020 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.76.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0603 14:05:52.311058 1131020 kubeadm.go:877] updating cluster {Name:old-k8s-version-506981 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1716228441-18934@sha256:628b3f20803bc9c4302fd048087dd36cf2ff5dc9ab0ded395ec3288e2f1d0862 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-506981 Namespace:default APIServerHAVIP: APIServerName:minik
ubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/
home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0603 14:05:52.311227 1131020 preload.go:132] Checking if preload exists for k8s version v1.20.0 and runtime containerd
I0603 14:05:52.311325 1131020 ssh_runner.go:195] Run: sudo crictl images --output json
I0603 14:05:52.364625 1131020 containerd.go:627] all images are preloaded for containerd runtime.
I0603 14:05:52.364650 1131020 containerd.go:534] Images already preloaded, skipping extraction
I0603 14:05:52.364742 1131020 ssh_runner.go:195] Run: sudo crictl images --output json
I0603 14:05:52.408317 1131020 containerd.go:627] all images are preloaded for containerd runtime.
I0603 14:05:52.408342 1131020 cache_images.go:84] Images are preloaded, skipping loading
I0603 14:05:52.408359 1131020 kubeadm.go:928] updating node { 192.168.76.2 8443 v1.20.0 containerd true true} ...
I0603 14:05:52.408486 1131020 kubeadm.go:940] kubelet [Unit]
Wants=containerd.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///run/containerd/containerd.sock --hostname-override=old-k8s-version-506981 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.76.2
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-506981 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0603 14:05:52.408569 1131020 ssh_runner.go:195] Run: sudo crictl info
I0603 14:05:52.458110 1131020 cni.go:84] Creating CNI manager for ""
I0603 14:05:52.458133 1131020 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0603 14:05:52.458145 1131020 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0603 14:05:52.458165 1131020 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.76.2 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-506981 NodeName:old-k8s-version-506981 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.76.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.76.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt
StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0603 14:05:52.458298 1131020 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.76.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /run/containerd/containerd.sock
name: "old-k8s-version-506981"
kubeletExtraArgs:
node-ip: 192.168.76.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.76.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0603 14:05:52.458375 1131020 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0603 14:05:52.467547 1131020 binaries.go:44] Found k8s binaries, skipping transfer
I0603 14:05:52.467672 1131020 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0603 14:05:52.476458 1131020 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (442 bytes)
I0603 14:05:52.494113 1131020 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0603 14:05:52.511742 1131020 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2125 bytes)
I0603 14:05:52.529581 1131020 ssh_runner.go:195] Run: grep 192.168.76.2 control-plane.minikube.internal$ /etc/hosts
I0603 14:05:52.533126 1131020 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.76.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0603 14:05:52.543289 1131020 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0603 14:05:52.635727 1131020 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0603 14:05:52.651513 1131020 certs.go:68] Setting up /home/jenkins/minikube-integration/19011-937109/.minikube/profiles/old-k8s-version-506981 for IP: 192.168.76.2
I0603 14:05:52.651536 1131020 certs.go:194] generating shared ca certs ...
I0603 14:05:52.651552 1131020 certs.go:226] acquiring lock for ca certs: {Name:mk853fcff69eaf29efad8518a57890a4039a3963 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0603 14:05:52.651695 1131020 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19011-937109/.minikube/ca.key
I0603 14:05:52.651782 1131020 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19011-937109/.minikube/proxy-client-ca.key
I0603 14:05:52.651799 1131020 certs.go:256] generating profile certs ...
I0603 14:05:52.651892 1131020 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/19011-937109/.minikube/profiles/old-k8s-version-506981/client.key
I0603 14:05:52.651958 1131020 certs.go:359] skipping valid signed profile cert regeneration for "minikube": /home/jenkins/minikube-integration/19011-937109/.minikube/profiles/old-k8s-version-506981/apiserver.key.049c4b3e
I0603 14:05:52.652005 1131020 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/19011-937109/.minikube/profiles/old-k8s-version-506981/proxy-client.key
I0603 14:05:52.652127 1131020 certs.go:484] found cert: /home/jenkins/minikube-integration/19011-937109/.minikube/certs/942541.pem (1338 bytes)
W0603 14:05:52.652164 1131020 certs.go:480] ignoring /home/jenkins/minikube-integration/19011-937109/.minikube/certs/942541_empty.pem, impossibly tiny 0 bytes
I0603 14:05:52.652177 1131020 certs.go:484] found cert: /home/jenkins/minikube-integration/19011-937109/.minikube/certs/ca-key.pem (1679 bytes)
I0603 14:05:52.652206 1131020 certs.go:484] found cert: /home/jenkins/minikube-integration/19011-937109/.minikube/certs/ca.pem (1082 bytes)
I0603 14:05:52.652233 1131020 certs.go:484] found cert: /home/jenkins/minikube-integration/19011-937109/.minikube/certs/cert.pem (1123 bytes)
I0603 14:05:52.652258 1131020 certs.go:484] found cert: /home/jenkins/minikube-integration/19011-937109/.minikube/certs/key.pem (1675 bytes)
I0603 14:05:52.652308 1131020 certs.go:484] found cert: /home/jenkins/minikube-integration/19011-937109/.minikube/files/etc/ssl/certs/9425412.pem (1708 bytes)
I0603 14:05:52.652975 1131020 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19011-937109/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0603 14:05:52.680459 1131020 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19011-937109/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0603 14:05:52.707219 1131020 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19011-937109/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0603 14:05:52.734115 1131020 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19011-937109/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0603 14:05:52.772580 1131020 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19011-937109/.minikube/profiles/old-k8s-version-506981/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0603 14:05:52.838141 1131020 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19011-937109/.minikube/profiles/old-k8s-version-506981/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0603 14:05:52.873939 1131020 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19011-937109/.minikube/profiles/old-k8s-version-506981/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0603 14:05:52.907733 1131020 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19011-937109/.minikube/profiles/old-k8s-version-506981/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0603 14:05:52.939047 1131020 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19011-937109/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0603 14:05:52.970490 1131020 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19011-937109/.minikube/certs/942541.pem --> /usr/share/ca-certificates/942541.pem (1338 bytes)
I0603 14:05:53.017776 1131020 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19011-937109/.minikube/files/etc/ssl/certs/9425412.pem --> /usr/share/ca-certificates/9425412.pem (1708 bytes)
I0603 14:05:53.050878 1131020 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0603 14:05:53.075467 1131020 ssh_runner.go:195] Run: openssl version
I0603 14:05:53.084510 1131020 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/942541.pem && ln -fs /usr/share/ca-certificates/942541.pem /etc/ssl/certs/942541.pem"
I0603 14:05:53.106232 1131020 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/942541.pem
I0603 14:05:53.109974 1131020 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Jun 3 13:27 /usr/share/ca-certificates/942541.pem
I0603 14:05:53.110038 1131020 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/942541.pem
I0603 14:05:53.119233 1131020 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/942541.pem /etc/ssl/certs/51391683.0"
I0603 14:05:53.129386 1131020 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/9425412.pem && ln -fs /usr/share/ca-certificates/9425412.pem /etc/ssl/certs/9425412.pem"
I0603 14:05:53.143351 1131020 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/9425412.pem
I0603 14:05:53.149007 1131020 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Jun 3 13:27 /usr/share/ca-certificates/9425412.pem
I0603 14:05:53.149092 1131020 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/9425412.pem
I0603 14:05:53.156463 1131020 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/9425412.pem /etc/ssl/certs/3ec20f2e.0"
I0603 14:05:53.171224 1131020 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0603 14:05:53.182000 1131020 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0603 14:05:53.187831 1131020 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Jun 3 13:20 /usr/share/ca-certificates/minikubeCA.pem
I0603 14:05:53.187897 1131020 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0603 14:05:53.198789 1131020 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0603 14:05:53.212660 1131020 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0603 14:05:53.218910 1131020 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
I0603 14:05:53.228087 1131020 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
I0603 14:05:53.238808 1131020 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
I0603 14:05:53.246570 1131020 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
I0603 14:05:53.255487 1131020 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
I0603 14:05:53.265491 1131020 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
I0603 14:05:53.274264 1131020 kubeadm.go:391] StartCluster: {Name:old-k8s-version-506981 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1716228441-18934@sha256:628b3f20803bc9c4302fd048087dd36cf2ff5dc9ab0ded395ec3288e2f1d0862 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-506981 Namespace:default APIServerHAVIP: APIServerName:minikube
CA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/hom
e/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0603 14:05:53.274446 1131020 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}
I0603 14:05:53.274536 1131020 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0603 14:05:53.328349 1131020 cri.go:89] found id: "78417eb766571e7487e28529180fd77f26d392a1ec4ea84a0f96fa78802948f6"
I0603 14:05:53.328430 1131020 cri.go:89] found id: "4877d09126aeced75668eb5084bd53add55bad2951822ef405a630af926cc099"
I0603 14:05:53.328451 1131020 cri.go:89] found id: "10016e00b20520484fc4df91882cc82f15109ad52a010f1c5b2731bd95c8024b"
I0603 14:05:53.328472 1131020 cri.go:89] found id: "6968f3f519bf8570d57156dc04ffb2b134f1771b089603deba6699b0da257329"
I0603 14:05:53.328501 1131020 cri.go:89] found id: "cff98b34e012670591f72e264bf28d021c645781e259a312066f3e8805f4afa6"
I0603 14:05:53.328523 1131020 cri.go:89] found id: "2812f3850287e9bd217797c7ff1ce588b53328c6abfa79f815865c965abed8c9"
I0603 14:05:53.328542 1131020 cri.go:89] found id: "f6edc129f54e8676287bbd7aee0210985585277489be4a27610b67d25024944e"
I0603 14:05:53.328562 1131020 cri.go:89] found id: "f95eb4638c61f9ec72d05ad64afd52ecbf878475d2abbe9148bc9cc5d92eae15"
I0603 14:05:53.328590 1131020 cri.go:89] found id: ""
I0603 14:05:53.328676 1131020 ssh_runner.go:195] Run: sudo runc --root /run/containerd/runc/k8s.io list -f json
I0603 14:05:53.347418 1131020 cri.go:116] JSON = null
W0603 14:05:53.347517 1131020 kubeadm.go:398] unpause failed: list paused: list returned 0 containers, but ps returned 8
I0603 14:05:53.347610 1131020 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
W0603 14:05:53.360439 1131020 kubeadm.go:404] apiserver tunnel failed: apiserver port not set
I0603 14:05:53.360513 1131020 kubeadm.go:407] found existing configuration files, will attempt cluster restart
I0603 14:05:53.360533 1131020 kubeadm.go:587] restartPrimaryControlPlane start ...
I0603 14:05:53.360619 1131020 ssh_runner.go:195] Run: sudo test -d /data/minikube
I0603 14:05:53.373042 1131020 kubeadm.go:129] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
stdout:
stderr:
I0603 14:05:53.373600 1131020 kubeconfig.go:47] verify endpoint returned: get endpoint: "old-k8s-version-506981" does not appear in /home/jenkins/minikube-integration/19011-937109/kubeconfig
I0603 14:05:53.373771 1131020 kubeconfig.go:62] /home/jenkins/minikube-integration/19011-937109/kubeconfig needs updating (will repair): [kubeconfig missing "old-k8s-version-506981" cluster setting kubeconfig missing "old-k8s-version-506981" context setting]
I0603 14:05:53.374118 1131020 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19011-937109/kubeconfig: {Name:mkb1a7be01b8c5ad5a58ece9e6b724b56a48ef61 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0603 14:05:53.375712 1131020 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
I0603 14:05:53.389020 1131020 kubeadm.go:624] The running cluster does not require reconfiguration: 192.168.76.2
I0603 14:05:53.389101 1131020 kubeadm.go:591] duration metric: took 28.546168ms to restartPrimaryControlPlane
I0603 14:05:53.389125 1131020 kubeadm.go:393] duration metric: took 114.884992ms to StartCluster
I0603 14:05:53.389169 1131020 settings.go:142] acquiring lock: {Name:mk5c6bc6c7308a6240c90a9b822a3ef910155ebf Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0603 14:05:53.389258 1131020 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/19011-937109/kubeconfig
I0603 14:05:53.389964 1131020 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19011-937109/kubeconfig: {Name:mkb1a7be01b8c5ad5a58ece9e6b724b56a48ef61 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0603 14:05:53.390233 1131020 start.go:234] Will wait 6m0s for node &{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}
I0603 14:05:53.390655 1131020 addons.go:507] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:true default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]
I0603 14:05:53.394227 1131020 addons.go:69] Setting storage-provisioner=true in profile "old-k8s-version-506981"
I0603 14:05:53.394266 1131020 addons.go:234] Setting addon storage-provisioner=true in "old-k8s-version-506981"
W0603 14:05:53.394274 1131020 addons.go:243] addon storage-provisioner should already be in state true
I0603 14:05:53.394305 1131020 host.go:66] Checking if "old-k8s-version-506981" exists ...
I0603 14:05:53.394735 1131020 cli_runner.go:164] Run: docker container inspect old-k8s-version-506981 --format={{.State.Status}}
I0603 14:05:53.394901 1131020 out.go:177] * Verifying Kubernetes components...
I0603 14:05:53.397633 1131020 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0603 14:05:53.395152 1131020 addons.go:69] Setting dashboard=true in profile "old-k8s-version-506981"
I0603 14:05:53.397892 1131020 addons.go:234] Setting addon dashboard=true in "old-k8s-version-506981"
W0603 14:05:53.397902 1131020 addons.go:243] addon dashboard should already be in state true
I0603 14:05:53.397936 1131020 host.go:66] Checking if "old-k8s-version-506981" exists ...
I0603 14:05:53.398337 1131020 cli_runner.go:164] Run: docker container inspect old-k8s-version-506981 --format={{.State.Status}}
I0603 14:05:53.390765 1131020 config.go:182] Loaded profile config "old-k8s-version-506981": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0
I0603 14:05:53.395168 1131020 addons.go:69] Setting default-storageclass=true in profile "old-k8s-version-506981"
I0603 14:05:53.398648 1131020 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "old-k8s-version-506981"
I0603 14:05:53.398872 1131020 cli_runner.go:164] Run: docker container inspect old-k8s-version-506981 --format={{.State.Status}}
I0603 14:05:53.395180 1131020 addons.go:69] Setting metrics-server=true in profile "old-k8s-version-506981"
I0603 14:05:53.399276 1131020 addons.go:234] Setting addon metrics-server=true in "old-k8s-version-506981"
W0603 14:05:53.399286 1131020 addons.go:243] addon metrics-server should already be in state true
I0603 14:05:53.399312 1131020 host.go:66] Checking if "old-k8s-version-506981" exists ...
I0603 14:05:53.399684 1131020 cli_runner.go:164] Run: docker container inspect old-k8s-version-506981 --format={{.State.Status}}
I0603 14:05:53.450972 1131020 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0603 14:05:53.454881 1131020 out.go:177] - Using image docker.io/kubernetesui/dashboard:v2.7.0
I0603 14:05:53.454900 1131020 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0603 14:05:53.463051 1131020 out.go:177] - Using image registry.k8s.io/echoserver:1.4
I0603 14:05:53.461372 1131020 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0603 14:05:53.465508 1131020 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-506981
I0603 14:05:53.469653 1131020 addons.go:234] Setting addon default-storageclass=true in "old-k8s-version-506981"
W0603 14:05:53.469669 1131020 addons.go:243] addon default-storageclass should already be in state true
I0603 14:05:53.469694 1131020 host.go:66] Checking if "old-k8s-version-506981" exists ...
I0603 14:05:53.470084 1131020 cli_runner.go:164] Run: docker container inspect old-k8s-version-506981 --format={{.State.Status}}
I0603 14:05:53.472947 1131020 addons.go:431] installing /etc/kubernetes/addons/dashboard-ns.yaml
I0603 14:05:53.472975 1131020 ssh_runner.go:362] scp dashboard/dashboard-ns.yaml --> /etc/kubernetes/addons/dashboard-ns.yaml (759 bytes)
I0603 14:05:53.473035 1131020 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-506981
I0603 14:05:53.483636 1131020 out.go:177] - Using image fake.domain/registry.k8s.io/echoserver:1.4
I0603 14:05:53.485441 1131020 addons.go:431] installing /etc/kubernetes/addons/metrics-apiservice.yaml
I0603 14:05:53.485463 1131020 ssh_runner.go:362] scp metrics-server/metrics-apiservice.yaml --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
I0603 14:05:53.485538 1131020 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-506981
I0603 14:05:53.540925 1131020 addons.go:431] installing /etc/kubernetes/addons/storageclass.yaml
I0603 14:05:53.540946 1131020 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0603 14:05:53.541007 1131020 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-506981
I0603 14:05:53.541238 1131020 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34194 SSHKeyPath:/home/jenkins/minikube-integration/19011-937109/.minikube/machines/old-k8s-version-506981/id_rsa Username:docker}
I0603 14:05:53.571211 1131020 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34194 SSHKeyPath:/home/jenkins/minikube-integration/19011-937109/.minikube/machines/old-k8s-version-506981/id_rsa Username:docker}
I0603 14:05:53.576999 1131020 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34194 SSHKeyPath:/home/jenkins/minikube-integration/19011-937109/.minikube/machines/old-k8s-version-506981/id_rsa Username:docker}
I0603 14:05:53.590287 1131020 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34194 SSHKeyPath:/home/jenkins/minikube-integration/19011-937109/.minikube/machines/old-k8s-version-506981/id_rsa Username:docker}
I0603 14:05:53.642743 1131020 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0603 14:05:53.715395 1131020 node_ready.go:35] waiting up to 6m0s for node "old-k8s-version-506981" to be "Ready" ...
I0603 14:05:53.790181 1131020 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0603 14:05:53.823671 1131020 addons.go:431] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
I0603 14:05:53.823742 1131020 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1825 bytes)
I0603 14:05:53.851370 1131020 addons.go:431] installing /etc/kubernetes/addons/dashboard-clusterrole.yaml
I0603 14:05:53.851441 1131020 ssh_runner.go:362] scp dashboard/dashboard-clusterrole.yaml --> /etc/kubernetes/addons/dashboard-clusterrole.yaml (1001 bytes)
I0603 14:05:53.864577 1131020 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0603 14:05:53.886835 1131020 addons.go:431] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
I0603 14:05:53.886909 1131020 ssh_runner.go:362] scp metrics-server/metrics-server-rbac.yaml --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
I0603 14:05:53.944950 1131020 addons.go:431] installing /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml
I0603 14:05:53.945025 1131020 ssh_runner.go:362] scp dashboard/dashboard-clusterrolebinding.yaml --> /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml (1018 bytes)
I0603 14:05:53.994108 1131020 addons.go:431] installing /etc/kubernetes/addons/metrics-server-service.yaml
I0603 14:05:53.994187 1131020 ssh_runner.go:362] scp metrics-server/metrics-server-service.yaml --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
I0603 14:05:54.024846 1131020 addons.go:431] installing /etc/kubernetes/addons/dashboard-configmap.yaml
I0603 14:05:54.024924 1131020 ssh_runner.go:362] scp dashboard/dashboard-configmap.yaml --> /etc/kubernetes/addons/dashboard-configmap.yaml (837 bytes)
I0603 14:05:54.114370 1131020 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0603 14:05:54.155356 1131020 addons.go:431] installing /etc/kubernetes/addons/dashboard-dp.yaml
I0603 14:05:54.155429 1131020 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-dp.yaml (4201 bytes)
W0603 14:05:54.183165 1131020 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0603 14:05:54.183253 1131020 retry.go:31] will retry after 302.841913ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0603 14:05:54.219469 1131020 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0603 14:05:54.219497 1131020 retry.go:31] will retry after 218.824422ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0603 14:05:54.246810 1131020 addons.go:431] installing /etc/kubernetes/addons/dashboard-role.yaml
I0603 14:05:54.246834 1131020 ssh_runner.go:362] scp dashboard/dashboard-role.yaml --> /etc/kubernetes/addons/dashboard-role.yaml (1724 bytes)
I0603 14:05:54.307703 1131020 addons.go:431] installing /etc/kubernetes/addons/dashboard-rolebinding.yaml
I0603 14:05:54.307725 1131020 ssh_runner.go:362] scp dashboard/dashboard-rolebinding.yaml --> /etc/kubernetes/addons/dashboard-rolebinding.yaml (1046 bytes)
I0603 14:05:54.343930 1131020 addons.go:431] installing /etc/kubernetes/addons/dashboard-sa.yaml
I0603 14:05:54.343959 1131020 ssh_runner.go:362] scp dashboard/dashboard-sa.yaml --> /etc/kubernetes/addons/dashboard-sa.yaml (837 bytes)
W0603 14:05:54.352987 1131020 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0603 14:05:54.353016 1131020 retry.go:31] will retry after 134.144035ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0603 14:05:54.380132 1131020 addons.go:431] installing /etc/kubernetes/addons/dashboard-secret.yaml
I0603 14:05:54.380202 1131020 ssh_runner.go:362] scp dashboard/dashboard-secret.yaml --> /etc/kubernetes/addons/dashboard-secret.yaml (1389 bytes)
I0603 14:05:54.411380 1131020 addons.go:431] installing /etc/kubernetes/addons/dashboard-svc.yaml
I0603 14:05:54.411453 1131020 ssh_runner.go:362] scp dashboard/dashboard-svc.yaml --> /etc/kubernetes/addons/dashboard-svc.yaml (1294 bytes)
I0603 14:05:54.439356 1131020 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0603 14:05:54.439520 1131020 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I0603 14:05:54.486593 1131020 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I0603 14:05:54.487861 1131020 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0603 14:05:54.742981 1131020 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0603 14:05:54.743058 1131020 retry.go:31] will retry after 405.853206ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0603 14:05:54.743133 1131020 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0603 14:05:54.743161 1131020 retry.go:31] will retry after 196.43224ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0603 14:05:54.832992 1131020 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0603 14:05:54.833072 1131020 retry.go:31] will retry after 305.625612ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0603 14:05:54.839251 1131020 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0603 14:05:54.839331 1131020 retry.go:31] will retry after 236.040624ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0603 14:05:54.940654 1131020 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0603 14:05:55.068214 1131020 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0603 14:05:55.068331 1131020 retry.go:31] will retry after 509.268076ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0603 14:05:55.076475 1131020 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0603 14:05:55.139867 1131020 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I0603 14:05:55.149272 1131020 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0603 14:05:55.291873 1131020 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0603 14:05:55.291959 1131020 retry.go:31] will retry after 348.559289ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0603 14:05:55.382129 1131020 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0603 14:05:55.382210 1131020 retry.go:31] will retry after 730.425363ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0603 14:05:55.401964 1131020 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0603 14:05:55.402044 1131020 retry.go:31] will retry after 697.116893ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0603 14:05:55.578407 1131020 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0603 14:05:55.640852 1131020 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0603 14:05:55.716262 1131020 node_ready.go:53] error getting node "old-k8s-version-506981": Get "https://192.168.76.2:8443/api/v1/nodes/old-k8s-version-506981": dial tcp 192.168.76.2:8443: connect: connection refused
W0603 14:05:55.758208 1131020 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0603 14:05:55.758284 1131020 retry.go:31] will retry after 622.569075ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0603 14:05:55.825344 1131020 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0603 14:05:55.825379 1131020 retry.go:31] will retry after 700.582768ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0603 14:05:56.099810 1131020 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I0603 14:05:56.113085 1131020 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0603 14:05:56.310207 1131020 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0603 14:05:56.310280 1131020 retry.go:31] will retry after 689.447761ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0603 14:05:56.310354 1131020 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0603 14:05:56.310382 1131020 retry.go:31] will retry after 1.145651872s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0603 14:05:56.381694 1131020 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0603 14:05:56.509804 1131020 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0603 14:05:56.509889 1131020 retry.go:31] will retry after 448.703622ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0603 14:05:56.527116 1131020 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0603 14:05:56.661063 1131020 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0603 14:05:56.661148 1131020 retry.go:31] will retry after 1.169527435s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0603 14:05:56.959110 1131020 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0603 14:05:57.000584 1131020 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0603 14:05:57.131233 1131020 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0603 14:05:57.131335 1131020 retry.go:31] will retry after 1.461698846s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0603 14:05:57.196878 1131020 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0603 14:05:57.196905 1131020 retry.go:31] will retry after 916.876722ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0603 14:05:57.457032 1131020 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0603 14:05:57.599279 1131020 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0603 14:05:57.599308 1131020 retry.go:31] will retry after 943.307977ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0603 14:05:57.831299 1131020 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0603 14:05:57.953431 1131020 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0603 14:05:57.953459 1131020 retry.go:31] will retry after 2.170108038s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0603 14:05:58.114828 1131020 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I0603 14:05:58.216473 1131020 node_ready.go:53] error getting node "old-k8s-version-506981": Get "https://192.168.76.2:8443/api/v1/nodes/old-k8s-version-506981": dial tcp 192.168.76.2:8443: connect: connection refused
W0603 14:05:58.259206 1131020 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0603 14:05:58.259249 1131020 retry.go:31] will retry after 2.448595947s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0603 14:05:58.543800 1131020 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I0603 14:05:58.593203 1131020 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0603 14:05:58.701387 1131020 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0603 14:05:58.701428 1131020 retry.go:31] will retry after 1.037749175s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0603 14:05:58.767078 1131020 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0603 14:05:58.767109 1131020 retry.go:31] will retry after 2.428667987s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0603 14:05:59.739970 1131020 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0603 14:05:59.841216 1131020 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0603 14:05:59.841248 1131020 retry.go:31] will retry after 2.910478547s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0603 14:06:00.123758 1131020 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0603 14:06:00.305117 1131020 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0603 14:06:00.305161 1131020 retry.go:31] will retry after 1.537991983s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0603 14:06:00.708809 1131020 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I0603 14:06:00.716365 1131020 node_ready.go:53] error getting node "old-k8s-version-506981": Get "https://192.168.76.2:8443/api/v1/nodes/old-k8s-version-506981": dial tcp 192.168.76.2:8443: connect: connection refused
W0603 14:06:00.789119 1131020 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0603 14:06:00.789213 1131020 retry.go:31] will retry after 2.596655293s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0603 14:06:01.196632 1131020 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0603 14:06:01.356934 1131020 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0603 14:06:01.356962 1131020 retry.go:31] will retry after 1.479856685s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0603 14:06:01.844146 1131020 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0603 14:06:02.214735 1131020 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0603 14:06:02.214772 1131020 retry.go:31] will retry after 4.049680301s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0603 14:06:02.752105 1131020 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I0603 14:06:02.837485 1131020 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0603 14:06:03.386632 1131020 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I0603 14:06:06.265571 1131020 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0603 14:06:10.204193 1131020 node_ready.go:49] node "old-k8s-version-506981" has status "Ready":"True"
I0603 14:06:10.204233 1131020 node_ready.go:38] duration metric: took 16.48879868s for node "old-k8s-version-506981" to be "Ready" ...
I0603 14:06:10.204243 1131020 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0603 14:06:10.413429 1131020 pod_ready.go:78] waiting up to 6m0s for pod "coredns-74ff55c5b-vqfdz" in "kube-system" namespace to be "Ready" ...
I0603 14:06:10.521587 1131020 pod_ready.go:92] pod "coredns-74ff55c5b-vqfdz" in "kube-system" namespace has status "Ready":"True"
I0603 14:06:10.521623 1131020 pod_ready.go:81] duration metric: took 108.159667ms for pod "coredns-74ff55c5b-vqfdz" in "kube-system" namespace to be "Ready" ...
I0603 14:06:10.521635 1131020 pod_ready.go:78] waiting up to 6m0s for pod "etcd-old-k8s-version-506981" in "kube-system" namespace to be "Ready" ...
I0603 14:06:10.549542 1131020 pod_ready.go:92] pod "etcd-old-k8s-version-506981" in "kube-system" namespace has status "Ready":"True"
I0603 14:06:10.549573 1131020 pod_ready.go:81] duration metric: took 27.929549ms for pod "etcd-old-k8s-version-506981" in "kube-system" namespace to be "Ready" ...
I0603 14:06:10.549588 1131020 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-old-k8s-version-506981" in "kube-system" namespace to be "Ready" ...
I0603 14:06:12.091355 1131020 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: (9.339153713s)
I0603 14:06:12.353361 1131020 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: (9.51582344s)
I0603 14:06:12.355255 1131020 out.go:177] * Some dashboard features require the metrics-server addon. To enable all features please run:
minikube -p old-k8s-version-506981 addons enable metrics-server
I0603 14:06:12.353561 1131020 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: (8.966899423s)
I0603 14:06:12.353627 1131020 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (6.088026927s)
I0603 14:06:12.356890 1131020 addons.go:475] Verifying addon metrics-server=true in "old-k8s-version-506981"
I0603 14:06:12.369234 1131020 out.go:177] * Enabled addons: storage-provisioner, metrics-server, dashboard, default-storageclass
I0603 14:06:12.370863 1131020 addons.go:510] duration metric: took 18.980200648s for enable addons: enabled=[storage-provisioner metrics-server dashboard default-storageclass]
I0603 14:06:12.566189 1131020 pod_ready.go:102] pod "kube-apiserver-old-k8s-version-506981" in "kube-system" namespace has status "Ready":"False"
I0603 14:06:15.072284 1131020 pod_ready.go:102] pod "kube-apiserver-old-k8s-version-506981" in "kube-system" namespace has status "Ready":"False"
I0603 14:06:17.556473 1131020 pod_ready.go:102] pod "kube-apiserver-old-k8s-version-506981" in "kube-system" namespace has status "Ready":"False"
I0603 14:06:19.555420 1131020 pod_ready.go:92] pod "kube-apiserver-old-k8s-version-506981" in "kube-system" namespace has status "Ready":"True"
I0603 14:06:19.555448 1131020 pod_ready.go:81] duration metric: took 9.005851557s for pod "kube-apiserver-old-k8s-version-506981" in "kube-system" namespace to be "Ready" ...
I0603 14:06:19.555460 1131020 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-old-k8s-version-506981" in "kube-system" namespace to be "Ready" ...
I0603 14:06:21.562620 1131020 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-506981" in "kube-system" namespace has status "Ready":"False"
I0603 14:06:24.063608 1131020 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-506981" in "kube-system" namespace has status "Ready":"False"
I0603 14:06:26.562685 1131020 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-506981" in "kube-system" namespace has status "Ready":"False"
I0603 14:06:28.563051 1131020 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-506981" in "kube-system" namespace has status "Ready":"False"
I0603 14:06:30.565478 1131020 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-506981" in "kube-system" namespace has status "Ready":"False"
I0603 14:06:33.067094 1131020 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-506981" in "kube-system" namespace has status "Ready":"False"
I0603 14:06:35.562810 1131020 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-506981" in "kube-system" namespace has status "Ready":"False"
I0603 14:06:37.563246 1131020 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-506981" in "kube-system" namespace has status "Ready":"False"
I0603 14:06:40.085263 1131020 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-506981" in "kube-system" namespace has status "Ready":"False"
I0603 14:06:42.561635 1131020 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-506981" in "kube-system" namespace has status "Ready":"False"
I0603 14:06:44.562504 1131020 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-506981" in "kube-system" namespace has status "Ready":"False"
I0603 14:06:47.062237 1131020 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-506981" in "kube-system" namespace has status "Ready":"False"
I0603 14:06:49.062447 1131020 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-506981" in "kube-system" namespace has status "Ready":"False"
I0603 14:06:51.062920 1131020 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-506981" in "kube-system" namespace has status "Ready":"False"
I0603 14:06:53.561642 1131020 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-506981" in "kube-system" namespace has status "Ready":"False"
I0603 14:06:55.577674 1131020 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-506981" in "kube-system" namespace has status "Ready":"False"
I0603 14:06:58.062283 1131020 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-506981" in "kube-system" namespace has status "Ready":"False"
I0603 14:07:00.075104 1131020 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-506981" in "kube-system" namespace has status "Ready":"False"
I0603 14:07:02.573491 1131020 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-506981" in "kube-system" namespace has status "Ready":"False"
I0603 14:07:05.063244 1131020 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-506981" in "kube-system" namespace has status "Ready":"False"
I0603 14:07:07.563299 1131020 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-506981" in "kube-system" namespace has status "Ready":"False"
I0603 14:07:09.563391 1131020 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-506981" in "kube-system" namespace has status "Ready":"False"
I0603 14:07:11.563564 1131020 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-506981" in "kube-system" namespace has status "Ready":"False"
I0603 14:07:14.062627 1131020 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-506981" in "kube-system" namespace has status "Ready":"False"
I0603 14:07:16.562103 1131020 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-506981" in "kube-system" namespace has status "Ready":"False"
I0603 14:07:19.063292 1131020 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-506981" in "kube-system" namespace has status "Ready":"False"
I0603 14:07:21.063449 1131020 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-506981" in "kube-system" namespace has status "Ready":"False"
I0603 14:07:23.563062 1131020 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-506981" in "kube-system" namespace has status "Ready":"False"
I0603 14:07:25.564216 1131020 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-506981" in "kube-system" namespace has status "Ready":"False"
I0603 14:07:28.061466 1131020 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-506981" in "kube-system" namespace has status "Ready":"False"
I0603 14:07:30.063361 1131020 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-506981" in "kube-system" namespace has status "Ready":"False"
I0603 14:07:32.566981 1131020 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-506981" in "kube-system" namespace has status "Ready":"False"
I0603 14:07:35.062254 1131020 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-506981" in "kube-system" namespace has status "Ready":"False"
I0603 14:07:37.562498 1131020 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-506981" in "kube-system" namespace has status "Ready":"False"
I0603 14:07:38.561813 1131020 pod_ready.go:92] pod "kube-controller-manager-old-k8s-version-506981" in "kube-system" namespace has status "Ready":"True"
I0603 14:07:38.561838 1131020 pod_ready.go:81] duration metric: took 1m19.00637049s for pod "kube-controller-manager-old-k8s-version-506981" in "kube-system" namespace to be "Ready" ...
I0603 14:07:38.561850 1131020 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-bxzwt" in "kube-system" namespace to be "Ready" ...
I0603 14:07:38.566435 1131020 pod_ready.go:92] pod "kube-proxy-bxzwt" in "kube-system" namespace has status "Ready":"True"
I0603 14:07:38.566462 1131020 pod_ready.go:81] duration metric: took 4.604603ms for pod "kube-proxy-bxzwt" in "kube-system" namespace to be "Ready" ...
I0603 14:07:38.566473 1131020 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-old-k8s-version-506981" in "kube-system" namespace to be "Ready" ...
I0603 14:07:38.570916 1131020 pod_ready.go:92] pod "kube-scheduler-old-k8s-version-506981" in "kube-system" namespace has status "Ready":"True"
I0603 14:07:38.570943 1131020 pod_ready.go:81] duration metric: took 4.461747ms for pod "kube-scheduler-old-k8s-version-506981" in "kube-system" namespace to be "Ready" ...
I0603 14:07:38.570954 1131020 pod_ready.go:78] waiting up to 6m0s for pod "metrics-server-9975d5f86-crpj5" in "kube-system" namespace to be "Ready" ...
I0603 14:07:40.629033 1131020 pod_ready.go:102] pod "metrics-server-9975d5f86-crpj5" in "kube-system" namespace has status "Ready":"False"
I0603 14:07:43.077367 1131020 pod_ready.go:102] pod "metrics-server-9975d5f86-crpj5" in "kube-system" namespace has status "Ready":"False"
I0603 14:07:45.078563 1131020 pod_ready.go:102] pod "metrics-server-9975d5f86-crpj5" in "kube-system" namespace has status "Ready":"False"
I0603 14:07:47.582934 1131020 pod_ready.go:102] pod "metrics-server-9975d5f86-crpj5" in "kube-system" namespace has status "Ready":"False"
I0603 14:07:50.078008 1131020 pod_ready.go:102] pod "metrics-server-9975d5f86-crpj5" in "kube-system" namespace has status "Ready":"False"
I0603 14:07:52.078114 1131020 pod_ready.go:102] pod "metrics-server-9975d5f86-crpj5" in "kube-system" namespace has status "Ready":"False"
I0603 14:07:54.576845 1131020 pod_ready.go:102] pod "metrics-server-9975d5f86-crpj5" in "kube-system" namespace has status "Ready":"False"
I0603 14:07:56.577964 1131020 pod_ready.go:102] pod "metrics-server-9975d5f86-crpj5" in "kube-system" namespace has status "Ready":"False"
I0603 14:07:59.078352 1131020 pod_ready.go:102] pod "metrics-server-9975d5f86-crpj5" in "kube-system" namespace has status "Ready":"False"
I0603 14:08:01.577587 1131020 pod_ready.go:102] pod "metrics-server-9975d5f86-crpj5" in "kube-system" namespace has status "Ready":"False"
I0603 14:08:03.578085 1131020 pod_ready.go:102] pod "metrics-server-9975d5f86-crpj5" in "kube-system" namespace has status "Ready":"False"
I0603 14:08:06.077224 1131020 pod_ready.go:102] pod "metrics-server-9975d5f86-crpj5" in "kube-system" namespace has status "Ready":"False"
I0603 14:08:08.077944 1131020 pod_ready.go:102] pod "metrics-server-9975d5f86-crpj5" in "kube-system" namespace has status "Ready":"False"
I0603 14:08:10.078470 1131020 pod_ready.go:102] pod "metrics-server-9975d5f86-crpj5" in "kube-system" namespace has status "Ready":"False"
I0603 14:08:12.078601 1131020 pod_ready.go:102] pod "metrics-server-9975d5f86-crpj5" in "kube-system" namespace has status "Ready":"False"
I0603 14:08:14.576948 1131020 pod_ready.go:102] pod "metrics-server-9975d5f86-crpj5" in "kube-system" namespace has status "Ready":"False"
I0603 14:08:16.577661 1131020 pod_ready.go:102] pod "metrics-server-9975d5f86-crpj5" in "kube-system" namespace has status "Ready":"False"
I0603 14:08:19.076873 1131020 pod_ready.go:102] pod "metrics-server-9975d5f86-crpj5" in "kube-system" namespace has status "Ready":"False"
I0603 14:08:21.077315 1131020 pod_ready.go:102] pod "metrics-server-9975d5f86-crpj5" in "kube-system" namespace has status "Ready":"False"
I0603 14:08:23.077744 1131020 pod_ready.go:102] pod "metrics-server-9975d5f86-crpj5" in "kube-system" namespace has status "Ready":"False"
I0603 14:08:25.078272 1131020 pod_ready.go:102] pod "metrics-server-9975d5f86-crpj5" in "kube-system" namespace has status "Ready":"False"
I0603 14:08:27.576772 1131020 pod_ready.go:102] pod "metrics-server-9975d5f86-crpj5" in "kube-system" namespace has status "Ready":"False"
I0603 14:08:29.576809 1131020 pod_ready.go:102] pod "metrics-server-9975d5f86-crpj5" in "kube-system" namespace has status "Ready":"False"
I0603 14:08:31.577065 1131020 pod_ready.go:102] pod "metrics-server-9975d5f86-crpj5" in "kube-system" namespace has status "Ready":"False"
I0603 14:08:33.577463 1131020 pod_ready.go:102] pod "metrics-server-9975d5f86-crpj5" in "kube-system" namespace has status "Ready":"False"
I0603 14:08:35.578006 1131020 pod_ready.go:102] pod "metrics-server-9975d5f86-crpj5" in "kube-system" namespace has status "Ready":"False"
I0603 14:08:38.078162 1131020 pod_ready.go:102] pod "metrics-server-9975d5f86-crpj5" in "kube-system" namespace has status "Ready":"False"
I0603 14:08:40.078606 1131020 pod_ready.go:102] pod "metrics-server-9975d5f86-crpj5" in "kube-system" namespace has status "Ready":"False"
I0603 14:08:42.578247 1131020 pod_ready.go:102] pod "metrics-server-9975d5f86-crpj5" in "kube-system" namespace has status "Ready":"False"
I0603 14:08:45.078292 1131020 pod_ready.go:102] pod "metrics-server-9975d5f86-crpj5" in "kube-system" namespace has status "Ready":"False"
I0603 14:08:47.577691 1131020 pod_ready.go:102] pod "metrics-server-9975d5f86-crpj5" in "kube-system" namespace has status "Ready":"False"
I0603 14:08:49.577997 1131020 pod_ready.go:102] pod "metrics-server-9975d5f86-crpj5" in "kube-system" namespace has status "Ready":"False"
I0603 14:08:52.077191 1131020 pod_ready.go:102] pod "metrics-server-9975d5f86-crpj5" in "kube-system" namespace has status "Ready":"False"
I0603 14:08:54.078368 1131020 pod_ready.go:102] pod "metrics-server-9975d5f86-crpj5" in "kube-system" namespace has status "Ready":"False"
I0603 14:08:56.577753 1131020 pod_ready.go:102] pod "metrics-server-9975d5f86-crpj5" in "kube-system" namespace has status "Ready":"False"
I0603 14:08:59.077944 1131020 pod_ready.go:102] pod "metrics-server-9975d5f86-crpj5" in "kube-system" namespace has status "Ready":"False"
I0603 14:09:01.585717 1131020 pod_ready.go:102] pod "metrics-server-9975d5f86-crpj5" in "kube-system" namespace has status "Ready":"False"
I0603 14:09:04.079076 1131020 pod_ready.go:102] pod "metrics-server-9975d5f86-crpj5" in "kube-system" namespace has status "Ready":"False"
I0603 14:09:06.578248 1131020 pod_ready.go:102] pod "metrics-server-9975d5f86-crpj5" in "kube-system" namespace has status "Ready":"False"
I0603 14:09:09.083150 1131020 pod_ready.go:102] pod "metrics-server-9975d5f86-crpj5" in "kube-system" namespace has status "Ready":"False"
I0603 14:09:11.577004 1131020 pod_ready.go:102] pod "metrics-server-9975d5f86-crpj5" in "kube-system" namespace has status "Ready":"False"
I0603 14:09:13.577268 1131020 pod_ready.go:102] pod "metrics-server-9975d5f86-crpj5" in "kube-system" namespace has status "Ready":"False"
I0603 14:09:15.577546 1131020 pod_ready.go:102] pod "metrics-server-9975d5f86-crpj5" in "kube-system" namespace has status "Ready":"False"
I0603 14:09:18.077238 1131020 pod_ready.go:102] pod "metrics-server-9975d5f86-crpj5" in "kube-system" namespace has status "Ready":"False"
I0603 14:09:20.079883 1131020 pod_ready.go:102] pod "metrics-server-9975d5f86-crpj5" in "kube-system" namespace has status "Ready":"False"
I0603 14:09:22.577812 1131020 pod_ready.go:102] pod "metrics-server-9975d5f86-crpj5" in "kube-system" namespace has status "Ready":"False"
I0603 14:09:25.077759 1131020 pod_ready.go:102] pod "metrics-server-9975d5f86-crpj5" in "kube-system" namespace has status "Ready":"False"
I0603 14:09:27.078222 1131020 pod_ready.go:102] pod "metrics-server-9975d5f86-crpj5" in "kube-system" namespace has status "Ready":"False"
I0603 14:09:29.576741 1131020 pod_ready.go:102] pod "metrics-server-9975d5f86-crpj5" in "kube-system" namespace has status "Ready":"False"
I0603 14:09:31.577789 1131020 pod_ready.go:102] pod "metrics-server-9975d5f86-crpj5" in "kube-system" namespace has status "Ready":"False"
I0603 14:09:34.077110 1131020 pod_ready.go:102] pod "metrics-server-9975d5f86-crpj5" in "kube-system" namespace has status "Ready":"False"
I0603 14:09:36.078228 1131020 pod_ready.go:102] pod "metrics-server-9975d5f86-crpj5" in "kube-system" namespace has status "Ready":"False"
I0603 14:09:38.576637 1131020 pod_ready.go:102] pod "metrics-server-9975d5f86-crpj5" in "kube-system" namespace has status "Ready":"False"
I0603 14:09:40.576957 1131020 pod_ready.go:102] pod "metrics-server-9975d5f86-crpj5" in "kube-system" namespace has status "Ready":"False"
I0603 14:09:43.076673 1131020 pod_ready.go:102] pod "metrics-server-9975d5f86-crpj5" in "kube-system" namespace has status "Ready":"False"
I0603 14:09:45.077904 1131020 pod_ready.go:102] pod "metrics-server-9975d5f86-crpj5" in "kube-system" namespace has status "Ready":"False"
I0603 14:09:47.577577 1131020 pod_ready.go:102] pod "metrics-server-9975d5f86-crpj5" in "kube-system" namespace has status "Ready":"False"
I0603 14:09:50.077182 1131020 pod_ready.go:102] pod "metrics-server-9975d5f86-crpj5" in "kube-system" namespace has status "Ready":"False"
I0603 14:09:52.077593 1131020 pod_ready.go:102] pod "metrics-server-9975d5f86-crpj5" in "kube-system" namespace has status "Ready":"False"
I0603 14:09:54.077759 1131020 pod_ready.go:102] pod "metrics-server-9975d5f86-crpj5" in "kube-system" namespace has status "Ready":"False"
I0603 14:09:56.577345 1131020 pod_ready.go:102] pod "metrics-server-9975d5f86-crpj5" in "kube-system" namespace has status "Ready":"False"
I0603 14:09:59.077316 1131020 pod_ready.go:102] pod "metrics-server-9975d5f86-crpj5" in "kube-system" namespace has status "Ready":"False"
I0603 14:10:01.077664 1131020 pod_ready.go:102] pod "metrics-server-9975d5f86-crpj5" in "kube-system" namespace has status "Ready":"False"
I0603 14:10:03.077772 1131020 pod_ready.go:102] pod "metrics-server-9975d5f86-crpj5" in "kube-system" namespace has status "Ready":"False"
I0603 14:10:05.079125 1131020 pod_ready.go:102] pod "metrics-server-9975d5f86-crpj5" in "kube-system" namespace has status "Ready":"False"
I0603 14:10:07.577474 1131020 pod_ready.go:102] pod "metrics-server-9975d5f86-crpj5" in "kube-system" namespace has status "Ready":"False"
I0603 14:10:09.585820 1131020 pod_ready.go:102] pod "metrics-server-9975d5f86-crpj5" in "kube-system" namespace has status "Ready":"False"
I0603 14:10:12.077789 1131020 pod_ready.go:102] pod "metrics-server-9975d5f86-crpj5" in "kube-system" namespace has status "Ready":"False"
I0603 14:10:14.578993 1131020 pod_ready.go:102] pod "metrics-server-9975d5f86-crpj5" in "kube-system" namespace has status "Ready":"False"
I0603 14:10:17.076342 1131020 pod_ready.go:102] pod "metrics-server-9975d5f86-crpj5" in "kube-system" namespace has status "Ready":"False"
I0603 14:10:19.076795 1131020 pod_ready.go:102] pod "metrics-server-9975d5f86-crpj5" in "kube-system" namespace has status "Ready":"False"
I0603 14:10:21.076844 1131020 pod_ready.go:102] pod "metrics-server-9975d5f86-crpj5" in "kube-system" namespace has status "Ready":"False"
I0603 14:10:23.577420 1131020 pod_ready.go:102] pod "metrics-server-9975d5f86-crpj5" in "kube-system" namespace has status "Ready":"False"
I0603 14:10:25.577760 1131020 pod_ready.go:102] pod "metrics-server-9975d5f86-crpj5" in "kube-system" namespace has status "Ready":"False"
I0603 14:10:28.077566 1131020 pod_ready.go:102] pod "metrics-server-9975d5f86-crpj5" in "kube-system" namespace has status "Ready":"False"
I0603 14:10:30.077692 1131020 pod_ready.go:102] pod "metrics-server-9975d5f86-crpj5" in "kube-system" namespace has status "Ready":"False"
I0603 14:10:32.113756 1131020 pod_ready.go:102] pod "metrics-server-9975d5f86-crpj5" in "kube-system" namespace has status "Ready":"False"
I0603 14:10:34.577579 1131020 pod_ready.go:102] pod "metrics-server-9975d5f86-crpj5" in "kube-system" namespace has status "Ready":"False"
I0603 14:10:37.077381 1131020 pod_ready.go:102] pod "metrics-server-9975d5f86-crpj5" in "kube-system" namespace has status "Ready":"False"
I0603 14:10:39.079364 1131020 pod_ready.go:102] pod "metrics-server-9975d5f86-crpj5" in "kube-system" namespace has status "Ready":"False"
I0603 14:10:41.578139 1131020 pod_ready.go:102] pod "metrics-server-9975d5f86-crpj5" in "kube-system" namespace has status "Ready":"False"
I0603 14:10:44.077517 1131020 pod_ready.go:102] pod "metrics-server-9975d5f86-crpj5" in "kube-system" namespace has status "Ready":"False"
I0603 14:10:46.578050 1131020 pod_ready.go:102] pod "metrics-server-9975d5f86-crpj5" in "kube-system" namespace has status "Ready":"False"
I0603 14:10:49.076811 1131020 pod_ready.go:102] pod "metrics-server-9975d5f86-crpj5" in "kube-system" namespace has status "Ready":"False"
I0603 14:10:51.078542 1131020 pod_ready.go:102] pod "metrics-server-9975d5f86-crpj5" in "kube-system" namespace has status "Ready":"False"
I0603 14:10:53.584323 1131020 pod_ready.go:102] pod "metrics-server-9975d5f86-crpj5" in "kube-system" namespace has status "Ready":"False"
I0603 14:10:56.077740 1131020 pod_ready.go:102] pod "metrics-server-9975d5f86-crpj5" in "kube-system" namespace has status "Ready":"False"
I0603 14:10:58.577014 1131020 pod_ready.go:102] pod "metrics-server-9975d5f86-crpj5" in "kube-system" namespace has status "Ready":"False"
I0603 14:11:00.578089 1131020 pod_ready.go:102] pod "metrics-server-9975d5f86-crpj5" in "kube-system" namespace has status "Ready":"False"
I0603 14:11:03.077339 1131020 pod_ready.go:102] pod "metrics-server-9975d5f86-crpj5" in "kube-system" namespace has status "Ready":"False"
I0603 14:11:05.077751 1131020 pod_ready.go:102] pod "metrics-server-9975d5f86-crpj5" in "kube-system" namespace has status "Ready":"False"
I0603 14:11:07.080131 1131020 pod_ready.go:102] pod "metrics-server-9975d5f86-crpj5" in "kube-system" namespace has status "Ready":"False"
I0603 14:11:09.577802 1131020 pod_ready.go:102] pod "metrics-server-9975d5f86-crpj5" in "kube-system" namespace has status "Ready":"False"
I0603 14:11:12.081041 1131020 pod_ready.go:102] pod "metrics-server-9975d5f86-crpj5" in "kube-system" namespace has status "Ready":"False"
I0603 14:11:14.577434 1131020 pod_ready.go:102] pod "metrics-server-9975d5f86-crpj5" in "kube-system" namespace has status "Ready":"False"
I0603 14:11:16.578366 1131020 pod_ready.go:102] pod "metrics-server-9975d5f86-crpj5" in "kube-system" namespace has status "Ready":"False"
I0603 14:11:18.582167 1131020 pod_ready.go:102] pod "metrics-server-9975d5f86-crpj5" in "kube-system" namespace has status "Ready":"False"
I0603 14:11:21.076320 1131020 pod_ready.go:102] pod "metrics-server-9975d5f86-crpj5" in "kube-system" namespace has status "Ready":"False"
I0603 14:11:23.076438 1131020 pod_ready.go:102] pod "metrics-server-9975d5f86-crpj5" in "kube-system" namespace has status "Ready":"False"
I0603 14:11:25.078226 1131020 pod_ready.go:102] pod "metrics-server-9975d5f86-crpj5" in "kube-system" namespace has status "Ready":"False"
I0603 14:11:27.576941 1131020 pod_ready.go:102] pod "metrics-server-9975d5f86-crpj5" in "kube-system" namespace has status "Ready":"False"
I0603 14:11:29.577248 1131020 pod_ready.go:102] pod "metrics-server-9975d5f86-crpj5" in "kube-system" namespace has status "Ready":"False"
I0603 14:11:32.085463 1131020 pod_ready.go:102] pod "metrics-server-9975d5f86-crpj5" in "kube-system" namespace has status "Ready":"False"
I0603 14:11:34.579444 1131020 pod_ready.go:102] pod "metrics-server-9975d5f86-crpj5" in "kube-system" namespace has status "Ready":"False"
I0603 14:11:37.079503 1131020 pod_ready.go:102] pod "metrics-server-9975d5f86-crpj5" in "kube-system" namespace has status "Ready":"False"
I0603 14:11:38.578466 1131020 pod_ready.go:81] duration metric: took 4m0.007497115s for pod "metrics-server-9975d5f86-crpj5" in "kube-system" namespace to be "Ready" ...
E0603 14:11:38.578490 1131020 pod_ready.go:66] WaitExtra: waitPodCondition: context deadline exceeded
I0603 14:11:38.578499 1131020 pod_ready.go:38] duration metric: took 5m28.374245729s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0603 14:11:38.578515 1131020 api_server.go:52] waiting for apiserver process to appear ...
I0603 14:11:38.578544 1131020 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
I0603 14:11:38.578598 1131020 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0603 14:11:38.633301 1131020 cri.go:89] found id: "b218a8377d49dd148a59f25d54662fb0057bb32bade5fbaa37cd1bdc0c602423"
I0603 14:11:38.633320 1131020 cri.go:89] found id: "cff98b34e012670591f72e264bf28d021c645781e259a312066f3e8805f4afa6"
I0603 14:11:38.633324 1131020 cri.go:89] found id: ""
I0603 14:11:38.633332 1131020 logs.go:276] 2 containers: [b218a8377d49dd148a59f25d54662fb0057bb32bade5fbaa37cd1bdc0c602423 cff98b34e012670591f72e264bf28d021c645781e259a312066f3e8805f4afa6]
I0603 14:11:38.633389 1131020 ssh_runner.go:195] Run: which crictl
I0603 14:11:38.636941 1131020 ssh_runner.go:195] Run: which crictl
I0603 14:11:38.640203 1131020 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
I0603 14:11:38.640268 1131020 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0603 14:11:38.720738 1131020 cri.go:89] found id: "d958ffdd2556ba8d9c17f04f13419000435af96172a5d9e20f0e013a71c59942"
I0603 14:11:38.720757 1131020 cri.go:89] found id: "2812f3850287e9bd217797c7ff1ce588b53328c6abfa79f815865c965abed8c9"
I0603 14:11:38.720767 1131020 cri.go:89] found id: ""
I0603 14:11:38.720774 1131020 logs.go:276] 2 containers: [d958ffdd2556ba8d9c17f04f13419000435af96172a5d9e20f0e013a71c59942 2812f3850287e9bd217797c7ff1ce588b53328c6abfa79f815865c965abed8c9]
I0603 14:11:38.720831 1131020 ssh_runner.go:195] Run: which crictl
I0603 14:11:38.725517 1131020 ssh_runner.go:195] Run: which crictl
I0603 14:11:38.730913 1131020 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
I0603 14:11:38.730980 1131020 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0603 14:11:38.799849 1131020 cri.go:89] found id: "63681387e89a2da532a81bdadf8fc98401b8666cce28ae3a2deb9614f979acca"
I0603 14:11:38.799868 1131020 cri.go:89] found id: "78417eb766571e7487e28529180fd77f26d392a1ec4ea84a0f96fa78802948f6"
I0603 14:11:38.799873 1131020 cri.go:89] found id: ""
I0603 14:11:38.799880 1131020 logs.go:276] 2 containers: [63681387e89a2da532a81bdadf8fc98401b8666cce28ae3a2deb9614f979acca 78417eb766571e7487e28529180fd77f26d392a1ec4ea84a0f96fa78802948f6]
I0603 14:11:38.799938 1131020 ssh_runner.go:195] Run: which crictl
I0603 14:11:38.803709 1131020 ssh_runner.go:195] Run: which crictl
I0603 14:11:38.807349 1131020 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
I0603 14:11:38.807419 1131020 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0603 14:11:38.873764 1131020 cri.go:89] found id: "efa8ad7214e50f2aaef508788558e96bf0b60fc7ec0d449f453d3d7633d71c4c"
I0603 14:11:38.873836 1131020 cri.go:89] found id: "f6edc129f54e8676287bbd7aee0210985585277489be4a27610b67d25024944e"
I0603 14:11:38.873854 1131020 cri.go:89] found id: ""
I0603 14:11:38.873879 1131020 logs.go:276] 2 containers: [efa8ad7214e50f2aaef508788558e96bf0b60fc7ec0d449f453d3d7633d71c4c f6edc129f54e8676287bbd7aee0210985585277489be4a27610b67d25024944e]
I0603 14:11:38.873963 1131020 ssh_runner.go:195] Run: which crictl
I0603 14:11:38.878922 1131020 ssh_runner.go:195] Run: which crictl
I0603 14:11:38.885240 1131020 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
I0603 14:11:38.885307 1131020 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0603 14:11:38.949469 1131020 cri.go:89] found id: "85188c97e04c30ddc1220ae997ad70782be4759cc69bed1cdfadaa142ce3801b"
I0603 14:11:38.949539 1131020 cri.go:89] found id: "6968f3f519bf8570d57156dc04ffb2b134f1771b089603deba6699b0da257329"
I0603 14:11:38.949560 1131020 cri.go:89] found id: ""
I0603 14:11:38.949591 1131020 logs.go:276] 2 containers: [85188c97e04c30ddc1220ae997ad70782be4759cc69bed1cdfadaa142ce3801b 6968f3f519bf8570d57156dc04ffb2b134f1771b089603deba6699b0da257329]
I0603 14:11:38.949675 1131020 ssh_runner.go:195] Run: which crictl
I0603 14:11:38.954069 1131020 ssh_runner.go:195] Run: which crictl
I0603 14:11:38.957380 1131020 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
I0603 14:11:38.957445 1131020 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0603 14:11:39.005984 1131020 cri.go:89] found id: "5a2f082a34bcb3453d32b29c5417b8c0f647127f6f1b676c1cf71297ba47272c"
I0603 14:11:39.006008 1131020 cri.go:89] found id: "f95eb4638c61f9ec72d05ad64afd52ecbf878475d2abbe9148bc9cc5d92eae15"
I0603 14:11:39.006013 1131020 cri.go:89] found id: ""
I0603 14:11:39.006021 1131020 logs.go:276] 2 containers: [5a2f082a34bcb3453d32b29c5417b8c0f647127f6f1b676c1cf71297ba47272c f95eb4638c61f9ec72d05ad64afd52ecbf878475d2abbe9148bc9cc5d92eae15]
I0603 14:11:39.006085 1131020 ssh_runner.go:195] Run: which crictl
I0603 14:11:39.011604 1131020 ssh_runner.go:195] Run: which crictl
I0603 14:11:39.019270 1131020 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
I0603 14:11:39.019392 1131020 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0603 14:11:39.083430 1131020 cri.go:89] found id: "6e61ebc3d6091ce5d38e949a66cfe5e03b2290c58168b498adbf315977f2e27f"
I0603 14:11:39.083450 1131020 cri.go:89] found id: "4877d09126aeced75668eb5084bd53add55bad2951822ef405a630af926cc099"
I0603 14:11:39.083455 1131020 cri.go:89] found id: ""
I0603 14:11:39.083463 1131020 logs.go:276] 2 containers: [6e61ebc3d6091ce5d38e949a66cfe5e03b2290c58168b498adbf315977f2e27f 4877d09126aeced75668eb5084bd53add55bad2951822ef405a630af926cc099]
I0603 14:11:39.083525 1131020 ssh_runner.go:195] Run: which crictl
I0603 14:11:39.091415 1131020 ssh_runner.go:195] Run: which crictl
I0603 14:11:39.095484 1131020 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
I0603 14:11:39.095571 1131020 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I0603 14:11:39.160804 1131020 cri.go:89] found id: "33fdccc7b8d89b6026b4d99aaa906dd249af2e13c9164ba7c300007c2e170409"
I0603 14:11:39.160828 1131020 cri.go:89] found id: ""
I0603 14:11:39.160836 1131020 logs.go:276] 1 containers: [33fdccc7b8d89b6026b4d99aaa906dd249af2e13c9164ba7c300007c2e170409]
I0603 14:11:39.160890 1131020 ssh_runner.go:195] Run: which crictl
I0603 14:11:39.175541 1131020 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
I0603 14:11:39.175615 1131020 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0603 14:11:39.224974 1131020 cri.go:89] found id: "d8876e71dcdbddfdf7645eb16fa82d58e3fdfe186a62fe3979cd00418d8f8bcc"
I0603 14:11:39.224997 1131020 cri.go:89] found id: "c328ba896fecaac93f102a2fbf5ebe2877e5f90cdd8963cb241341d2758e21bb"
I0603 14:11:39.225002 1131020 cri.go:89] found id: ""
I0603 14:11:39.225010 1131020 logs.go:276] 2 containers: [d8876e71dcdbddfdf7645eb16fa82d58e3fdfe186a62fe3979cd00418d8f8bcc c328ba896fecaac93f102a2fbf5ebe2877e5f90cdd8963cb241341d2758e21bb]
I0603 14:11:39.225070 1131020 ssh_runner.go:195] Run: which crictl
I0603 14:11:39.229810 1131020 ssh_runner.go:195] Run: which crictl
I0603 14:11:39.235566 1131020 logs.go:123] Gathering logs for kube-proxy [85188c97e04c30ddc1220ae997ad70782be4759cc69bed1cdfadaa142ce3801b] ...
I0603 14:11:39.235593 1131020 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 85188c97e04c30ddc1220ae997ad70782be4759cc69bed1cdfadaa142ce3801b"
I0603 14:11:39.300297 1131020 logs.go:123] Gathering logs for kube-proxy [6968f3f519bf8570d57156dc04ffb2b134f1771b089603deba6699b0da257329] ...
I0603 14:11:39.300322 1131020 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 6968f3f519bf8570d57156dc04ffb2b134f1771b089603deba6699b0da257329"
I0603 14:11:39.350701 1131020 logs.go:123] Gathering logs for kube-controller-manager [5a2f082a34bcb3453d32b29c5417b8c0f647127f6f1b676c1cf71297ba47272c] ...
I0603 14:11:39.350724 1131020 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 5a2f082a34bcb3453d32b29c5417b8c0f647127f6f1b676c1cf71297ba47272c"
I0603 14:11:39.461407 1131020 logs.go:123] Gathering logs for kube-controller-manager [f95eb4638c61f9ec72d05ad64afd52ecbf878475d2abbe9148bc9cc5d92eae15] ...
I0603 14:11:39.461443 1131020 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 f95eb4638c61f9ec72d05ad64afd52ecbf878475d2abbe9148bc9cc5d92eae15"
I0603 14:11:39.543004 1131020 logs.go:123] Gathering logs for kindnet [6e61ebc3d6091ce5d38e949a66cfe5e03b2290c58168b498adbf315977f2e27f] ...
I0603 14:11:39.543080 1131020 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 6e61ebc3d6091ce5d38e949a66cfe5e03b2290c58168b498adbf315977f2e27f"
I0603 14:11:39.622973 1131020 logs.go:123] Gathering logs for storage-provisioner [c328ba896fecaac93f102a2fbf5ebe2877e5f90cdd8963cb241341d2758e21bb] ...
I0603 14:11:39.623121 1131020 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 c328ba896fecaac93f102a2fbf5ebe2877e5f90cdd8963cb241341d2758e21bb"
I0603 14:11:39.671405 1131020 logs.go:123] Gathering logs for containerd ...
I0603 14:11:39.671469 1131020 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
I0603 14:11:39.736433 1131020 logs.go:123] Gathering logs for kubelet ...
I0603 14:11:39.736511 1131020 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0603 14:11:39.789130 1131020 logs.go:138] Found kubelet problem: Jun 03 14:06:10 old-k8s-version-506981 kubelet[664]: E0603 14:06:10.208177 664 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:old-k8s-version-506981" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-506981' and this object
W0603 14:11:39.789410 1131020 logs.go:138] Found kubelet problem: Jun 03 14:06:10 old-k8s-version-506981 kubelet[664]: E0603 14:06:10.209941 664 reflector.go:138] object-"kube-system"/"kube-proxy-token-pvz57": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kube-proxy-token-pvz57" is forbidden: User "system:node:old-k8s-version-506981" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-506981' and this object
W0603 14:11:39.789671 1131020 logs.go:138] Found kubelet problem: Jun 03 14:06:10 old-k8s-version-506981 kubelet[664]: E0603 14:06:10.210190 664 reflector.go:138] object-"kube-system"/"storage-provisioner-token-smbcg": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "storage-provisioner-token-smbcg" is forbidden: User "system:node:old-k8s-version-506981" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-506981' and this object
W0603 14:11:39.789901 1131020 logs.go:138] Found kubelet problem: Jun 03 14:06:10 old-k8s-version-506981 kubelet[664]: E0603 14:06:10.210456 664 reflector.go:138] object-"kube-system"/"coredns-token-xv6d8": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "coredns-token-xv6d8" is forbidden: User "system:node:old-k8s-version-506981" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-506981' and this object
W0603 14:11:39.790132 1131020 logs.go:138] Found kubelet problem: Jun 03 14:06:10 old-k8s-version-506981 kubelet[664]: E0603 14:06:10.210528 664 reflector.go:138] object-"kube-system"/"kindnet-token-fq9hv": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kindnet-token-fq9hv" is forbidden: User "system:node:old-k8s-version-506981" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-506981' and this object
W0603 14:11:39.796292 1131020 logs.go:138] Found kubelet problem: Jun 03 14:06:11 old-k8s-version-506981 kubelet[664]: E0603 14:06:11.073812 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0603 14:11:39.798966 1131020 logs.go:138] Found kubelet problem: Jun 03 14:06:11 old-k8s-version-506981 kubelet[664]: E0603 14:06:11.614544 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0603 14:11:39.802167 1131020 logs.go:138] Found kubelet problem: Jun 03 14:06:24 old-k8s-version-506981 kubelet[664]: E0603 14:06:24.329859 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0603 14:11:39.804030 1131020 logs.go:138] Found kubelet problem: Jun 03 14:06:38 old-k8s-version-506981 kubelet[664]: E0603 14:06:38.315629 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0603 14:11:39.804499 1131020 logs.go:138] Found kubelet problem: Jun 03 14:06:38 old-k8s-version-506981 kubelet[664]: E0603 14:06:38.732103 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
W0603 14:11:39.804841 1131020 logs.go:138] Found kubelet problem: Jun 03 14:06:39 old-k8s-version-506981 kubelet[664]: E0603 14:06:39.734217 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
W0603 14:11:39.805619 1131020 logs.go:138] Found kubelet problem: Jun 03 14:06:43 old-k8s-version-506981 kubelet[664]: E0603 14:06:43.748705 664 pod_workers.go:191] Error syncing pod f6d55879-c128-4952-b79e-f043befb0117 ("storage-provisioner_kube-system(f6d55879-c128-4952-b79e-f043befb0117)"), skipping: failed to "StartContainer" for "storage-provisioner" with CrashLoopBackOff: "back-off 10s restarting failed container=storage-provisioner pod=storage-provisioner_kube-system(f6d55879-c128-4952-b79e-f043befb0117)"
W0603 14:11:39.806208 1131020 logs.go:138] Found kubelet problem: Jun 03 14:06:48 old-k8s-version-506981 kubelet[664]: E0603 14:06:48.761458 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
W0603 14:11:39.808644 1131020 logs.go:138] Found kubelet problem: Jun 03 14:06:52 old-k8s-version-506981 kubelet[664]: E0603 14:06:52.332609 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0603 14:11:39.809443 1131020 logs.go:138] Found kubelet problem: Jun 03 14:06:58 old-k8s-version-506981 kubelet[664]: E0603 14:06:58.329403 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
W0603 14:11:39.809633 1131020 logs.go:138] Found kubelet problem: Jun 03 14:07:06 old-k8s-version-506981 kubelet[664]: E0603 14:07:06.320342 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0603 14:11:39.810227 1131020 logs.go:138] Found kubelet problem: Jun 03 14:07:10 old-k8s-version-506981 kubelet[664]: E0603 14:07:10.829816 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
W0603 14:11:39.810413 1131020 logs.go:138] Found kubelet problem: Jun 03 14:07:17 old-k8s-version-506981 kubelet[664]: E0603 14:07:17.316558 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0603 14:11:39.810911 1131020 logs.go:138] Found kubelet problem: Jun 03 14:07:18 old-k8s-version-506981 kubelet[664]: E0603 14:07:18.329173 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
W0603 14:11:39.811249 1131020 logs.go:138] Found kubelet problem: Jun 03 14:07:31 old-k8s-version-506981 kubelet[664]: E0603 14:07:31.317042 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
W0603 14:11:39.811447 1131020 logs.go:138] Found kubelet problem: Jun 03 14:07:31 old-k8s-version-506981 kubelet[664]: E0603 14:07:31.317768 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0603 14:11:39.813926 1131020 logs.go:138] Found kubelet problem: Jun 03 14:07:44 old-k8s-version-506981 kubelet[664]: E0603 14:07:44.324077 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0603 14:11:39.814259 1131020 logs.go:138] Found kubelet problem: Jun 03 14:07:45 old-k8s-version-506981 kubelet[664]: E0603 14:07:45.315456 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
W0603 14:11:39.814896 1131020 logs.go:138] Found kubelet problem: Jun 03 14:07:56 old-k8s-version-506981 kubelet[664]: E0603 14:07:56.923998 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
W0603 14:11:39.815230 1131020 logs.go:138] Found kubelet problem: Jun 03 14:07:58 old-k8s-version-506981 kubelet[664]: E0603 14:07:58.329444 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
W0603 14:11:39.815426 1131020 logs.go:138] Found kubelet problem: Jun 03 14:07:59 old-k8s-version-506981 kubelet[664]: E0603 14:07:59.315936 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0603 14:11:39.815759 1131020 logs.go:138] Found kubelet problem: Jun 03 14:08:11 old-k8s-version-506981 kubelet[664]: E0603 14:08:11.316364 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
W0603 14:11:39.815943 1131020 logs.go:138] Found kubelet problem: Jun 03 14:08:14 old-k8s-version-506981 kubelet[664]: E0603 14:08:14.325727 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0603 14:11:39.816270 1131020 logs.go:138] Found kubelet problem: Jun 03 14:08:26 old-k8s-version-506981 kubelet[664]: E0603 14:08:26.315345 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
W0603 14:11:39.816457 1131020 logs.go:138] Found kubelet problem: Jun 03 14:08:27 old-k8s-version-506981 kubelet[664]: E0603 14:08:27.315749 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0603 14:11:39.816646 1131020 logs.go:138] Found kubelet problem: Jun 03 14:08:39 old-k8s-version-506981 kubelet[664]: E0603 14:08:39.320622 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0603 14:11:39.816988 1131020 logs.go:138] Found kubelet problem: Jun 03 14:08:40 old-k8s-version-506981 kubelet[664]: E0603 14:08:40.316125 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
W0603 14:11:39.817173 1131020 logs.go:138] Found kubelet problem: Jun 03 14:08:51 old-k8s-version-506981 kubelet[664]: E0603 14:08:51.315996 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0603 14:11:39.817506 1131020 logs.go:138] Found kubelet problem: Jun 03 14:08:53 old-k8s-version-506981 kubelet[664]: E0603 14:08:53.316043 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
W0603 14:11:39.819943 1131020 logs.go:138] Found kubelet problem: Jun 03 14:09:06 old-k8s-version-506981 kubelet[664]: E0603 14:09:06.327535 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0603 14:11:39.820271 1131020 logs.go:138] Found kubelet problem: Jun 03 14:09:08 old-k8s-version-506981 kubelet[664]: E0603 14:09:08.315370 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
W0603 14:11:39.820867 1131020 logs.go:138] Found kubelet problem: Jun 03 14:09:20 old-k8s-version-506981 kubelet[664]: E0603 14:09:20.148479 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
W0603 14:11:39.821053 1131020 logs.go:138] Found kubelet problem: Jun 03 14:09:20 old-k8s-version-506981 kubelet[664]: E0603 14:09:20.315640 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0603 14:11:39.821380 1131020 logs.go:138] Found kubelet problem: Jun 03 14:09:28 old-k8s-version-506981 kubelet[664]: E0603 14:09:28.329571 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
W0603 14:11:39.821565 1131020 logs.go:138] Found kubelet problem: Jun 03 14:09:33 old-k8s-version-506981 kubelet[664]: E0603 14:09:33.319989 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0603 14:11:39.821899 1131020 logs.go:138] Found kubelet problem: Jun 03 14:09:41 old-k8s-version-506981 kubelet[664]: E0603 14:09:41.316992 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
W0603 14:11:39.822083 1131020 logs.go:138] Found kubelet problem: Jun 03 14:09:45 old-k8s-version-506981 kubelet[664]: E0603 14:09:45.316906 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0603 14:11:39.822411 1131020 logs.go:138] Found kubelet problem: Jun 03 14:09:52 old-k8s-version-506981 kubelet[664]: E0603 14:09:52.315330 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
W0603 14:11:39.822595 1131020 logs.go:138] Found kubelet problem: Jun 03 14:09:56 old-k8s-version-506981 kubelet[664]: E0603 14:09:56.315834 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0603 14:11:39.822974 1131020 logs.go:138] Found kubelet problem: Jun 03 14:10:05 old-k8s-version-506981 kubelet[664]: E0603 14:10:05.315871 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
W0603 14:11:39.823167 1131020 logs.go:138] Found kubelet problem: Jun 03 14:10:11 old-k8s-version-506981 kubelet[664]: E0603 14:10:11.316009 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0603 14:11:39.823498 1131020 logs.go:138] Found kubelet problem: Jun 03 14:10:20 old-k8s-version-506981 kubelet[664]: E0603 14:10:20.315554 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
W0603 14:11:39.823760 1131020 logs.go:138] Found kubelet problem: Jun 03 14:10:25 old-k8s-version-506981 kubelet[664]: E0603 14:10:25.315808 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0603 14:11:39.824099 1131020 logs.go:138] Found kubelet problem: Jun 03 14:10:33 old-k8s-version-506981 kubelet[664]: E0603 14:10:33.315329 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
W0603 14:11:39.824287 1131020 logs.go:138] Found kubelet problem: Jun 03 14:10:36 old-k8s-version-506981 kubelet[664]: E0603 14:10:36.315735 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0603 14:11:39.824616 1131020 logs.go:138] Found kubelet problem: Jun 03 14:10:48 old-k8s-version-506981 kubelet[664]: E0603 14:10:48.315758 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
W0603 14:11:39.824827 1131020 logs.go:138] Found kubelet problem: Jun 03 14:10:48 old-k8s-version-506981 kubelet[664]: E0603 14:10:48.316596 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0603 14:11:39.825156 1131020 logs.go:138] Found kubelet problem: Jun 03 14:11:02 old-k8s-version-506981 kubelet[664]: E0603 14:11:02.316423 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
W0603 14:11:39.825340 1131020 logs.go:138] Found kubelet problem: Jun 03 14:11:02 old-k8s-version-506981 kubelet[664]: E0603 14:11:02.317204 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0603 14:11:39.825672 1131020 logs.go:138] Found kubelet problem: Jun 03 14:11:14 old-k8s-version-506981 kubelet[664]: E0603 14:11:14.315897 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
W0603 14:11:39.825857 1131020 logs.go:138] Found kubelet problem: Jun 03 14:11:17 old-k8s-version-506981 kubelet[664]: E0603 14:11:17.315838 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0603 14:11:39.826187 1131020 logs.go:138] Found kubelet problem: Jun 03 14:11:27 old-k8s-version-506981 kubelet[664]: E0603 14:11:27.315441 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
W0603 14:11:39.826373 1131020 logs.go:138] Found kubelet problem: Jun 03 14:11:32 old-k8s-version-506981 kubelet[664]: E0603 14:11:32.315742 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0603 14:11:39.826808 1131020 logs.go:138] Found kubelet problem: Jun 03 14:11:38 old-k8s-version-506981 kubelet[664]: E0603 14:11:38.315767 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
I0603 14:11:39.826822 1131020 logs.go:123] Gathering logs for etcd [2812f3850287e9bd217797c7ff1ce588b53328c6abfa79f815865c965abed8c9] ...
I0603 14:11:39.826836 1131020 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 2812f3850287e9bd217797c7ff1ce588b53328c6abfa79f815865c965abed8c9"
I0603 14:11:39.880852 1131020 logs.go:123] Gathering logs for kube-scheduler [efa8ad7214e50f2aaef508788558e96bf0b60fc7ec0d449f453d3d7633d71c4c] ...
I0603 14:11:39.880885 1131020 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 efa8ad7214e50f2aaef508788558e96bf0b60fc7ec0d449f453d3d7633d71c4c"
I0603 14:11:39.934000 1131020 logs.go:123] Gathering logs for kubernetes-dashboard [33fdccc7b8d89b6026b4d99aaa906dd249af2e13c9164ba7c300007c2e170409] ...
I0603 14:11:39.934034 1131020 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 33fdccc7b8d89b6026b4d99aaa906dd249af2e13c9164ba7c300007c2e170409"
I0603 14:11:39.985626 1131020 logs.go:123] Gathering logs for container status ...
I0603 14:11:39.985658 1131020 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0603 14:11:40.051504 1131020 logs.go:123] Gathering logs for dmesg ...
I0603 14:11:40.051531 1131020 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0603 14:11:40.072795 1131020 logs.go:123] Gathering logs for coredns [63681387e89a2da532a81bdadf8fc98401b8666cce28ae3a2deb9614f979acca] ...
I0603 14:11:40.072827 1131020 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 63681387e89a2da532a81bdadf8fc98401b8666cce28ae3a2deb9614f979acca"
I0603 14:11:40.130775 1131020 logs.go:123] Gathering logs for coredns [78417eb766571e7487e28529180fd77f26d392a1ec4ea84a0f96fa78802948f6] ...
I0603 14:11:40.130805 1131020 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 78417eb766571e7487e28529180fd77f26d392a1ec4ea84a0f96fa78802948f6"
I0603 14:11:40.190773 1131020 logs.go:123] Gathering logs for kindnet [4877d09126aeced75668eb5084bd53add55bad2951822ef405a630af926cc099] ...
I0603 14:11:40.190802 1131020 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 4877d09126aeced75668eb5084bd53add55bad2951822ef405a630af926cc099"
I0603 14:11:40.239105 1131020 logs.go:123] Gathering logs for kube-apiserver [b218a8377d49dd148a59f25d54662fb0057bb32bade5fbaa37cd1bdc0c602423] ...
I0603 14:11:40.239180 1131020 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 b218a8377d49dd148a59f25d54662fb0057bb32bade5fbaa37cd1bdc0c602423"
I0603 14:11:40.333052 1131020 logs.go:123] Gathering logs for kube-apiserver [cff98b34e012670591f72e264bf28d021c645781e259a312066f3e8805f4afa6] ...
I0603 14:11:40.333086 1131020 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 cff98b34e012670591f72e264bf28d021c645781e259a312066f3e8805f4afa6"
I0603 14:11:40.406845 1131020 logs.go:123] Gathering logs for etcd [d958ffdd2556ba8d9c17f04f13419000435af96172a5d9e20f0e013a71c59942] ...
I0603 14:11:40.406880 1131020 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 d958ffdd2556ba8d9c17f04f13419000435af96172a5d9e20f0e013a71c59942"
I0603 14:11:40.479193 1131020 logs.go:123] Gathering logs for kube-scheduler [f6edc129f54e8676287bbd7aee0210985585277489be4a27610b67d25024944e] ...
I0603 14:11:40.479271 1131020 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 f6edc129f54e8676287bbd7aee0210985585277489be4a27610b67d25024944e"
I0603 14:11:40.546517 1131020 logs.go:123] Gathering logs for storage-provisioner [d8876e71dcdbddfdf7645eb16fa82d58e3fdfe186a62fe3979cd00418d8f8bcc] ...
I0603 14:11:40.546587 1131020 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 d8876e71dcdbddfdf7645eb16fa82d58e3fdfe186a62fe3979cd00418d8f8bcc"
I0603 14:11:40.623916 1131020 logs.go:123] Gathering logs for describe nodes ...
I0603 14:11:40.623985 1131020 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0603 14:11:40.811347 1131020 out.go:304] Setting ErrFile to fd 2...
I0603 14:11:40.811427 1131020 out.go:338] TERM=,COLORTERM=, which probably does not support color
W0603 14:11:40.811502 1131020 out.go:239] X Problems detected in kubelet:
X Problems detected in kubelet:
W0603 14:11:40.811548 1131020 out.go:239] Jun 03 14:11:14 old-k8s-version-506981 kubelet[664]: E0603 14:11:14.315897 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
Jun 03 14:11:14 old-k8s-version-506981 kubelet[664]: E0603 14:11:14.315897 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
W0603 14:11:40.811585 1131020 out.go:239] Jun 03 14:11:17 old-k8s-version-506981 kubelet[664]: E0603 14:11:17.315838 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jun 03 14:11:17 old-k8s-version-506981 kubelet[664]: E0603 14:11:17.315838 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0603 14:11:40.811620 1131020 out.go:239] Jun 03 14:11:27 old-k8s-version-506981 kubelet[664]: E0603 14:11:27.315441 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
Jun 03 14:11:27 old-k8s-version-506981 kubelet[664]: E0603 14:11:27.315441 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
W0603 14:11:40.811658 1131020 out.go:239] Jun 03 14:11:32 old-k8s-version-506981 kubelet[664]: E0603 14:11:32.315742 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jun 03 14:11:32 old-k8s-version-506981 kubelet[664]: E0603 14:11:32.315742 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0603 14:11:40.811703 1131020 out.go:239] Jun 03 14:11:38 old-k8s-version-506981 kubelet[664]: E0603 14:11:38.315767 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
Jun 03 14:11:38 old-k8s-version-506981 kubelet[664]: E0603 14:11:38.315767 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
I0603 14:11:40.811816 1131020 out.go:304] Setting ErrFile to fd 2...
I0603 14:11:40.811840 1131020 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0603 14:11:50.813181 1131020 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0603 14:11:50.826984 1131020 api_server.go:72] duration metric: took 5m57.436679808s to wait for apiserver process to appear ...
I0603 14:11:50.827006 1131020 api_server.go:88] waiting for apiserver healthz status ...
I0603 14:11:50.827043 1131020 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
I0603 14:11:50.827099 1131020 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0603 14:11:50.891087 1131020 cri.go:89] found id: "b218a8377d49dd148a59f25d54662fb0057bb32bade5fbaa37cd1bdc0c602423"
I0603 14:11:50.891105 1131020 cri.go:89] found id: "cff98b34e012670591f72e264bf28d021c645781e259a312066f3e8805f4afa6"
I0603 14:11:50.891110 1131020 cri.go:89] found id: ""
I0603 14:11:50.891117 1131020 logs.go:276] 2 containers: [b218a8377d49dd148a59f25d54662fb0057bb32bade5fbaa37cd1bdc0c602423 cff98b34e012670591f72e264bf28d021c645781e259a312066f3e8805f4afa6]
I0603 14:11:50.891174 1131020 ssh_runner.go:195] Run: which crictl
I0603 14:11:50.895802 1131020 ssh_runner.go:195] Run: which crictl
I0603 14:11:50.900432 1131020 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
I0603 14:11:50.900499 1131020 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0603 14:11:50.949831 1131020 cri.go:89] found id: "d958ffdd2556ba8d9c17f04f13419000435af96172a5d9e20f0e013a71c59942"
I0603 14:11:50.949850 1131020 cri.go:89] found id: "2812f3850287e9bd217797c7ff1ce588b53328c6abfa79f815865c965abed8c9"
I0603 14:11:50.949855 1131020 cri.go:89] found id: ""
I0603 14:11:50.949864 1131020 logs.go:276] 2 containers: [d958ffdd2556ba8d9c17f04f13419000435af96172a5d9e20f0e013a71c59942 2812f3850287e9bd217797c7ff1ce588b53328c6abfa79f815865c965abed8c9]
I0603 14:11:50.949923 1131020 ssh_runner.go:195] Run: which crictl
I0603 14:11:50.956750 1131020 ssh_runner.go:195] Run: which crictl
I0603 14:11:50.961654 1131020 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
I0603 14:11:50.961722 1131020 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0603 14:11:51.010783 1131020 cri.go:89] found id: "63681387e89a2da532a81bdadf8fc98401b8666cce28ae3a2deb9614f979acca"
I0603 14:11:51.010802 1131020 cri.go:89] found id: "78417eb766571e7487e28529180fd77f26d392a1ec4ea84a0f96fa78802948f6"
I0603 14:11:51.010806 1131020 cri.go:89] found id: ""
I0603 14:11:51.010813 1131020 logs.go:276] 2 containers: [63681387e89a2da532a81bdadf8fc98401b8666cce28ae3a2deb9614f979acca 78417eb766571e7487e28529180fd77f26d392a1ec4ea84a0f96fa78802948f6]
I0603 14:11:51.010878 1131020 ssh_runner.go:195] Run: which crictl
I0603 14:11:51.015404 1131020 ssh_runner.go:195] Run: which crictl
I0603 14:11:51.019770 1131020 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
I0603 14:11:51.019901 1131020 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0603 14:11:51.098178 1131020 cri.go:89] found id: "efa8ad7214e50f2aaef508788558e96bf0b60fc7ec0d449f453d3d7633d71c4c"
I0603 14:11:51.098267 1131020 cri.go:89] found id: "f6edc129f54e8676287bbd7aee0210985585277489be4a27610b67d25024944e"
I0603 14:11:51.098275 1131020 cri.go:89] found id: ""
I0603 14:11:51.098283 1131020 logs.go:276] 2 containers: [efa8ad7214e50f2aaef508788558e96bf0b60fc7ec0d449f453d3d7633d71c4c f6edc129f54e8676287bbd7aee0210985585277489be4a27610b67d25024944e]
I0603 14:11:51.098379 1131020 ssh_runner.go:195] Run: which crictl
I0603 14:11:51.110606 1131020 ssh_runner.go:195] Run: which crictl
I0603 14:11:51.115425 1131020 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
I0603 14:11:51.115514 1131020 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0603 14:11:51.217495 1131020 cri.go:89] found id: "85188c97e04c30ddc1220ae997ad70782be4759cc69bed1cdfadaa142ce3801b"
I0603 14:11:51.217514 1131020 cri.go:89] found id: "6968f3f519bf8570d57156dc04ffb2b134f1771b089603deba6699b0da257329"
I0603 14:11:51.217519 1131020 cri.go:89] found id: ""
I0603 14:11:51.217527 1131020 logs.go:276] 2 containers: [85188c97e04c30ddc1220ae997ad70782be4759cc69bed1cdfadaa142ce3801b 6968f3f519bf8570d57156dc04ffb2b134f1771b089603deba6699b0da257329]
I0603 14:11:51.217584 1131020 ssh_runner.go:195] Run: which crictl
I0603 14:11:51.222474 1131020 ssh_runner.go:195] Run: which crictl
I0603 14:11:51.225950 1131020 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
I0603 14:11:51.226053 1131020 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0603 14:11:51.276869 1131020 cri.go:89] found id: "5a2f082a34bcb3453d32b29c5417b8c0f647127f6f1b676c1cf71297ba47272c"
I0603 14:11:51.276886 1131020 cri.go:89] found id: "f95eb4638c61f9ec72d05ad64afd52ecbf878475d2abbe9148bc9cc5d92eae15"
I0603 14:11:51.276891 1131020 cri.go:89] found id: ""
I0603 14:11:51.276898 1131020 logs.go:276] 2 containers: [5a2f082a34bcb3453d32b29c5417b8c0f647127f6f1b676c1cf71297ba47272c f95eb4638c61f9ec72d05ad64afd52ecbf878475d2abbe9148bc9cc5d92eae15]
I0603 14:11:51.276954 1131020 ssh_runner.go:195] Run: which crictl
I0603 14:11:51.280497 1131020 ssh_runner.go:195] Run: which crictl
I0603 14:11:51.284057 1131020 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
I0603 14:11:51.284180 1131020 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0603 14:11:51.334067 1131020 cri.go:89] found id: "6e61ebc3d6091ce5d38e949a66cfe5e03b2290c58168b498adbf315977f2e27f"
I0603 14:11:51.334089 1131020 cri.go:89] found id: "4877d09126aeced75668eb5084bd53add55bad2951822ef405a630af926cc099"
I0603 14:11:51.334093 1131020 cri.go:89] found id: ""
I0603 14:11:51.334100 1131020 logs.go:276] 2 containers: [6e61ebc3d6091ce5d38e949a66cfe5e03b2290c58168b498adbf315977f2e27f 4877d09126aeced75668eb5084bd53add55bad2951822ef405a630af926cc099]
I0603 14:11:51.334157 1131020 ssh_runner.go:195] Run: which crictl
I0603 14:11:51.338160 1131020 ssh_runner.go:195] Run: which crictl
I0603 14:11:51.342871 1131020 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
I0603 14:11:51.342935 1131020 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I0603 14:11:51.399518 1131020 cri.go:89] found id: "33fdccc7b8d89b6026b4d99aaa906dd249af2e13c9164ba7c300007c2e170409"
I0603 14:11:51.399536 1131020 cri.go:89] found id: ""
I0603 14:11:51.399546 1131020 logs.go:276] 1 containers: [33fdccc7b8d89b6026b4d99aaa906dd249af2e13c9164ba7c300007c2e170409]
I0603 14:11:51.399671 1131020 ssh_runner.go:195] Run: which crictl
I0603 14:11:51.403980 1131020 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
I0603 14:11:51.404098 1131020 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0603 14:11:51.458279 1131020 cri.go:89] found id: "d8876e71dcdbddfdf7645eb16fa82d58e3fdfe186a62fe3979cd00418d8f8bcc"
I0603 14:11:51.458310 1131020 cri.go:89] found id: "c328ba896fecaac93f102a2fbf5ebe2877e5f90cdd8963cb241341d2758e21bb"
I0603 14:11:51.458315 1131020 cri.go:89] found id: ""
I0603 14:11:51.458322 1131020 logs.go:276] 2 containers: [d8876e71dcdbddfdf7645eb16fa82d58e3fdfe186a62fe3979cd00418d8f8bcc c328ba896fecaac93f102a2fbf5ebe2877e5f90cdd8963cb241341d2758e21bb]
I0603 14:11:51.458378 1131020 ssh_runner.go:195] Run: which crictl
I0603 14:11:51.461985 1131020 ssh_runner.go:195] Run: which crictl
I0603 14:11:51.465265 1131020 logs.go:123] Gathering logs for dmesg ...
I0603 14:11:51.465330 1131020 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0603 14:11:51.485699 1131020 logs.go:123] Gathering logs for etcd [d958ffdd2556ba8d9c17f04f13419000435af96172a5d9e20f0e013a71c59942] ...
I0603 14:11:51.485730 1131020 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 d958ffdd2556ba8d9c17f04f13419000435af96172a5d9e20f0e013a71c59942"
I0603 14:11:51.555800 1131020 logs.go:123] Gathering logs for kube-scheduler [efa8ad7214e50f2aaef508788558e96bf0b60fc7ec0d449f453d3d7633d71c4c] ...
I0603 14:11:51.555830 1131020 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 efa8ad7214e50f2aaef508788558e96bf0b60fc7ec0d449f453d3d7633d71c4c"
I0603 14:11:51.622097 1131020 logs.go:123] Gathering logs for kube-controller-manager [5a2f082a34bcb3453d32b29c5417b8c0f647127f6f1b676c1cf71297ba47272c] ...
I0603 14:11:51.622127 1131020 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 5a2f082a34bcb3453d32b29c5417b8c0f647127f6f1b676c1cf71297ba47272c"
I0603 14:11:51.708238 1131020 logs.go:123] Gathering logs for storage-provisioner [d8876e71dcdbddfdf7645eb16fa82d58e3fdfe186a62fe3979cd00418d8f8bcc] ...
I0603 14:11:51.708319 1131020 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 d8876e71dcdbddfdf7645eb16fa82d58e3fdfe186a62fe3979cd00418d8f8bcc"
I0603 14:11:51.766030 1131020 logs.go:123] Gathering logs for kube-apiserver [cff98b34e012670591f72e264bf28d021c645781e259a312066f3e8805f4afa6] ...
I0603 14:11:51.766057 1131020 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 cff98b34e012670591f72e264bf28d021c645781e259a312066f3e8805f4afa6"
I0603 14:11:51.880289 1131020 logs.go:123] Gathering logs for kindnet [6e61ebc3d6091ce5d38e949a66cfe5e03b2290c58168b498adbf315977f2e27f] ...
I0603 14:11:51.880329 1131020 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 6e61ebc3d6091ce5d38e949a66cfe5e03b2290c58168b498adbf315977f2e27f"
I0603 14:11:51.976542 1131020 logs.go:123] Gathering logs for container status ...
I0603 14:11:51.976574 1131020 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0603 14:11:52.044746 1131020 logs.go:123] Gathering logs for kube-apiserver [b218a8377d49dd148a59f25d54662fb0057bb32bade5fbaa37cd1bdc0c602423] ...
I0603 14:11:52.044777 1131020 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 b218a8377d49dd148a59f25d54662fb0057bb32bade5fbaa37cd1bdc0c602423"
I0603 14:11:52.123439 1131020 logs.go:123] Gathering logs for kube-scheduler [f6edc129f54e8676287bbd7aee0210985585277489be4a27610b67d25024944e] ...
I0603 14:11:52.123515 1131020 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 f6edc129f54e8676287bbd7aee0210985585277489be4a27610b67d25024944e"
I0603 14:11:52.193830 1131020 logs.go:123] Gathering logs for kube-proxy [85188c97e04c30ddc1220ae997ad70782be4759cc69bed1cdfadaa142ce3801b] ...
I0603 14:11:52.193865 1131020 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 85188c97e04c30ddc1220ae997ad70782be4759cc69bed1cdfadaa142ce3801b"
I0603 14:11:52.247302 1131020 logs.go:123] Gathering logs for kube-proxy [6968f3f519bf8570d57156dc04ffb2b134f1771b089603deba6699b0da257329] ...
I0603 14:11:52.247327 1131020 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 6968f3f519bf8570d57156dc04ffb2b134f1771b089603deba6699b0da257329"
I0603 14:11:52.294515 1131020 logs.go:123] Gathering logs for kube-controller-manager [f95eb4638c61f9ec72d05ad64afd52ecbf878475d2abbe9148bc9cc5d92eae15] ...
I0603 14:11:52.294549 1131020 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 f95eb4638c61f9ec72d05ad64afd52ecbf878475d2abbe9148bc9cc5d92eae15"
I0603 14:11:52.404073 1131020 logs.go:123] Gathering logs for kubernetes-dashboard [33fdccc7b8d89b6026b4d99aaa906dd249af2e13c9164ba7c300007c2e170409] ...
I0603 14:11:52.404163 1131020 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 33fdccc7b8d89b6026b4d99aaa906dd249af2e13c9164ba7c300007c2e170409"
I0603 14:11:52.447795 1131020 logs.go:123] Gathering logs for storage-provisioner [c328ba896fecaac93f102a2fbf5ebe2877e5f90cdd8963cb241341d2758e21bb] ...
I0603 14:11:52.447822 1131020 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 c328ba896fecaac93f102a2fbf5ebe2877e5f90cdd8963cb241341d2758e21bb"
I0603 14:11:52.493088 1131020 logs.go:123] Gathering logs for kubelet ...
I0603 14:11:52.493113 1131020 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0603 14:11:52.549848 1131020 logs.go:138] Found kubelet problem: Jun 03 14:06:10 old-k8s-version-506981 kubelet[664]: E0603 14:06:10.208177 664 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:old-k8s-version-506981" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-506981' and this object
W0603 14:11:52.550083 1131020 logs.go:138] Found kubelet problem: Jun 03 14:06:10 old-k8s-version-506981 kubelet[664]: E0603 14:06:10.209941 664 reflector.go:138] object-"kube-system"/"kube-proxy-token-pvz57": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kube-proxy-token-pvz57" is forbidden: User "system:node:old-k8s-version-506981" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-506981' and this object
W0603 14:11:52.550314 1131020 logs.go:138] Found kubelet problem: Jun 03 14:06:10 old-k8s-version-506981 kubelet[664]: E0603 14:06:10.210190 664 reflector.go:138] object-"kube-system"/"storage-provisioner-token-smbcg": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "storage-provisioner-token-smbcg" is forbidden: User "system:node:old-k8s-version-506981" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-506981' and this object
W0603 14:11:52.550525 1131020 logs.go:138] Found kubelet problem: Jun 03 14:06:10 old-k8s-version-506981 kubelet[664]: E0603 14:06:10.210456 664 reflector.go:138] object-"kube-system"/"coredns-token-xv6d8": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "coredns-token-xv6d8" is forbidden: User "system:node:old-k8s-version-506981" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-506981' and this object
W0603 14:11:52.550737 1131020 logs.go:138] Found kubelet problem: Jun 03 14:06:10 old-k8s-version-506981 kubelet[664]: E0603 14:06:10.210528 664 reflector.go:138] object-"kube-system"/"kindnet-token-fq9hv": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kindnet-token-fq9hv" is forbidden: User "system:node:old-k8s-version-506981" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-506981' and this object
W0603 14:11:52.557166 1131020 logs.go:138] Found kubelet problem: Jun 03 14:06:11 old-k8s-version-506981 kubelet[664]: E0603 14:06:11.073812 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0603 14:11:52.560313 1131020 logs.go:138] Found kubelet problem: Jun 03 14:06:11 old-k8s-version-506981 kubelet[664]: E0603 14:06:11.614544 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0603 14:11:52.563733 1131020 logs.go:138] Found kubelet problem: Jun 03 14:06:24 old-k8s-version-506981 kubelet[664]: E0603 14:06:24.329859 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0603 14:11:52.565555 1131020 logs.go:138] Found kubelet problem: Jun 03 14:06:38 old-k8s-version-506981 kubelet[664]: E0603 14:06:38.315629 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0603 14:11:52.566028 1131020 logs.go:138] Found kubelet problem: Jun 03 14:06:38 old-k8s-version-506981 kubelet[664]: E0603 14:06:38.732103 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
W0603 14:11:52.566358 1131020 logs.go:138] Found kubelet problem: Jun 03 14:06:39 old-k8s-version-506981 kubelet[664]: E0603 14:06:39.734217 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
W0603 14:11:52.567220 1131020 logs.go:138] Found kubelet problem: Jun 03 14:06:43 old-k8s-version-506981 kubelet[664]: E0603 14:06:43.748705 664 pod_workers.go:191] Error syncing pod f6d55879-c128-4952-b79e-f043befb0117 ("storage-provisioner_kube-system(f6d55879-c128-4952-b79e-f043befb0117)"), skipping: failed to "StartContainer" for "storage-provisioner" with CrashLoopBackOff: "back-off 10s restarting failed container=storage-provisioner pod=storage-provisioner_kube-system(f6d55879-c128-4952-b79e-f043befb0117)"
W0603 14:11:52.567819 1131020 logs.go:138] Found kubelet problem: Jun 03 14:06:48 old-k8s-version-506981 kubelet[664]: E0603 14:06:48.761458 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
W0603 14:11:52.571317 1131020 logs.go:138] Found kubelet problem: Jun 03 14:06:52 old-k8s-version-506981 kubelet[664]: E0603 14:06:52.332609 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0603 14:11:52.572218 1131020 logs.go:138] Found kubelet problem: Jun 03 14:06:58 old-k8s-version-506981 kubelet[664]: E0603 14:06:58.329403 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
W0603 14:11:52.572429 1131020 logs.go:138] Found kubelet problem: Jun 03 14:07:06 old-k8s-version-506981 kubelet[664]: E0603 14:07:06.320342 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0603 14:11:52.573025 1131020 logs.go:138] Found kubelet problem: Jun 03 14:07:10 old-k8s-version-506981 kubelet[664]: E0603 14:07:10.829816 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
W0603 14:11:52.573213 1131020 logs.go:138] Found kubelet problem: Jun 03 14:07:17 old-k8s-version-506981 kubelet[664]: E0603 14:07:17.316558 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0603 14:11:52.573571 1131020 logs.go:138] Found kubelet problem: Jun 03 14:07:18 old-k8s-version-506981 kubelet[664]: E0603 14:07:18.329173 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
W0603 14:11:52.573922 1131020 logs.go:138] Found kubelet problem: Jun 03 14:07:31 old-k8s-version-506981 kubelet[664]: E0603 14:07:31.317042 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
W0603 14:11:52.574152 1131020 logs.go:138] Found kubelet problem: Jun 03 14:07:31 old-k8s-version-506981 kubelet[664]: E0603 14:07:31.317768 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0603 14:11:52.576679 1131020 logs.go:138] Found kubelet problem: Jun 03 14:07:44 old-k8s-version-506981 kubelet[664]: E0603 14:07:44.324077 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0603 14:11:52.577018 1131020 logs.go:138] Found kubelet problem: Jun 03 14:07:45 old-k8s-version-506981 kubelet[664]: E0603 14:07:45.315456 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
W0603 14:11:52.577613 1131020 logs.go:138] Found kubelet problem: Jun 03 14:07:56 old-k8s-version-506981 kubelet[664]: E0603 14:07:56.923998 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
W0603 14:11:52.577966 1131020 logs.go:138] Found kubelet problem: Jun 03 14:07:58 old-k8s-version-506981 kubelet[664]: E0603 14:07:58.329444 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
W0603 14:11:52.578155 1131020 logs.go:138] Found kubelet problem: Jun 03 14:07:59 old-k8s-version-506981 kubelet[664]: E0603 14:07:59.315936 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0603 14:11:52.578484 1131020 logs.go:138] Found kubelet problem: Jun 03 14:08:11 old-k8s-version-506981 kubelet[664]: E0603 14:08:11.316364 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
W0603 14:11:52.578668 1131020 logs.go:138] Found kubelet problem: Jun 03 14:08:14 old-k8s-version-506981 kubelet[664]: E0603 14:08:14.325727 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0603 14:11:52.579081 1131020 logs.go:138] Found kubelet problem: Jun 03 14:08:26 old-k8s-version-506981 kubelet[664]: E0603 14:08:26.315345 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
W0603 14:11:52.579274 1131020 logs.go:138] Found kubelet problem: Jun 03 14:08:27 old-k8s-version-506981 kubelet[664]: E0603 14:08:27.315749 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0603 14:11:52.579458 1131020 logs.go:138] Found kubelet problem: Jun 03 14:08:39 old-k8s-version-506981 kubelet[664]: E0603 14:08:39.320622 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0603 14:11:52.579785 1131020 logs.go:138] Found kubelet problem: Jun 03 14:08:40 old-k8s-version-506981 kubelet[664]: E0603 14:08:40.316125 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
W0603 14:11:52.579969 1131020 logs.go:138] Found kubelet problem: Jun 03 14:08:51 old-k8s-version-506981 kubelet[664]: E0603 14:08:51.315996 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0603 14:11:52.580310 1131020 logs.go:138] Found kubelet problem: Jun 03 14:08:53 old-k8s-version-506981 kubelet[664]: E0603 14:08:53.316043 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
W0603 14:11:52.582830 1131020 logs.go:138] Found kubelet problem: Jun 03 14:09:06 old-k8s-version-506981 kubelet[664]: E0603 14:09:06.327535 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0603 14:11:52.583177 1131020 logs.go:138] Found kubelet problem: Jun 03 14:09:08 old-k8s-version-506981 kubelet[664]: E0603 14:09:08.315370 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
W0603 14:11:52.583847 1131020 logs.go:138] Found kubelet problem: Jun 03 14:09:20 old-k8s-version-506981 kubelet[664]: E0603 14:09:20.148479 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
W0603 14:11:52.584052 1131020 logs.go:138] Found kubelet problem: Jun 03 14:09:20 old-k8s-version-506981 kubelet[664]: E0603 14:09:20.315640 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0603 14:11:52.584385 1131020 logs.go:138] Found kubelet problem: Jun 03 14:09:28 old-k8s-version-506981 kubelet[664]: E0603 14:09:28.329571 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
W0603 14:11:52.584570 1131020 logs.go:138] Found kubelet problem: Jun 03 14:09:33 old-k8s-version-506981 kubelet[664]: E0603 14:09:33.319989 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0603 14:11:52.584907 1131020 logs.go:138] Found kubelet problem: Jun 03 14:09:41 old-k8s-version-506981 kubelet[664]: E0603 14:09:41.316992 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
W0603 14:11:52.585091 1131020 logs.go:138] Found kubelet problem: Jun 03 14:09:45 old-k8s-version-506981 kubelet[664]: E0603 14:09:45.316906 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0603 14:11:52.585415 1131020 logs.go:138] Found kubelet problem: Jun 03 14:09:52 old-k8s-version-506981 kubelet[664]: E0603 14:09:52.315330 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
W0603 14:11:52.585604 1131020 logs.go:138] Found kubelet problem: Jun 03 14:09:56 old-k8s-version-506981 kubelet[664]: E0603 14:09:56.315834 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0603 14:11:52.585929 1131020 logs.go:138] Found kubelet problem: Jun 03 14:10:05 old-k8s-version-506981 kubelet[664]: E0603 14:10:05.315871 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
W0603 14:11:52.586108 1131020 logs.go:138] Found kubelet problem: Jun 03 14:10:11 old-k8s-version-506981 kubelet[664]: E0603 14:10:11.316009 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0603 14:11:52.586432 1131020 logs.go:138] Found kubelet problem: Jun 03 14:10:20 old-k8s-version-506981 kubelet[664]: E0603 14:10:20.315554 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
W0603 14:11:52.586613 1131020 logs.go:138] Found kubelet problem: Jun 03 14:10:25 old-k8s-version-506981 kubelet[664]: E0603 14:10:25.315808 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0603 14:11:52.586939 1131020 logs.go:138] Found kubelet problem: Jun 03 14:10:33 old-k8s-version-506981 kubelet[664]: E0603 14:10:33.315329 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
W0603 14:11:52.587120 1131020 logs.go:138] Found kubelet problem: Jun 03 14:10:36 old-k8s-version-506981 kubelet[664]: E0603 14:10:36.315735 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0603 14:11:52.587443 1131020 logs.go:138] Found kubelet problem: Jun 03 14:10:48 old-k8s-version-506981 kubelet[664]: E0603 14:10:48.315758 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
W0603 14:11:52.587624 1131020 logs.go:138] Found kubelet problem: Jun 03 14:10:48 old-k8s-version-506981 kubelet[664]: E0603 14:10:48.316596 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0603 14:11:52.587949 1131020 logs.go:138] Found kubelet problem: Jun 03 14:11:02 old-k8s-version-506981 kubelet[664]: E0603 14:11:02.316423 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
W0603 14:11:52.588128 1131020 logs.go:138] Found kubelet problem: Jun 03 14:11:02 old-k8s-version-506981 kubelet[664]: E0603 14:11:02.317204 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0603 14:11:52.588452 1131020 logs.go:138] Found kubelet problem: Jun 03 14:11:14 old-k8s-version-506981 kubelet[664]: E0603 14:11:14.315897 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
W0603 14:11:52.588634 1131020 logs.go:138] Found kubelet problem: Jun 03 14:11:17 old-k8s-version-506981 kubelet[664]: E0603 14:11:17.315838 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0603 14:11:52.588975 1131020 logs.go:138] Found kubelet problem: Jun 03 14:11:27 old-k8s-version-506981 kubelet[664]: E0603 14:11:27.315441 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
W0603 14:11:52.589155 1131020 logs.go:138] Found kubelet problem: Jun 03 14:11:32 old-k8s-version-506981 kubelet[664]: E0603 14:11:32.315742 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0603 14:11:52.589478 1131020 logs.go:138] Found kubelet problem: Jun 03 14:11:38 old-k8s-version-506981 kubelet[664]: E0603 14:11:38.315767 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
W0603 14:11:52.589662 1131020 logs.go:138] Found kubelet problem: Jun 03 14:11:44 old-k8s-version-506981 kubelet[664]: E0603 14:11:44.316492 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
I0603 14:11:52.589671 1131020 logs.go:123] Gathering logs for describe nodes ...
I0603 14:11:52.589684 1131020 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0603 14:11:52.809194 1131020 logs.go:123] Gathering logs for etcd [2812f3850287e9bd217797c7ff1ce588b53328c6abfa79f815865c965abed8c9] ...
I0603 14:11:52.809270 1131020 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 2812f3850287e9bd217797c7ff1ce588b53328c6abfa79f815865c965abed8c9"
I0603 14:11:52.946370 1131020 logs.go:123] Gathering logs for coredns [63681387e89a2da532a81bdadf8fc98401b8666cce28ae3a2deb9614f979acca] ...
I0603 14:11:52.946445 1131020 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 63681387e89a2da532a81bdadf8fc98401b8666cce28ae3a2deb9614f979acca"
I0603 14:11:53.043735 1131020 logs.go:123] Gathering logs for coredns [78417eb766571e7487e28529180fd77f26d392a1ec4ea84a0f96fa78802948f6] ...
I0603 14:11:53.043820 1131020 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 78417eb766571e7487e28529180fd77f26d392a1ec4ea84a0f96fa78802948f6"
I0603 14:11:53.098134 1131020 logs.go:123] Gathering logs for kindnet [4877d09126aeced75668eb5084bd53add55bad2951822ef405a630af926cc099] ...
I0603 14:11:53.098160 1131020 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 4877d09126aeced75668eb5084bd53add55bad2951822ef405a630af926cc099"
I0603 14:11:53.162273 1131020 logs.go:123] Gathering logs for containerd ...
I0603 14:11:53.162345 1131020 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
I0603 14:11:53.231720 1131020 out.go:304] Setting ErrFile to fd 2...
I0603 14:11:53.231797 1131020 out.go:338] TERM=,COLORTERM=, which probably does not support color
W0603 14:11:53.231876 1131020 out.go:239] X Problems detected in kubelet:
X Problems detected in kubelet:
W0603 14:11:53.232036 1131020 out.go:239] Jun 03 14:11:17 old-k8s-version-506981 kubelet[664]: E0603 14:11:17.315838 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jun 03 14:11:17 old-k8s-version-506981 kubelet[664]: E0603 14:11:17.315838 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0603 14:11:53.232073 1131020 out.go:239] Jun 03 14:11:27 old-k8s-version-506981 kubelet[664]: E0603 14:11:27.315441 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
Jun 03 14:11:27 old-k8s-version-506981 kubelet[664]: E0603 14:11:27.315441 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
W0603 14:11:53.232117 1131020 out.go:239] Jun 03 14:11:32 old-k8s-version-506981 kubelet[664]: E0603 14:11:32.315742 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jun 03 14:11:32 old-k8s-version-506981 kubelet[664]: E0603 14:11:32.315742 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0603 14:11:53.232161 1131020 out.go:239] Jun 03 14:11:38 old-k8s-version-506981 kubelet[664]: E0603 14:11:38.315767 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
Jun 03 14:11:38 old-k8s-version-506981 kubelet[664]: E0603 14:11:38.315767 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
W0603 14:11:53.232205 1131020 out.go:239] Jun 03 14:11:44 old-k8s-version-506981 kubelet[664]: E0603 14:11:44.316492 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jun 03 14:11:44 old-k8s-version-506981 kubelet[664]: E0603 14:11:44.316492 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
I0603 14:11:53.232255 1131020 out.go:304] Setting ErrFile to fd 2...
I0603 14:11:53.232275 1131020 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0603 14:12:03.233231 1131020 api_server.go:253] Checking apiserver healthz at https://192.168.76.2:8443/healthz ...
I0603 14:12:03.242436 1131020 api_server.go:279] https://192.168.76.2:8443/healthz returned 200:
ok
I0603 14:12:03.244500 1131020 out.go:177]
W0603 14:12:03.246219 1131020 out.go:239] X Exiting due to K8S_UNHEALTHY_CONTROL_PLANE: wait 6m0s for node: wait for healthy API server: controlPlane never updated to v1.20.0
X Exiting due to K8S_UNHEALTHY_CONTROL_PLANE: wait 6m0s for node: wait for healthy API server: controlPlane never updated to v1.20.0
W0603 14:12:03.246262 1131020 out.go:239] * Suggestion: Control Plane could not update, try minikube delete --all --purge
* Suggestion: Control Plane could not update, try minikube delete --all --purge
W0603 14:12:03.246290 1131020 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/11417
* Related issue: https://github.com/kubernetes/minikube/issues/11417
W0603 14:12:03.246301 1131020 out.go:239] *
*
W0603 14:12:03.247257 1131020 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0603 14:12:03.248987 1131020 out.go:177]
** /stderr **
start_stop_delete_test.go:259: failed to start minikube post-stop. args "out/minikube-linux-arm64 start -p old-k8s-version-506981 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=containerd --kubernetes-version=v1.20.0": exit status 102
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: docker inspect <======
helpers_test.go:231: (dbg) Run: docker inspect old-k8s-version-506981
helpers_test.go:235: (dbg) docker inspect old-k8s-version-506981:
-- stdout --
[
{
"Id": "ef1aae829e08c5c89f96d1ca9733f86dee196ca44ea83668b1364e647b2f42e2",
"Created": "2024-06-03T14:02:46.428952722Z",
"Path": "/usr/local/bin/entrypoint",
"Args": [
"/sbin/init"
],
"State": {
"Status": "running",
"Running": true,
"Paused": false,
"Restarting": false,
"OOMKilled": false,
"Dead": false,
"Pid": 1131212,
"ExitCode": 0,
"Error": "",
"StartedAt": "2024-06-03T14:05:46.458368593Z",
"FinishedAt": "2024-06-03T14:05:45.229398918Z"
},
"Image": "sha256:acea75078737755d2f999491dfa245ea1d1040bffc73283b8c9ba9ff1fde89b5",
"ResolvConfPath": "/var/lib/docker/containers/ef1aae829e08c5c89f96d1ca9733f86dee196ca44ea83668b1364e647b2f42e2/resolv.conf",
"HostnamePath": "/var/lib/docker/containers/ef1aae829e08c5c89f96d1ca9733f86dee196ca44ea83668b1364e647b2f42e2/hostname",
"HostsPath": "/var/lib/docker/containers/ef1aae829e08c5c89f96d1ca9733f86dee196ca44ea83668b1364e647b2f42e2/hosts",
"LogPath": "/var/lib/docker/containers/ef1aae829e08c5c89f96d1ca9733f86dee196ca44ea83668b1364e647b2f42e2/ef1aae829e08c5c89f96d1ca9733f86dee196ca44ea83668b1364e647b2f42e2-json.log",
"Name": "/old-k8s-version-506981",
"RestartCount": 0,
"Driver": "overlay2",
"Platform": "linux",
"MountLabel": "",
"ProcessLabel": "",
"AppArmorProfile": "unconfined",
"ExecIDs": null,
"HostConfig": {
"Binds": [
"/lib/modules:/lib/modules:ro",
"old-k8s-version-506981:/var"
],
"ContainerIDFile": "",
"LogConfig": {
"Type": "json-file",
"Config": {}
},
"NetworkMode": "old-k8s-version-506981",
"PortBindings": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
]
},
"RestartPolicy": {
"Name": "no",
"MaximumRetryCount": 0
},
"AutoRemove": false,
"VolumeDriver": "",
"VolumesFrom": null,
"ConsoleSize": [
0,
0
],
"CapAdd": null,
"CapDrop": null,
"CgroupnsMode": "host",
"Dns": [],
"DnsOptions": [],
"DnsSearch": [],
"ExtraHosts": null,
"GroupAdd": null,
"IpcMode": "private",
"Cgroup": "",
"Links": null,
"OomScoreAdj": 0,
"PidMode": "",
"Privileged": true,
"PublishAllPorts": false,
"ReadonlyRootfs": false,
"SecurityOpt": [
"seccomp=unconfined",
"apparmor=unconfined",
"label=disable"
],
"Tmpfs": {
"/run": "",
"/tmp": ""
},
"UTSMode": "",
"UsernsMode": "",
"ShmSize": 67108864,
"Runtime": "runc",
"Isolation": "",
"CpuShares": 0,
"Memory": 2306867200,
"NanoCpus": 2000000000,
"CgroupParent": "",
"BlkioWeight": 0,
"BlkioWeightDevice": [],
"BlkioDeviceReadBps": [],
"BlkioDeviceWriteBps": [],
"BlkioDeviceReadIOps": [],
"BlkioDeviceWriteIOps": [],
"CpuPeriod": 0,
"CpuQuota": 0,
"CpuRealtimePeriod": 0,
"CpuRealtimeRuntime": 0,
"CpusetCpus": "",
"CpusetMems": "",
"Devices": [],
"DeviceCgroupRules": null,
"DeviceRequests": null,
"MemoryReservation": 0,
"MemorySwap": 4613734400,
"MemorySwappiness": null,
"OomKillDisable": false,
"PidsLimit": null,
"Ulimits": [],
"CpuCount": 0,
"CpuPercent": 0,
"IOMaximumIOps": 0,
"IOMaximumBandwidth": 0,
"MaskedPaths": null,
"ReadonlyPaths": null
},
"GraphDriver": {
"Data": {
"LowerDir": "/var/lib/docker/overlay2/c0437dab1660fd4a023580fbed1518e20bfd3c0d28354e4e519c7e656d8c18aa-init/diff:/var/lib/docker/overlay2/09086fd2cdd1b6b6c3140eb646e07f7cca45866209e25b61eb87cd8ac625c506/diff",
"MergedDir": "/var/lib/docker/overlay2/c0437dab1660fd4a023580fbed1518e20bfd3c0d28354e4e519c7e656d8c18aa/merged",
"UpperDir": "/var/lib/docker/overlay2/c0437dab1660fd4a023580fbed1518e20bfd3c0d28354e4e519c7e656d8c18aa/diff",
"WorkDir": "/var/lib/docker/overlay2/c0437dab1660fd4a023580fbed1518e20bfd3c0d28354e4e519c7e656d8c18aa/work"
},
"Name": "overlay2"
},
"Mounts": [
{
"Type": "bind",
"Source": "/lib/modules",
"Destination": "/lib/modules",
"Mode": "ro",
"RW": false,
"Propagation": "rprivate"
},
{
"Type": "volume",
"Name": "old-k8s-version-506981",
"Source": "/var/lib/docker/volumes/old-k8s-version-506981/_data",
"Destination": "/var",
"Driver": "local",
"Mode": "z",
"RW": true,
"Propagation": ""
}
],
"Config": {
"Hostname": "old-k8s-version-506981",
"Domainname": "",
"User": "",
"AttachStdin": false,
"AttachStdout": false,
"AttachStderr": false,
"ExposedPorts": {
"22/tcp": {},
"2376/tcp": {},
"32443/tcp": {},
"5000/tcp": {},
"8443/tcp": {}
},
"Tty": true,
"OpenStdin": false,
"StdinOnce": false,
"Env": [
"container=docker",
"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
],
"Cmd": null,
"Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1716228441-18934@sha256:628b3f20803bc9c4302fd048087dd36cf2ff5dc9ab0ded395ec3288e2f1d0862",
"Volumes": null,
"WorkingDir": "/",
"Entrypoint": [
"/usr/local/bin/entrypoint",
"/sbin/init"
],
"OnBuild": null,
"Labels": {
"created_by.minikube.sigs.k8s.io": "true",
"mode.minikube.sigs.k8s.io": "old-k8s-version-506981",
"name.minikube.sigs.k8s.io": "old-k8s-version-506981",
"role.minikube.sigs.k8s.io": ""
},
"StopSignal": "SIGRTMIN+3"
},
"NetworkSettings": {
"Bridge": "",
"SandboxID": "3a37fafb43ba94d289320627c9aab38fbe4b69cb702238d110ecfd9866746572",
"SandboxKey": "/var/run/docker/netns/3a37fafb43ba",
"Ports": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "34194"
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "34193"
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "34190"
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "34192"
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "34191"
}
]
},
"HairpinMode": false,
"LinkLocalIPv6Address": "",
"LinkLocalIPv6PrefixLen": 0,
"SecondaryIPAddresses": null,
"SecondaryIPv6Addresses": null,
"EndpointID": "",
"Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"IPAddress": "",
"IPPrefixLen": 0,
"IPv6Gateway": "",
"MacAddress": "",
"Networks": {
"old-k8s-version-506981": {
"IPAMConfig": {
"IPv4Address": "192.168.76.2"
},
"Links": null,
"Aliases": null,
"MacAddress": "02:42:c0:a8:4c:02",
"NetworkID": "140bb90eb980977b211c8581eb665a7cc85b06fe1ed9e0a8eb00c9bb31eb558b",
"EndpointID": "45830e78d0c31baae6d37d2f065e0b788ef3688bbb948b526438b8eb830262d3",
"Gateway": "192.168.76.1",
"IPAddress": "192.168.76.2",
"IPPrefixLen": 24,
"IPv6Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"DriverOpts": null,
"DNSNames": [
"old-k8s-version-506981",
"ef1aae829e08"
]
}
}
}
}
]
-- /stdout --
helpers_test.go:239: (dbg) Run: out/minikube-linux-arm64 status --format={{.Host}} -p old-k8s-version-506981 -n old-k8s-version-506981
helpers_test.go:244: <<< TestStartStop/group/old-k8s-version/serial/SecondStart FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: minikube logs <======
helpers_test.go:247: (dbg) Run: out/minikube-linux-arm64 -p old-k8s-version-506981 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-arm64 -p old-k8s-version-506981 logs -n 25: (3.025536748s)
helpers_test.go:252: TestStartStop/group/old-k8s-version/serial/SecondStart logs:
-- stdout --
==> Audit <==
|---------|--------------------------------------------------------|--------------------------|---------|---------|---------------------|---------------------|
| Command | Args | Profile | User | Version | Start Time | End Time |
|---------|--------------------------------------------------------|--------------------------|---------|---------|---------------------|---------------------|
| start | -p cert-expiration-294114 | cert-expiration-294114 | jenkins | v1.33.1 | 03 Jun 24 14:01 UTC | 03 Jun 24 14:02 UTC |
| | --memory=2048 | | | | | |
| | --cert-expiration=3m | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| ssh | force-systemd-env-221348 | force-systemd-env-221348 | jenkins | v1.33.1 | 03 Jun 24 14:02 UTC | 03 Jun 24 14:02 UTC |
| | ssh cat | | | | | |
| | /etc/containerd/config.toml | | | | | |
| delete | -p force-systemd-env-221348 | force-systemd-env-221348 | jenkins | v1.33.1 | 03 Jun 24 14:02 UTC | 03 Jun 24 14:02 UTC |
| start | -p cert-options-163067 | cert-options-163067 | jenkins | v1.33.1 | 03 Jun 24 14:02 UTC | 03 Jun 24 14:02 UTC |
| | --memory=2048 | | | | | |
| | --apiserver-ips=127.0.0.1 | | | | | |
| | --apiserver-ips=192.168.15.15 | | | | | |
| | --apiserver-names=localhost | | | | | |
| | --apiserver-names=www.google.com | | | | | |
| | --apiserver-port=8555 | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| ssh | cert-options-163067 ssh | cert-options-163067 | jenkins | v1.33.1 | 03 Jun 24 14:02 UTC | 03 Jun 24 14:02 UTC |
| | openssl x509 -text -noout -in | | | | | |
| | /var/lib/minikube/certs/apiserver.crt | | | | | |
| ssh | -p cert-options-163067 -- sudo | cert-options-163067 | jenkins | v1.33.1 | 03 Jun 24 14:02 UTC | 03 Jun 24 14:02 UTC |
| | cat /etc/kubernetes/admin.conf | | | | | |
| delete | -p cert-options-163067 | cert-options-163067 | jenkins | v1.33.1 | 03 Jun 24 14:02 UTC | 03 Jun 24 14:02 UTC |
| start | -p old-k8s-version-506981 | old-k8s-version-506981 | jenkins | v1.33.1 | 03 Jun 24 14:02 UTC | 03 Jun 24 14:05 UTC |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --kvm-network=default | | | | | |
| | --kvm-qemu-uri=qemu:///system | | | | | |
| | --disable-driver-mounts | | | | | |
| | --keep-context=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --kubernetes-version=v1.20.0 | | | | | |
| start | -p cert-expiration-294114 | cert-expiration-294114 | jenkins | v1.33.1 | 03 Jun 24 14:05 UTC | 03 Jun 24 14:05 UTC |
| | --memory=2048 | | | | | |
| | --cert-expiration=8760h | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| delete | -p cert-expiration-294114 | cert-expiration-294114 | jenkins | v1.33.1 | 03 Jun 24 14:05 UTC | 03 Jun 24 14:05 UTC |
| start | -p no-preload-035370 | no-preload-035370 | jenkins | v1.33.1 | 03 Jun 24 14:05 UTC | 03 Jun 24 14:06 UTC |
| | --memory=2200 | | | | | |
| | --alsologtostderr | | | | | |
| | --wait=true --preload=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --kubernetes-version=v1.30.1 | | | | | |
| addons | enable metrics-server -p old-k8s-version-506981 | old-k8s-version-506981 | jenkins | v1.33.1 | 03 Jun 24 14:05 UTC | 03 Jun 24 14:05 UTC |
| | --images=MetricsServer=registry.k8s.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| stop | -p old-k8s-version-506981 | old-k8s-version-506981 | jenkins | v1.33.1 | 03 Jun 24 14:05 UTC | 03 Jun 24 14:05 UTC |
| | --alsologtostderr -v=3 | | | | | |
| addons | enable dashboard -p old-k8s-version-506981 | old-k8s-version-506981 | jenkins | v1.33.1 | 03 Jun 24 14:05 UTC | 03 Jun 24 14:05 UTC |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| start | -p old-k8s-version-506981 | old-k8s-version-506981 | jenkins | v1.33.1 | 03 Jun 24 14:05 UTC | |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --kvm-network=default | | | | | |
| | --kvm-qemu-uri=qemu:///system | | | | | |
| | --disable-driver-mounts | | | | | |
| | --keep-context=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --kubernetes-version=v1.20.0 | | | | | |
| addons | enable metrics-server -p no-preload-035370 | no-preload-035370 | jenkins | v1.33.1 | 03 Jun 24 14:06 UTC | 03 Jun 24 14:06 UTC |
| | --images=MetricsServer=registry.k8s.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| stop | -p no-preload-035370 | no-preload-035370 | jenkins | v1.33.1 | 03 Jun 24 14:06 UTC | 03 Jun 24 14:06 UTC |
| | --alsologtostderr -v=3 | | | | | |
| addons | enable dashboard -p no-preload-035370 | no-preload-035370 | jenkins | v1.33.1 | 03 Jun 24 14:06 UTC | 03 Jun 24 14:06 UTC |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| start | -p no-preload-035370 | no-preload-035370 | jenkins | v1.33.1 | 03 Jun 24 14:06 UTC | 03 Jun 24 14:11 UTC |
| | --memory=2200 | | | | | |
| | --alsologtostderr | | | | | |
| | --wait=true --preload=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --kubernetes-version=v1.30.1 | | | | | |
| image | no-preload-035370 image list | no-preload-035370 | jenkins | v1.33.1 | 03 Jun 24 14:11 UTC | 03 Jun 24 14:11 UTC |
| | --format=json | | | | | |
| pause | -p no-preload-035370 | no-preload-035370 | jenkins | v1.33.1 | 03 Jun 24 14:11 UTC | 03 Jun 24 14:11 UTC |
| | --alsologtostderr -v=1 | | | | | |
| unpause | -p no-preload-035370 | no-preload-035370 | jenkins | v1.33.1 | 03 Jun 24 14:11 UTC | 03 Jun 24 14:11 UTC |
| | --alsologtostderr -v=1 | | | | | |
| delete | -p no-preload-035370 | no-preload-035370 | jenkins | v1.33.1 | 03 Jun 24 14:11 UTC | 03 Jun 24 14:11 UTC |
| delete | -p no-preload-035370 | no-preload-035370 | jenkins | v1.33.1 | 03 Jun 24 14:11 UTC | 03 Jun 24 14:11 UTC |
| start | -p embed-certs-674995 | embed-certs-674995 | jenkins | v1.33.1 | 03 Jun 24 14:11 UTC | |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --embed-certs --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --kubernetes-version=v1.30.1 | | | | | |
|---------|--------------------------------------------------------|--------------------------|---------|---------|---------------------|---------------------|
==> Last Start <==
Log file created at: 2024/06/03 14:11:38
Running on machine: ip-172-31-21-244
Binary: Built with gc go1.22.3 for linux/arm64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I0603 14:11:38.038918 1141423 out.go:291] Setting OutFile to fd 1 ...
I0603 14:11:38.039148 1141423 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0603 14:11:38.039177 1141423 out.go:304] Setting ErrFile to fd 2...
I0603 14:11:38.039198 1141423 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0603 14:11:38.039480 1141423 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19011-937109/.minikube/bin
I0603 14:11:38.040046 1141423 out.go:298] Setting JSON to false
I0603 14:11:38.041320 1141423 start.go:129] hostinfo: {"hostname":"ip-172-31-21-244","uptime":17642,"bootTime":1717406256,"procs":221,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1062-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"da8ac1fd-6236-412a-a346-95873c98230d"}
I0603 14:11:38.041422 1141423 start.go:139] virtualization:
I0603 14:11:38.043676 1141423 out.go:177] * [embed-certs-674995] minikube v1.33.1 on Ubuntu 20.04 (arm64)
I0603 14:11:38.045831 1141423 out.go:177] - MINIKUBE_LOCATION=19011
I0603 14:11:38.047627 1141423 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0603 14:11:38.045948 1141423 notify.go:220] Checking for updates...
I0603 14:11:38.049451 1141423 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/19011-937109/kubeconfig
I0603 14:11:38.051111 1141423 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/19011-937109/.minikube
I0603 14:11:38.052822 1141423 out.go:177] - MINIKUBE_BIN=out/minikube-linux-arm64
I0603 14:11:38.054655 1141423 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0603 14:11:38.056949 1141423 config.go:182] Loaded profile config "old-k8s-version-506981": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0
I0603 14:11:38.057089 1141423 driver.go:392] Setting default libvirt URI to qemu:///system
I0603 14:11:38.084143 1141423 docker.go:122] docker version: linux-26.1.3:Docker Engine - Community
I0603 14:11:38.084274 1141423 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0603 14:11:38.151885 1141423 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:33 OomKillDisable:true NGoroutines:52 SystemTime:2024-06-03 14:11:38.140645756 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1062-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214970368 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:26.1.3 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:8b3b7ca2e5ce38e8f31a34f35b2b68ceb8470d89 Expected:8b3b7ca2e5ce38e8f31a34f35b2b68ceb8470d89} RuncCommit:{ID:v1.1.12-0-g51d5e94 Expected:v1.1.12-0-g51d5e94} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.14.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.27.0]] Warnings:<nil>}}
I0603 14:11:38.152006 1141423 docker.go:295] overlay module found
I0603 14:11:38.155322 1141423 out.go:177] * Using the docker driver based on user configuration
I0603 14:11:38.157099 1141423 start.go:297] selected driver: docker
I0603 14:11:38.157117 1141423 start.go:901] validating driver "docker" against <nil>
I0603 14:11:38.157139 1141423 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0603 14:11:38.157833 1141423 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0603 14:11:38.225885 1141423 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:33 OomKillDisable:true NGoroutines:52 SystemTime:2024-06-03 14:11:38.215714152 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1062-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214970368 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:26.1.3 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:8b3b7ca2e5ce38e8f31a34f35b2b68ceb8470d89 Expected:8b3b7ca2e5ce38e8f31a34f35b2b68ceb8470d89} RuncCommit:{ID:v1.1.12-0-g51d5e94 Expected:v1.1.12-0-g51d5e94} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.14.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.27.0]] Warnings:<nil>}}
I0603 14:11:38.226051 1141423 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0603 14:11:38.226276 1141423 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0603 14:11:38.227971 1141423 out.go:177] * Using Docker driver with root privileges
I0603 14:11:38.229651 1141423 cni.go:84] Creating CNI manager for ""
I0603 14:11:38.229672 1141423 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0603 14:11:38.229681 1141423 start_flags.go:319] Found "CNI" CNI - setting NetworkPlugin=cni
I0603 14:11:38.229769 1141423 start.go:340] cluster config:
{Name:embed-certs-674995 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1716228441-18934@sha256:628b3f20803bc9c4302fd048087dd36cf2ff5dc9ab0ded395ec3288e2f1d0862 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.1 ClusterName:embed-certs-674995 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Contain
erRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.30.1 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: Stati
cIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0603 14:11:38.231555 1141423 out.go:177] * Starting "embed-certs-674995" primary control-plane node in "embed-certs-674995" cluster
I0603 14:11:38.233047 1141423 cache.go:121] Beginning downloading kic base image for docker with containerd
I0603 14:11:38.234843 1141423 out.go:177] * Pulling base image v0.0.44-1716228441-18934 ...
I0603 14:11:38.236764 1141423 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1716228441-18934@sha256:628b3f20803bc9c4302fd048087dd36cf2ff5dc9ab0ded395ec3288e2f1d0862 in local docker daemon
I0603 14:11:38.236915 1141423 preload.go:132] Checking if preload exists for k8s version v1.30.1 and runtime containerd
I0603 14:11:38.236945 1141423 preload.go:147] Found local preload: /home/jenkins/minikube-integration/19011-937109/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.1-containerd-overlay2-arm64.tar.lz4
I0603 14:11:38.236955 1141423 cache.go:56] Caching tarball of preloaded images
I0603 14:11:38.237026 1141423 preload.go:173] Found /home/jenkins/minikube-integration/19011-937109/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.1-containerd-overlay2-arm64.tar.lz4 in cache, skipping download
I0603 14:11:38.237041 1141423 cache.go:59] Finished verifying existence of preloaded tar for v1.30.1 on containerd
I0603 14:11:38.237141 1141423 profile.go:143] Saving config to /home/jenkins/minikube-integration/19011-937109/.minikube/profiles/embed-certs-674995/config.json ...
I0603 14:11:38.237162 1141423 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19011-937109/.minikube/profiles/embed-certs-674995/config.json: {Name:mk4f20bd77930d951c7406a819d8886cdc2baef8 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0603 14:11:38.252644 1141423 image.go:83] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1716228441-18934@sha256:628b3f20803bc9c4302fd048087dd36cf2ff5dc9ab0ded395ec3288e2f1d0862 in local docker daemon, skipping pull
I0603 14:11:38.252680 1141423 cache.go:144] gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1716228441-18934@sha256:628b3f20803bc9c4302fd048087dd36cf2ff5dc9ab0ded395ec3288e2f1d0862 exists in daemon, skipping load
I0603 14:11:38.252778 1141423 cache.go:194] Successfully downloaded all kic artifacts
I0603 14:11:38.252817 1141423 start.go:360] acquireMachinesLock for embed-certs-674995: {Name:mk4a2076c9dff358e363a9cde52485c262baadf8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0603 14:11:38.252932 1141423 start.go:364] duration metric: took 92.052µs to acquireMachinesLock for "embed-certs-674995"
I0603 14:11:38.252963 1141423 start.go:93] Provisioning new machine with config: &{Name:embed-certs-674995 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1716228441-18934@sha256:628b3f20803bc9c4302fd048087dd36cf2ff5dc9ab0ded395ec3288e2f1d0862 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.1 ClusterName:embed-certs-674995 Namespace:default APIServerHAVIP: APIServe
rName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.30.1 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableM
etrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.30.1 ContainerRuntime:containerd ControlPlane:true Worker:true}
I0603 14:11:38.253043 1141423 start.go:125] createHost starting for "" (driver="docker")
I0603 14:11:37.079503 1131020 pod_ready.go:102] pod "metrics-server-9975d5f86-crpj5" in "kube-system" namespace has status "Ready":"False"
I0603 14:11:38.578466 1131020 pod_ready.go:81] duration metric: took 4m0.007497115s for pod "metrics-server-9975d5f86-crpj5" in "kube-system" namespace to be "Ready" ...
E0603 14:11:38.578490 1131020 pod_ready.go:66] WaitExtra: waitPodCondition: context deadline exceeded
I0603 14:11:38.578499 1131020 pod_ready.go:38] duration metric: took 5m28.374245729s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0603 14:11:38.578515 1131020 api_server.go:52] waiting for apiserver process to appear ...
I0603 14:11:38.578544 1131020 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
I0603 14:11:38.578598 1131020 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0603 14:11:38.633301 1131020 cri.go:89] found id: "b218a8377d49dd148a59f25d54662fb0057bb32bade5fbaa37cd1bdc0c602423"
I0603 14:11:38.633320 1131020 cri.go:89] found id: "cff98b34e012670591f72e264bf28d021c645781e259a312066f3e8805f4afa6"
I0603 14:11:38.633324 1131020 cri.go:89] found id: ""
I0603 14:11:38.633332 1131020 logs.go:276] 2 containers: [b218a8377d49dd148a59f25d54662fb0057bb32bade5fbaa37cd1bdc0c602423 cff98b34e012670591f72e264bf28d021c645781e259a312066f3e8805f4afa6]
I0603 14:11:38.633389 1131020 ssh_runner.go:195] Run: which crictl
I0603 14:11:38.636941 1131020 ssh_runner.go:195] Run: which crictl
I0603 14:11:38.640203 1131020 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
I0603 14:11:38.640268 1131020 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0603 14:11:38.720738 1131020 cri.go:89] found id: "d958ffdd2556ba8d9c17f04f13419000435af96172a5d9e20f0e013a71c59942"
I0603 14:11:38.720757 1131020 cri.go:89] found id: "2812f3850287e9bd217797c7ff1ce588b53328c6abfa79f815865c965abed8c9"
I0603 14:11:38.720767 1131020 cri.go:89] found id: ""
I0603 14:11:38.720774 1131020 logs.go:276] 2 containers: [d958ffdd2556ba8d9c17f04f13419000435af96172a5d9e20f0e013a71c59942 2812f3850287e9bd217797c7ff1ce588b53328c6abfa79f815865c965abed8c9]
I0603 14:11:38.720831 1131020 ssh_runner.go:195] Run: which crictl
I0603 14:11:38.725517 1131020 ssh_runner.go:195] Run: which crictl
I0603 14:11:38.730913 1131020 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
I0603 14:11:38.730980 1131020 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0603 14:11:38.799849 1131020 cri.go:89] found id: "63681387e89a2da532a81bdadf8fc98401b8666cce28ae3a2deb9614f979acca"
I0603 14:11:38.799868 1131020 cri.go:89] found id: "78417eb766571e7487e28529180fd77f26d392a1ec4ea84a0f96fa78802948f6"
I0603 14:11:38.799873 1131020 cri.go:89] found id: ""
I0603 14:11:38.799880 1131020 logs.go:276] 2 containers: [63681387e89a2da532a81bdadf8fc98401b8666cce28ae3a2deb9614f979acca 78417eb766571e7487e28529180fd77f26d392a1ec4ea84a0f96fa78802948f6]
I0603 14:11:38.799938 1131020 ssh_runner.go:195] Run: which crictl
I0603 14:11:38.803709 1131020 ssh_runner.go:195] Run: which crictl
I0603 14:11:38.807349 1131020 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
I0603 14:11:38.807419 1131020 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0603 14:11:38.873764 1131020 cri.go:89] found id: "efa8ad7214e50f2aaef508788558e96bf0b60fc7ec0d449f453d3d7633d71c4c"
I0603 14:11:38.873836 1131020 cri.go:89] found id: "f6edc129f54e8676287bbd7aee0210985585277489be4a27610b67d25024944e"
I0603 14:11:38.873854 1131020 cri.go:89] found id: ""
I0603 14:11:38.873879 1131020 logs.go:276] 2 containers: [efa8ad7214e50f2aaef508788558e96bf0b60fc7ec0d449f453d3d7633d71c4c f6edc129f54e8676287bbd7aee0210985585277489be4a27610b67d25024944e]
I0603 14:11:38.873963 1131020 ssh_runner.go:195] Run: which crictl
I0603 14:11:38.878922 1131020 ssh_runner.go:195] Run: which crictl
I0603 14:11:38.885240 1131020 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
I0603 14:11:38.885307 1131020 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0603 14:11:38.949469 1131020 cri.go:89] found id: "85188c97e04c30ddc1220ae997ad70782be4759cc69bed1cdfadaa142ce3801b"
I0603 14:11:38.949539 1131020 cri.go:89] found id: "6968f3f519bf8570d57156dc04ffb2b134f1771b089603deba6699b0da257329"
I0603 14:11:38.949560 1131020 cri.go:89] found id: ""
I0603 14:11:38.949591 1131020 logs.go:276] 2 containers: [85188c97e04c30ddc1220ae997ad70782be4759cc69bed1cdfadaa142ce3801b 6968f3f519bf8570d57156dc04ffb2b134f1771b089603deba6699b0da257329]
I0603 14:11:38.949675 1131020 ssh_runner.go:195] Run: which crictl
I0603 14:11:38.954069 1131020 ssh_runner.go:195] Run: which crictl
I0603 14:11:38.957380 1131020 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
I0603 14:11:38.957445 1131020 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0603 14:11:39.005984 1131020 cri.go:89] found id: "5a2f082a34bcb3453d32b29c5417b8c0f647127f6f1b676c1cf71297ba47272c"
I0603 14:11:39.006008 1131020 cri.go:89] found id: "f95eb4638c61f9ec72d05ad64afd52ecbf878475d2abbe9148bc9cc5d92eae15"
I0603 14:11:39.006013 1131020 cri.go:89] found id: ""
I0603 14:11:39.006021 1131020 logs.go:276] 2 containers: [5a2f082a34bcb3453d32b29c5417b8c0f647127f6f1b676c1cf71297ba47272c f95eb4638c61f9ec72d05ad64afd52ecbf878475d2abbe9148bc9cc5d92eae15]
I0603 14:11:39.006085 1131020 ssh_runner.go:195] Run: which crictl
I0603 14:11:39.011604 1131020 ssh_runner.go:195] Run: which crictl
I0603 14:11:39.019270 1131020 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
I0603 14:11:39.019392 1131020 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0603 14:11:39.083430 1131020 cri.go:89] found id: "6e61ebc3d6091ce5d38e949a66cfe5e03b2290c58168b498adbf315977f2e27f"
I0603 14:11:39.083450 1131020 cri.go:89] found id: "4877d09126aeced75668eb5084bd53add55bad2951822ef405a630af926cc099"
I0603 14:11:39.083455 1131020 cri.go:89] found id: ""
I0603 14:11:39.083463 1131020 logs.go:276] 2 containers: [6e61ebc3d6091ce5d38e949a66cfe5e03b2290c58168b498adbf315977f2e27f 4877d09126aeced75668eb5084bd53add55bad2951822ef405a630af926cc099]
I0603 14:11:39.083525 1131020 ssh_runner.go:195] Run: which crictl
I0603 14:11:39.091415 1131020 ssh_runner.go:195] Run: which crictl
I0603 14:11:39.095484 1131020 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
I0603 14:11:39.095571 1131020 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I0603 14:11:39.160804 1131020 cri.go:89] found id: "33fdccc7b8d89b6026b4d99aaa906dd249af2e13c9164ba7c300007c2e170409"
I0603 14:11:39.160828 1131020 cri.go:89] found id: ""
I0603 14:11:39.160836 1131020 logs.go:276] 1 containers: [33fdccc7b8d89b6026b4d99aaa906dd249af2e13c9164ba7c300007c2e170409]
I0603 14:11:39.160890 1131020 ssh_runner.go:195] Run: which crictl
I0603 14:11:39.175541 1131020 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
I0603 14:11:39.175615 1131020 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0603 14:11:39.224974 1131020 cri.go:89] found id: "d8876e71dcdbddfdf7645eb16fa82d58e3fdfe186a62fe3979cd00418d8f8bcc"
I0603 14:11:39.224997 1131020 cri.go:89] found id: "c328ba896fecaac93f102a2fbf5ebe2877e5f90cdd8963cb241341d2758e21bb"
I0603 14:11:39.225002 1131020 cri.go:89] found id: ""
I0603 14:11:39.225010 1131020 logs.go:276] 2 containers: [d8876e71dcdbddfdf7645eb16fa82d58e3fdfe186a62fe3979cd00418d8f8bcc c328ba896fecaac93f102a2fbf5ebe2877e5f90cdd8963cb241341d2758e21bb]
I0603 14:11:39.225070 1131020 ssh_runner.go:195] Run: which crictl
I0603 14:11:39.229810 1131020 ssh_runner.go:195] Run: which crictl
I0603 14:11:39.235566 1131020 logs.go:123] Gathering logs for kube-proxy [85188c97e04c30ddc1220ae997ad70782be4759cc69bed1cdfadaa142ce3801b] ...
I0603 14:11:39.235593 1131020 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 85188c97e04c30ddc1220ae997ad70782be4759cc69bed1cdfadaa142ce3801b"
I0603 14:11:39.300297 1131020 logs.go:123] Gathering logs for kube-proxy [6968f3f519bf8570d57156dc04ffb2b134f1771b089603deba6699b0da257329] ...
I0603 14:11:39.300322 1131020 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 6968f3f519bf8570d57156dc04ffb2b134f1771b089603deba6699b0da257329"
I0603 14:11:39.350701 1131020 logs.go:123] Gathering logs for kube-controller-manager [5a2f082a34bcb3453d32b29c5417b8c0f647127f6f1b676c1cf71297ba47272c] ...
I0603 14:11:39.350724 1131020 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 5a2f082a34bcb3453d32b29c5417b8c0f647127f6f1b676c1cf71297ba47272c"
I0603 14:11:39.461407 1131020 logs.go:123] Gathering logs for kube-controller-manager [f95eb4638c61f9ec72d05ad64afd52ecbf878475d2abbe9148bc9cc5d92eae15] ...
I0603 14:11:39.461443 1131020 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 f95eb4638c61f9ec72d05ad64afd52ecbf878475d2abbe9148bc9cc5d92eae15"
I0603 14:11:39.543004 1131020 logs.go:123] Gathering logs for kindnet [6e61ebc3d6091ce5d38e949a66cfe5e03b2290c58168b498adbf315977f2e27f] ...
I0603 14:11:39.543080 1131020 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 6e61ebc3d6091ce5d38e949a66cfe5e03b2290c58168b498adbf315977f2e27f"
I0603 14:11:39.622973 1131020 logs.go:123] Gathering logs for storage-provisioner [c328ba896fecaac93f102a2fbf5ebe2877e5f90cdd8963cb241341d2758e21bb] ...
I0603 14:11:39.623121 1131020 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 c328ba896fecaac93f102a2fbf5ebe2877e5f90cdd8963cb241341d2758e21bb"
I0603 14:11:39.671405 1131020 logs.go:123] Gathering logs for containerd ...
I0603 14:11:39.671469 1131020 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
I0603 14:11:39.736433 1131020 logs.go:123] Gathering logs for kubelet ...
I0603 14:11:39.736511 1131020 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0603 14:11:39.789130 1131020 logs.go:138] Found kubelet problem: Jun 03 14:06:10 old-k8s-version-506981 kubelet[664]: E0603 14:06:10.208177 664 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:old-k8s-version-506981" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-506981' and this object
W0603 14:11:39.789410 1131020 logs.go:138] Found kubelet problem: Jun 03 14:06:10 old-k8s-version-506981 kubelet[664]: E0603 14:06:10.209941 664 reflector.go:138] object-"kube-system"/"kube-proxy-token-pvz57": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kube-proxy-token-pvz57" is forbidden: User "system:node:old-k8s-version-506981" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-506981' and this object
W0603 14:11:39.789671 1131020 logs.go:138] Found kubelet problem: Jun 03 14:06:10 old-k8s-version-506981 kubelet[664]: E0603 14:06:10.210190 664 reflector.go:138] object-"kube-system"/"storage-provisioner-token-smbcg": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "storage-provisioner-token-smbcg" is forbidden: User "system:node:old-k8s-version-506981" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-506981' and this object
W0603 14:11:39.789901 1131020 logs.go:138] Found kubelet problem: Jun 03 14:06:10 old-k8s-version-506981 kubelet[664]: E0603 14:06:10.210456 664 reflector.go:138] object-"kube-system"/"coredns-token-xv6d8": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "coredns-token-xv6d8" is forbidden: User "system:node:old-k8s-version-506981" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-506981' and this object
W0603 14:11:39.790132 1131020 logs.go:138] Found kubelet problem: Jun 03 14:06:10 old-k8s-version-506981 kubelet[664]: E0603 14:06:10.210528 664 reflector.go:138] object-"kube-system"/"kindnet-token-fq9hv": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kindnet-token-fq9hv" is forbidden: User "system:node:old-k8s-version-506981" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-506981' and this object
W0603 14:11:39.796292 1131020 logs.go:138] Found kubelet problem: Jun 03 14:06:11 old-k8s-version-506981 kubelet[664]: E0603 14:06:11.073812 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0603 14:11:39.798966 1131020 logs.go:138] Found kubelet problem: Jun 03 14:06:11 old-k8s-version-506981 kubelet[664]: E0603 14:06:11.614544 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0603 14:11:39.802167 1131020 logs.go:138] Found kubelet problem: Jun 03 14:06:24 old-k8s-version-506981 kubelet[664]: E0603 14:06:24.329859 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0603 14:11:39.804030 1131020 logs.go:138] Found kubelet problem: Jun 03 14:06:38 old-k8s-version-506981 kubelet[664]: E0603 14:06:38.315629 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0603 14:11:39.804499 1131020 logs.go:138] Found kubelet problem: Jun 03 14:06:38 old-k8s-version-506981 kubelet[664]: E0603 14:06:38.732103 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
W0603 14:11:39.804841 1131020 logs.go:138] Found kubelet problem: Jun 03 14:06:39 old-k8s-version-506981 kubelet[664]: E0603 14:06:39.734217 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
W0603 14:11:39.805619 1131020 logs.go:138] Found kubelet problem: Jun 03 14:06:43 old-k8s-version-506981 kubelet[664]: E0603 14:06:43.748705 664 pod_workers.go:191] Error syncing pod f6d55879-c128-4952-b79e-f043befb0117 ("storage-provisioner_kube-system(f6d55879-c128-4952-b79e-f043befb0117)"), skipping: failed to "StartContainer" for "storage-provisioner" with CrashLoopBackOff: "back-off 10s restarting failed container=storage-provisioner pod=storage-provisioner_kube-system(f6d55879-c128-4952-b79e-f043befb0117)"
W0603 14:11:39.806208 1131020 logs.go:138] Found kubelet problem: Jun 03 14:06:48 old-k8s-version-506981 kubelet[664]: E0603 14:06:48.761458 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
W0603 14:11:39.808644 1131020 logs.go:138] Found kubelet problem: Jun 03 14:06:52 old-k8s-version-506981 kubelet[664]: E0603 14:06:52.332609 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0603 14:11:39.809443 1131020 logs.go:138] Found kubelet problem: Jun 03 14:06:58 old-k8s-version-506981 kubelet[664]: E0603 14:06:58.329403 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
W0603 14:11:39.809633 1131020 logs.go:138] Found kubelet problem: Jun 03 14:07:06 old-k8s-version-506981 kubelet[664]: E0603 14:07:06.320342 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0603 14:11:39.810227 1131020 logs.go:138] Found kubelet problem: Jun 03 14:07:10 old-k8s-version-506981 kubelet[664]: E0603 14:07:10.829816 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
W0603 14:11:39.810413 1131020 logs.go:138] Found kubelet problem: Jun 03 14:07:17 old-k8s-version-506981 kubelet[664]: E0603 14:07:17.316558 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0603 14:11:39.810911 1131020 logs.go:138] Found kubelet problem: Jun 03 14:07:18 old-k8s-version-506981 kubelet[664]: E0603 14:07:18.329173 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
W0603 14:11:39.811249 1131020 logs.go:138] Found kubelet problem: Jun 03 14:07:31 old-k8s-version-506981 kubelet[664]: E0603 14:07:31.317042 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
W0603 14:11:39.811447 1131020 logs.go:138] Found kubelet problem: Jun 03 14:07:31 old-k8s-version-506981 kubelet[664]: E0603 14:07:31.317768 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0603 14:11:39.813926 1131020 logs.go:138] Found kubelet problem: Jun 03 14:07:44 old-k8s-version-506981 kubelet[664]: E0603 14:07:44.324077 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0603 14:11:39.814259 1131020 logs.go:138] Found kubelet problem: Jun 03 14:07:45 old-k8s-version-506981 kubelet[664]: E0603 14:07:45.315456 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
W0603 14:11:39.814896 1131020 logs.go:138] Found kubelet problem: Jun 03 14:07:56 old-k8s-version-506981 kubelet[664]: E0603 14:07:56.923998 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
W0603 14:11:39.815230 1131020 logs.go:138] Found kubelet problem: Jun 03 14:07:58 old-k8s-version-506981 kubelet[664]: E0603 14:07:58.329444 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
W0603 14:11:39.815426 1131020 logs.go:138] Found kubelet problem: Jun 03 14:07:59 old-k8s-version-506981 kubelet[664]: E0603 14:07:59.315936 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0603 14:11:39.815759 1131020 logs.go:138] Found kubelet problem: Jun 03 14:08:11 old-k8s-version-506981 kubelet[664]: E0603 14:08:11.316364 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
W0603 14:11:39.815943 1131020 logs.go:138] Found kubelet problem: Jun 03 14:08:14 old-k8s-version-506981 kubelet[664]: E0603 14:08:14.325727 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0603 14:11:39.816270 1131020 logs.go:138] Found kubelet problem: Jun 03 14:08:26 old-k8s-version-506981 kubelet[664]: E0603 14:08:26.315345 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
W0603 14:11:39.816457 1131020 logs.go:138] Found kubelet problem: Jun 03 14:08:27 old-k8s-version-506981 kubelet[664]: E0603 14:08:27.315749 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0603 14:11:39.816646 1131020 logs.go:138] Found kubelet problem: Jun 03 14:08:39 old-k8s-version-506981 kubelet[664]: E0603 14:08:39.320622 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0603 14:11:39.816988 1131020 logs.go:138] Found kubelet problem: Jun 03 14:08:40 old-k8s-version-506981 kubelet[664]: E0603 14:08:40.316125 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
W0603 14:11:39.817173 1131020 logs.go:138] Found kubelet problem: Jun 03 14:08:51 old-k8s-version-506981 kubelet[664]: E0603 14:08:51.315996 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0603 14:11:39.817506 1131020 logs.go:138] Found kubelet problem: Jun 03 14:08:53 old-k8s-version-506981 kubelet[664]: E0603 14:08:53.316043 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
W0603 14:11:39.819943 1131020 logs.go:138] Found kubelet problem: Jun 03 14:09:06 old-k8s-version-506981 kubelet[664]: E0603 14:09:06.327535 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0603 14:11:39.820271 1131020 logs.go:138] Found kubelet problem: Jun 03 14:09:08 old-k8s-version-506981 kubelet[664]: E0603 14:09:08.315370 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
W0603 14:11:39.820867 1131020 logs.go:138] Found kubelet problem: Jun 03 14:09:20 old-k8s-version-506981 kubelet[664]: E0603 14:09:20.148479 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
W0603 14:11:39.821053 1131020 logs.go:138] Found kubelet problem: Jun 03 14:09:20 old-k8s-version-506981 kubelet[664]: E0603 14:09:20.315640 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0603 14:11:39.821380 1131020 logs.go:138] Found kubelet problem: Jun 03 14:09:28 old-k8s-version-506981 kubelet[664]: E0603 14:09:28.329571 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
W0603 14:11:39.821565 1131020 logs.go:138] Found kubelet problem: Jun 03 14:09:33 old-k8s-version-506981 kubelet[664]: E0603 14:09:33.319989 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0603 14:11:39.821899 1131020 logs.go:138] Found kubelet problem: Jun 03 14:09:41 old-k8s-version-506981 kubelet[664]: E0603 14:09:41.316992 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
W0603 14:11:39.822083 1131020 logs.go:138] Found kubelet problem: Jun 03 14:09:45 old-k8s-version-506981 kubelet[664]: E0603 14:09:45.316906 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0603 14:11:39.822411 1131020 logs.go:138] Found kubelet problem: Jun 03 14:09:52 old-k8s-version-506981 kubelet[664]: E0603 14:09:52.315330 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
W0603 14:11:39.822595 1131020 logs.go:138] Found kubelet problem: Jun 03 14:09:56 old-k8s-version-506981 kubelet[664]: E0603 14:09:56.315834 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0603 14:11:39.822974 1131020 logs.go:138] Found kubelet problem: Jun 03 14:10:05 old-k8s-version-506981 kubelet[664]: E0603 14:10:05.315871 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
W0603 14:11:39.823167 1131020 logs.go:138] Found kubelet problem: Jun 03 14:10:11 old-k8s-version-506981 kubelet[664]: E0603 14:10:11.316009 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0603 14:11:39.823498 1131020 logs.go:138] Found kubelet problem: Jun 03 14:10:20 old-k8s-version-506981 kubelet[664]: E0603 14:10:20.315554 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
W0603 14:11:39.823760 1131020 logs.go:138] Found kubelet problem: Jun 03 14:10:25 old-k8s-version-506981 kubelet[664]: E0603 14:10:25.315808 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0603 14:11:39.824099 1131020 logs.go:138] Found kubelet problem: Jun 03 14:10:33 old-k8s-version-506981 kubelet[664]: E0603 14:10:33.315329 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
W0603 14:11:39.824287 1131020 logs.go:138] Found kubelet problem: Jun 03 14:10:36 old-k8s-version-506981 kubelet[664]: E0603 14:10:36.315735 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0603 14:11:39.824616 1131020 logs.go:138] Found kubelet problem: Jun 03 14:10:48 old-k8s-version-506981 kubelet[664]: E0603 14:10:48.315758 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
W0603 14:11:39.824827 1131020 logs.go:138] Found kubelet problem: Jun 03 14:10:48 old-k8s-version-506981 kubelet[664]: E0603 14:10:48.316596 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0603 14:11:39.825156 1131020 logs.go:138] Found kubelet problem: Jun 03 14:11:02 old-k8s-version-506981 kubelet[664]: E0603 14:11:02.316423 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
W0603 14:11:39.825340 1131020 logs.go:138] Found kubelet problem: Jun 03 14:11:02 old-k8s-version-506981 kubelet[664]: E0603 14:11:02.317204 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0603 14:11:39.825672 1131020 logs.go:138] Found kubelet problem: Jun 03 14:11:14 old-k8s-version-506981 kubelet[664]: E0603 14:11:14.315897 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
W0603 14:11:39.825857 1131020 logs.go:138] Found kubelet problem: Jun 03 14:11:17 old-k8s-version-506981 kubelet[664]: E0603 14:11:17.315838 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0603 14:11:39.826187 1131020 logs.go:138] Found kubelet problem: Jun 03 14:11:27 old-k8s-version-506981 kubelet[664]: E0603 14:11:27.315441 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
W0603 14:11:39.826373 1131020 logs.go:138] Found kubelet problem: Jun 03 14:11:32 old-k8s-version-506981 kubelet[664]: E0603 14:11:32.315742 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0603 14:11:39.826808 1131020 logs.go:138] Found kubelet problem: Jun 03 14:11:38 old-k8s-version-506981 kubelet[664]: E0603 14:11:38.315767 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
I0603 14:11:39.826822 1131020 logs.go:123] Gathering logs for etcd [2812f3850287e9bd217797c7ff1ce588b53328c6abfa79f815865c965abed8c9] ...
I0603 14:11:39.826836 1131020 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 2812f3850287e9bd217797c7ff1ce588b53328c6abfa79f815865c965abed8c9"
I0603 14:11:39.880852 1131020 logs.go:123] Gathering logs for kube-scheduler [efa8ad7214e50f2aaef508788558e96bf0b60fc7ec0d449f453d3d7633d71c4c] ...
I0603 14:11:39.880885 1131020 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 efa8ad7214e50f2aaef508788558e96bf0b60fc7ec0d449f453d3d7633d71c4c"
I0603 14:11:39.934000 1131020 logs.go:123] Gathering logs for kubernetes-dashboard [33fdccc7b8d89b6026b4d99aaa906dd249af2e13c9164ba7c300007c2e170409] ...
I0603 14:11:39.934034 1131020 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 33fdccc7b8d89b6026b4d99aaa906dd249af2e13c9164ba7c300007c2e170409"
I0603 14:11:39.985626 1131020 logs.go:123] Gathering logs for container status ...
I0603 14:11:39.985658 1131020 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0603 14:11:40.051504 1131020 logs.go:123] Gathering logs for dmesg ...
I0603 14:11:40.051531 1131020 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0603 14:11:40.072795 1131020 logs.go:123] Gathering logs for coredns [63681387e89a2da532a81bdadf8fc98401b8666cce28ae3a2deb9614f979acca] ...
I0603 14:11:40.072827 1131020 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 63681387e89a2da532a81bdadf8fc98401b8666cce28ae3a2deb9614f979acca"
I0603 14:11:40.130775 1131020 logs.go:123] Gathering logs for coredns [78417eb766571e7487e28529180fd77f26d392a1ec4ea84a0f96fa78802948f6] ...
I0603 14:11:40.130805 1131020 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 78417eb766571e7487e28529180fd77f26d392a1ec4ea84a0f96fa78802948f6"
I0603 14:11:40.190773 1131020 logs.go:123] Gathering logs for kindnet [4877d09126aeced75668eb5084bd53add55bad2951822ef405a630af926cc099] ...
I0603 14:11:40.190802 1131020 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 4877d09126aeced75668eb5084bd53add55bad2951822ef405a630af926cc099"
I0603 14:11:40.239105 1131020 logs.go:123] Gathering logs for kube-apiserver [b218a8377d49dd148a59f25d54662fb0057bb32bade5fbaa37cd1bdc0c602423] ...
I0603 14:11:40.239180 1131020 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 b218a8377d49dd148a59f25d54662fb0057bb32bade5fbaa37cd1bdc0c602423"
I0603 14:11:40.333052 1131020 logs.go:123] Gathering logs for kube-apiserver [cff98b34e012670591f72e264bf28d021c645781e259a312066f3e8805f4afa6] ...
I0603 14:11:40.333086 1131020 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 cff98b34e012670591f72e264bf28d021c645781e259a312066f3e8805f4afa6"
I0603 14:11:40.406845 1131020 logs.go:123] Gathering logs for etcd [d958ffdd2556ba8d9c17f04f13419000435af96172a5d9e20f0e013a71c59942] ...
I0603 14:11:40.406880 1131020 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 d958ffdd2556ba8d9c17f04f13419000435af96172a5d9e20f0e013a71c59942"
I0603 14:11:40.479193 1131020 logs.go:123] Gathering logs for kube-scheduler [f6edc129f54e8676287bbd7aee0210985585277489be4a27610b67d25024944e] ...
I0603 14:11:40.479271 1131020 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 f6edc129f54e8676287bbd7aee0210985585277489be4a27610b67d25024944e"
I0603 14:11:40.546517 1131020 logs.go:123] Gathering logs for storage-provisioner [d8876e71dcdbddfdf7645eb16fa82d58e3fdfe186a62fe3979cd00418d8f8bcc] ...
I0603 14:11:40.546587 1131020 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 d8876e71dcdbddfdf7645eb16fa82d58e3fdfe186a62fe3979cd00418d8f8bcc"
I0603 14:11:40.623916 1131020 logs.go:123] Gathering logs for describe nodes ...
I0603 14:11:40.623985 1131020 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0603 14:11:38.256181 1141423 out.go:204] * Creating docker container (CPUs=2, Memory=2200MB) ...
I0603 14:11:38.256435 1141423 start.go:159] libmachine.API.Create for "embed-certs-674995" (driver="docker")
I0603 14:11:38.256464 1141423 client.go:168] LocalClient.Create starting
I0603 14:11:38.256527 1141423 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19011-937109/.minikube/certs/ca.pem
I0603 14:11:38.256567 1141423 main.go:141] libmachine: Decoding PEM data...
I0603 14:11:38.256580 1141423 main.go:141] libmachine: Parsing certificate...
I0603 14:11:38.256630 1141423 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19011-937109/.minikube/certs/cert.pem
I0603 14:11:38.256645 1141423 main.go:141] libmachine: Decoding PEM data...
I0603 14:11:38.256655 1141423 main.go:141] libmachine: Parsing certificate...
I0603 14:11:38.257115 1141423 cli_runner.go:164] Run: docker network inspect embed-certs-674995 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
W0603 14:11:38.271924 1141423 cli_runner.go:211] docker network inspect embed-certs-674995 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
I0603 14:11:38.272024 1141423 network_create.go:281] running [docker network inspect embed-certs-674995] to gather additional debugging logs...
I0603 14:11:38.272045 1141423 cli_runner.go:164] Run: docker network inspect embed-certs-674995
W0603 14:11:38.287688 1141423 cli_runner.go:211] docker network inspect embed-certs-674995 returned with exit code 1
I0603 14:11:38.287722 1141423 network_create.go:284] error running [docker network inspect embed-certs-674995]: docker network inspect embed-certs-674995: exit status 1
stdout:
[]
stderr:
Error response from daemon: network embed-certs-674995 not found
I0603 14:11:38.287735 1141423 network_create.go:286] output of [docker network inspect embed-certs-674995]: -- stdout --
[]
-- /stdout --
** stderr **
Error response from daemon: network embed-certs-674995 not found
** /stderr **
I0603 14:11:38.287833 1141423 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0603 14:11:38.304026 1141423 network.go:211] skipping subnet 192.168.49.0/24 that is taken: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName:br-6e5ec6770357 IfaceIPv4:192.168.49.1 IfaceMTU:1500 IfaceMAC:02:42:83:de:b4:1f} reservation:<nil>}
I0603 14:11:38.304483 1141423 network.go:211] skipping subnet 192.168.58.0/24 that is taken: &{IP:192.168.58.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.58.0/24 Gateway:192.168.58.1 ClientMin:192.168.58.2 ClientMax:192.168.58.254 Broadcast:192.168.58.255 IsPrivate:true Interface:{IfaceName:br-637e170d5a68 IfaceIPv4:192.168.58.1 IfaceMTU:1500 IfaceMAC:02:42:38:41:3c:2e} reservation:<nil>}
I0603 14:11:38.304888 1141423 network.go:211] skipping subnet 192.168.67.0/24 that is taken: &{IP:192.168.67.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.67.0/24 Gateway:192.168.67.1 ClientMin:192.168.67.2 ClientMax:192.168.67.254 Broadcast:192.168.67.255 IsPrivate:true Interface:{IfaceName:br-b2a5bc4e6e2e IfaceIPv4:192.168.67.1 IfaceMTU:1500 IfaceMAC:02:42:92:59:dc:0c} reservation:<nil>}
I0603 14:11:38.305327 1141423 network.go:211] skipping subnet 192.168.76.0/24 that is taken: &{IP:192.168.76.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.76.0/24 Gateway:192.168.76.1 ClientMin:192.168.76.2 ClientMax:192.168.76.254 Broadcast:192.168.76.255 IsPrivate:true Interface:{IfaceName:br-140bb90eb980 IfaceIPv4:192.168.76.1 IfaceMTU:1500 IfaceMAC:02:42:22:bd:c5:bd} reservation:<nil>}
I0603 14:11:38.305855 1141423 network.go:206] using free private subnet 192.168.85.0/24: &{IP:192.168.85.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.85.0/24 Gateway:192.168.85.1 ClientMin:192.168.85.2 ClientMax:192.168.85.254 Broadcast:192.168.85.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0x40018a16c0}
I0603 14:11:38.305902 1141423 network_create.go:124] attempt to create docker network embed-certs-674995 192.168.85.0/24 with gateway 192.168.85.1 and MTU of 1500 ...
I0603 14:11:38.305970 1141423 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.85.0/24 --gateway=192.168.85.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=embed-certs-674995 embed-certs-674995
I0603 14:11:38.375895 1141423 network_create.go:108] docker network embed-certs-674995 192.168.85.0/24 created
I0603 14:11:38.375930 1141423 kic.go:121] calculated static IP "192.168.85.2" for the "embed-certs-674995" container
I0603 14:11:38.376014 1141423 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
I0603 14:11:38.394260 1141423 cli_runner.go:164] Run: docker volume create embed-certs-674995 --label name.minikube.sigs.k8s.io=embed-certs-674995 --label created_by.minikube.sigs.k8s.io=true
I0603 14:11:38.410142 1141423 oci.go:103] Successfully created a docker volume embed-certs-674995
I0603 14:11:38.410246 1141423 cli_runner.go:164] Run: docker run --rm --name embed-certs-674995-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=embed-certs-674995 --entrypoint /usr/bin/test -v embed-certs-674995:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1716228441-18934@sha256:628b3f20803bc9c4302fd048087dd36cf2ff5dc9ab0ded395ec3288e2f1d0862 -d /var/lib
I0603 14:11:39.085333 1141423 oci.go:107] Successfully prepared a docker volume embed-certs-674995
I0603 14:11:39.085380 1141423 preload.go:132] Checking if preload exists for k8s version v1.30.1 and runtime containerd
I0603 14:11:39.085400 1141423 kic.go:194] Starting extracting preloaded images to volume ...
I0603 14:11:39.085473 1141423 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/19011-937109/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.1-containerd-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v embed-certs-674995:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1716228441-18934@sha256:628b3f20803bc9c4302fd048087dd36cf2ff5dc9ab0ded395ec3288e2f1d0862 -I lz4 -xf /preloaded.tar -C /extractDir
I0603 14:11:40.811347 1131020 out.go:304] Setting ErrFile to fd 2...
I0603 14:11:40.811427 1131020 out.go:338] TERM=,COLORTERM=, which probably does not support color
W0603 14:11:40.811502 1131020 out.go:239] X Problems detected in kubelet:
W0603 14:11:40.811548 1131020 out.go:239] Jun 03 14:11:14 old-k8s-version-506981 kubelet[664]: E0603 14:11:14.315897 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
W0603 14:11:40.811585 1131020 out.go:239] Jun 03 14:11:17 old-k8s-version-506981 kubelet[664]: E0603 14:11:17.315838 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0603 14:11:40.811620 1131020 out.go:239] Jun 03 14:11:27 old-k8s-version-506981 kubelet[664]: E0603 14:11:27.315441 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
W0603 14:11:40.811658 1131020 out.go:239] Jun 03 14:11:32 old-k8s-version-506981 kubelet[664]: E0603 14:11:32.315742 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0603 14:11:40.811703 1131020 out.go:239] Jun 03 14:11:38 old-k8s-version-506981 kubelet[664]: E0603 14:11:38.315767 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
I0603 14:11:40.811816 1131020 out.go:304] Setting ErrFile to fd 2...
I0603 14:11:40.811840 1131020 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0603 14:11:43.973293 1141423 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/19011-937109/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.1-containerd-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v embed-certs-674995:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1716228441-18934@sha256:628b3f20803bc9c4302fd048087dd36cf2ff5dc9ab0ded395ec3288e2f1d0862 -I lz4 -xf /preloaded.tar -C /extractDir: (4.887781967s)
I0603 14:11:43.973324 1141423 kic.go:203] duration metric: took 4.887919843s to extract preloaded images to volume ...
W0603 14:11:43.973462 1141423 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
I0603 14:11:43.973605 1141423 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
I0603 14:11:44.024389 1141423 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname embed-certs-674995 --name embed-certs-674995 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=embed-certs-674995 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=embed-certs-674995 --network embed-certs-674995 --ip 192.168.85.2 --volume embed-certs-674995:/var --security-opt apparmor=unconfined --memory=2200mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1716228441-18934@sha256:628b3f20803bc9c4302fd048087dd36cf2ff5dc9ab0ded395ec3288e2f1d0862
I0603 14:11:44.373321 1141423 cli_runner.go:164] Run: docker container inspect embed-certs-674995 --format={{.State.Running}}
I0603 14:11:44.393858 1141423 cli_runner.go:164] Run: docker container inspect embed-certs-674995 --format={{.State.Status}}
I0603 14:11:44.413689 1141423 cli_runner.go:164] Run: docker exec embed-certs-674995 stat /var/lib/dpkg/alternatives/iptables
I0603 14:11:44.481621 1141423 oci.go:144] the created container "embed-certs-674995" has a running status.
I0603 14:11:44.481648 1141423 kic.go:225] Creating ssh key for kic: /home/jenkins/minikube-integration/19011-937109/.minikube/machines/embed-certs-674995/id_rsa...
I0603 14:11:44.712291 1141423 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/19011-937109/.minikube/machines/embed-certs-674995/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
I0603 14:11:44.744943 1141423 cli_runner.go:164] Run: docker container inspect embed-certs-674995 --format={{.State.Status}}
I0603 14:11:44.763553 1141423 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
I0603 14:11:44.763571 1141423 kic_runner.go:114] Args: [docker exec --privileged embed-certs-674995 chown docker:docker /home/docker/.ssh/authorized_keys]
I0603 14:11:44.856119 1141423 cli_runner.go:164] Run: docker container inspect embed-certs-674995 --format={{.State.Status}}
I0603 14:11:44.877909 1141423 machine.go:94] provisionDockerMachine start ...
I0603 14:11:44.878000 1141423 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-674995
I0603 14:11:44.896593 1141423 main.go:141] libmachine: Using SSH client type: native
I0603 14:11:44.896975 1141423 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2b30] 0x3e5390 <nil> [] 0s} 127.0.0.1 34204 <nil> <nil>}
I0603 14:11:44.896989 1141423 main.go:141] libmachine: About to run SSH command:
hostname
I0603 14:11:44.898763 1141423 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: EOF
I0603 14:11:48.020785 1141423 main.go:141] libmachine: SSH cmd err, output: <nil>: embed-certs-674995
I0603 14:11:48.020816 1141423 ubuntu.go:169] provisioning hostname "embed-certs-674995"
I0603 14:11:48.020887 1141423 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-674995
I0603 14:11:48.038441 1141423 main.go:141] libmachine: Using SSH client type: native
I0603 14:11:48.038723 1141423 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2b30] 0x3e5390 <nil> [] 0s} 127.0.0.1 34204 <nil> <nil>}
I0603 14:11:48.038743 1141423 main.go:141] libmachine: About to run SSH command:
sudo hostname embed-certs-674995 && echo "embed-certs-674995" | sudo tee /etc/hostname
I0603 14:11:48.174594 1141423 main.go:141] libmachine: SSH cmd err, output: <nil>: embed-certs-674995
I0603 14:11:48.174676 1141423 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-674995
I0603 14:11:48.198071 1141423 main.go:141] libmachine: Using SSH client type: native
I0603 14:11:48.198334 1141423 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2b30] 0x3e5390 <nil> [] 0s} 127.0.0.1 34204 <nil> <nil>}
I0603 14:11:48.198356 1141423 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sembed-certs-674995' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 embed-certs-674995/g' /etc/hosts;
else
echo '127.0.1.1 embed-certs-674995' | sudo tee -a /etc/hosts;
fi
fi
I0603 14:11:48.324626 1141423 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0603 14:11:48.324654 1141423 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/19011-937109/.minikube CaCertPath:/home/jenkins/minikube-integration/19011-937109/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19011-937109/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19011-937109/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19011-937109/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19011-937109/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19011-937109/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19011-937109/.minikube}
I0603 14:11:48.324679 1141423 ubuntu.go:177] setting up certificates
I0603 14:11:48.324714 1141423 provision.go:84] configureAuth start
I0603 14:11:48.324791 1141423 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-674995
I0603 14:11:48.340599 1141423 provision.go:143] copyHostCerts
I0603 14:11:48.340677 1141423 exec_runner.go:144] found /home/jenkins/minikube-integration/19011-937109/.minikube/ca.pem, removing ...
I0603 14:11:48.340746 1141423 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19011-937109/.minikube/ca.pem
I0603 14:11:48.340848 1141423 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19011-937109/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19011-937109/.minikube/ca.pem (1082 bytes)
I0603 14:11:48.340954 1141423 exec_runner.go:144] found /home/jenkins/minikube-integration/19011-937109/.minikube/cert.pem, removing ...
I0603 14:11:48.340965 1141423 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19011-937109/.minikube/cert.pem
I0603 14:11:48.340998 1141423 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19011-937109/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19011-937109/.minikube/cert.pem (1123 bytes)
I0603 14:11:48.341070 1141423 exec_runner.go:144] found /home/jenkins/minikube-integration/19011-937109/.minikube/key.pem, removing ...
I0603 14:11:48.341079 1141423 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19011-937109/.minikube/key.pem
I0603 14:11:48.341106 1141423 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19011-937109/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19011-937109/.minikube/key.pem (1675 bytes)
I0603 14:11:48.341169 1141423 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19011-937109/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19011-937109/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19011-937109/.minikube/certs/ca-key.pem org=jenkins.embed-certs-674995 san=[127.0.0.1 192.168.85.2 embed-certs-674995 localhost minikube]
I0603 14:11:48.878497 1141423 provision.go:177] copyRemoteCerts
I0603 14:11:48.878572 1141423 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0603 14:11:48.878619 1141423 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-674995
I0603 14:11:48.897041 1141423 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34204 SSHKeyPath:/home/jenkins/minikube-integration/19011-937109/.minikube/machines/embed-certs-674995/id_rsa Username:docker}
I0603 14:11:48.986727 1141423 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19011-937109/.minikube/machines/server.pem --> /etc/docker/server.pem (1224 bytes)
I0603 14:11:49.015153 1141423 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19011-937109/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0603 14:11:49.040629 1141423 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19011-937109/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
I0603 14:11:49.065120 1141423 provision.go:87] duration metric: took 740.390342ms to configureAuth
I0603 14:11:49.065204 1141423 ubuntu.go:193] setting minikube options for container-runtime
I0603 14:11:49.065416 1141423 config.go:182] Loaded profile config "embed-certs-674995": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.30.1
I0603 14:11:49.065439 1141423 machine.go:97] duration metric: took 4.187502256s to provisionDockerMachine
I0603 14:11:49.065447 1141423 client.go:171] duration metric: took 10.808978512s to LocalClient.Create
I0603 14:11:49.065465 1141423 start.go:167] duration metric: took 10.809031114s to libmachine.API.Create "embed-certs-674995"
I0603 14:11:49.065476 1141423 start.go:293] postStartSetup for "embed-certs-674995" (driver="docker")
I0603 14:11:49.065485 1141423 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0603 14:11:49.065546 1141423 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0603 14:11:49.065599 1141423 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-674995
I0603 14:11:49.081482 1141423 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34204 SSHKeyPath:/home/jenkins/minikube-integration/19011-937109/.minikube/machines/embed-certs-674995/id_rsa Username:docker}
I0603 14:11:49.170026 1141423 ssh_runner.go:195] Run: cat /etc/os-release
I0603 14:11:49.173077 1141423 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0603 14:11:49.173112 1141423 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0603 14:11:49.173122 1141423 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0603 14:11:49.173129 1141423 info.go:137] Remote host: Ubuntu 22.04.4 LTS
I0603 14:11:49.173138 1141423 filesync.go:126] Scanning /home/jenkins/minikube-integration/19011-937109/.minikube/addons for local assets ...
I0603 14:11:49.173196 1141423 filesync.go:126] Scanning /home/jenkins/minikube-integration/19011-937109/.minikube/files for local assets ...
I0603 14:11:49.173284 1141423 filesync.go:149] local asset: /home/jenkins/minikube-integration/19011-937109/.minikube/files/etc/ssl/certs/9425412.pem -> 9425412.pem in /etc/ssl/certs
I0603 14:11:49.173389 1141423 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0603 14:11:49.181690 1141423 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19011-937109/.minikube/files/etc/ssl/certs/9425412.pem --> /etc/ssl/certs/9425412.pem (1708 bytes)
I0603 14:11:49.206834 1141423 start.go:296] duration metric: took 141.34403ms for postStartSetup
I0603 14:11:49.207259 1141423 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-674995
I0603 14:11:49.223666 1141423 profile.go:143] Saving config to /home/jenkins/minikube-integration/19011-937109/.minikube/profiles/embed-certs-674995/config.json ...
I0603 14:11:49.223951 1141423 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0603 14:11:49.224004 1141423 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-674995
I0603 14:11:49.239801 1141423 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34204 SSHKeyPath:/home/jenkins/minikube-integration/19011-937109/.minikube/machines/embed-certs-674995/id_rsa Username:docker}
I0603 14:11:49.329609 1141423 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I0603 14:11:49.334287 1141423 start.go:128] duration metric: took 11.081228635s to createHost
I0603 14:11:49.334311 1141423 start.go:83] releasing machines lock for "embed-certs-674995", held for 11.08136734s
I0603 14:11:49.334381 1141423 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-674995
I0603 14:11:49.349188 1141423 ssh_runner.go:195] Run: cat /version.json
I0603 14:11:49.349245 1141423 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-674995
I0603 14:11:49.349246 1141423 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0603 14:11:49.349318 1141423 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-674995
I0603 14:11:49.373261 1141423 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34204 SSHKeyPath:/home/jenkins/minikube-integration/19011-937109/.minikube/machines/embed-certs-674995/id_rsa Username:docker}
I0603 14:11:49.374581 1141423 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34204 SSHKeyPath:/home/jenkins/minikube-integration/19011-937109/.minikube/machines/embed-certs-674995/id_rsa Username:docker}
I0603 14:11:49.574723 1141423 ssh_runner.go:195] Run: systemctl --version
I0603 14:11:49.579458 1141423 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I0603 14:11:49.583715 1141423 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
I0603 14:11:49.611314 1141423 cni.go:230] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
I0603 14:11:49.611400 1141423 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0603 14:11:49.640964 1141423 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist, /etc/cni/net.d/100-crio-bridge.conf] bridge cni config(s)
I0603 14:11:49.640999 1141423 start.go:494] detecting cgroup driver to use...
I0603 14:11:49.641037 1141423 detect.go:196] detected "cgroupfs" cgroup driver on host os
I0603 14:11:49.641100 1141423 ssh_runner.go:195] Run: sudo systemctl stop -f crio
I0603 14:11:49.654004 1141423 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I0603 14:11:49.665784 1141423 docker.go:217] disabling cri-docker service (if available) ...
I0603 14:11:49.665869 1141423 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0603 14:11:49.687515 1141423 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0603 14:11:49.709442 1141423 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0603 14:11:49.809414 1141423 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0603 14:11:49.916823 1141423 docker.go:233] disabling docker service ...
I0603 14:11:49.916928 1141423 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0603 14:11:49.938515 1141423 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0603 14:11:49.951055 1141423 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0603 14:11:50.054533 1141423 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0603 14:11:50.170575 1141423 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0603 14:11:50.182835 1141423 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///run/containerd/containerd.sock
" | sudo tee /etc/crictl.yaml"
I0603 14:11:50.200241 1141423 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.9"|' /etc/containerd/config.toml"
I0603 14:11:50.210591 1141423 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
I0603 14:11:50.220568 1141423 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...
I0603 14:11:50.220639 1141423 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
I0603 14:11:50.230823 1141423 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0603 14:11:50.240495 1141423 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
I0603 14:11:50.252585 1141423 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0603 14:11:50.262937 1141423 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0603 14:11:50.272186 1141423 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
I0603 14:11:50.282515 1141423 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *enable_unprivileged_ports = .*/d' /etc/containerd/config.toml"
I0603 14:11:50.292200 1141423 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)\[plugins."io.containerd.grpc.v1.cri"\]|&\n\1 enable_unprivileged_ports = true|' /etc/containerd/config.toml"
I0603 14:11:50.302353 1141423 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0603 14:11:50.310814 1141423 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0603 14:11:50.319591 1141423 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0603 14:11:50.415352 1141423 ssh_runner.go:195] Run: sudo systemctl restart containerd
I0603 14:11:50.561671 1141423 start.go:541] Will wait 60s for socket path /run/containerd/containerd.sock
I0603 14:11:50.561793 1141423 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
I0603 14:11:50.565860 1141423 start.go:562] Will wait 60s for crictl version
I0603 14:11:50.565964 1141423 ssh_runner.go:195] Run: which crictl
I0603 14:11:50.569573 1141423 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0603 14:11:50.606533 1141423 start.go:578] Version: 0.1.0
RuntimeName: containerd
RuntimeVersion: 1.6.31
RuntimeApiVersion: v1
I0603 14:11:50.606642 1141423 ssh_runner.go:195] Run: containerd --version
I0603 14:11:50.631114 1141423 ssh_runner.go:195] Run: containerd --version
I0603 14:11:50.655743 1141423 out.go:177] * Preparing Kubernetes v1.30.1 on containerd 1.6.31 ...
I0603 14:11:50.657278 1141423 cli_runner.go:164] Run: docker network inspect embed-certs-674995 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0603 14:11:50.671876 1141423 ssh_runner.go:195] Run: grep 192.168.85.1 host.minikube.internal$ /etc/hosts
I0603 14:11:50.675398 1141423 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.85.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0603 14:11:50.686462 1141423 kubeadm.go:877] updating cluster {Name:embed-certs-674995 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1716228441-18934@sha256:628b3f20803bc9c4302fd048087dd36cf2ff5dc9ab0ded395ec3288e2f1d0862 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.1 ClusterName:embed-certs-674995 Namespace:default APIServerHAVIP: APIServerName:minikubeCA AP
IServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.30.1 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:
false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0603 14:11:50.686579 1141423 preload.go:132] Checking if preload exists for k8s version v1.30.1 and runtime containerd
I0603 14:11:50.686640 1141423 ssh_runner.go:195] Run: sudo crictl images --output json
I0603 14:11:50.724606 1141423 containerd.go:627] all images are preloaded for containerd runtime.
I0603 14:11:50.724627 1141423 containerd.go:534] Images already preloaded, skipping extraction
I0603 14:11:50.724711 1141423 ssh_runner.go:195] Run: sudo crictl images --output json
I0603 14:11:50.763102 1141423 containerd.go:627] all images are preloaded for containerd runtime.
I0603 14:11:50.763127 1141423 cache_images.go:84] Images are preloaded, skipping loading
I0603 14:11:50.763136 1141423 kubeadm.go:928] updating node { 192.168.85.2 8443 v1.30.1 containerd true true} ...
I0603 14:11:50.763236 1141423 kubeadm.go:940] kubelet [Unit]
Wants=containerd.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.30.1/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=embed-certs-674995 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.85.2
[Install]
config:
{KubernetesVersion:v1.30.1 ClusterName:embed-certs-674995 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0603 14:11:50.763305 1141423 ssh_runner.go:195] Run: sudo crictl info
I0603 14:11:50.801374 1141423 cni.go:84] Creating CNI manager for ""
I0603 14:11:50.801398 1141423 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0603 14:11:50.801407 1141423 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0603 14:11:50.801452 1141423 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.85.2 APIServerPort:8443 KubernetesVersion:v1.30.1 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:embed-certs-674995 NodeName:embed-certs-674995 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.85.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.85.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPo
dPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///run/containerd/containerd.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I0603 14:11:50.801598 1141423 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta3
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.85.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///run/containerd/containerd.sock
name: "embed-certs-674995"
kubeletExtraArgs:
node-ip: 192.168.85.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta3
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.85.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.30.1
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
containerRuntimeEndpoint: unix:///run/containerd/containerd.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%!"(MISSING)
nodefs.inodesFree: "0%!"(MISSING)
imagefs.available: "0%!"(MISSING)
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0603 14:11:50.801668 1141423 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.30.1
I0603 14:11:50.810628 1141423 binaries.go:44] Found k8s binaries, skipping transfer
I0603 14:11:50.810701 1141423 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0603 14:11:50.820917 1141423 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (322 bytes)
I0603 14:11:50.846566 1141423 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0603 14:11:50.867992 1141423 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2172 bytes)
I0603 14:11:50.893778 1141423 ssh_runner.go:195] Run: grep 192.168.85.2 control-plane.minikube.internal$ /etc/hosts
I0603 14:11:50.897919 1141423 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.85.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0603 14:11:50.909809 1141423 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0603 14:11:51.039136 1141423 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0603 14:11:51.057750 1141423 certs.go:68] Setting up /home/jenkins/minikube-integration/19011-937109/.minikube/profiles/embed-certs-674995 for IP: 192.168.85.2
I0603 14:11:51.057777 1141423 certs.go:194] generating shared ca certs ...
I0603 14:11:51.057793 1141423 certs.go:226] acquiring lock for ca certs: {Name:mk853fcff69eaf29efad8518a57890a4039a3963 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0603 14:11:51.057941 1141423 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19011-937109/.minikube/ca.key
I0603 14:11:51.058030 1141423 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19011-937109/.minikube/proxy-client-ca.key
I0603 14:11:51.058048 1141423 certs.go:256] generating profile certs ...
I0603 14:11:51.058110 1141423 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/19011-937109/.minikube/profiles/embed-certs-674995/client.key
I0603 14:11:51.058136 1141423 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19011-937109/.minikube/profiles/embed-certs-674995/client.crt with IP's: []
I0603 14:11:51.732599 1141423 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19011-937109/.minikube/profiles/embed-certs-674995/client.crt ...
I0603 14:11:51.732631 1141423 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19011-937109/.minikube/profiles/embed-certs-674995/client.crt: {Name:mk2bff13c5f259bb9e8d9f7967b80d26362e6736 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0603 14:11:51.737435 1141423 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19011-937109/.minikube/profiles/embed-certs-674995/client.key ...
I0603 14:11:51.737506 1141423 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19011-937109/.minikube/profiles/embed-certs-674995/client.key: {Name:mk2bcf2f793b9e5f231802f6281b6517fd01bcd7 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0603 14:11:51.738118 1141423 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19011-937109/.minikube/profiles/embed-certs-674995/apiserver.key.f5fe0049
I0603 14:11:51.738170 1141423 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19011-937109/.minikube/profiles/embed-certs-674995/apiserver.crt.f5fe0049 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.85.2]
I0603 14:11:52.736462 1141423 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19011-937109/.minikube/profiles/embed-certs-674995/apiserver.crt.f5fe0049 ...
I0603 14:11:52.736497 1141423 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19011-937109/.minikube/profiles/embed-certs-674995/apiserver.crt.f5fe0049: {Name:mk2f6f9b00b7ab7bdba2057c0a64490b9c9104f5 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0603 14:11:52.737839 1141423 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19011-937109/.minikube/profiles/embed-certs-674995/apiserver.key.f5fe0049 ...
I0603 14:11:52.737868 1141423 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19011-937109/.minikube/profiles/embed-certs-674995/apiserver.key.f5fe0049: {Name:mk3713e04891a04e605c0fb2a60b3c1b33e2239c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0603 14:11:52.738018 1141423 certs.go:381] copying /home/jenkins/minikube-integration/19011-937109/.minikube/profiles/embed-certs-674995/apiserver.crt.f5fe0049 -> /home/jenkins/minikube-integration/19011-937109/.minikube/profiles/embed-certs-674995/apiserver.crt
I0603 14:11:52.738145 1141423 certs.go:385] copying /home/jenkins/minikube-integration/19011-937109/.minikube/profiles/embed-certs-674995/apiserver.key.f5fe0049 -> /home/jenkins/minikube-integration/19011-937109/.minikube/profiles/embed-certs-674995/apiserver.key
I0603 14:11:52.738232 1141423 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/19011-937109/.minikube/profiles/embed-certs-674995/proxy-client.key
I0603 14:11:52.738267 1141423 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19011-937109/.minikube/profiles/embed-certs-674995/proxy-client.crt with IP's: []
I0603 14:11:53.602809 1141423 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19011-937109/.minikube/profiles/embed-certs-674995/proxy-client.crt ...
I0603 14:11:53.602841 1141423 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19011-937109/.minikube/profiles/embed-certs-674995/proxy-client.crt: {Name:mk4758e4f9f3eaa409f3cf85560dd43d5e94952b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0603 14:11:53.603572 1141423 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19011-937109/.minikube/profiles/embed-certs-674995/proxy-client.key ...
I0603 14:11:53.603593 1141423 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19011-937109/.minikube/profiles/embed-certs-674995/proxy-client.key: {Name:mkc04a04d4f052a0c2eaf977b7eff320390d4f5d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0603 14:11:53.604251 1141423 certs.go:484] found cert: /home/jenkins/minikube-integration/19011-937109/.minikube/certs/942541.pem (1338 bytes)
W0603 14:11:53.604302 1141423 certs.go:480] ignoring /home/jenkins/minikube-integration/19011-937109/.minikube/certs/942541_empty.pem, impossibly tiny 0 bytes
I0603 14:11:53.604319 1141423 certs.go:484] found cert: /home/jenkins/minikube-integration/19011-937109/.minikube/certs/ca-key.pem (1679 bytes)
I0603 14:11:53.604344 1141423 certs.go:484] found cert: /home/jenkins/minikube-integration/19011-937109/.minikube/certs/ca.pem (1082 bytes)
I0603 14:11:53.604376 1141423 certs.go:484] found cert: /home/jenkins/minikube-integration/19011-937109/.minikube/certs/cert.pem (1123 bytes)
I0603 14:11:53.604402 1141423 certs.go:484] found cert: /home/jenkins/minikube-integration/19011-937109/.minikube/certs/key.pem (1675 bytes)
I0603 14:11:53.604454 1141423 certs.go:484] found cert: /home/jenkins/minikube-integration/19011-937109/.minikube/files/etc/ssl/certs/9425412.pem (1708 bytes)
I0603 14:11:53.605546 1141423 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19011-937109/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0603 14:11:53.633273 1141423 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19011-937109/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0603 14:11:53.658952 1141423 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19011-937109/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0603 14:11:53.683190 1141423 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19011-937109/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0603 14:11:53.708786 1141423 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19011-937109/.minikube/profiles/embed-certs-674995/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1428 bytes)
I0603 14:11:53.734735 1141423 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19011-937109/.minikube/profiles/embed-certs-674995/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0603 14:11:53.765267 1141423 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19011-937109/.minikube/profiles/embed-certs-674995/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0603 14:11:53.791129 1141423 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19011-937109/.minikube/profiles/embed-certs-674995/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0603 14:11:53.816542 1141423 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19011-937109/.minikube/certs/942541.pem --> /usr/share/ca-certificates/942541.pem (1338 bytes)
I0603 14:11:53.841811 1141423 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19011-937109/.minikube/files/etc/ssl/certs/9425412.pem --> /usr/share/ca-certificates/9425412.pem (1708 bytes)
I0603 14:11:53.865818 1141423 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19011-937109/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0603 14:11:53.891595 1141423 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0603 14:11:53.909715 1141423 ssh_runner.go:195] Run: openssl version
I0603 14:11:53.915251 1141423 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/942541.pem && ln -fs /usr/share/ca-certificates/942541.pem /etc/ssl/certs/942541.pem"
I0603 14:11:53.926155 1141423 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/942541.pem
I0603 14:11:53.929731 1141423 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Jun 3 13:27 /usr/share/ca-certificates/942541.pem
I0603 14:11:53.929800 1141423 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/942541.pem
I0603 14:11:53.936844 1141423 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/942541.pem /etc/ssl/certs/51391683.0"
I0603 14:11:53.946974 1141423 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/9425412.pem && ln -fs /usr/share/ca-certificates/9425412.pem /etc/ssl/certs/9425412.pem"
I0603 14:11:53.956363 1141423 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/9425412.pem
I0603 14:11:53.959898 1141423 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Jun 3 13:27 /usr/share/ca-certificates/9425412.pem
I0603 14:11:53.959961 1141423 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/9425412.pem
I0603 14:11:53.968358 1141423 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/9425412.pem /etc/ssl/certs/3ec20f2e.0"
I0603 14:11:53.977992 1141423 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0603 14:11:53.987265 1141423 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0603 14:11:53.992224 1141423 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Jun 3 13:20 /usr/share/ca-certificates/minikubeCA.pem
I0603 14:11:53.992332 1141423 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0603 14:11:53.999160 1141423 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0603 14:11:54.012248 1141423 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0603 14:11:54.015990 1141423 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0603 14:11:54.016058 1141423 kubeadm.go:391] StartCluster: {Name:embed-certs-674995 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1716228441-18934@sha256:628b3f20803bc9c4302fd048087dd36cf2ff5dc9ab0ded395ec3288e2f1d0862 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.1 ClusterName:embed-certs-674995 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APISe
rverNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.30.1 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:fal
se CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0603 14:11:54.016149 1141423 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}
I0603 14:11:54.016210 1141423 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0603 14:11:54.062863 1141423 cri.go:89] found id: ""
I0603 14:11:54.062950 1141423 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0603 14:11:54.072729 1141423 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0603 14:11:54.082557 1141423 kubeadm.go:213] ignoring SystemVerification for kubeadm because of docker driver
I0603 14:11:54.082632 1141423 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0603 14:11:54.093239 1141423 kubeadm.go:154] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0603 14:11:54.093262 1141423 kubeadm.go:156] found existing configuration files:
I0603 14:11:54.093317 1141423 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0603 14:11:54.104229 1141423 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0603 14:11:54.104348 1141423 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0603 14:11:54.114850 1141423 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0603 14:11:54.125037 1141423 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0603 14:11:54.125161 1141423 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0603 14:11:54.148717 1141423 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0603 14:11:54.159980 1141423 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0603 14:11:54.160094 1141423 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0603 14:11:54.174135 1141423 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0603 14:11:54.183172 1141423 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0603 14:11:54.183271 1141423 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0603 14:11:54.192202 1141423 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.30.1:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
I0603 14:11:54.250398 1141423 kubeadm.go:309] [init] Using Kubernetes version: v1.30.1
I0603 14:11:54.250739 1141423 kubeadm.go:309] [preflight] Running pre-flight checks
I0603 14:11:54.296732 1141423 kubeadm.go:309] [preflight] The system verification failed. Printing the output from the verification:
I0603 14:11:54.296877 1141423 kubeadm.go:309] [0;37mKERNEL_VERSION[0m: [0;32m5.15.0-1062-aws[0m
I0603 14:11:54.296942 1141423 kubeadm.go:309] [0;37mOS[0m: [0;32mLinux[0m
I0603 14:11:54.297026 1141423 kubeadm.go:309] [0;37mCGROUPS_CPU[0m: [0;32menabled[0m
I0603 14:11:54.297112 1141423 kubeadm.go:309] [0;37mCGROUPS_CPUACCT[0m: [0;32menabled[0m
I0603 14:11:54.297214 1141423 kubeadm.go:309] [0;37mCGROUPS_CPUSET[0m: [0;32menabled[0m
I0603 14:11:54.297292 1141423 kubeadm.go:309] [0;37mCGROUPS_DEVICES[0m: [0;32menabled[0m
I0603 14:11:54.297359 1141423 kubeadm.go:309] [0;37mCGROUPS_FREEZER[0m: [0;32menabled[0m
I0603 14:11:54.297433 1141423 kubeadm.go:309] [0;37mCGROUPS_MEMORY[0m: [0;32menabled[0m
I0603 14:11:54.297498 1141423 kubeadm.go:309] [0;37mCGROUPS_PIDS[0m: [0;32menabled[0m
I0603 14:11:54.297584 1141423 kubeadm.go:309] [0;37mCGROUPS_HUGETLB[0m: [0;32menabled[0m
I0603 14:11:54.297653 1141423 kubeadm.go:309] [0;37mCGROUPS_BLKIO[0m: [0;32menabled[0m
I0603 14:11:54.367892 1141423 kubeadm.go:309] [preflight] Pulling images required for setting up a Kubernetes cluster
I0603 14:11:54.368095 1141423 kubeadm.go:309] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0603 14:11:54.368255 1141423 kubeadm.go:309] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0603 14:11:54.607148 1141423 kubeadm.go:309] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0603 14:11:50.813181 1131020 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0603 14:11:50.826984 1131020 api_server.go:72] duration metric: took 5m57.436679808s to wait for apiserver process to appear ...
I0603 14:11:50.827006 1131020 api_server.go:88] waiting for apiserver healthz status ...
I0603 14:11:50.827043 1131020 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
I0603 14:11:50.827099 1131020 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0603 14:11:50.891087 1131020 cri.go:89] found id: "b218a8377d49dd148a59f25d54662fb0057bb32bade5fbaa37cd1bdc0c602423"
I0603 14:11:50.891105 1131020 cri.go:89] found id: "cff98b34e012670591f72e264bf28d021c645781e259a312066f3e8805f4afa6"
I0603 14:11:50.891110 1131020 cri.go:89] found id: ""
I0603 14:11:50.891117 1131020 logs.go:276] 2 containers: [b218a8377d49dd148a59f25d54662fb0057bb32bade5fbaa37cd1bdc0c602423 cff98b34e012670591f72e264bf28d021c645781e259a312066f3e8805f4afa6]
I0603 14:11:50.891174 1131020 ssh_runner.go:195] Run: which crictl
I0603 14:11:50.895802 1131020 ssh_runner.go:195] Run: which crictl
I0603 14:11:50.900432 1131020 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
I0603 14:11:50.900499 1131020 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0603 14:11:50.949831 1131020 cri.go:89] found id: "d958ffdd2556ba8d9c17f04f13419000435af96172a5d9e20f0e013a71c59942"
I0603 14:11:50.949850 1131020 cri.go:89] found id: "2812f3850287e9bd217797c7ff1ce588b53328c6abfa79f815865c965abed8c9"
I0603 14:11:50.949855 1131020 cri.go:89] found id: ""
I0603 14:11:50.949864 1131020 logs.go:276] 2 containers: [d958ffdd2556ba8d9c17f04f13419000435af96172a5d9e20f0e013a71c59942 2812f3850287e9bd217797c7ff1ce588b53328c6abfa79f815865c965abed8c9]
I0603 14:11:50.949923 1131020 ssh_runner.go:195] Run: which crictl
I0603 14:11:50.956750 1131020 ssh_runner.go:195] Run: which crictl
I0603 14:11:50.961654 1131020 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
I0603 14:11:50.961722 1131020 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0603 14:11:51.010783 1131020 cri.go:89] found id: "63681387e89a2da532a81bdadf8fc98401b8666cce28ae3a2deb9614f979acca"
I0603 14:11:51.010802 1131020 cri.go:89] found id: "78417eb766571e7487e28529180fd77f26d392a1ec4ea84a0f96fa78802948f6"
I0603 14:11:51.010806 1131020 cri.go:89] found id: ""
I0603 14:11:51.010813 1131020 logs.go:276] 2 containers: [63681387e89a2da532a81bdadf8fc98401b8666cce28ae3a2deb9614f979acca 78417eb766571e7487e28529180fd77f26d392a1ec4ea84a0f96fa78802948f6]
I0603 14:11:51.010878 1131020 ssh_runner.go:195] Run: which crictl
I0603 14:11:51.015404 1131020 ssh_runner.go:195] Run: which crictl
I0603 14:11:51.019770 1131020 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
I0603 14:11:51.019901 1131020 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0603 14:11:51.098178 1131020 cri.go:89] found id: "efa8ad7214e50f2aaef508788558e96bf0b60fc7ec0d449f453d3d7633d71c4c"
I0603 14:11:51.098267 1131020 cri.go:89] found id: "f6edc129f54e8676287bbd7aee0210985585277489be4a27610b67d25024944e"
I0603 14:11:51.098275 1131020 cri.go:89] found id: ""
I0603 14:11:51.098283 1131020 logs.go:276] 2 containers: [efa8ad7214e50f2aaef508788558e96bf0b60fc7ec0d449f453d3d7633d71c4c f6edc129f54e8676287bbd7aee0210985585277489be4a27610b67d25024944e]
I0603 14:11:51.098379 1131020 ssh_runner.go:195] Run: which crictl
I0603 14:11:51.110606 1131020 ssh_runner.go:195] Run: which crictl
I0603 14:11:51.115425 1131020 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
I0603 14:11:51.115514 1131020 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0603 14:11:51.217495 1131020 cri.go:89] found id: "85188c97e04c30ddc1220ae997ad70782be4759cc69bed1cdfadaa142ce3801b"
I0603 14:11:51.217514 1131020 cri.go:89] found id: "6968f3f519bf8570d57156dc04ffb2b134f1771b089603deba6699b0da257329"
I0603 14:11:51.217519 1131020 cri.go:89] found id: ""
I0603 14:11:51.217527 1131020 logs.go:276] 2 containers: [85188c97e04c30ddc1220ae997ad70782be4759cc69bed1cdfadaa142ce3801b 6968f3f519bf8570d57156dc04ffb2b134f1771b089603deba6699b0da257329]
I0603 14:11:51.217584 1131020 ssh_runner.go:195] Run: which crictl
I0603 14:11:51.222474 1131020 ssh_runner.go:195] Run: which crictl
I0603 14:11:51.225950 1131020 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
I0603 14:11:51.226053 1131020 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0603 14:11:51.276869 1131020 cri.go:89] found id: "5a2f082a34bcb3453d32b29c5417b8c0f647127f6f1b676c1cf71297ba47272c"
I0603 14:11:51.276886 1131020 cri.go:89] found id: "f95eb4638c61f9ec72d05ad64afd52ecbf878475d2abbe9148bc9cc5d92eae15"
I0603 14:11:51.276891 1131020 cri.go:89] found id: ""
I0603 14:11:51.276898 1131020 logs.go:276] 2 containers: [5a2f082a34bcb3453d32b29c5417b8c0f647127f6f1b676c1cf71297ba47272c f95eb4638c61f9ec72d05ad64afd52ecbf878475d2abbe9148bc9cc5d92eae15]
I0603 14:11:51.276954 1131020 ssh_runner.go:195] Run: which crictl
I0603 14:11:51.280497 1131020 ssh_runner.go:195] Run: which crictl
I0603 14:11:51.284057 1131020 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
I0603 14:11:51.284180 1131020 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0603 14:11:51.334067 1131020 cri.go:89] found id: "6e61ebc3d6091ce5d38e949a66cfe5e03b2290c58168b498adbf315977f2e27f"
I0603 14:11:51.334089 1131020 cri.go:89] found id: "4877d09126aeced75668eb5084bd53add55bad2951822ef405a630af926cc099"
I0603 14:11:51.334093 1131020 cri.go:89] found id: ""
I0603 14:11:51.334100 1131020 logs.go:276] 2 containers: [6e61ebc3d6091ce5d38e949a66cfe5e03b2290c58168b498adbf315977f2e27f 4877d09126aeced75668eb5084bd53add55bad2951822ef405a630af926cc099]
I0603 14:11:51.334157 1131020 ssh_runner.go:195] Run: which crictl
I0603 14:11:51.338160 1131020 ssh_runner.go:195] Run: which crictl
I0603 14:11:51.342871 1131020 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
I0603 14:11:51.342935 1131020 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I0603 14:11:51.399518 1131020 cri.go:89] found id: "33fdccc7b8d89b6026b4d99aaa906dd249af2e13c9164ba7c300007c2e170409"
I0603 14:11:51.399536 1131020 cri.go:89] found id: ""
I0603 14:11:51.399546 1131020 logs.go:276] 1 containers: [33fdccc7b8d89b6026b4d99aaa906dd249af2e13c9164ba7c300007c2e170409]
I0603 14:11:51.399671 1131020 ssh_runner.go:195] Run: which crictl
I0603 14:11:51.403980 1131020 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
I0603 14:11:51.404098 1131020 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0603 14:11:51.458279 1131020 cri.go:89] found id: "d8876e71dcdbddfdf7645eb16fa82d58e3fdfe186a62fe3979cd00418d8f8bcc"
I0603 14:11:51.458310 1131020 cri.go:89] found id: "c328ba896fecaac93f102a2fbf5ebe2877e5f90cdd8963cb241341d2758e21bb"
I0603 14:11:51.458315 1131020 cri.go:89] found id: ""
I0603 14:11:51.458322 1131020 logs.go:276] 2 containers: [d8876e71dcdbddfdf7645eb16fa82d58e3fdfe186a62fe3979cd00418d8f8bcc c328ba896fecaac93f102a2fbf5ebe2877e5f90cdd8963cb241341d2758e21bb]
I0603 14:11:51.458378 1131020 ssh_runner.go:195] Run: which crictl
I0603 14:11:51.461985 1131020 ssh_runner.go:195] Run: which crictl
I0603 14:11:51.465265 1131020 logs.go:123] Gathering logs for dmesg ...
I0603 14:11:51.465330 1131020 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0603 14:11:51.485699 1131020 logs.go:123] Gathering logs for etcd [d958ffdd2556ba8d9c17f04f13419000435af96172a5d9e20f0e013a71c59942] ...
I0603 14:11:51.485730 1131020 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 d958ffdd2556ba8d9c17f04f13419000435af96172a5d9e20f0e013a71c59942"
I0603 14:11:51.555800 1131020 logs.go:123] Gathering logs for kube-scheduler [efa8ad7214e50f2aaef508788558e96bf0b60fc7ec0d449f453d3d7633d71c4c] ...
I0603 14:11:51.555830 1131020 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 efa8ad7214e50f2aaef508788558e96bf0b60fc7ec0d449f453d3d7633d71c4c"
I0603 14:11:51.622097 1131020 logs.go:123] Gathering logs for kube-controller-manager [5a2f082a34bcb3453d32b29c5417b8c0f647127f6f1b676c1cf71297ba47272c] ...
I0603 14:11:51.622127 1131020 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 5a2f082a34bcb3453d32b29c5417b8c0f647127f6f1b676c1cf71297ba47272c"
I0603 14:11:51.708238 1131020 logs.go:123] Gathering logs for storage-provisioner [d8876e71dcdbddfdf7645eb16fa82d58e3fdfe186a62fe3979cd00418d8f8bcc] ...
I0603 14:11:51.708319 1131020 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 d8876e71dcdbddfdf7645eb16fa82d58e3fdfe186a62fe3979cd00418d8f8bcc"
I0603 14:11:51.766030 1131020 logs.go:123] Gathering logs for kube-apiserver [cff98b34e012670591f72e264bf28d021c645781e259a312066f3e8805f4afa6] ...
I0603 14:11:51.766057 1131020 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 cff98b34e012670591f72e264bf28d021c645781e259a312066f3e8805f4afa6"
I0603 14:11:51.880289 1131020 logs.go:123] Gathering logs for kindnet [6e61ebc3d6091ce5d38e949a66cfe5e03b2290c58168b498adbf315977f2e27f] ...
I0603 14:11:51.880329 1131020 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 6e61ebc3d6091ce5d38e949a66cfe5e03b2290c58168b498adbf315977f2e27f"
I0603 14:11:51.976542 1131020 logs.go:123] Gathering logs for container status ...
I0603 14:11:51.976574 1131020 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0603 14:11:52.044746 1131020 logs.go:123] Gathering logs for kube-apiserver [b218a8377d49dd148a59f25d54662fb0057bb32bade5fbaa37cd1bdc0c602423] ...
I0603 14:11:52.044777 1131020 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 b218a8377d49dd148a59f25d54662fb0057bb32bade5fbaa37cd1bdc0c602423"
I0603 14:11:52.123439 1131020 logs.go:123] Gathering logs for kube-scheduler [f6edc129f54e8676287bbd7aee0210985585277489be4a27610b67d25024944e] ...
I0603 14:11:52.123515 1131020 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 f6edc129f54e8676287bbd7aee0210985585277489be4a27610b67d25024944e"
I0603 14:11:52.193830 1131020 logs.go:123] Gathering logs for kube-proxy [85188c97e04c30ddc1220ae997ad70782be4759cc69bed1cdfadaa142ce3801b] ...
I0603 14:11:52.193865 1131020 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 85188c97e04c30ddc1220ae997ad70782be4759cc69bed1cdfadaa142ce3801b"
I0603 14:11:52.247302 1131020 logs.go:123] Gathering logs for kube-proxy [6968f3f519bf8570d57156dc04ffb2b134f1771b089603deba6699b0da257329] ...
I0603 14:11:52.247327 1131020 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 6968f3f519bf8570d57156dc04ffb2b134f1771b089603deba6699b0da257329"
I0603 14:11:52.294515 1131020 logs.go:123] Gathering logs for kube-controller-manager [f95eb4638c61f9ec72d05ad64afd52ecbf878475d2abbe9148bc9cc5d92eae15] ...
I0603 14:11:52.294549 1131020 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 f95eb4638c61f9ec72d05ad64afd52ecbf878475d2abbe9148bc9cc5d92eae15"
I0603 14:11:52.404073 1131020 logs.go:123] Gathering logs for kubernetes-dashboard [33fdccc7b8d89b6026b4d99aaa906dd249af2e13c9164ba7c300007c2e170409] ...
I0603 14:11:52.404163 1131020 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 33fdccc7b8d89b6026b4d99aaa906dd249af2e13c9164ba7c300007c2e170409"
I0603 14:11:52.447795 1131020 logs.go:123] Gathering logs for storage-provisioner [c328ba896fecaac93f102a2fbf5ebe2877e5f90cdd8963cb241341d2758e21bb] ...
I0603 14:11:52.447822 1131020 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 c328ba896fecaac93f102a2fbf5ebe2877e5f90cdd8963cb241341d2758e21bb"
I0603 14:11:52.493088 1131020 logs.go:123] Gathering logs for kubelet ...
I0603 14:11:52.493113 1131020 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0603 14:11:52.549848 1131020 logs.go:138] Found kubelet problem: Jun 03 14:06:10 old-k8s-version-506981 kubelet[664]: E0603 14:06:10.208177 664 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:old-k8s-version-506981" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-506981' and this object
W0603 14:11:52.550083 1131020 logs.go:138] Found kubelet problem: Jun 03 14:06:10 old-k8s-version-506981 kubelet[664]: E0603 14:06:10.209941 664 reflector.go:138] object-"kube-system"/"kube-proxy-token-pvz57": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kube-proxy-token-pvz57" is forbidden: User "system:node:old-k8s-version-506981" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-506981' and this object
W0603 14:11:52.550314 1131020 logs.go:138] Found kubelet problem: Jun 03 14:06:10 old-k8s-version-506981 kubelet[664]: E0603 14:06:10.210190 664 reflector.go:138] object-"kube-system"/"storage-provisioner-token-smbcg": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "storage-provisioner-token-smbcg" is forbidden: User "system:node:old-k8s-version-506981" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-506981' and this object
W0603 14:11:52.550525 1131020 logs.go:138] Found kubelet problem: Jun 03 14:06:10 old-k8s-version-506981 kubelet[664]: E0603 14:06:10.210456 664 reflector.go:138] object-"kube-system"/"coredns-token-xv6d8": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "coredns-token-xv6d8" is forbidden: User "system:node:old-k8s-version-506981" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-506981' and this object
W0603 14:11:52.550737 1131020 logs.go:138] Found kubelet problem: Jun 03 14:06:10 old-k8s-version-506981 kubelet[664]: E0603 14:06:10.210528 664 reflector.go:138] object-"kube-system"/"kindnet-token-fq9hv": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kindnet-token-fq9hv" is forbidden: User "system:node:old-k8s-version-506981" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-506981' and this object
W0603 14:11:52.557166 1131020 logs.go:138] Found kubelet problem: Jun 03 14:06:11 old-k8s-version-506981 kubelet[664]: E0603 14:06:11.073812 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0603 14:11:52.560313 1131020 logs.go:138] Found kubelet problem: Jun 03 14:06:11 old-k8s-version-506981 kubelet[664]: E0603 14:06:11.614544 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0603 14:11:52.563733 1131020 logs.go:138] Found kubelet problem: Jun 03 14:06:24 old-k8s-version-506981 kubelet[664]: E0603 14:06:24.329859 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0603 14:11:52.565555 1131020 logs.go:138] Found kubelet problem: Jun 03 14:06:38 old-k8s-version-506981 kubelet[664]: E0603 14:06:38.315629 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0603 14:11:52.566028 1131020 logs.go:138] Found kubelet problem: Jun 03 14:06:38 old-k8s-version-506981 kubelet[664]: E0603 14:06:38.732103 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
W0603 14:11:52.566358 1131020 logs.go:138] Found kubelet problem: Jun 03 14:06:39 old-k8s-version-506981 kubelet[664]: E0603 14:06:39.734217 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
W0603 14:11:52.567220 1131020 logs.go:138] Found kubelet problem: Jun 03 14:06:43 old-k8s-version-506981 kubelet[664]: E0603 14:06:43.748705 664 pod_workers.go:191] Error syncing pod f6d55879-c128-4952-b79e-f043befb0117 ("storage-provisioner_kube-system(f6d55879-c128-4952-b79e-f043befb0117)"), skipping: failed to "StartContainer" for "storage-provisioner" with CrashLoopBackOff: "back-off 10s restarting failed container=storage-provisioner pod=storage-provisioner_kube-system(f6d55879-c128-4952-b79e-f043befb0117)"
W0603 14:11:52.567819 1131020 logs.go:138] Found kubelet problem: Jun 03 14:06:48 old-k8s-version-506981 kubelet[664]: E0603 14:06:48.761458 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
W0603 14:11:52.571317 1131020 logs.go:138] Found kubelet problem: Jun 03 14:06:52 old-k8s-version-506981 kubelet[664]: E0603 14:06:52.332609 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0603 14:11:52.572218 1131020 logs.go:138] Found kubelet problem: Jun 03 14:06:58 old-k8s-version-506981 kubelet[664]: E0603 14:06:58.329403 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
W0603 14:11:52.572429 1131020 logs.go:138] Found kubelet problem: Jun 03 14:07:06 old-k8s-version-506981 kubelet[664]: E0603 14:07:06.320342 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0603 14:11:52.573025 1131020 logs.go:138] Found kubelet problem: Jun 03 14:07:10 old-k8s-version-506981 kubelet[664]: E0603 14:07:10.829816 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
W0603 14:11:52.573213 1131020 logs.go:138] Found kubelet problem: Jun 03 14:07:17 old-k8s-version-506981 kubelet[664]: E0603 14:07:17.316558 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0603 14:11:52.573571 1131020 logs.go:138] Found kubelet problem: Jun 03 14:07:18 old-k8s-version-506981 kubelet[664]: E0603 14:07:18.329173 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
W0603 14:11:52.573922 1131020 logs.go:138] Found kubelet problem: Jun 03 14:07:31 old-k8s-version-506981 kubelet[664]: E0603 14:07:31.317042 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
W0603 14:11:52.574152 1131020 logs.go:138] Found kubelet problem: Jun 03 14:07:31 old-k8s-version-506981 kubelet[664]: E0603 14:07:31.317768 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0603 14:11:52.576679 1131020 logs.go:138] Found kubelet problem: Jun 03 14:07:44 old-k8s-version-506981 kubelet[664]: E0603 14:07:44.324077 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0603 14:11:52.577018 1131020 logs.go:138] Found kubelet problem: Jun 03 14:07:45 old-k8s-version-506981 kubelet[664]: E0603 14:07:45.315456 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
W0603 14:11:52.577613 1131020 logs.go:138] Found kubelet problem: Jun 03 14:07:56 old-k8s-version-506981 kubelet[664]: E0603 14:07:56.923998 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
W0603 14:11:52.577966 1131020 logs.go:138] Found kubelet problem: Jun 03 14:07:58 old-k8s-version-506981 kubelet[664]: E0603 14:07:58.329444 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
W0603 14:11:52.578155 1131020 logs.go:138] Found kubelet problem: Jun 03 14:07:59 old-k8s-version-506981 kubelet[664]: E0603 14:07:59.315936 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0603 14:11:52.578484 1131020 logs.go:138] Found kubelet problem: Jun 03 14:08:11 old-k8s-version-506981 kubelet[664]: E0603 14:08:11.316364 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
W0603 14:11:52.578668 1131020 logs.go:138] Found kubelet problem: Jun 03 14:08:14 old-k8s-version-506981 kubelet[664]: E0603 14:08:14.325727 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0603 14:11:52.579081 1131020 logs.go:138] Found kubelet problem: Jun 03 14:08:26 old-k8s-version-506981 kubelet[664]: E0603 14:08:26.315345 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
W0603 14:11:52.579274 1131020 logs.go:138] Found kubelet problem: Jun 03 14:08:27 old-k8s-version-506981 kubelet[664]: E0603 14:08:27.315749 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0603 14:11:52.579458 1131020 logs.go:138] Found kubelet problem: Jun 03 14:08:39 old-k8s-version-506981 kubelet[664]: E0603 14:08:39.320622 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0603 14:11:52.579785 1131020 logs.go:138] Found kubelet problem: Jun 03 14:08:40 old-k8s-version-506981 kubelet[664]: E0603 14:08:40.316125 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
W0603 14:11:52.579969 1131020 logs.go:138] Found kubelet problem: Jun 03 14:08:51 old-k8s-version-506981 kubelet[664]: E0603 14:08:51.315996 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0603 14:11:52.580310 1131020 logs.go:138] Found kubelet problem: Jun 03 14:08:53 old-k8s-version-506981 kubelet[664]: E0603 14:08:53.316043 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
W0603 14:11:52.582830 1131020 logs.go:138] Found kubelet problem: Jun 03 14:09:06 old-k8s-version-506981 kubelet[664]: E0603 14:09:06.327535 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0603 14:11:52.583177 1131020 logs.go:138] Found kubelet problem: Jun 03 14:09:08 old-k8s-version-506981 kubelet[664]: E0603 14:09:08.315370 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
W0603 14:11:52.583847 1131020 logs.go:138] Found kubelet problem: Jun 03 14:09:20 old-k8s-version-506981 kubelet[664]: E0603 14:09:20.148479 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
W0603 14:11:52.584052 1131020 logs.go:138] Found kubelet problem: Jun 03 14:09:20 old-k8s-version-506981 kubelet[664]: E0603 14:09:20.315640 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0603 14:11:52.584385 1131020 logs.go:138] Found kubelet problem: Jun 03 14:09:28 old-k8s-version-506981 kubelet[664]: E0603 14:09:28.329571 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
W0603 14:11:52.584570 1131020 logs.go:138] Found kubelet problem: Jun 03 14:09:33 old-k8s-version-506981 kubelet[664]: E0603 14:09:33.319989 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0603 14:11:52.584907 1131020 logs.go:138] Found kubelet problem: Jun 03 14:09:41 old-k8s-version-506981 kubelet[664]: E0603 14:09:41.316992 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
W0603 14:11:52.585091 1131020 logs.go:138] Found kubelet problem: Jun 03 14:09:45 old-k8s-version-506981 kubelet[664]: E0603 14:09:45.316906 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0603 14:11:52.585415 1131020 logs.go:138] Found kubelet problem: Jun 03 14:09:52 old-k8s-version-506981 kubelet[664]: E0603 14:09:52.315330 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
W0603 14:11:52.585604 1131020 logs.go:138] Found kubelet problem: Jun 03 14:09:56 old-k8s-version-506981 kubelet[664]: E0603 14:09:56.315834 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0603 14:11:52.585929 1131020 logs.go:138] Found kubelet problem: Jun 03 14:10:05 old-k8s-version-506981 kubelet[664]: E0603 14:10:05.315871 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
W0603 14:11:52.586108 1131020 logs.go:138] Found kubelet problem: Jun 03 14:10:11 old-k8s-version-506981 kubelet[664]: E0603 14:10:11.316009 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0603 14:11:52.586432 1131020 logs.go:138] Found kubelet problem: Jun 03 14:10:20 old-k8s-version-506981 kubelet[664]: E0603 14:10:20.315554 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
W0603 14:11:52.586613 1131020 logs.go:138] Found kubelet problem: Jun 03 14:10:25 old-k8s-version-506981 kubelet[664]: E0603 14:10:25.315808 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0603 14:11:52.586939 1131020 logs.go:138] Found kubelet problem: Jun 03 14:10:33 old-k8s-version-506981 kubelet[664]: E0603 14:10:33.315329 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
W0603 14:11:52.587120 1131020 logs.go:138] Found kubelet problem: Jun 03 14:10:36 old-k8s-version-506981 kubelet[664]: E0603 14:10:36.315735 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0603 14:11:52.587443 1131020 logs.go:138] Found kubelet problem: Jun 03 14:10:48 old-k8s-version-506981 kubelet[664]: E0603 14:10:48.315758 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
W0603 14:11:52.587624 1131020 logs.go:138] Found kubelet problem: Jun 03 14:10:48 old-k8s-version-506981 kubelet[664]: E0603 14:10:48.316596 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0603 14:11:52.587949 1131020 logs.go:138] Found kubelet problem: Jun 03 14:11:02 old-k8s-version-506981 kubelet[664]: E0603 14:11:02.316423 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
W0603 14:11:52.588128 1131020 logs.go:138] Found kubelet problem: Jun 03 14:11:02 old-k8s-version-506981 kubelet[664]: E0603 14:11:02.317204 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0603 14:11:52.588452 1131020 logs.go:138] Found kubelet problem: Jun 03 14:11:14 old-k8s-version-506981 kubelet[664]: E0603 14:11:14.315897 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
W0603 14:11:52.588634 1131020 logs.go:138] Found kubelet problem: Jun 03 14:11:17 old-k8s-version-506981 kubelet[664]: E0603 14:11:17.315838 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0603 14:11:52.588975 1131020 logs.go:138] Found kubelet problem: Jun 03 14:11:27 old-k8s-version-506981 kubelet[664]: E0603 14:11:27.315441 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
W0603 14:11:52.589155 1131020 logs.go:138] Found kubelet problem: Jun 03 14:11:32 old-k8s-version-506981 kubelet[664]: E0603 14:11:32.315742 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0603 14:11:52.589478 1131020 logs.go:138] Found kubelet problem: Jun 03 14:11:38 old-k8s-version-506981 kubelet[664]: E0603 14:11:38.315767 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
W0603 14:11:52.589662 1131020 logs.go:138] Found kubelet problem: Jun 03 14:11:44 old-k8s-version-506981 kubelet[664]: E0603 14:11:44.316492 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
I0603 14:11:52.589671 1131020 logs.go:123] Gathering logs for describe nodes ...
I0603 14:11:52.589684 1131020 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0603 14:11:52.809194 1131020 logs.go:123] Gathering logs for etcd [2812f3850287e9bd217797c7ff1ce588b53328c6abfa79f815865c965abed8c9] ...
I0603 14:11:52.809270 1131020 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 2812f3850287e9bd217797c7ff1ce588b53328c6abfa79f815865c965abed8c9"
I0603 14:11:52.946370 1131020 logs.go:123] Gathering logs for coredns [63681387e89a2da532a81bdadf8fc98401b8666cce28ae3a2deb9614f979acca] ...
I0603 14:11:52.946445 1131020 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 63681387e89a2da532a81bdadf8fc98401b8666cce28ae3a2deb9614f979acca"
I0603 14:11:53.043735 1131020 logs.go:123] Gathering logs for coredns [78417eb766571e7487e28529180fd77f26d392a1ec4ea84a0f96fa78802948f6] ...
I0603 14:11:53.043820 1131020 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 78417eb766571e7487e28529180fd77f26d392a1ec4ea84a0f96fa78802948f6"
I0603 14:11:53.098134 1131020 logs.go:123] Gathering logs for kindnet [4877d09126aeced75668eb5084bd53add55bad2951822ef405a630af926cc099] ...
I0603 14:11:53.098160 1131020 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 4877d09126aeced75668eb5084bd53add55bad2951822ef405a630af926cc099"
I0603 14:11:53.162273 1131020 logs.go:123] Gathering logs for containerd ...
I0603 14:11:53.162345 1131020 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
I0603 14:11:53.231720 1131020 out.go:304] Setting ErrFile to fd 2...
I0603 14:11:53.231797 1131020 out.go:338] TERM=,COLORTERM=, which probably does not support color
W0603 14:11:53.231876 1131020 out.go:239] X Problems detected in kubelet:
W0603 14:11:53.232036 1131020 out.go:239] Jun 03 14:11:17 old-k8s-version-506981 kubelet[664]: E0603 14:11:17.315838 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0603 14:11:53.232073 1131020 out.go:239] Jun 03 14:11:27 old-k8s-version-506981 kubelet[664]: E0603 14:11:27.315441 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
W0603 14:11:53.232117 1131020 out.go:239] Jun 03 14:11:32 old-k8s-version-506981 kubelet[664]: E0603 14:11:32.315742 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0603 14:11:53.232161 1131020 out.go:239] Jun 03 14:11:38 old-k8s-version-506981 kubelet[664]: E0603 14:11:38.315767 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
W0603 14:11:53.232205 1131020 out.go:239] Jun 03 14:11:44 old-k8s-version-506981 kubelet[664]: E0603 14:11:44.316492 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
I0603 14:11:53.232255 1131020 out.go:304] Setting ErrFile to fd 2...
I0603 14:11:53.232275 1131020 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0603 14:11:54.610069 1141423 out.go:204] - Generating certificates and keys ...
I0603 14:11:54.610257 1141423 kubeadm.go:309] [certs] Using existing ca certificate authority
I0603 14:11:54.610379 1141423 kubeadm.go:309] [certs] Using existing apiserver certificate and key on disk
I0603 14:11:55.197209 1141423 kubeadm.go:309] [certs] Generating "apiserver-kubelet-client" certificate and key
I0603 14:11:55.683673 1141423 kubeadm.go:309] [certs] Generating "front-proxy-ca" certificate and key
I0603 14:11:55.934686 1141423 kubeadm.go:309] [certs] Generating "front-proxy-client" certificate and key
I0603 14:11:56.097571 1141423 kubeadm.go:309] [certs] Generating "etcd/ca" certificate and key
I0603 14:11:57.152600 1141423 kubeadm.go:309] [certs] Generating "etcd/server" certificate and key
I0603 14:11:57.152785 1141423 kubeadm.go:309] [certs] etcd/server serving cert is signed for DNS names [embed-certs-674995 localhost] and IPs [192.168.85.2 127.0.0.1 ::1]
I0603 14:11:57.308769 1141423 kubeadm.go:309] [certs] Generating "etcd/peer" certificate and key
I0603 14:11:57.309048 1141423 kubeadm.go:309] [certs] etcd/peer serving cert is signed for DNS names [embed-certs-674995 localhost] and IPs [192.168.85.2 127.0.0.1 ::1]
I0603 14:11:57.454721 1141423 kubeadm.go:309] [certs] Generating "etcd/healthcheck-client" certificate and key
I0603 14:11:57.930221 1141423 kubeadm.go:309] [certs] Generating "apiserver-etcd-client" certificate and key
I0603 14:11:58.319929 1141423 kubeadm.go:309] [certs] Generating "sa" key and public key
I0603 14:11:58.320188 1141423 kubeadm.go:309] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0603 14:11:58.505721 1141423 kubeadm.go:309] [kubeconfig] Writing "admin.conf" kubeconfig file
I0603 14:11:58.762319 1141423 kubeadm.go:309] [kubeconfig] Writing "super-admin.conf" kubeconfig file
I0603 14:11:59.125349 1141423 kubeadm.go:309] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0603 14:11:59.427510 1141423 kubeadm.go:309] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0603 14:11:59.557462 1141423 kubeadm.go:309] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0603 14:11:59.558165 1141423 kubeadm.go:309] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0603 14:11:59.562754 1141423 kubeadm.go:309] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0603 14:11:59.564933 1141423 out.go:204] - Booting up control plane ...
I0603 14:11:59.565038 1141423 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0603 14:11:59.565121 1141423 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0603 14:11:59.565930 1141423 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0603 14:11:59.577982 1141423 kubeadm.go:309] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0603 14:11:59.581404 1141423 kubeadm.go:309] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0603 14:11:59.581461 1141423 kubeadm.go:309] [kubelet-start] Starting the kubelet
I0603 14:11:59.679079 1141423 kubeadm.go:309] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests"
I0603 14:11:59.679170 1141423 kubeadm.go:309] [kubelet-check] Waiting for a healthy kubelet. This can take up to 4m0s
I0603 14:12:00.679833 1141423 kubeadm.go:309] [kubelet-check] The kubelet is healthy after 1.000896176s
I0603 14:12:00.679922 1141423 kubeadm.go:309] [api-check] Waiting for a healthy API server. This can take up to 4m0s
I0603 14:12:03.233231 1131020 api_server.go:253] Checking apiserver healthz at https://192.168.76.2:8443/healthz ...
I0603 14:12:03.242436 1131020 api_server.go:279] https://192.168.76.2:8443/healthz returned 200:
ok
I0603 14:12:03.244500 1131020 out.go:177]
W0603 14:12:03.246219 1131020 out.go:239] X Exiting due to K8S_UNHEALTHY_CONTROL_PLANE: wait 6m0s for node: wait for healthy API server: controlPlane never updated to v1.20.0
W0603 14:12:03.246262 1131020 out.go:239] * Suggestion: Control Plane could not update, try minikube delete --all --purge
W0603 14:12:03.246290 1131020 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/11417
W0603 14:12:03.246301 1131020 out.go:239] *
W0603 14:12:03.247257 1131020 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0603 14:12:03.248987 1131020 out.go:177]
==> container status <==
CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID POD
73f4ba64c15fa 523cad1a4df73 2 minutes ago Exited dashboard-metrics-scraper 5 a5e70e7fb6648 dashboard-metrics-scraper-8d5bb5db8-tcv2x
d8876e71dcdbd ba04bb24b9575 5 minutes ago Running storage-provisioner 2 14056d3e933ec storage-provisioner
33fdccc7b8d89 20b332c9a70d8 5 minutes ago Running kubernetes-dashboard 0 163b90e9b2293 kubernetes-dashboard-cd95d586-tl2sj
63681387e89a2 db91994f4ee8f 5 minutes ago Running coredns 1 64c42bc84c015 coredns-74ff55c5b-vqfdz
6e61ebc3d6091 89d73d416b992 5 minutes ago Running kindnet-cni 1 b78821b7de5c8 kindnet-fbj8b
c328ba896feca ba04bb24b9575 5 minutes ago Exited storage-provisioner 1 14056d3e933ec storage-provisioner
85188c97e04c3 25a5233254979 5 minutes ago Running kube-proxy 1 ee4cbdf7c9f87 kube-proxy-bxzwt
e0ebf2afea088 1611cd07b61d5 5 minutes ago Running busybox 1 b774c46e63e5f busybox
5a2f082a34bcb 1df8a2b116bd1 6 minutes ago Running kube-controller-manager 1 f351fdebf8c46 kube-controller-manager-old-k8s-version-506981
efa8ad7214e50 e7605f88f17d6 6 minutes ago Running kube-scheduler 1 20544645890ba kube-scheduler-old-k8s-version-506981
d958ffdd2556b 05b738aa1bc63 6 minutes ago Running etcd 1 9094dddfb68f0 etcd-old-k8s-version-506981
b218a8377d49d 2c08bbbc02d3a 6 minutes ago Running kube-apiserver 1 8d5a09c46cca7 kube-apiserver-old-k8s-version-506981
9387cddb62f6e 1611cd07b61d5 6 minutes ago Exited busybox 0 83cc10601d584 busybox
78417eb766571 db91994f4ee8f 8 minutes ago Exited coredns 0 a7542e0dcfb58 coredns-74ff55c5b-vqfdz
4877d09126aec 89d73d416b992 8 minutes ago Exited kindnet-cni 0 564dc48ee8a96 kindnet-fbj8b
6968f3f519bf8 25a5233254979 8 minutes ago Exited kube-proxy 0 ee880206fb9e8 kube-proxy-bxzwt
cff98b34e0126 2c08bbbc02d3a 8 minutes ago Exited kube-apiserver 0 f6426a88de51c kube-apiserver-old-k8s-version-506981
2812f3850287e 05b738aa1bc63 8 minutes ago Exited etcd 0 52eb44ea7404a etcd-old-k8s-version-506981
f6edc129f54e8 e7605f88f17d6 8 minutes ago Exited kube-scheduler 0 5f01ce8c1ff3c kube-scheduler-old-k8s-version-506981
f95eb4638c61f 1df8a2b116bd1 8 minutes ago Exited kube-controller-manager 0 36ccf3cccbc44 kube-controller-manager-old-k8s-version-506981
==> containerd <==
Jun 03 14:07:56 old-k8s-version-506981 containerd[572]: time="2024-06-03T14:07:56.340666316Z" level=info msg="CreateContainer within sandbox \"a5e70e7fb6648b5a8a91d5579cee80538830e1bd9dbc33cac37ca7a9b10dac42\" for &ContainerMetadata{Name:dashboard-metrics-scraper,Attempt:4,} returns container id \"0f1c3f9a58875e03d4625e12e01d4c48219837d6e791549d7a80fc16633e3401\""
Jun 03 14:07:56 old-k8s-version-506981 containerd[572]: time="2024-06-03T14:07:56.342357028Z" level=info msg="StartContainer for \"0f1c3f9a58875e03d4625e12e01d4c48219837d6e791549d7a80fc16633e3401\""
Jun 03 14:07:56 old-k8s-version-506981 containerd[572]: time="2024-06-03T14:07:56.406525603Z" level=info msg="StartContainer for \"0f1c3f9a58875e03d4625e12e01d4c48219837d6e791549d7a80fc16633e3401\" returns successfully"
Jun 03 14:07:56 old-k8s-version-506981 containerd[572]: time="2024-06-03T14:07:56.434149334Z" level=info msg="shim disconnected" id=0f1c3f9a58875e03d4625e12e01d4c48219837d6e791549d7a80fc16633e3401
Jun 03 14:07:56 old-k8s-version-506981 containerd[572]: time="2024-06-03T14:07:56.434213521Z" level=warning msg="cleaning up after shim disconnected" id=0f1c3f9a58875e03d4625e12e01d4c48219837d6e791549d7a80fc16633e3401 namespace=k8s.io
Jun 03 14:07:56 old-k8s-version-506981 containerd[572]: time="2024-06-03T14:07:56.434225295Z" level=info msg="cleaning up dead shim"
Jun 03 14:07:56 old-k8s-version-506981 containerd[572]: time="2024-06-03T14:07:56.442625272Z" level=warning msg="cleanup warnings time=\"2024-06-03T14:07:56Z\" level=info msg=\"starting signal loop\" namespace=k8s.io pid=2931 runtime=io.containerd.runc.v2\n"
Jun 03 14:07:56 old-k8s-version-506981 containerd[572]: time="2024-06-03T14:07:56.930021588Z" level=info msg="RemoveContainer for \"2a502758050a1233bf6d9d8d634b68c49c6eaa58c71734e639465fbd28726eb4\""
Jun 03 14:07:56 old-k8s-version-506981 containerd[572]: time="2024-06-03T14:07:56.936491883Z" level=info msg="RemoveContainer for \"2a502758050a1233bf6d9d8d634b68c49c6eaa58c71734e639465fbd28726eb4\" returns successfully"
Jun 03 14:09:06 old-k8s-version-506981 containerd[572]: time="2024-06-03T14:09:06.316042151Z" level=info msg="PullImage \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jun 03 14:09:06 old-k8s-version-506981 containerd[572]: time="2024-06-03T14:09:06.320831193Z" level=info msg="trying next host" error="failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host" host=fake.domain
Jun 03 14:09:06 old-k8s-version-506981 containerd[572]: time="2024-06-03T14:09:06.327044081Z" level=error msg="PullImage \"fake.domain/registry.k8s.io/echoserver:1.4\" failed" error="failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
Jun 03 14:09:19 old-k8s-version-506981 containerd[572]: time="2024-06-03T14:09:19.326163220Z" level=info msg="CreateContainer within sandbox \"a5e70e7fb6648b5a8a91d5579cee80538830e1bd9dbc33cac37ca7a9b10dac42\" for container &ContainerMetadata{Name:dashboard-metrics-scraper,Attempt:5,}"
Jun 03 14:09:19 old-k8s-version-506981 containerd[572]: time="2024-06-03T14:09:19.346034310Z" level=info msg="CreateContainer within sandbox \"a5e70e7fb6648b5a8a91d5579cee80538830e1bd9dbc33cac37ca7a9b10dac42\" for &ContainerMetadata{Name:dashboard-metrics-scraper,Attempt:5,} returns container id \"73f4ba64c15fad7c13f9bcade7a85c063263c80631622f29af0076c2d4ad2cce\""
Jun 03 14:09:19 old-k8s-version-506981 containerd[572]: time="2024-06-03T14:09:19.346722230Z" level=info msg="StartContainer for \"73f4ba64c15fad7c13f9bcade7a85c063263c80631622f29af0076c2d4ad2cce\""
Jun 03 14:09:19 old-k8s-version-506981 containerd[572]: time="2024-06-03T14:09:19.416896956Z" level=info msg="StartContainer for \"73f4ba64c15fad7c13f9bcade7a85c063263c80631622f29af0076c2d4ad2cce\" returns successfully"
Jun 03 14:09:19 old-k8s-version-506981 containerd[572]: time="2024-06-03T14:09:19.443956314Z" level=info msg="shim disconnected" id=73f4ba64c15fad7c13f9bcade7a85c063263c80631622f29af0076c2d4ad2cce
Jun 03 14:09:19 old-k8s-version-506981 containerd[572]: time="2024-06-03T14:09:19.444018910Z" level=warning msg="cleaning up after shim disconnected" id=73f4ba64c15fad7c13f9bcade7a85c063263c80631622f29af0076c2d4ad2cce namespace=k8s.io
Jun 03 14:09:19 old-k8s-version-506981 containerd[572]: time="2024-06-03T14:09:19.444032989Z" level=info msg="cleaning up dead shim"
Jun 03 14:09:19 old-k8s-version-506981 containerd[572]: time="2024-06-03T14:09:19.453774738Z" level=warning msg="cleanup warnings time=\"2024-06-03T14:09:19Z\" level=info msg=\"starting signal loop\" namespace=k8s.io pid=3168 runtime=io.containerd.runc.v2\n"
Jun 03 14:09:20 old-k8s-version-506981 containerd[572]: time="2024-06-03T14:09:20.149839811Z" level=info msg="RemoveContainer for \"0f1c3f9a58875e03d4625e12e01d4c48219837d6e791549d7a80fc16633e3401\""
Jun 03 14:09:20 old-k8s-version-506981 containerd[572]: time="2024-06-03T14:09:20.156062841Z" level=info msg="RemoveContainer for \"0f1c3f9a58875e03d4625e12e01d4c48219837d6e791549d7a80fc16633e3401\" returns successfully"
Jun 03 14:11:59 old-k8s-version-506981 containerd[572]: time="2024-06-03T14:11:59.316673454Z" level=info msg="PullImage \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jun 03 14:11:59 old-k8s-version-506981 containerd[572]: time="2024-06-03T14:11:59.323606539Z" level=info msg="trying next host" error="failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host" host=fake.domain
Jun 03 14:11:59 old-k8s-version-506981 containerd[572]: time="2024-06-03T14:11:59.325197611Z" level=error msg="PullImage \"fake.domain/registry.k8s.io/echoserver:1.4\" failed" error="failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
==> coredns [63681387e89a2da532a81bdadf8fc98401b8666cce28ae3a2deb9614f979acca] <==
.:53
[INFO] plugin/reload: Running configuration MD5 = b494d968e357ba1b925cee838fbd78ed
CoreDNS-1.7.0
linux/arm64, go1.14.4, f59c03d
[INFO] 127.0.0.1:43869 - 31717 "HINFO IN 1300017641051358055.5244119688257068534. udp 57 false 512" NXDOMAIN qr,rd,ra 57 0.030790608s
==> coredns [78417eb766571e7487e28529180fd77f26d392a1ec4ea84a0f96fa78802948f6] <==
.:53
[INFO] plugin/reload: Running configuration MD5 = b494d968e357ba1b925cee838fbd78ed
CoreDNS-1.7.0
linux/arm64, go1.14.4, f59c03d
[INFO] 127.0.0.1:49186 - 5544 "HINFO IN 5724290200225008692.7577537957784476404. udp 57 false 512" NXDOMAIN qr,rd,ra 57 0.042742856s
==> describe nodes <==
Name: old-k8s-version-506981
Roles: control-plane,master
Labels: beta.kubernetes.io/arch=arm64
beta.kubernetes.io/os=linux
kubernetes.io/arch=arm64
kubernetes.io/hostname=old-k8s-version-506981
kubernetes.io/os=linux
minikube.k8s.io/commit=3e16338a2e51863cb2fad83b163378f045b3a354
minikube.k8s.io/name=old-k8s-version-506981
minikube.k8s.io/primary=true
minikube.k8s.io/updated_at=2024_06_03T14_03_26_0700
minikube.k8s.io/version=v1.33.1
node-role.kubernetes.io/control-plane=
node-role.kubernetes.io/master=
Annotations: kubeadm.alpha.kubernetes.io/cri-socket: /run/containerd/containerd.sock
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Mon, 03 Jun 2024 14:03:23 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: old-k8s-version-506981
AcquireTime: <unset>
RenewTime: Mon, 03 Jun 2024 14:12:03 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Mon, 03 Jun 2024 14:07:10 +0000 Mon, 03 Jun 2024 14:03:15 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Mon, 03 Jun 2024 14:07:10 +0000 Mon, 03 Jun 2024 14:03:15 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Mon, 03 Jun 2024 14:07:10 +0000 Mon, 03 Jun 2024 14:03:15 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Mon, 03 Jun 2024 14:07:10 +0000 Mon, 03 Jun 2024 14:03:41 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.76.2
Hostname: old-k8s-version-506981
Capacity:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022432Ki
pods: 110
Allocatable:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022432Ki
pods: 110
System Info:
Machine ID: 2f6ded5963e04e999994d5c12e318ac3
System UUID: 7f6d2341-2b32-42f6-a46e-9f3573642886
Boot ID: 366ffa85-e804-4ef8-93d3-afb045a5a50b
Kernel Version: 5.15.0-1062-aws
OS Image: Ubuntu 22.04.4 LTS
Operating System: linux
Architecture: arm64
Container Runtime Version: containerd://1.6.31
Kubelet Version: v1.20.0
Kube-Proxy Version: v1.20.0
PodCIDR: 10.244.0.0/24
PodCIDRs: 10.244.0.0/24
Non-terminated Pods: (12 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits AGE
--------- ---- ------------ ---------- --------------- ------------- ---
default busybox 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 6m44s
kube-system coredns-74ff55c5b-vqfdz 100m (5%!)(MISSING) 0 (0%!)(MISSING) 70Mi (0%!)(MISSING) 170Mi (2%!)(MISSING) 8m24s
kube-system etcd-old-k8s-version-506981 100m (5%!)(MISSING) 0 (0%!)(MISSING) 100Mi (1%!)(MISSING) 0 (0%!)(MISSING) 8m31s
kube-system kindnet-fbj8b 100m (5%!)(MISSING) 100m (5%!)(MISSING) 50Mi (0%!)(MISSING) 50Mi (0%!)(MISSING) 8m24s
kube-system kube-apiserver-old-k8s-version-506981 250m (12%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 8m31s
kube-system kube-controller-manager-old-k8s-version-506981 200m (10%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 8m31s
kube-system kube-proxy-bxzwt 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 8m24s
kube-system kube-scheduler-old-k8s-version-506981 100m (5%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 8m31s
kube-system metrics-server-9975d5f86-crpj5 100m (5%!)(MISSING) 0 (0%!)(MISSING) 200Mi (2%!)(MISSING) 0 (0%!)(MISSING) 6m33s
kube-system storage-provisioner 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 8m22s
kubernetes-dashboard dashboard-metrics-scraper-8d5bb5db8-tcv2x 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 5m37s
kubernetes-dashboard kubernetes-dashboard-cd95d586-tl2sj 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 5m37s
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 950m (47%!)(MISSING) 100m (5%!)(MISSING)
memory 420Mi (5%!)(MISSING) 220Mi (2%!)(MISSING)
ephemeral-storage 100Mi (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-1Gi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-2Mi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-32Mi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-64Ki 0 (0%!)(MISSING) 0 (0%!)(MISSING)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal NodeHasSufficientMemory 8m52s (x4 over 8m52s) kubelet Node old-k8s-version-506981 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 8m52s (x4 over 8m52s) kubelet Node old-k8s-version-506981 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 8m52s (x4 over 8m52s) kubelet Node old-k8s-version-506981 status is now: NodeHasSufficientPID
Normal Starting 8m31s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 8m31s kubelet Node old-k8s-version-506981 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 8m31s kubelet Node old-k8s-version-506981 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 8m31s kubelet Node old-k8s-version-506981 status is now: NodeHasSufficientPID
Normal NodeAllocatableEnforced 8m31s kubelet Updated Node Allocatable limit across pods
Normal NodeReady 8m24s kubelet Node old-k8s-version-506981 status is now: NodeReady
Normal Starting 8m23s kube-proxy Starting kube-proxy.
Normal Starting 6m4s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 6m4s (x8 over 6m4s) kubelet Node old-k8s-version-506981 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 6m4s (x8 over 6m4s) kubelet Node old-k8s-version-506981 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 6m4s (x7 over 6m4s) kubelet Node old-k8s-version-506981 status is now: NodeHasSufficientPID
Normal NodeAllocatableEnforced 6m4s kubelet Updated Node Allocatable limit across pods
Normal Starting 5m53s kube-proxy Starting kube-proxy.
==> dmesg <==
[ +0.001106] FS-Cache: O-key=[8] 'e5613b0000000000'
[ +0.000812] FS-Cache: N-cookie c=00000042 [p=00000039 fl=2 nc=0 na=1]
[ +0.000992] FS-Cache: N-cookie d=000000007e50ed2a{9p.inode} n=0000000042a6335d
[ +0.001110] FS-Cache: N-key=[8] 'e5613b0000000000'
[ +0.007119] FS-Cache: Duplicate cookie detected
[ +0.000739] FS-Cache: O-cookie c=0000003c [p=00000039 fl=226 nc=0 na=1]
[ +0.000990] FS-Cache: O-cookie d=000000007e50ed2a{9p.inode} n=00000000f477bffe
[ +0.001190] FS-Cache: O-key=[8] 'e5613b0000000000'
[ +0.000740] FS-Cache: N-cookie c=00000043 [p=00000039 fl=2 nc=0 na=1]
[ +0.000952] FS-Cache: N-cookie d=000000007e50ed2a{9p.inode} n=0000000025308fbc
[ +0.001071] FS-Cache: N-key=[8] 'e5613b0000000000'
[ +2.585561] FS-Cache: Duplicate cookie detected
[ +0.000712] FS-Cache: O-cookie c=0000003a [p=00000039 fl=226 nc=0 na=1]
[ +0.000969] FS-Cache: O-cookie d=000000007e50ed2a{9p.inode} n=00000000a312f59c
[ +0.001075] FS-Cache: O-key=[8] 'e4613b0000000000'
[ +0.000776] FS-Cache: N-cookie c=00000045 [p=00000039 fl=2 nc=0 na=1]
[ +0.000927] FS-Cache: N-cookie d=000000007e50ed2a{9p.inode} n=00000000814985bf
[ +0.001048] FS-Cache: N-key=[8] 'e4613b0000000000'
[ +0.354417] FS-Cache: Duplicate cookie detected
[ +0.000868] FS-Cache: O-cookie c=0000003f [p=00000039 fl=226 nc=0 na=1]
[ +0.001032] FS-Cache: O-cookie d=000000007e50ed2a{9p.inode} n=00000000fa407f75
[ +0.001167] FS-Cache: O-key=[8] 'eb613b0000000000'
[ +0.000895] FS-Cache: N-cookie c=00000046 [p=00000039 fl=2 nc=0 na=1]
[ +0.000937] FS-Cache: N-cookie d=000000007e50ed2a{9p.inode} n=000000007f7582e0
[ +0.001173] FS-Cache: N-key=[8] 'eb613b0000000000'
==> etcd [2812f3850287e9bd217797c7ff1ce588b53328c6abfa79f815865c965abed8c9] <==
raft2024/06/03 14:03:15 INFO: ea7e25599daad906 is starting a new election at term 1
raft2024/06/03 14:03:15 INFO: ea7e25599daad906 became candidate at term 2
raft2024/06/03 14:03:15 INFO: ea7e25599daad906 received MsgVoteResp from ea7e25599daad906 at term 2
raft2024/06/03 14:03:15 INFO: ea7e25599daad906 became leader at term 2
raft2024/06/03 14:03:15 INFO: raft.node: ea7e25599daad906 elected leader ea7e25599daad906 at term 2
2024-06-03 14:03:15.410186 I | etcdserver: setting up the initial cluster version to 3.4
2024-06-03 14:03:15.411137 N | etcdserver/membership: set the initial cluster version to 3.4
2024-06-03 14:03:15.411253 I | etcdserver/api: enabled capabilities for version 3.4
2024-06-03 14:03:15.411302 I | etcdserver: published {Name:old-k8s-version-506981 ClientURLs:[https://192.168.76.2:2379]} to cluster 6f20f2c4b2fb5f8a
2024-06-03 14:03:15.411373 I | embed: ready to serve client requests
2024-06-03 14:03:15.415782 I | embed: ready to serve client requests
2024-06-03 14:03:15.417214 I | embed: serving client requests on 192.168.76.2:2379
2024-06-03 14:03:15.429349 I | embed: serving client requests on 127.0.0.1:2379
2024-06-03 14:03:36.613097 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-03 14:03:43.552769 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-03 14:03:53.552942 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-03 14:04:03.553183 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-03 14:04:13.552881 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-03 14:04:23.553006 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-03 14:04:33.553038 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-03 14:04:43.552940 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-03 14:04:53.552908 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-03 14:05:03.552960 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-03 14:05:13.553118 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-03 14:05:23.552997 I | etcdserver/api/etcdhttp: /health OK (status code 200)
==> etcd [d958ffdd2556ba8d9c17f04f13419000435af96172a5d9e20f0e013a71c59942] <==
2024-06-03 14:08:02.467707 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-03 14:08:12.467717 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-03 14:08:22.467616 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-03 14:08:32.467896 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-03 14:08:42.467689 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-03 14:08:52.467844 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-03 14:09:02.467626 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-03 14:09:12.467670 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-03 14:09:22.467692 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-03 14:09:32.467611 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-03 14:09:42.467853 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-03 14:09:52.467748 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-03 14:10:02.467692 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-03 14:10:12.467807 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-03 14:10:22.467728 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-03 14:10:32.467646 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-03 14:10:42.467702 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-03 14:10:52.467637 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-03 14:11:02.467687 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-03 14:11:12.468180 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-03 14:11:22.467764 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-03 14:11:32.467886 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-03 14:11:42.467584 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-03 14:11:52.467579 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-03 14:12:02.467781 I | etcdserver/api/etcdhttp: /health OK (status code 200)
==> kernel <==
14:12:05 up 4:54, 0 users, load average: 1.86, 2.01, 2.62
Linux old-k8s-version-506981 5.15.0-1062-aws #68~20.04.1-Ubuntu SMP Tue May 7 11:50:35 UTC 2024 aarch64 aarch64 aarch64 GNU/Linux
PRETTY_NAME="Ubuntu 22.04.4 LTS"
==> kindnet [4877d09126aeced75668eb5084bd53add55bad2951822ef405a630af926cc099] <==
I0603 14:03:44.719366 1 main.go:116] setting mtu 1500 for CNI
I0603 14:03:44.719382 1 main.go:146] kindnetd IP family: "ipv4"
I0603 14:03:44.719396 1 main.go:150] noMask IPv4 subnets: [10.244.0.0/16]
I0603 14:03:45.024552 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0603 14:03:45.024591 1 main.go:227] handling current node
I0603 14:03:55.046186 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0603 14:03:55.046225 1 main.go:227] handling current node
I0603 14:04:05.055313 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0603 14:04:05.055341 1 main.go:227] handling current node
I0603 14:04:15.071810 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0603 14:04:15.071844 1 main.go:227] handling current node
I0603 14:04:25.088733 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0603 14:04:25.088762 1 main.go:227] handling current node
I0603 14:04:35.106317 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0603 14:04:35.106349 1 main.go:227] handling current node
I0603 14:04:45.122347 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0603 14:04:45.122387 1 main.go:227] handling current node
I0603 14:04:55.140145 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0603 14:04:55.140173 1 main.go:227] handling current node
I0603 14:05:05.157995 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0603 14:05:05.158026 1 main.go:227] handling current node
I0603 14:05:15.172384 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0603 14:05:15.172415 1 main.go:227] handling current node
I0603 14:05:25.191393 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0603 14:05:25.191425 1 main.go:227] handling current node
==> kindnet [6e61ebc3d6091ce5d38e949a66cfe5e03b2290c58168b498adbf315977f2e27f] <==
I0603 14:10:03.777584 1 main.go:227] handling current node
I0603 14:10:13.788645 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0603 14:10:13.788677 1 main.go:227] handling current node
I0603 14:10:23.807272 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0603 14:10:23.807302 1 main.go:227] handling current node
I0603 14:10:33.821737 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0603 14:10:33.821768 1 main.go:227] handling current node
I0603 14:10:43.838828 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0603 14:10:43.838860 1 main.go:227] handling current node
I0603 14:10:53.854465 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0603 14:10:53.854495 1 main.go:227] handling current node
I0603 14:11:03.868486 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0603 14:11:03.868513 1 main.go:227] handling current node
I0603 14:11:13.877126 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0603 14:11:13.877156 1 main.go:227] handling current node
I0603 14:11:23.893533 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0603 14:11:23.893682 1 main.go:227] handling current node
I0603 14:11:33.904479 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0603 14:11:33.904506 1 main.go:227] handling current node
I0603 14:11:43.914385 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0603 14:11:43.914572 1 main.go:227] handling current node
I0603 14:11:53.925303 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0603 14:11:53.925500 1 main.go:227] handling current node
I0603 14:12:03.943695 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0603 14:12:03.943779 1 main.go:227] handling current node
==> kube-apiserver [b218a8377d49dd148a59f25d54662fb0057bb32bade5fbaa37cd1bdc0c602423] <==
I0603 14:09:03.327459 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0603 14:09:03.327467 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
W0603 14:09:13.444982 1 handler_proxy.go:102] no RequestInfo found in the context
E0603 14:09:13.445068 1 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I0603 14:09:13.445085 1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
I0603 14:09:35.269220 1 client.go:360] parsed scheme: "passthrough"
I0603 14:09:35.269271 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0603 14:09:35.269280 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0603 14:10:12.125983 1 client.go:360] parsed scheme: "passthrough"
I0603 14:10:12.126031 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0603 14:10:12.126040 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0603 14:10:50.611777 1 client.go:360] parsed scheme: "passthrough"
I0603 14:10:50.611823 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0603 14:10:50.611833 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
W0603 14:11:11.137150 1 handler_proxy.go:102] no RequestInfo found in the context
E0603 14:11:11.137230 1 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I0603 14:11:11.137244 1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
I0603 14:11:32.653374 1 client.go:360] parsed scheme: "passthrough"
I0603 14:11:32.653596 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0603 14:11:32.653690 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0603 14:12:02.738434 1 client.go:360] parsed scheme: "passthrough"
I0603 14:12:02.738549 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0603 14:12:02.738580 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
==> kube-apiserver [cff98b34e012670591f72e264bf28d021c645781e259a312066f3e8805f4afa6] <==
I0603 14:03:23.959292 1 storage_scheduling.go:132] created PriorityClass system-cluster-critical with value 2000000000
I0603 14:03:23.959311 1 storage_scheduling.go:148] all system priority classes are created successfully or already exist.
I0603 14:03:24.461783 1 controller.go:606] quota admission added evaluator for: roles.rbac.authorization.k8s.io
I0603 14:03:24.504142 1 controller.go:606] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io
W0603 14:03:24.596292 1 lease.go:233] Resetting endpoints for master service "kubernetes" to [192.168.76.2]
I0603 14:03:24.597623 1 controller.go:606] quota admission added evaluator for: endpoints
I0603 14:03:24.602911 1 controller.go:606] quota admission added evaluator for: endpointslices.discovery.k8s.io
I0603 14:03:25.690021 1 controller.go:606] quota admission added evaluator for: serviceaccounts
I0603 14:03:25.971582 1 controller.go:606] quota admission added evaluator for: deployments.apps
I0603 14:03:26.050526 1 controller.go:606] quota admission added evaluator for: daemonsets.apps
I0603 14:03:34.390848 1 controller.go:606] quota admission added evaluator for: leases.coordination.k8s.io
I0603 14:03:41.711820 1 controller.go:606] quota admission added evaluator for: controllerrevisions.apps
I0603 14:03:41.747988 1 controller.go:606] quota admission added evaluator for: replicasets.apps
I0603 14:03:53.337678 1 client.go:360] parsed scheme: "passthrough"
I0603 14:03:53.337723 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0603 14:03:53.337967 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0603 14:04:24.066794 1 client.go:360] parsed scheme: "passthrough"
I0603 14:04:24.066855 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0603 14:04:24.066864 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0603 14:04:56.740212 1 client.go:360] parsed scheme: "passthrough"
I0603 14:04:56.740255 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0603 14:04:56.740265 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0603 14:05:30.650266 1 client.go:360] parsed scheme: "passthrough"
I0603 14:05:30.650311 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0603 14:05:30.650321 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
==> kube-controller-manager [5a2f082a34bcb3453d32b29c5417b8c0f647127f6f1b676c1cf71297ba47272c] <==
E0603 14:08:00.486102 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0603 14:08:06.971043 1 request.go:655] Throttling request took 1.048282048s, request: GET:https://192.168.76.2:8443/apis/extensions/v1beta1?timeout=32s
W0603 14:08:07.822593 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0603 14:08:31.033026 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0603 14:08:39.473304 1 request.go:655] Throttling request took 1.048465006s, request: GET:https://192.168.76.2:8443/apis/apiextensions.k8s.io/v1?timeout=32s
W0603 14:08:40.324820 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0603 14:09:01.535024 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0603 14:09:11.975184 1 request.go:655] Throttling request took 1.048492712s, request: GET:https://192.168.76.2:8443/apis/certificates.k8s.io/v1?timeout=32s
W0603 14:09:12.826647 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0603 14:09:32.037006 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0603 14:09:44.477078 1 request.go:655] Throttling request took 1.048432423s, request: GET:https://192.168.76.2:8443/apis/batch/v1beta1?timeout=32s
W0603 14:09:45.328539 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0603 14:10:02.539059 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0603 14:10:16.978948 1 request.go:655] Throttling request took 1.048092003s, request: GET:https://192.168.76.2:8443/apis/coordination.k8s.io/v1?timeout=32s
W0603 14:10:17.833315 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0603 14:10:33.040942 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0603 14:10:49.483737 1 request.go:655] Throttling request took 1.048436426s, request: GET:https://192.168.76.2:8443/apis/rbac.authorization.k8s.io/v1?timeout=32s
W0603 14:10:50.335094 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0603 14:11:03.542798 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0603 14:11:21.985758 1 request.go:655] Throttling request took 1.048329358s, request: GET:https://192.168.76.2:8443/apis/extensions/v1beta1?timeout=32s
W0603 14:11:22.837159 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0603 14:11:34.045178 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0603 14:11:54.587646 1 request.go:655] Throttling request took 1.048164675s, request: GET:https://192.168.76.2:8443/apis/extensions/v1beta1?timeout=32s
W0603 14:11:55.439206 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0603 14:12:04.547258 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
==> kube-controller-manager [f95eb4638c61f9ec72d05ad64afd52ecbf878475d2abbe9148bc9cc5d92eae15] <==
I0603 14:03:41.770976 1 shared_informer.go:247] Caches are synced for disruption
I0603 14:03:41.771026 1 disruption.go:339] Sending events to api server.
I0603 14:03:41.771070 1 shared_informer.go:247] Caches are synced for job
I0603 14:03:41.786033 1 event.go:291] "Event occurred" object="kube-system/kube-apiserver-old-k8s-version-506981" kind="Pod" apiVersion="v1" type="Warning" reason="NodeNotReady" message="Node is not ready"
I0603 14:03:41.820914 1 event.go:291] "Event occurred" object="kube-system/coredns" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set coredns-74ff55c5b to 2"
I0603 14:03:41.821161 1 event.go:291] "Event occurred" object="kube-system/kindnet" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kindnet-fbj8b"
I0603 14:03:41.825140 1 event.go:291] "Event occurred" object="kube-system/kube-proxy" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kube-proxy-bxzwt"
I0603 14:03:41.853251 1 request.go:655] Throttling request took 1.049157658s, request: GET:https://192.168.76.2:8443/apis/autoscaling/v2beta1?timeout=32s
E0603 14:03:41.854590 1 clusterroleaggregation_controller.go:181] admin failed with : Operation cannot be fulfilled on clusterroles.rbac.authorization.k8s.io "admin": the object has been modified; please apply your changes to the latest version and try again
I0603 14:03:41.890792 1 event.go:291] "Event occurred" object="kube-system/coredns-74ff55c5b" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-74ff55c5b-gxcf5"
I0603 14:03:41.906831 1 shared_informer.go:247] Caches are synced for resource quota
I0603 14:03:41.938288 1 event.go:291] "Event occurred" object="kube-system/coredns-74ff55c5b" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-74ff55c5b-vqfdz"
I0603 14:03:42.035279 1 shared_informer.go:240] Waiting for caches to sync for garbage collector
I0603 14:03:42.352883 1 shared_informer.go:247] Caches are synced for garbage collector
I0603 14:03:42.352906 1 garbagecollector.go:151] Garbage collector: all resource monitors have synced. Proceeding to collect garbage
I0603 14:03:42.354674 1 shared_informer.go:247] Caches are synced for garbage collector
I0603 14:03:42.659521 1 shared_informer.go:240] Waiting for caches to sync for resource quota
I0603 14:03:42.659587 1 shared_informer.go:247] Caches are synced for resource quota
I0603 14:03:43.403843 1 event.go:291] "Event occurred" object="kube-system/coredns" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled down replica set coredns-74ff55c5b to 1"
I0603 14:03:43.419524 1 event.go:291] "Event occurred" object="kube-system/coredns-74ff55c5b" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulDelete" message="Deleted pod: coredns-74ff55c5b-gxcf5"
I0603 14:03:46.705209 1 node_lifecycle_controller.go:1222] Controller detected that some Nodes are Ready. Exiting master disruption mode.
I0603 14:05:31.245512 1 event.go:291] "Event occurred" object="kube-system/metrics-server" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set metrics-server-9975d5f86 to 1"
I0603 14:05:31.303014 1 event.go:291] "Event occurred" object="kube-system/metrics-server-9975d5f86" kind="ReplicaSet" apiVersion="apps/v1" type="Warning" reason="FailedCreate" message="Error creating: pods \"metrics-server-9975d5f86-\" is forbidden: error looking up service account kube-system/metrics-server: serviceaccount \"metrics-server\" not found"
E0603 14:05:31.340441 1 replica_set.go:532] sync "kube-system/metrics-server-9975d5f86" failed with pods "metrics-server-9975d5f86-" is forbidden: error looking up service account kube-system/metrics-server: serviceaccount "metrics-server" not found
E0603 14:05:31.430694 1 clusterroleaggregation_controller.go:181] edit failed with : Operation cannot be fulfilled on clusterroles.rbac.authorization.k8s.io "edit": the object has been modified; please apply your changes to the latest version and try again
==> kube-proxy [6968f3f519bf8570d57156dc04ffb2b134f1771b089603deba6699b0da257329] <==
I0603 14:03:42.820247 1 node.go:172] Successfully retrieved node IP: 192.168.76.2
I0603 14:03:42.820405 1 server_others.go:142] kube-proxy node IP is an IPv4 address (192.168.76.2), assume IPv4 operation
W0603 14:03:42.870411 1 server_others.go:578] Unknown proxy mode "", assuming iptables proxy
I0603 14:03:42.870495 1 server_others.go:185] Using iptables Proxier.
I0603 14:03:42.870715 1 server.go:650] Version: v1.20.0
I0603 14:03:42.871256 1 config.go:315] Starting service config controller
I0603 14:03:42.871273 1 shared_informer.go:240] Waiting for caches to sync for service config
I0603 14:03:42.874708 1 config.go:224] Starting endpoint slice config controller
I0603 14:03:42.874741 1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config
I0603 14:03:42.971446 1 shared_informer.go:247] Caches are synced for service config
I0603 14:03:42.976198 1 shared_informer.go:247] Caches are synced for endpoint slice config
==> kube-proxy [85188c97e04c30ddc1220ae997ad70782be4759cc69bed1cdfadaa142ce3801b] <==
I0603 14:06:12.852578 1 node.go:172] Successfully retrieved node IP: 192.168.76.2
I0603 14:06:12.852645 1 server_others.go:142] kube-proxy node IP is an IPv4 address (192.168.76.2), assume IPv4 operation
W0603 14:06:12.877110 1 server_others.go:578] Unknown proxy mode "", assuming iptables proxy
I0603 14:06:12.877201 1 server_others.go:185] Using iptables Proxier.
I0603 14:06:12.877432 1 server.go:650] Version: v1.20.0
I0603 14:06:12.877898 1 config.go:315] Starting service config controller
I0603 14:06:12.877905 1 shared_informer.go:240] Waiting for caches to sync for service config
I0603 14:06:12.878902 1 config.go:224] Starting endpoint slice config controller
I0603 14:06:12.878912 1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config
I0603 14:06:12.978544 1 shared_informer.go:247] Caches are synced for service config
I0603 14:06:12.985126 1 shared_informer.go:247] Caches are synced for endpoint slice config
==> kube-scheduler [efa8ad7214e50f2aaef508788558e96bf0b60fc7ec0d449f453d3d7633d71c4c] <==
I0603 14:06:05.333517 1 serving.go:331] Generated self-signed cert in-memory
W0603 14:06:09.828477 1 requestheader_controller.go:193] Unable to get configmap/extension-apiserver-authentication in kube-system. Usually fixed by 'kubectl create rolebinding -n kube-system ROLEBINDING_NAME --role=extension-apiserver-authentication-reader --serviceaccount=YOUR_NS:YOUR_SA'
W0603 14:06:09.828505 1 authentication.go:332] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"
W0603 14:06:09.828515 1 authentication.go:333] Continuing without authentication configuration. This may treat all requests as anonymous.
W0603 14:06:09.828520 1 authentication.go:334] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false
I0603 14:06:09.906701 1 secure_serving.go:197] Serving securely on 127.0.0.1:10259
I0603 14:06:09.906860 1 configmap_cafile_content.go:202] Starting client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0603 14:06:09.906869 1 shared_informer.go:240] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0603 14:06:09.906884 1 tlsconfig.go:240] Starting DynamicServingCertificateController
E0603 14:06:09.971878 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
E0603 14:06:09.971975 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
E0603 14:06:09.972060 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
E0603 14:06:09.972126 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
E0603 14:06:09.972209 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
E0603 14:06:09.972275 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
E0603 14:06:09.972659 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
E0603 14:06:09.972822 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
E0603 14:06:09.972898 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
E0603 14:06:09.972976 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
E0603 14:06:09.973042 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1beta1.PodDisruptionBudget: failed to list *v1beta1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
E0603 14:06:10.013001 1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
I0603 14:06:11.517562 1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
==> kube-scheduler [f6edc129f54e8676287bbd7aee0210985585277489be4a27610b67d25024944e] <==
W0603 14:03:23.179519 1 authentication.go:334] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false
I0603 14:03:23.231448 1 secure_serving.go:197] Serving securely on 127.0.0.1:10259
I0603 14:03:23.231758 1 configmap_cafile_content.go:202] Starting client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0603 14:03:23.231864 1 shared_informer.go:240] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0603 14:03:23.232036 1 tlsconfig.go:240] Starting DynamicServingCertificateController
E0603 14:03:23.242349 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
E0603 14:03:23.242633 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
E0603 14:03:23.242826 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
E0603 14:03:23.243053 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
E0603 14:03:23.242659 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
E0603 14:03:23.243317 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
E0603 14:03:23.243600 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
E0603 14:03:23.243665 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1beta1.PodDisruptionBudget: failed to list *v1beta1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
E0603 14:03:23.243726 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
E0603 14:03:23.244458 1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
E0603 14:03:23.244592 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
E0603 14:03:23.244844 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
E0603 14:03:24.135868 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
E0603 14:03:24.189006 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1beta1.PodDisruptionBudget: failed to list *v1beta1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
E0603 14:03:24.239492 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
E0603 14:03:24.253804 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
E0603 14:03:24.278173 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
E0603 14:03:24.282279 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
E0603 14:03:24.381132 1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
I0603 14:03:26.332773 1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
==> kubelet <==
Jun 03 14:10:33 old-k8s-version-506981 kubelet[664]: I0603 14:10:33.315013 664 scope.go:95] [topologymanager] RemoveContainer - Container ID: 73f4ba64c15fad7c13f9bcade7a85c063263c80631622f29af0076c2d4ad2cce
Jun 03 14:10:33 old-k8s-version-506981 kubelet[664]: E0603 14:10:33.315329 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
Jun 03 14:10:36 old-k8s-version-506981 kubelet[664]: E0603 14:10:36.315735 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jun 03 14:10:48 old-k8s-version-506981 kubelet[664]: I0603 14:10:48.315464 664 scope.go:95] [topologymanager] RemoveContainer - Container ID: 73f4ba64c15fad7c13f9bcade7a85c063263c80631622f29af0076c2d4ad2cce
Jun 03 14:10:48 old-k8s-version-506981 kubelet[664]: E0603 14:10:48.315758 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
Jun 03 14:10:48 old-k8s-version-506981 kubelet[664]: E0603 14:10:48.316596 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jun 03 14:11:02 old-k8s-version-506981 kubelet[664]: I0603 14:11:02.315653 664 scope.go:95] [topologymanager] RemoveContainer - Container ID: 73f4ba64c15fad7c13f9bcade7a85c063263c80631622f29af0076c2d4ad2cce
Jun 03 14:11:02 old-k8s-version-506981 kubelet[664]: E0603 14:11:02.316423 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
Jun 03 14:11:02 old-k8s-version-506981 kubelet[664]: E0603 14:11:02.317204 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jun 03 14:11:14 old-k8s-version-506981 kubelet[664]: I0603 14:11:14.315102 664 scope.go:95] [topologymanager] RemoveContainer - Container ID: 73f4ba64c15fad7c13f9bcade7a85c063263c80631622f29af0076c2d4ad2cce
Jun 03 14:11:14 old-k8s-version-506981 kubelet[664]: E0603 14:11:14.315897 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
Jun 03 14:11:17 old-k8s-version-506981 kubelet[664]: E0603 14:11:17.315838 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jun 03 14:11:27 old-k8s-version-506981 kubelet[664]: I0603 14:11:27.315113 664 scope.go:95] [topologymanager] RemoveContainer - Container ID: 73f4ba64c15fad7c13f9bcade7a85c063263c80631622f29af0076c2d4ad2cce
Jun 03 14:11:27 old-k8s-version-506981 kubelet[664]: E0603 14:11:27.315441 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
Jun 03 14:11:32 old-k8s-version-506981 kubelet[664]: E0603 14:11:32.315742 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jun 03 14:11:38 old-k8s-version-506981 kubelet[664]: I0603 14:11:38.314994 664 scope.go:95] [topologymanager] RemoveContainer - Container ID: 73f4ba64c15fad7c13f9bcade7a85c063263c80631622f29af0076c2d4ad2cce
Jun 03 14:11:38 old-k8s-version-506981 kubelet[664]: E0603 14:11:38.315767 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
Jun 03 14:11:44 old-k8s-version-506981 kubelet[664]: E0603 14:11:44.316492 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jun 03 14:11:53 old-k8s-version-506981 kubelet[664]: I0603 14:11:53.316059 664 scope.go:95] [topologymanager] RemoveContainer - Container ID: 73f4ba64c15fad7c13f9bcade7a85c063263c80631622f29af0076c2d4ad2cce
Jun 03 14:11:53 old-k8s-version-506981 kubelet[664]: E0603 14:11:53.317226 664 pod_workers.go:191] Error syncing pod e55bffd2-8b40-40e7-98bf-c63aa6234e80 ("dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-tcv2x_kubernetes-dashboard(e55bffd2-8b40-40e7-98bf-c63aa6234e80)"
Jun 03 14:11:59 old-k8s-version-506981 kubelet[664]: E0603 14:11:59.325517 664 remote_image.go:113] PullImage "fake.domain/registry.k8s.io/echoserver:1.4" from image service failed: rpc error: code = Unknown desc = failed to pull and unpack image "fake.domain/registry.k8s.io/echoserver:1.4": failed to resolve reference "fake.domain/registry.k8s.io/echoserver:1.4": failed to do request: Head "https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host
Jun 03 14:11:59 old-k8s-version-506981 kubelet[664]: E0603 14:11:59.326043 664 kuberuntime_image.go:51] Pull image "fake.domain/registry.k8s.io/echoserver:1.4" failed: rpc error: code = Unknown desc = failed to pull and unpack image "fake.domain/registry.k8s.io/echoserver:1.4": failed to resolve reference "fake.domain/registry.k8s.io/echoserver:1.4": failed to do request: Head "https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host
Jun 03 14:11:59 old-k8s-version-506981 kubelet[664]: E0603 14:11:59.326359 664 kuberuntime_manager.go:829] container &Container{Name:metrics-server,Image:fake.domain/registry.k8s.io/echoserver:1.4,Command:[],Args:[--cert-dir=/tmp --secure-port=4443 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --kubelet-use-node-status-port --metric-resolution=60s --kubelet-insecure-tls],WorkingDir:,Ports:[]ContainerPort{ContainerPort{Name:https,HostPort:0,ContainerPort:4443,Protocol:TCP,HostIP:,},},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{cpu: {{100 -3} {<nil>} 100m DecimalSI},memory: {{209715200 0} {<nil>} BinarySI},},},VolumeMounts:[]VolumeMount{VolumeMount{Name:tmp-dir,ReadOnly:false,MountPath:/tmp,SubPath:,MountPropagation:nil,SubPathExpr:,},VolumeMount{Name:metrics-server-token-4pvq2,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:&Probe{Handler:Handler{Exec
:nil,HTTPGet:&HTTPGetAction{Path:/livez,Port:{1 0 https},Host:,Scheme:HTTPS,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,},InitialDelaySeconds:0,TimeoutSeconds:1,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,},ReadinessProbe:&Probe{Handler:Handler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/readyz,Port:{1 0 https},Host:,Scheme:HTTPS,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,},InitialDelaySeconds:0,TimeoutSeconds:1,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:*1000,RunAsNonRoot:*true,ReadOnlyRootFilesystem:*true,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,} start failed in pod metrics-server-9975d5f86-crpj5_kube-system(5a93001
f-765d-4153-85ac-dea8baba3bac): ErrImagePull: rpc error: code = Unknown desc = failed to pull and unpack image "fake.domain/registry.k8s.io/echoserver:1.4": failed to resolve reference "fake.domain/registry.k8s.io/echoserver:1.4": failed to do request: Head "https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host
Jun 03 14:11:59 old-k8s-version-506981 kubelet[664]: E0603 14:11:59.326596 664 pod_workers.go:191] Error syncing pod 5a93001f-765d-4153-85ac-dea8baba3bac ("metrics-server-9975d5f86-crpj5_kube-system(5a93001f-765d-4153-85ac-dea8baba3bac)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
Jun 03 14:12:05 old-k8s-version-506981 kubelet[664]: I0603 14:12:05.315119 664 scope.go:95] [topologymanager] RemoveContainer - Container ID: 73f4ba64c15fad7c13f9bcade7a85c063263c80631622f29af0076c2d4ad2cce
==> kubernetes-dashboard [33fdccc7b8d89b6026b4d99aaa906dd249af2e13c9164ba7c300007c2e170409] <==
2024/06/03 14:06:33 Using namespace: kubernetes-dashboard
2024/06/03 14:06:33 Using in-cluster config to connect to apiserver
2024/06/03 14:06:33 Using secret token for csrf signing
2024/06/03 14:06:33 Initializing csrf token from kubernetes-dashboard-csrf secret
2024/06/03 14:06:33 Empty token. Generating and storing in a secret kubernetes-dashboard-csrf
2024/06/03 14:06:33 Successful initial request to the apiserver, version: v1.20.0
2024/06/03 14:06:33 Generating JWE encryption key
2024/06/03 14:06:33 New synchronizer has been registered: kubernetes-dashboard-key-holder-kubernetes-dashboard. Starting
2024/06/03 14:06:33 Starting secret synchronizer for kubernetes-dashboard-key-holder in namespace kubernetes-dashboard
2024/06/03 14:06:34 Initializing JWE encryption key from synchronized object
2024/06/03 14:06:34 Creating in-cluster Sidecar client
2024/06/03 14:06:34 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/06/03 14:06:34 Serving insecurely on HTTP port: 9090
2024/06/03 14:07:04 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/06/03 14:07:34 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/06/03 14:08:04 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/06/03 14:08:34 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/06/03 14:09:04 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/06/03 14:09:34 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/06/03 14:10:04 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/06/03 14:10:34 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/06/03 14:11:04 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/06/03 14:11:34 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/06/03 14:12:04 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/06/03 14:06:33 Starting overwatch
==> storage-provisioner [c328ba896fecaac93f102a2fbf5ebe2877e5f90cdd8963cb241341d2758e21bb] <==
I0603 14:06:12.804143 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
F0603 14:06:42.807554 1 main.go:39] error getting server version: Get "https://10.96.0.1:443/version?timeout=32s": dial tcp 10.96.0.1:443: i/o timeout
==> storage-provisioner [d8876e71dcdbddfdf7645eb16fa82d58e3fdfe186a62fe3979cd00418d8f8bcc] <==
I0603 14:06:55.542098 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
I0603 14:06:55.577646 1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
I0603 14:06:55.577714 1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
I0603 14:07:13.083668 1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
I0603 14:07:13.093765 1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"3cbed486-c403-4734-b47a-c4187d30f593", APIVersion:"v1", ResourceVersion:"841", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' old-k8s-version-506981_87aa58a9-ca12-4806-b496-d569b5b6497f became leader
I0603 14:07:13.095867 1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_old-k8s-version-506981_87aa58a9-ca12-4806-b496-d569b5b6497f!
I0603 14:07:13.196298 1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_old-k8s-version-506981_87aa58a9-ca12-4806-b496-d569b5b6497f!
-- /stdout --
helpers_test.go:254: (dbg) Run: out/minikube-linux-arm64 status --format={{.APIServer}} -p old-k8s-version-506981 -n old-k8s-version-506981
helpers_test.go:261: (dbg) Run: kubectl --context old-k8s-version-506981 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:272: non-running pods: metrics-server-9975d5f86-crpj5
helpers_test.go:274: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: describe non-running pods <======
helpers_test.go:277: (dbg) Run: kubectl --context old-k8s-version-506981 describe pod metrics-server-9975d5f86-crpj5
helpers_test.go:277: (dbg) Non-zero exit: kubectl --context old-k8s-version-506981 describe pod metrics-server-9975d5f86-crpj5: exit status 1 (136.024143ms)
** stderr **
Error from server (NotFound): pods "metrics-server-9975d5f86-crpj5" not found
** /stderr **
helpers_test.go:279: kubectl --context old-k8s-version-506981 describe pod metrics-server-9975d5f86-crpj5: exit status 1
--- FAIL: TestStartStop/group/old-k8s-version/serial/SecondStart (381.99s)