=== RUN TestStartStop/group/old-k8s-version/serial/SecondStart
start_stop_delete_test.go:254: (dbg) Run: out/minikube-linux-arm64 start -p old-k8s-version-949994 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=containerd --kubernetes-version=v1.20.0
start_stop_delete_test.go:254: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p old-k8s-version-949994 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=containerd --kubernetes-version=v1.20.0: exit status 102 (6m13.926387341s)
-- stdout --
* [old-k8s-version-949994] minikube v1.35.0 on Ubuntu 20.04 (arm64)
- MINIKUBE_LOCATION=20316
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/20316-3581420/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/20316-3581420/.minikube
- MINIKUBE_BIN=out/minikube-linux-arm64
- MINIKUBE_FORCE_SYSTEMD=
* Kubernetes 1.32.1 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.32.1
* Using the docker driver based on existing profile
* Starting "old-k8s-version-949994" primary control-plane node in "old-k8s-version-949994" cluster
* Pulling base image v0.0.46 ...
* Restarting existing docker container for "old-k8s-version-949994" ...
* Preparing Kubernetes v1.20.0 on containerd 1.7.24 ...
* Verifying Kubernetes components...
- Using image gcr.io/k8s-minikube/storage-provisioner:v5
- Using image registry.k8s.io/echoserver:1.4
- Using image docker.io/kubernetesui/dashboard:v2.7.0
- Using image fake.domain/registry.k8s.io/echoserver:1.4
* Some dashboard features require the metrics-server addon. To enable all features please run:
minikube -p old-k8s-version-949994 addons enable metrics-server
* Enabled addons: storage-provisioner, metrics-server, dashboard, default-storageclass
-- /stdout --
** stderr **
I0127 02:53:23.329081 3796111 out.go:345] Setting OutFile to fd 1 ...
I0127 02:53:23.329301 3796111 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0127 02:53:23.329328 3796111 out.go:358] Setting ErrFile to fd 2...
I0127 02:53:23.329347 3796111 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0127 02:53:23.329620 3796111 root.go:338] Updating PATH: /home/jenkins/minikube-integration/20316-3581420/.minikube/bin
I0127 02:53:23.330051 3796111 out.go:352] Setting JSON to false
I0127 02:53:23.331073 3796111 start.go:129] hostinfo: {"hostname":"ip-172-31-21-244","uptime":92147,"bootTime":1737854256,"procs":185,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1075-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"da8ac1fd-6236-412a-a346-95873c98230d"}
I0127 02:53:23.331175 3796111 start.go:139] virtualization:
I0127 02:53:23.334733 3796111 out.go:177] * [old-k8s-version-949994] minikube v1.35.0 on Ubuntu 20.04 (arm64)
I0127 02:53:23.338614 3796111 notify.go:220] Checking for updates...
I0127 02:53:23.341995 3796111 out.go:177] - MINIKUBE_LOCATION=20316
I0127 02:53:23.345117 3796111 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0127 02:53:23.348029 3796111 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/20316-3581420/kubeconfig
I0127 02:53:23.350915 3796111 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/20316-3581420/.minikube
I0127 02:53:23.353813 3796111 out.go:177] - MINIKUBE_BIN=out/minikube-linux-arm64
I0127 02:53:23.356744 3796111 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0127 02:53:23.360206 3796111 config.go:182] Loaded profile config "old-k8s-version-949994": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0
I0127 02:53:23.363617 3796111 out.go:177] * Kubernetes 1.32.1 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.32.1
I0127 02:53:23.366383 3796111 driver.go:394] Setting default libvirt URI to qemu:///system
I0127 02:53:23.395585 3796111 docker.go:123] docker version: linux-27.5.1:Docker Engine - Community
I0127 02:53:23.395716 3796111 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0127 02:53:23.454502 3796111 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:49 OomKillDisable:true NGoroutines:56 SystemTime:2025-01-27 02:53:23.44464573 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1075-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aa
rch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214835200 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:27.5.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:bcc810d6b9066471b0b6fa75f557a15a1cbf31bb Expected:bcc810d6b9066471b0b6fa75f557a15a1cbf31bb} RuncCommit:{ID:v1.2.4-0-g6c52b3f Expected:v1.2.4-0-g6c52b3f} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerError
s:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.20.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.32.4]] Warnings:<nil>}}
I0127 02:53:23.454621 3796111 docker.go:318] overlay module found
I0127 02:53:23.457823 3796111 out.go:177] * Using the docker driver based on existing profile
I0127 02:53:23.460620 3796111 start.go:297] selected driver: docker
I0127 02:53:23.460642 3796111 start.go:901] validating driver "docker" against &{Name:old-k8s-version-949994 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.46@sha256:fd2d445ddcc33ebc5c6b68a17e6219ea207ce63c005095ea1525296da2d1a279 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-949994 Namespace:default APIServerHAVIP: APIServerName:minikubeCA A
PIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/je
nkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0127 02:53:23.460758 3796111 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0127 02:53:23.461493 3796111 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0127 02:53:23.515773 3796111 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:49 OomKillDisable:true NGoroutines:56 SystemTime:2025-01-27 02:53:23.506204627 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1075-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:a
arch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214835200 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:27.5.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:bcc810d6b9066471b0b6fa75f557a15a1cbf31bb Expected:bcc810d6b9066471b0b6fa75f557a15a1cbf31bb} RuncCommit:{ID:v1.2.4-0-g6c52b3f Expected:v1.2.4-0-g6c52b3f} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.20.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.32.4]] Warnings:<nil>}}
I0127 02:53:23.516173 3796111 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0127 02:53:23.516205 3796111 cni.go:84] Creating CNI manager for ""
I0127 02:53:23.516254 3796111 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0127 02:53:23.516296 3796111 start.go:340] cluster config:
{Name:old-k8s-version-949994 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.46@sha256:fd2d445ddcc33ebc5c6b68a17e6219ea207ce63c005095ea1525296da2d1a279 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-949994 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:contai
nerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize
:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0127 02:53:23.519637 3796111 out.go:177] * Starting "old-k8s-version-949994" primary control-plane node in "old-k8s-version-949994" cluster
I0127 02:53:23.522414 3796111 cache.go:121] Beginning downloading kic base image for docker with containerd
I0127 02:53:23.525360 3796111 out.go:177] * Pulling base image v0.0.46 ...
I0127 02:53:23.528155 3796111 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime containerd
I0127 02:53:23.528214 3796111 preload.go:146] Found local preload: /home/jenkins/minikube-integration/20316-3581420/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-containerd-overlay2-arm64.tar.lz4
I0127 02:53:23.528233 3796111 cache.go:56] Caching tarball of preloaded images
I0127 02:53:23.528241 3796111 image.go:81] Checking for gcr.io/k8s-minikube/kicbase:v0.0.46@sha256:fd2d445ddcc33ebc5c6b68a17e6219ea207ce63c005095ea1525296da2d1a279 in local docker daemon
I0127 02:53:23.528326 3796111 preload.go:172] Found /home/jenkins/minikube-integration/20316-3581420/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-containerd-overlay2-arm64.tar.lz4 in cache, skipping download
I0127 02:53:23.528338 3796111 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on containerd
I0127 02:53:23.528447 3796111 profile.go:143] Saving config to /home/jenkins/minikube-integration/20316-3581420/.minikube/profiles/old-k8s-version-949994/config.json ...
I0127 02:53:23.547260 3796111 image.go:100] Found gcr.io/k8s-minikube/kicbase:v0.0.46@sha256:fd2d445ddcc33ebc5c6b68a17e6219ea207ce63c005095ea1525296da2d1a279 in local docker daemon, skipping pull
I0127 02:53:23.547284 3796111 cache.go:145] gcr.io/k8s-minikube/kicbase:v0.0.46@sha256:fd2d445ddcc33ebc5c6b68a17e6219ea207ce63c005095ea1525296da2d1a279 exists in daemon, skipping load
I0127 02:53:23.547299 3796111 cache.go:230] Successfully downloaded all kic artifacts
I0127 02:53:23.547329 3796111 start.go:360] acquireMachinesLock for old-k8s-version-949994: {Name:mk8caef1ff0c794c9f7daffab3099799a376ca86 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0127 02:53:23.547387 3796111 start.go:364] duration metric: took 34.961µs to acquireMachinesLock for "old-k8s-version-949994"
I0127 02:53:23.547412 3796111 start.go:96] Skipping create...Using existing machine configuration
I0127 02:53:23.547423 3796111 fix.go:54] fixHost starting:
I0127 02:53:23.547681 3796111 cli_runner.go:164] Run: docker container inspect old-k8s-version-949994 --format={{.State.Status}}
I0127 02:53:23.564213 3796111 fix.go:112] recreateIfNeeded on old-k8s-version-949994: state=Stopped err=<nil>
W0127 02:53:23.564244 3796111 fix.go:138] unexpected machine state, will restart: <nil>
I0127 02:53:23.567465 3796111 out.go:177] * Restarting existing docker container for "old-k8s-version-949994" ...
I0127 02:53:23.570239 3796111 cli_runner.go:164] Run: docker start old-k8s-version-949994
I0127 02:53:23.908279 3796111 cli_runner.go:164] Run: docker container inspect old-k8s-version-949994 --format={{.State.Status}}
I0127 02:53:23.929410 3796111 kic.go:430] container "old-k8s-version-949994" state is running.
I0127 02:53:23.930718 3796111 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-949994
I0127 02:53:23.950912 3796111 profile.go:143] Saving config to /home/jenkins/minikube-integration/20316-3581420/.minikube/profiles/old-k8s-version-949994/config.json ...
I0127 02:53:23.951386 3796111 machine.go:93] provisionDockerMachine start ...
I0127 02:53:23.951460 3796111 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-949994
I0127 02:53:23.971656 3796111 main.go:141] libmachine: Using SSH client type: native
I0127 02:53:23.972046 3796111 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x4132a0] 0x415ae0 <nil> [] 0s} 127.0.0.1 37781 <nil> <nil>}
I0127 02:53:23.972059 3796111 main.go:141] libmachine: About to run SSH command:
hostname
I0127 02:53:23.973030 3796111 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: EOF
I0127 02:53:27.097504 3796111 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-949994
I0127 02:53:27.097530 3796111 ubuntu.go:169] provisioning hostname "old-k8s-version-949994"
I0127 02:53:27.097604 3796111 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-949994
I0127 02:53:27.114778 3796111 main.go:141] libmachine: Using SSH client type: native
I0127 02:53:27.115036 3796111 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x4132a0] 0x415ae0 <nil> [] 0s} 127.0.0.1 37781 <nil> <nil>}
I0127 02:53:27.115056 3796111 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-949994 && echo "old-k8s-version-949994" | sudo tee /etc/hostname
I0127 02:53:27.258253 3796111 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-949994
I0127 02:53:27.258347 3796111 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-949994
I0127 02:53:27.285966 3796111 main.go:141] libmachine: Using SSH client type: native
I0127 02:53:27.286392 3796111 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x4132a0] 0x415ae0 <nil> [] 0s} 127.0.0.1 37781 <nil> <nil>}
I0127 02:53:27.286422 3796111 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-949994' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-949994/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-949994' | sudo tee -a /etc/hosts;
fi
fi
I0127 02:53:27.430186 3796111 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0127 02:53:27.430216 3796111 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/20316-3581420/.minikube CaCertPath:/home/jenkins/minikube-integration/20316-3581420/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/20316-3581420/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/20316-3581420/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/20316-3581420/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/20316-3581420/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/20316-3581420/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/20316-3581420/.minikube}
I0127 02:53:27.430238 3796111 ubuntu.go:177] setting up certificates
I0127 02:53:27.430250 3796111 provision.go:84] configureAuth start
I0127 02:53:27.430315 3796111 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-949994
I0127 02:53:27.448032 3796111 provision.go:143] copyHostCerts
I0127 02:53:27.448093 3796111 exec_runner.go:144] found /home/jenkins/minikube-integration/20316-3581420/.minikube/ca.pem, removing ...
I0127 02:53:27.448102 3796111 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20316-3581420/.minikube/ca.pem
I0127 02:53:27.448175 3796111 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20316-3581420/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20316-3581420/.minikube/ca.pem (1078 bytes)
I0127 02:53:27.449140 3796111 exec_runner.go:144] found /home/jenkins/minikube-integration/20316-3581420/.minikube/cert.pem, removing ...
I0127 02:53:27.449154 3796111 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20316-3581420/.minikube/cert.pem
I0127 02:53:27.449215 3796111 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20316-3581420/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20316-3581420/.minikube/cert.pem (1123 bytes)
I0127 02:53:27.449307 3796111 exec_runner.go:144] found /home/jenkins/minikube-integration/20316-3581420/.minikube/key.pem, removing ...
I0127 02:53:27.449313 3796111 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20316-3581420/.minikube/key.pem
I0127 02:53:27.449339 3796111 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20316-3581420/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20316-3581420/.minikube/key.pem (1679 bytes)
I0127 02:53:27.452926 3796111 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20316-3581420/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20316-3581420/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20316-3581420/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-949994 san=[127.0.0.1 192.168.76.2 localhost minikube old-k8s-version-949994]
I0127 02:53:28.668709 3796111 provision.go:177] copyRemoteCerts
I0127 02:53:28.668966 3796111 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0127 02:53:28.669038 3796111 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-949994
I0127 02:53:28.698812 3796111 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:37781 SSHKeyPath:/home/jenkins/minikube-integration/20316-3581420/.minikube/machines/old-k8s-version-949994/id_rsa Username:docker}
I0127 02:53:28.791134 3796111 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20316-3581420/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0127 02:53:28.819720 3796111 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20316-3581420/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0127 02:53:28.852918 3796111 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20316-3581420/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0127 02:53:28.887669 3796111 provision.go:87] duration metric: took 1.457405722s to configureAuth
I0127 02:53:28.887740 3796111 ubuntu.go:193] setting minikube options for container-runtime
I0127 02:53:28.887974 3796111 config.go:182] Loaded profile config "old-k8s-version-949994": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0
I0127 02:53:28.888004 3796111 machine.go:96] duration metric: took 4.936609679s to provisionDockerMachine
I0127 02:53:28.888027 3796111 start.go:293] postStartSetup for "old-k8s-version-949994" (driver="docker")
I0127 02:53:28.888050 3796111 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0127 02:53:28.888134 3796111 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0127 02:53:28.888196 3796111 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-949994
I0127 02:53:28.918335 3796111 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:37781 SSHKeyPath:/home/jenkins/minikube-integration/20316-3581420/.minikube/machines/old-k8s-version-949994/id_rsa Username:docker}
I0127 02:53:29.017587 3796111 ssh_runner.go:195] Run: cat /etc/os-release
I0127 02:53:29.021291 3796111 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0127 02:53:29.021331 3796111 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0127 02:53:29.021343 3796111 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0127 02:53:29.021352 3796111 info.go:137] Remote host: Ubuntu 22.04.5 LTS
I0127 02:53:29.021362 3796111 filesync.go:126] Scanning /home/jenkins/minikube-integration/20316-3581420/.minikube/addons for local assets ...
I0127 02:53:29.021426 3796111 filesync.go:126] Scanning /home/jenkins/minikube-integration/20316-3581420/.minikube/files for local assets ...
I0127 02:53:29.021507 3796111 filesync.go:149] local asset: /home/jenkins/minikube-integration/20316-3581420/.minikube/files/etc/ssl/certs/35868002.pem -> 35868002.pem in /etc/ssl/certs
I0127 02:53:29.021618 3796111 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0127 02:53:29.033520 3796111 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20316-3581420/.minikube/files/etc/ssl/certs/35868002.pem --> /etc/ssl/certs/35868002.pem (1708 bytes)
I0127 02:53:29.069431 3796111 start.go:296] duration metric: took 181.376719ms for postStartSetup
I0127 02:53:29.069539 3796111 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0127 02:53:29.069584 3796111 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-949994
I0127 02:53:29.086748 3796111 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:37781 SSHKeyPath:/home/jenkins/minikube-integration/20316-3581420/.minikube/machines/old-k8s-version-949994/id_rsa Username:docker}
I0127 02:53:29.176151 3796111 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I0127 02:53:29.181203 3796111 fix.go:56] duration metric: took 5.633772041s for fixHost
I0127 02:53:29.181228 3796111 start.go:83] releasing machines lock for "old-k8s-version-949994", held for 5.633827514s
I0127 02:53:29.181300 3796111 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-949994
I0127 02:53:29.198286 3796111 ssh_runner.go:195] Run: cat /version.json
I0127 02:53:29.198347 3796111 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-949994
I0127 02:53:29.198622 3796111 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0127 02:53:29.198697 3796111 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-949994
I0127 02:53:29.218942 3796111 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:37781 SSHKeyPath:/home/jenkins/minikube-integration/20316-3581420/.minikube/machines/old-k8s-version-949994/id_rsa Username:docker}
I0127 02:53:29.240970 3796111 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:37781 SSHKeyPath:/home/jenkins/minikube-integration/20316-3581420/.minikube/machines/old-k8s-version-949994/id_rsa Username:docker}
I0127 02:53:29.473885 3796111 ssh_runner.go:195] Run: systemctl --version
I0127 02:53:29.478870 3796111 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I0127 02:53:29.483506 3796111 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
I0127 02:53:29.500844 3796111 cni.go:230] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
I0127 02:53:29.500958 3796111 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0127 02:53:29.509874 3796111 cni.go:259] no active bridge cni configs found in "/etc/cni/net.d" - nothing to disable
I0127 02:53:29.509941 3796111 start.go:495] detecting cgroup driver to use...
I0127 02:53:29.509987 3796111 detect.go:187] detected "cgroupfs" cgroup driver on host os
I0127 02:53:29.510064 3796111 ssh_runner.go:195] Run: sudo systemctl stop -f crio
I0127 02:53:29.524775 3796111 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I0127 02:53:29.536649 3796111 docker.go:217] disabling cri-docker service (if available) ...
I0127 02:53:29.536748 3796111 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0127 02:53:29.549950 3796111 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0127 02:53:29.561639 3796111 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0127 02:53:29.645297 3796111 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0127 02:53:29.734323 3796111 docker.go:233] disabling docker service ...
I0127 02:53:29.734440 3796111 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0127 02:53:29.747766 3796111 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0127 02:53:29.759061 3796111 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0127 02:53:29.852247 3796111 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0127 02:53:29.935040 3796111 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0127 02:53:29.946316 3796111 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock
" | sudo tee /etc/crictl.yaml"
I0127 02:53:29.963146 3796111 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.2"|' /etc/containerd/config.toml"
I0127 02:53:29.972975 3796111 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
I0127 02:53:29.982718 3796111 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...
I0127 02:53:29.982793 3796111 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
I0127 02:53:29.992718 3796111 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0127 02:53:30.005663 3796111 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
I0127 02:53:30.021465 3796111 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0127 02:53:30.040260 3796111 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0127 02:53:30.051245 3796111 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
I0127 02:53:30.062930 3796111 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0127 02:53:30.074437 3796111 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0127 02:53:30.084203 3796111 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0127 02:53:30.172078 3796111 ssh_runner.go:195] Run: sudo systemctl restart containerd
I0127 02:53:30.362861 3796111 start.go:542] Will wait 60s for socket path /run/containerd/containerd.sock
I0127 02:53:30.362982 3796111 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
I0127 02:53:30.366677 3796111 start.go:563] Will wait 60s for crictl version
I0127 02:53:30.366780 3796111 ssh_runner.go:195] Run: which crictl
I0127 02:53:30.370077 3796111 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0127 02:53:30.406531 3796111 start.go:579] Version: 0.1.0
RuntimeName: containerd
RuntimeVersion: 1.7.24
RuntimeApiVersion: v1
I0127 02:53:30.406697 3796111 ssh_runner.go:195] Run: containerd --version
I0127 02:53:30.433813 3796111 ssh_runner.go:195] Run: containerd --version
I0127 02:53:30.462236 3796111 out.go:177] * Preparing Kubernetes v1.20.0 on containerd 1.7.24 ...
I0127 02:53:30.465289 3796111 cli_runner.go:164] Run: docker network inspect old-k8s-version-949994 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0127 02:53:30.481479 3796111 ssh_runner.go:195] Run: grep 192.168.76.1 host.minikube.internal$ /etc/hosts
I0127 02:53:30.484890 3796111 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.76.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0127 02:53:30.495309 3796111 kubeadm.go:883] updating cluster {Name:old-k8s-version-949994 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.46@sha256:fd2d445ddcc33ebc5c6b68a17e6219ea207ce63c005095ea1525296da2d1a279 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-949994 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[]
APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-h
ost Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0127 02:53:30.495428 3796111 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime containerd
I0127 02:53:30.495490 3796111 ssh_runner.go:195] Run: sudo crictl images --output json
I0127 02:53:30.534120 3796111 containerd.go:627] all images are preloaded for containerd runtime.
I0127 02:53:30.534142 3796111 containerd.go:534] Images already preloaded, skipping extraction
I0127 02:53:30.534201 3796111 ssh_runner.go:195] Run: sudo crictl images --output json
I0127 02:53:30.568738 3796111 containerd.go:627] all images are preloaded for containerd runtime.
I0127 02:53:30.568758 3796111 cache_images.go:84] Images are preloaded, skipping loading
I0127 02:53:30.568766 3796111 kubeadm.go:934] updating node { 192.168.76.2 8443 v1.20.0 containerd true true} ...
I0127 02:53:30.568878 3796111 kubeadm.go:946] kubelet [Unit]
Wants=containerd.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///run/containerd/containerd.sock --hostname-override=old-k8s-version-949994 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.76.2
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-949994 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0127 02:53:30.568940 3796111 ssh_runner.go:195] Run: sudo crictl info
I0127 02:53:30.609531 3796111 cni.go:84] Creating CNI manager for ""
I0127 02:53:30.609564 3796111 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0127 02:53:30.609575 3796111 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0127 02:53:30.609627 3796111 kubeadm.go:189] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.76.2 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-949994 NodeName:old-k8s-version-949994 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.76.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.76.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt
StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0127 02:53:30.609800 3796111 kubeadm.go:195] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.76.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /run/containerd/containerd.sock
name: "old-k8s-version-949994"
kubeletExtraArgs:
node-ip: 192.168.76.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.76.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0127 02:53:30.609885 3796111 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0127 02:53:30.619581 3796111 binaries.go:44] Found k8s binaries, skipping transfer
I0127 02:53:30.619678 3796111 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0127 02:53:30.628059 3796111 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (442 bytes)
I0127 02:53:30.645266 3796111 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0127 02:53:30.663024 3796111 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2125 bytes)
I0127 02:53:30.680785 3796111 ssh_runner.go:195] Run: grep 192.168.76.2 control-plane.minikube.internal$ /etc/hosts
I0127 02:53:30.684131 3796111 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.76.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0127 02:53:30.694941 3796111 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0127 02:53:30.783185 3796111 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0127 02:53:30.797915 3796111 certs.go:68] Setting up /home/jenkins/minikube-integration/20316-3581420/.minikube/profiles/old-k8s-version-949994 for IP: 192.168.76.2
I0127 02:53:30.797946 3796111 certs.go:194] generating shared ca certs ...
I0127 02:53:30.797963 3796111 certs.go:226] acquiring lock for ca certs: {Name:mk1bae14ef6af74439063c8478bc03213541b880 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0127 02:53:30.798190 3796111 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/20316-3581420/.minikube/ca.key
I0127 02:53:30.798244 3796111 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/20316-3581420/.minikube/proxy-client-ca.key
I0127 02:53:30.798257 3796111 certs.go:256] generating profile certs ...
I0127 02:53:30.798344 3796111 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/20316-3581420/.minikube/profiles/old-k8s-version-949994/client.key
I0127 02:53:30.798414 3796111 certs.go:359] skipping valid signed profile cert regeneration for "minikube": /home/jenkins/minikube-integration/20316-3581420/.minikube/profiles/old-k8s-version-949994/apiserver.key.05cfac9d
I0127 02:53:30.798463 3796111 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/20316-3581420/.minikube/profiles/old-k8s-version-949994/proxy-client.key
I0127 02:53:30.798578 3796111 certs.go:484] found cert: /home/jenkins/minikube-integration/20316-3581420/.minikube/certs/3586800.pem (1338 bytes)
W0127 02:53:30.798610 3796111 certs.go:480] ignoring /home/jenkins/minikube-integration/20316-3581420/.minikube/certs/3586800_empty.pem, impossibly tiny 0 bytes
I0127 02:53:30.798624 3796111 certs.go:484] found cert: /home/jenkins/minikube-integration/20316-3581420/.minikube/certs/ca-key.pem (1675 bytes)
I0127 02:53:30.798648 3796111 certs.go:484] found cert: /home/jenkins/minikube-integration/20316-3581420/.minikube/certs/ca.pem (1078 bytes)
I0127 02:53:30.798676 3796111 certs.go:484] found cert: /home/jenkins/minikube-integration/20316-3581420/.minikube/certs/cert.pem (1123 bytes)
I0127 02:53:30.798700 3796111 certs.go:484] found cert: /home/jenkins/minikube-integration/20316-3581420/.minikube/certs/key.pem (1679 bytes)
I0127 02:53:30.798745 3796111 certs.go:484] found cert: /home/jenkins/minikube-integration/20316-3581420/.minikube/files/etc/ssl/certs/35868002.pem (1708 bytes)
I0127 02:53:30.799347 3796111 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20316-3581420/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0127 02:53:30.830541 3796111 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20316-3581420/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0127 02:53:30.855768 3796111 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20316-3581420/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0127 02:53:30.880883 3796111 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20316-3581420/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0127 02:53:30.906006 3796111 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20316-3581420/.minikube/profiles/old-k8s-version-949994/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0127 02:53:30.930978 3796111 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20316-3581420/.minikube/profiles/old-k8s-version-949994/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0127 02:53:30.958628 3796111 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20316-3581420/.minikube/profiles/old-k8s-version-949994/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0127 02:53:30.986129 3796111 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20316-3581420/.minikube/profiles/old-k8s-version-949994/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0127 02:53:31.013051 3796111 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20316-3581420/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0127 02:53:31.037419 3796111 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20316-3581420/.minikube/certs/3586800.pem --> /usr/share/ca-certificates/3586800.pem (1338 bytes)
I0127 02:53:31.061991 3796111 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20316-3581420/.minikube/files/etc/ssl/certs/35868002.pem --> /usr/share/ca-certificates/35868002.pem (1708 bytes)
I0127 02:53:31.087131 3796111 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0127 02:53:31.106191 3796111 ssh_runner.go:195] Run: openssl version
I0127 02:53:31.115025 3796111 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/3586800.pem && ln -fs /usr/share/ca-certificates/3586800.pem /etc/ssl/certs/3586800.pem"
I0127 02:53:31.125502 3796111 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/3586800.pem
I0127 02:53:31.129126 3796111 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Jan 27 02:16 /usr/share/ca-certificates/3586800.pem
I0127 02:53:31.129192 3796111 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/3586800.pem
I0127 02:53:31.136768 3796111 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/3586800.pem /etc/ssl/certs/51391683.0"
I0127 02:53:31.145984 3796111 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/35868002.pem && ln -fs /usr/share/ca-certificates/35868002.pem /etc/ssl/certs/35868002.pem"
I0127 02:53:31.155353 3796111 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/35868002.pem
I0127 02:53:31.159092 3796111 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Jan 27 02:16 /usr/share/ca-certificates/35868002.pem
I0127 02:53:31.159208 3796111 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/35868002.pem
I0127 02:53:31.166054 3796111 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/35868002.pem /etc/ssl/certs/3ec20f2e.0"
I0127 02:53:31.175068 3796111 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0127 02:53:31.184641 3796111 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0127 02:53:31.188178 3796111 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Jan 27 02:08 /usr/share/ca-certificates/minikubeCA.pem
I0127 02:53:31.188251 3796111 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0127 02:53:31.195159 3796111 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0127 02:53:31.204090 3796111 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0127 02:53:31.207625 3796111 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
I0127 02:53:31.214435 3796111 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
I0127 02:53:31.221319 3796111 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
I0127 02:53:31.228244 3796111 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
I0127 02:53:31.235165 3796111 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
I0127 02:53:31.241993 3796111 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
I0127 02:53:31.249701 3796111 kubeadm.go:392] StartCluster: {Name:old-k8s-version-949994 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.46@sha256:fd2d445ddcc33ebc5c6b68a17e6219ea207ce63c005095ea1525296da2d1a279 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-949994 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] API
ServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host
Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0127 02:53:31.249800 3796111 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}
I0127 02:53:31.249870 3796111 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0127 02:53:31.287282 3796111 cri.go:89] found id: "c13cdebc5015733e24bab16edcf17edc46267951f0fd3d8422baef4ecc5b4eb1"
I0127 02:53:31.287357 3796111 cri.go:89] found id: "2333f389a3e6eb63094687bfb2df8df33f3fdb8498fc24f92452e8fffd240cca"
I0127 02:53:31.287366 3796111 cri.go:89] found id: "17ad11f28e20777140f3d682704f30e56a34c3f85630bf0758795ca29f6f719a"
I0127 02:53:31.287371 3796111 cri.go:89] found id: "a7fa3720da9a726a9f6f8d791e969823b89c23d447e9434ee4a64f80336f7aa2"
I0127 02:53:31.287374 3796111 cri.go:89] found id: "f2925631dd795b8801f2679b3e0abf7fb3982c9a2992d20dab2cd4fe3d74a687"
I0127 02:53:31.287378 3796111 cri.go:89] found id: "d422478362adb4ddd09d8598be12970c37fc3c672548faefb895f3b8924598a3"
I0127 02:53:31.287381 3796111 cri.go:89] found id: "8d9862575a02aedaa20cbdbc29f350c7d048f408b17d76e6899b001882f093b9"
I0127 02:53:31.287384 3796111 cri.go:89] found id: "0f4ff9b6b17b830c0f2505936c14a703649af8de56a7960df790d5e970f75414"
I0127 02:53:31.287387 3796111 cri.go:89] found id: "ae3fb4241ae87bccf92d74ec50fcca30938fee4da6ee2129c5306d476811e810"
I0127 02:53:31.287394 3796111 cri.go:89] found id: ""
I0127 02:53:31.287451 3796111 ssh_runner.go:195] Run: sudo runc --root /run/containerd/runc/k8s.io list -f json
W0127 02:53:31.301632 3796111 kubeadm.go:399] unpause failed: list paused: runc: sudo runc --root /run/containerd/runc/k8s.io list -f json: Process exited with status 1
stdout:
stderr:
time="2025-01-27T02:53:31Z" level=error msg="open /run/containerd/runc/k8s.io: no such file or directory"
I0127 02:53:31.301735 3796111 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0127 02:53:31.311428 3796111 kubeadm.go:408] found existing configuration files, will attempt cluster restart
I0127 02:53:31.311492 3796111 kubeadm.go:593] restartPrimaryControlPlane start ...
I0127 02:53:31.311572 3796111 ssh_runner.go:195] Run: sudo test -d /data/minikube
I0127 02:53:31.320881 3796111 kubeadm.go:130] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
stdout:
stderr:
I0127 02:53:31.321348 3796111 kubeconfig.go:47] verify endpoint returned: get endpoint: "old-k8s-version-949994" does not appear in /home/jenkins/minikube-integration/20316-3581420/kubeconfig
I0127 02:53:31.321462 3796111 kubeconfig.go:62] /home/jenkins/minikube-integration/20316-3581420/kubeconfig needs updating (will repair): [kubeconfig missing "old-k8s-version-949994" cluster setting kubeconfig missing "old-k8s-version-949994" context setting]
I0127 02:53:31.321736 3796111 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20316-3581420/kubeconfig: {Name:mkc8ad8c78feebc7c27d31aea066c6fc5e1767bd Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0127 02:53:31.322963 3796111 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
I0127 02:53:31.333842 3796111 kubeadm.go:630] The running cluster does not require reconfiguration: 192.168.76.2
I0127 02:53:31.333916 3796111 kubeadm.go:597] duration metric: took 22.403517ms to restartPrimaryControlPlane
I0127 02:53:31.333933 3796111 kubeadm.go:394] duration metric: took 84.242283ms to StartCluster
I0127 02:53:31.333948 3796111 settings.go:142] acquiring lock: {Name:mk735c76882f337c2ca62b3dd2d1bbcced4c92cb Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0127 02:53:31.334023 3796111 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/20316-3581420/kubeconfig
I0127 02:53:31.334803 3796111 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20316-3581420/kubeconfig: {Name:mkc8ad8c78feebc7c27d31aea066c6fc5e1767bd Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0127 02:53:31.335028 3796111 start.go:235] Will wait 6m0s for node &{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}
I0127 02:53:31.335399 3796111 config.go:182] Loaded profile config "old-k8s-version-949994": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0
I0127 02:53:31.335443 3796111 addons.go:511] enable addons start: toEnable=map[ambassador:false amd-gpu-device-plugin:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:true default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]
I0127 02:53:31.335514 3796111 addons.go:69] Setting storage-provisioner=true in profile "old-k8s-version-949994"
I0127 02:53:31.335541 3796111 addons.go:238] Setting addon storage-provisioner=true in "old-k8s-version-949994"
W0127 02:53:31.335553 3796111 addons.go:247] addon storage-provisioner should already be in state true
I0127 02:53:31.335544 3796111 addons.go:69] Setting default-storageclass=true in profile "old-k8s-version-949994"
I0127 02:53:31.335624 3796111 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "old-k8s-version-949994"
I0127 02:53:31.335575 3796111 host.go:66] Checking if "old-k8s-version-949994" exists ...
I0127 02:53:31.336035 3796111 cli_runner.go:164] Run: docker container inspect old-k8s-version-949994 --format={{.State.Status}}
I0127 02:53:31.335579 3796111 addons.go:69] Setting metrics-server=true in profile "old-k8s-version-949994"
I0127 02:53:31.336554 3796111 addons.go:238] Setting addon metrics-server=true in "old-k8s-version-949994"
W0127 02:53:31.336565 3796111 addons.go:247] addon metrics-server should already be in state true
I0127 02:53:31.336578 3796111 cli_runner.go:164] Run: docker container inspect old-k8s-version-949994 --format={{.State.Status}}
I0127 02:53:31.336587 3796111 host.go:66] Checking if "old-k8s-version-949994" exists ...
I0127 02:53:31.336999 3796111 cli_runner.go:164] Run: docker container inspect old-k8s-version-949994 --format={{.State.Status}}
I0127 02:53:31.335584 3796111 addons.go:69] Setting dashboard=true in profile "old-k8s-version-949994"
I0127 02:53:31.341037 3796111 addons.go:238] Setting addon dashboard=true in "old-k8s-version-949994"
W0127 02:53:31.341050 3796111 addons.go:247] addon dashboard should already be in state true
I0127 02:53:31.341087 3796111 host.go:66] Checking if "old-k8s-version-949994" exists ...
I0127 02:53:31.341543 3796111 cli_runner.go:164] Run: docker container inspect old-k8s-version-949994 --format={{.State.Status}}
I0127 02:53:31.343431 3796111 out.go:177] * Verifying Kubernetes components...
I0127 02:53:31.346602 3796111 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0127 02:53:31.365269 3796111 addons.go:238] Setting addon default-storageclass=true in "old-k8s-version-949994"
W0127 02:53:31.365298 3796111 addons.go:247] addon default-storageclass should already be in state true
I0127 02:53:31.365324 3796111 host.go:66] Checking if "old-k8s-version-949994" exists ...
I0127 02:53:31.365738 3796111 cli_runner.go:164] Run: docker container inspect old-k8s-version-949994 --format={{.State.Status}}
I0127 02:53:31.382665 3796111 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0127 02:53:31.390733 3796111 addons.go:435] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0127 02:53:31.390758 3796111 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0127 02:53:31.390827 3796111 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-949994
I0127 02:53:31.393897 3796111 out.go:177] - Using image registry.k8s.io/echoserver:1.4
I0127 02:53:31.397308 3796111 out.go:177] - Using image docker.io/kubernetesui/dashboard:v2.7.0
I0127 02:53:31.400114 3796111 addons.go:435] installing /etc/kubernetes/addons/dashboard-ns.yaml
I0127 02:53:31.400145 3796111 ssh_runner.go:362] scp dashboard/dashboard-ns.yaml --> /etc/kubernetes/addons/dashboard-ns.yaml (759 bytes)
I0127 02:53:31.400216 3796111 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-949994
I0127 02:53:31.427437 3796111 out.go:177] - Using image fake.domain/registry.k8s.io/echoserver:1.4
I0127 02:53:31.434263 3796111 addons.go:435] installing /etc/kubernetes/addons/metrics-apiservice.yaml
I0127 02:53:31.434299 3796111 ssh_runner.go:362] scp metrics-server/metrics-apiservice.yaml --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
I0127 02:53:31.434373 3796111 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-949994
I0127 02:53:31.438071 3796111 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:37781 SSHKeyPath:/home/jenkins/minikube-integration/20316-3581420/.minikube/machines/old-k8s-version-949994/id_rsa Username:docker}
I0127 02:53:31.446895 3796111 addons.go:435] installing /etc/kubernetes/addons/storageclass.yaml
I0127 02:53:31.446922 3796111 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0127 02:53:31.446988 3796111 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-949994
I0127 02:53:31.466935 3796111 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:37781 SSHKeyPath:/home/jenkins/minikube-integration/20316-3581420/.minikube/machines/old-k8s-version-949994/id_rsa Username:docker}
I0127 02:53:31.526279 3796111 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:37781 SSHKeyPath:/home/jenkins/minikube-integration/20316-3581420/.minikube/machines/old-k8s-version-949994/id_rsa Username:docker}
I0127 02:53:31.542056 3796111 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0127 02:53:31.555502 3796111 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:37781 SSHKeyPath:/home/jenkins/minikube-integration/20316-3581420/.minikube/machines/old-k8s-version-949994/id_rsa Username:docker}
I0127 02:53:31.560232 3796111 node_ready.go:35] waiting up to 6m0s for node "old-k8s-version-949994" to be "Ready" ...
I0127 02:53:31.572507 3796111 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0127 02:53:31.608936 3796111 addons.go:435] installing /etc/kubernetes/addons/dashboard-clusterrole.yaml
I0127 02:53:31.609017 3796111 ssh_runner.go:362] scp dashboard/dashboard-clusterrole.yaml --> /etc/kubernetes/addons/dashboard-clusterrole.yaml (1001 bytes)
I0127 02:53:31.629026 3796111 addons.go:435] installing /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml
I0127 02:53:31.629050 3796111 ssh_runner.go:362] scp dashboard/dashboard-clusterrolebinding.yaml --> /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml (1018 bytes)
I0127 02:53:31.664349 3796111 addons.go:435] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
I0127 02:53:31.664423 3796111 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1825 bytes)
I0127 02:53:31.667195 3796111 addons.go:435] installing /etc/kubernetes/addons/dashboard-configmap.yaml
I0127 02:53:31.667263 3796111 ssh_runner.go:362] scp dashboard/dashboard-configmap.yaml --> /etc/kubernetes/addons/dashboard-configmap.yaml (837 bytes)
I0127 02:53:31.693111 3796111 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0127 02:53:31.734174 3796111 addons.go:435] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
I0127 02:53:31.734254 3796111 ssh_runner.go:362] scp metrics-server/metrics-server-rbac.yaml --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
I0127 02:53:31.769743 3796111 addons.go:435] installing /etc/kubernetes/addons/dashboard-dp.yaml
I0127 02:53:31.769816 3796111 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-dp.yaml (4201 bytes)
W0127 02:53:31.783586 3796111 addons.go:461] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0127 02:53:31.783685 3796111 retry.go:31] will retry after 308.903671ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0127 02:53:31.792548 3796111 addons.go:435] installing /etc/kubernetes/addons/metrics-server-service.yaml
I0127 02:53:31.792621 3796111 ssh_runner.go:362] scp metrics-server/metrics-server-service.yaml --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
I0127 02:53:31.843833 3796111 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0127 02:53:31.851425 3796111 addons.go:435] installing /etc/kubernetes/addons/dashboard-role.yaml
I0127 02:53:31.851447 3796111 ssh_runner.go:362] scp dashboard/dashboard-role.yaml --> /etc/kubernetes/addons/dashboard-role.yaml (1724 bytes)
W0127 02:53:31.877942 3796111 addons.go:461] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0127 02:53:31.877973 3796111 retry.go:31] will retry after 264.460508ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0127 02:53:31.906521 3796111 addons.go:435] installing /etc/kubernetes/addons/dashboard-rolebinding.yaml
I0127 02:53:31.906543 3796111 ssh_runner.go:362] scp dashboard/dashboard-rolebinding.yaml --> /etc/kubernetes/addons/dashboard-rolebinding.yaml (1046 bytes)
I0127 02:53:31.939597 3796111 addons.go:435] installing /etc/kubernetes/addons/dashboard-sa.yaml
I0127 02:53:31.939619 3796111 ssh_runner.go:362] scp dashboard/dashboard-sa.yaml --> /etc/kubernetes/addons/dashboard-sa.yaml (837 bytes)
I0127 02:53:31.962177 3796111 addons.go:435] installing /etc/kubernetes/addons/dashboard-secret.yaml
I0127 02:53:31.962199 3796111 ssh_runner.go:362] scp dashboard/dashboard-secret.yaml --> /etc/kubernetes/addons/dashboard-secret.yaml (1389 bytes)
W0127 02:53:31.984859 3796111 addons.go:461] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0127 02:53:31.984891 3796111 retry.go:31] will retry after 362.645979ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0127 02:53:31.987802 3796111 addons.go:435] installing /etc/kubernetes/addons/dashboard-svc.yaml
I0127 02:53:31.987826 3796111 ssh_runner.go:362] scp dashboard/dashboard-svc.yaml --> /etc/kubernetes/addons/dashboard-svc.yaml (1294 bytes)
I0127 02:53:32.012949 3796111 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0127 02:53:32.093065 3796111 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0127 02:53:32.125400 3796111 addons.go:461] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0127 02:53:32.125435 3796111 retry.go:31] will retry after 161.941326ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0127 02:53:32.142797 3796111 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0127 02:53:32.250442 3796111 addons.go:461] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0127 02:53:32.250473 3796111 retry.go:31] will retry after 250.979803ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0127 02:53:32.256566 3796111 addons.go:461] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0127 02:53:32.256594 3796111 retry.go:31] will retry after 260.913733ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0127 02:53:32.287911 3796111 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0127 02:53:32.348289 3796111 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0127 02:53:32.400967 3796111 addons.go:461] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0127 02:53:32.400997 3796111 retry.go:31] will retry after 462.862077ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0127 02:53:32.474043 3796111 addons.go:461] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0127 02:53:32.474073 3796111 retry.go:31] will retry after 396.89833ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0127 02:53:32.502422 3796111 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I0127 02:53:32.517694 3796111 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0127 02:53:32.629080 3796111 addons.go:461] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0127 02:53:32.629110 3796111 retry.go:31] will retry after 569.100826ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0127 02:53:32.675455 3796111 addons.go:461] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0127 02:53:32.675489 3796111 retry.go:31] will retry after 806.341729ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0127 02:53:32.864595 3796111 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0127 02:53:32.874474 3796111 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0127 02:53:33.037119 3796111 addons.go:461] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0127 02:53:33.037152 3796111 retry.go:31] will retry after 740.905547ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0127 02:53:33.037187 3796111 addons.go:461] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0127 02:53:33.037194 3796111 retry.go:31] will retry after 500.746469ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0127 02:53:33.199093 3796111 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0127 02:53:33.304641 3796111 addons.go:461] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0127 02:53:33.304672 3796111 retry.go:31] will retry after 1.040611531s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0127 02:53:33.482460 3796111 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I0127 02:53:33.538412 3796111 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0127 02:53:33.561019 3796111 node_ready.go:53] error getting node "old-k8s-version-949994": Get "https://192.168.76.2:8443/api/v1/nodes/old-k8s-version-949994": dial tcp 192.168.76.2:8443: connect: connection refused
W0127 02:53:33.630898 3796111 addons.go:461] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0127 02:53:33.630930 3796111 retry.go:31] will retry after 609.259794ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0127 02:53:33.762337 3796111 addons.go:461] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0127 02:53:33.762374 3796111 retry.go:31] will retry after 906.647338ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0127 02:53:33.778774 3796111 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0127 02:53:33.926685 3796111 addons.go:461] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0127 02:53:33.926720 3796111 retry.go:31] will retry after 781.619075ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0127 02:53:34.240642 3796111 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0127 02:53:34.342660 3796111 addons.go:461] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0127 02:53:34.342693 3796111 retry.go:31] will retry after 1.847735819s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0127 02:53:34.345941 3796111 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0127 02:53:34.440212 3796111 addons.go:461] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0127 02:53:34.440240 3796111 retry.go:31] will retry after 1.237695708s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0127 02:53:34.670356 3796111 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0127 02:53:34.708739 3796111 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0127 02:53:34.899182 3796111 addons.go:461] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0127 02:53:34.899213 3796111 retry.go:31] will retry after 763.822356ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0127 02:53:34.930776 3796111 addons.go:461] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0127 02:53:34.930807 3796111 retry.go:31] will retry after 1.541249452s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0127 02:53:35.561437 3796111 node_ready.go:53] error getting node "old-k8s-version-949994": Get "https://192.168.76.2:8443/api/v1/nodes/old-k8s-version-949994": dial tcp 192.168.76.2:8443: connect: connection refused
I0127 02:53:35.663651 3796111 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0127 02:53:35.678986 3796111 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0127 02:53:35.889238 3796111 addons.go:461] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0127 02:53:35.889268 3796111 retry.go:31] will retry after 1.945377799s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0127 02:53:35.926329 3796111 addons.go:461] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0127 02:53:35.926360 3796111 retry.go:31] will retry after 2.550128111s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0127 02:53:36.191351 3796111 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0127 02:53:36.320168 3796111 addons.go:461] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0127 02:53:36.320197 3796111 retry.go:31] will retry after 2.184810208s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0127 02:53:36.472595 3796111 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0127 02:53:36.614569 3796111 addons.go:461] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0127 02:53:36.614599 3796111 retry.go:31] will retry after 2.043266532s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0127 02:53:37.561517 3796111 node_ready.go:53] error getting node "old-k8s-version-949994": Get "https://192.168.76.2:8443/api/v1/nodes/old-k8s-version-949994": dial tcp 192.168.76.2:8443: connect: connection refused
I0127 02:53:37.835005 3796111 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0127 02:53:37.946261 3796111 addons.go:461] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0127 02:53:37.946294 3796111 retry.go:31] will retry after 2.215585943s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0127 02:53:38.476693 3796111 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I0127 02:53:38.505989 3796111 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I0127 02:53:38.658896 3796111 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0127 02:53:38.675666 3796111 addons.go:461] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0127 02:53:38.675697 3796111 retry.go:31] will retry after 2.63789832s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0127 02:53:38.746567 3796111 addons.go:461] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0127 02:53:38.746661 3796111 retry.go:31] will retry after 2.641720268s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0127 02:53:38.850214 3796111 addons.go:461] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0127 02:53:38.850297 3796111 retry.go:31] will retry after 3.339056224s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0127 02:53:40.060814 3796111 node_ready.go:53] error getting node "old-k8s-version-949994": Get "https://192.168.76.2:8443/api/v1/nodes/old-k8s-version-949994": dial tcp 192.168.76.2:8443: connect: connection refused
I0127 02:53:40.162175 3796111 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0127 02:53:40.330399 3796111 addons.go:461] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0127 02:53:40.330475 3796111 retry.go:31] will retry after 2.397678788s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0127 02:53:41.313795 3796111 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I0127 02:53:41.389354 3796111 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I0127 02:53:42.190467 3796111 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0127 02:53:42.729219 3796111 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0127 02:53:51.062368 3796111 node_ready.go:53] error getting node "old-k8s-version-949994": Get "https://192.168.76.2:8443/api/v1/nodes/old-k8s-version-949994": net/http: TLS handshake timeout
I0127 02:53:52.142409 3796111 node_ready.go:49] node "old-k8s-version-949994" has status "Ready":"True"
I0127 02:53:52.142433 3796111 node_ready.go:38] duration metric: took 20.582168026s for node "old-k8s-version-949994" to be "Ready" ...
I0127 02:53:52.142444 3796111 pod_ready.go:36] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0127 02:53:52.394940 3796111 pod_ready.go:79] waiting up to 6m0s for pod "coredns-74ff55c5b-fbwzt" in "kube-system" namespace to be "Ready" ...
I0127 02:53:52.605554 3796111 pod_ready.go:93] pod "coredns-74ff55c5b-fbwzt" in "kube-system" namespace has status "Ready":"True"
I0127 02:53:52.605625 3796111 pod_ready.go:82] duration metric: took 210.595986ms for pod "coredns-74ff55c5b-fbwzt" in "kube-system" namespace to be "Ready" ...
I0127 02:53:52.605652 3796111 pod_ready.go:79] waiting up to 6m0s for pod "etcd-old-k8s-version-949994" in "kube-system" namespace to be "Ready" ...
I0127 02:53:52.694592 3796111 pod_ready.go:93] pod "etcd-old-k8s-version-949994" in "kube-system" namespace has status "Ready":"True"
I0127 02:53:52.694673 3796111 pod_ready.go:82] duration metric: took 88.998503ms for pod "etcd-old-k8s-version-949994" in "kube-system" namespace to be "Ready" ...
I0127 02:53:52.694703 3796111 pod_ready.go:79] waiting up to 6m0s for pod "kube-apiserver-old-k8s-version-949994" in "kube-system" namespace to be "Ready" ...
I0127 02:53:52.820844 3796111 pod_ready.go:93] pod "kube-apiserver-old-k8s-version-949994" in "kube-system" namespace has status "Ready":"True"
I0127 02:53:52.820921 3796111 pod_ready.go:82] duration metric: took 126.181859ms for pod "kube-apiserver-old-k8s-version-949994" in "kube-system" namespace to be "Ready" ...
I0127 02:53:52.820948 3796111 pod_ready.go:79] waiting up to 6m0s for pod "kube-controller-manager-old-k8s-version-949994" in "kube-system" namespace to be "Ready" ...
I0127 02:53:54.406918 3796111 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: (13.017478568s)
W0127 02:53:54.407000 3796111 addons.go:461] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
Unable to connect to the server: net/http: TLS handshake timeout
I0127 02:53:54.407031 3796111 retry.go:31] will retry after 3.302396858s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
Unable to connect to the server: net/http: TLS handshake timeout
I0127 02:53:54.411107 3796111 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: (13.09721629s)
I0127 02:53:54.868785 3796111 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-949994" in "kube-system" namespace has status "Ready":"False"
I0127 02:53:55.237374 3796111 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: (13.0468605s)
I0127 02:53:55.237716 3796111 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (12.508468132s)
I0127 02:53:55.237781 3796111 addons.go:479] Verifying addon metrics-server=true in "old-k8s-version-949994"
I0127 02:53:55.242785 3796111 out.go:177] * Some dashboard features require the metrics-server addon. To enable all features please run:
minikube -p old-k8s-version-949994 addons enable metrics-server
I0127 02:53:57.328983 3796111 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-949994" in "kube-system" namespace has status "Ready":"False"
I0127 02:53:57.710619 3796111 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I0127 02:53:58.270618 3796111 out.go:177] * Enabled addons: storage-provisioner, metrics-server, dashboard, default-storageclass
I0127 02:53:58.285945 3796111 addons.go:514] duration metric: took 26.950486407s for enable addons: enabled=[storage-provisioner metrics-server dashboard default-storageclass]
I0127 02:53:59.832536 3796111 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-949994" in "kube-system" namespace has status "Ready":"False"
I0127 02:54:02.328048 3796111 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-949994" in "kube-system" namespace has status "Ready":"False"
I0127 02:54:04.827595 3796111 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-949994" in "kube-system" namespace has status "Ready":"False"
I0127 02:54:06.828080 3796111 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-949994" in "kube-system" namespace has status "Ready":"False"
I0127 02:54:09.327450 3796111 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-949994" in "kube-system" namespace has status "Ready":"False"
I0127 02:54:11.328233 3796111 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-949994" in "kube-system" namespace has status "Ready":"False"
I0127 02:54:13.331340 3796111 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-949994" in "kube-system" namespace has status "Ready":"False"
I0127 02:54:15.828464 3796111 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-949994" in "kube-system" namespace has status "Ready":"False"
I0127 02:54:17.828684 3796111 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-949994" in "kube-system" namespace has status "Ready":"False"
I0127 02:54:19.829017 3796111 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-949994" in "kube-system" namespace has status "Ready":"False"
I0127 02:54:21.832959 3796111 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-949994" in "kube-system" namespace has status "Ready":"False"
I0127 02:54:24.327508 3796111 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-949994" in "kube-system" namespace has status "Ready":"False"
I0127 02:54:26.827620 3796111 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-949994" in "kube-system" namespace has status "Ready":"False"
I0127 02:54:28.827830 3796111 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-949994" in "kube-system" namespace has status "Ready":"False"
I0127 02:54:30.827951 3796111 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-949994" in "kube-system" namespace has status "Ready":"False"
I0127 02:54:33.327618 3796111 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-949994" in "kube-system" namespace has status "Ready":"False"
I0127 02:54:35.828124 3796111 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-949994" in "kube-system" namespace has status "Ready":"False"
I0127 02:54:38.328076 3796111 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-949994" in "kube-system" namespace has status "Ready":"False"
I0127 02:54:40.827345 3796111 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-949994" in "kube-system" namespace has status "Ready":"False"
I0127 02:54:43.327961 3796111 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-949994" in "kube-system" namespace has status "Ready":"False"
I0127 02:54:45.828967 3796111 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-949994" in "kube-system" namespace has status "Ready":"False"
I0127 02:54:48.327775 3796111 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-949994" in "kube-system" namespace has status "Ready":"False"
I0127 02:54:50.328107 3796111 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-949994" in "kube-system" namespace has status "Ready":"False"
I0127 02:54:52.829898 3796111 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-949994" in "kube-system" namespace has status "Ready":"False"
I0127 02:54:54.827748 3796111 pod_ready.go:93] pod "kube-controller-manager-old-k8s-version-949994" in "kube-system" namespace has status "Ready":"True"
I0127 02:54:54.827777 3796111 pod_ready.go:82] duration metric: took 1m2.006792121s for pod "kube-controller-manager-old-k8s-version-949994" in "kube-system" namespace to be "Ready" ...
I0127 02:54:54.827791 3796111 pod_ready.go:79] waiting up to 6m0s for pod "kube-proxy-5hzlg" in "kube-system" namespace to be "Ready" ...
I0127 02:54:54.833179 3796111 pod_ready.go:93] pod "kube-proxy-5hzlg" in "kube-system" namespace has status "Ready":"True"
I0127 02:54:54.833208 3796111 pod_ready.go:82] duration metric: took 5.408281ms for pod "kube-proxy-5hzlg" in "kube-system" namespace to be "Ready" ...
I0127 02:54:54.833222 3796111 pod_ready.go:79] waiting up to 6m0s for pod "kube-scheduler-old-k8s-version-949994" in "kube-system" namespace to be "Ready" ...
I0127 02:54:56.839308 3796111 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-949994" in "kube-system" namespace has status "Ready":"False"
I0127 02:54:58.840171 3796111 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-949994" in "kube-system" namespace has status "Ready":"False"
I0127 02:55:01.340251 3796111 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-949994" in "kube-system" namespace has status "Ready":"False"
I0127 02:55:03.839676 3796111 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-949994" in "kube-system" namespace has status "Ready":"False"
I0127 02:55:05.839918 3796111 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-949994" in "kube-system" namespace has status "Ready":"False"
I0127 02:55:08.340819 3796111 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-949994" in "kube-system" namespace has status "Ready":"False"
I0127 02:55:10.839499 3796111 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-949994" in "kube-system" namespace has status "Ready":"False"
I0127 02:55:12.841075 3796111 pod_ready.go:93] pod "kube-scheduler-old-k8s-version-949994" in "kube-system" namespace has status "Ready":"True"
I0127 02:55:12.841104 3796111 pod_ready.go:82] duration metric: took 18.007873373s for pod "kube-scheduler-old-k8s-version-949994" in "kube-system" namespace to be "Ready" ...
I0127 02:55:12.841118 3796111 pod_ready.go:79] waiting up to 6m0s for pod "metrics-server-9975d5f86-mftgr" in "kube-system" namespace to be "Ready" ...
I0127 02:55:14.846761 3796111 pod_ready.go:103] pod "metrics-server-9975d5f86-mftgr" in "kube-system" namespace has status "Ready":"False"
I0127 02:55:16.848015 3796111 pod_ready.go:103] pod "metrics-server-9975d5f86-mftgr" in "kube-system" namespace has status "Ready":"False"
I0127 02:55:19.347166 3796111 pod_ready.go:103] pod "metrics-server-9975d5f86-mftgr" in "kube-system" namespace has status "Ready":"False"
I0127 02:55:21.350199 3796111 pod_ready.go:103] pod "metrics-server-9975d5f86-mftgr" in "kube-system" namespace has status "Ready":"False"
I0127 02:55:23.847883 3796111 pod_ready.go:103] pod "metrics-server-9975d5f86-mftgr" in "kube-system" namespace has status "Ready":"False"
I0127 02:55:25.847949 3796111 pod_ready.go:103] pod "metrics-server-9975d5f86-mftgr" in "kube-system" namespace has status "Ready":"False"
I0127 02:55:27.848010 3796111 pod_ready.go:103] pod "metrics-server-9975d5f86-mftgr" in "kube-system" namespace has status "Ready":"False"
I0127 02:55:30.348323 3796111 pod_ready.go:103] pod "metrics-server-9975d5f86-mftgr" in "kube-system" namespace has status "Ready":"False"
I0127 02:55:32.368715 3796111 pod_ready.go:103] pod "metrics-server-9975d5f86-mftgr" in "kube-system" namespace has status "Ready":"False"
I0127 02:55:34.848348 3796111 pod_ready.go:103] pod "metrics-server-9975d5f86-mftgr" in "kube-system" namespace has status "Ready":"False"
I0127 02:55:37.347130 3796111 pod_ready.go:103] pod "metrics-server-9975d5f86-mftgr" in "kube-system" namespace has status "Ready":"False"
I0127 02:55:39.847094 3796111 pod_ready.go:103] pod "metrics-server-9975d5f86-mftgr" in "kube-system" namespace has status "Ready":"False"
I0127 02:55:42.347519 3796111 pod_ready.go:103] pod "metrics-server-9975d5f86-mftgr" in "kube-system" namespace has status "Ready":"False"
I0127 02:55:44.848181 3796111 pod_ready.go:103] pod "metrics-server-9975d5f86-mftgr" in "kube-system" namespace has status "Ready":"False"
I0127 02:55:47.351581 3796111 pod_ready.go:103] pod "metrics-server-9975d5f86-mftgr" in "kube-system" namespace has status "Ready":"False"
I0127 02:55:49.849323 3796111 pod_ready.go:103] pod "metrics-server-9975d5f86-mftgr" in "kube-system" namespace has status "Ready":"False"
I0127 02:55:52.347834 3796111 pod_ready.go:103] pod "metrics-server-9975d5f86-mftgr" in "kube-system" namespace has status "Ready":"False"
I0127 02:55:54.348818 3796111 pod_ready.go:103] pod "metrics-server-9975d5f86-mftgr" in "kube-system" namespace has status "Ready":"False"
I0127 02:55:56.847564 3796111 pod_ready.go:103] pod "metrics-server-9975d5f86-mftgr" in "kube-system" namespace has status "Ready":"False"
I0127 02:55:58.848128 3796111 pod_ready.go:103] pod "metrics-server-9975d5f86-mftgr" in "kube-system" namespace has status "Ready":"False"
I0127 02:56:01.348494 3796111 pod_ready.go:103] pod "metrics-server-9975d5f86-mftgr" in "kube-system" namespace has status "Ready":"False"
I0127 02:56:03.847102 3796111 pod_ready.go:103] pod "metrics-server-9975d5f86-mftgr" in "kube-system" namespace has status "Ready":"False"
I0127 02:56:05.847596 3796111 pod_ready.go:103] pod "metrics-server-9975d5f86-mftgr" in "kube-system" namespace has status "Ready":"False"
I0127 02:56:07.847816 3796111 pod_ready.go:103] pod "metrics-server-9975d5f86-mftgr" in "kube-system" namespace has status "Ready":"False"
I0127 02:56:10.351672 3796111 pod_ready.go:103] pod "metrics-server-9975d5f86-mftgr" in "kube-system" namespace has status "Ready":"False"
I0127 02:56:12.847861 3796111 pod_ready.go:103] pod "metrics-server-9975d5f86-mftgr" in "kube-system" namespace has status "Ready":"False"
I0127 02:56:15.346895 3796111 pod_ready.go:103] pod "metrics-server-9975d5f86-mftgr" in "kube-system" namespace has status "Ready":"False"
I0127 02:56:17.347600 3796111 pod_ready.go:103] pod "metrics-server-9975d5f86-mftgr" in "kube-system" namespace has status "Ready":"False"
I0127 02:56:19.347737 3796111 pod_ready.go:103] pod "metrics-server-9975d5f86-mftgr" in "kube-system" namespace has status "Ready":"False"
I0127 02:56:21.847596 3796111 pod_ready.go:103] pod "metrics-server-9975d5f86-mftgr" in "kube-system" namespace has status "Ready":"False"
I0127 02:56:24.347987 3796111 pod_ready.go:103] pod "metrics-server-9975d5f86-mftgr" in "kube-system" namespace has status "Ready":"False"
I0127 02:56:26.348203 3796111 pod_ready.go:103] pod "metrics-server-9975d5f86-mftgr" in "kube-system" namespace has status "Ready":"False"
I0127 02:56:28.348456 3796111 pod_ready.go:103] pod "metrics-server-9975d5f86-mftgr" in "kube-system" namespace has status "Ready":"False"
I0127 02:56:30.348806 3796111 pod_ready.go:103] pod "metrics-server-9975d5f86-mftgr" in "kube-system" namespace has status "Ready":"False"
I0127 02:56:32.888161 3796111 pod_ready.go:103] pod "metrics-server-9975d5f86-mftgr" in "kube-system" namespace has status "Ready":"False"
I0127 02:56:35.348735 3796111 pod_ready.go:103] pod "metrics-server-9975d5f86-mftgr" in "kube-system" namespace has status "Ready":"False"
I0127 02:56:37.352293 3796111 pod_ready.go:103] pod "metrics-server-9975d5f86-mftgr" in "kube-system" namespace has status "Ready":"False"
I0127 02:56:39.847523 3796111 pod_ready.go:103] pod "metrics-server-9975d5f86-mftgr" in "kube-system" namespace has status "Ready":"False"
I0127 02:56:42.348688 3796111 pod_ready.go:103] pod "metrics-server-9975d5f86-mftgr" in "kube-system" namespace has status "Ready":"False"
I0127 02:56:44.847833 3796111 pod_ready.go:103] pod "metrics-server-9975d5f86-mftgr" in "kube-system" namespace has status "Ready":"False"
I0127 02:56:47.347201 3796111 pod_ready.go:103] pod "metrics-server-9975d5f86-mftgr" in "kube-system" namespace has status "Ready":"False"
I0127 02:56:49.351533 3796111 pod_ready.go:103] pod "metrics-server-9975d5f86-mftgr" in "kube-system" namespace has status "Ready":"False"
I0127 02:56:51.847752 3796111 pod_ready.go:103] pod "metrics-server-9975d5f86-mftgr" in "kube-system" namespace has status "Ready":"False"
I0127 02:56:53.847835 3796111 pod_ready.go:103] pod "metrics-server-9975d5f86-mftgr" in "kube-system" namespace has status "Ready":"False"
I0127 02:56:55.848108 3796111 pod_ready.go:103] pod "metrics-server-9975d5f86-mftgr" in "kube-system" namespace has status "Ready":"False"
I0127 02:56:57.848910 3796111 pod_ready.go:103] pod "metrics-server-9975d5f86-mftgr" in "kube-system" namespace has status "Ready":"False"
I0127 02:57:00.348250 3796111 pod_ready.go:103] pod "metrics-server-9975d5f86-mftgr" in "kube-system" namespace has status "Ready":"False"
I0127 02:57:02.847479 3796111 pod_ready.go:103] pod "metrics-server-9975d5f86-mftgr" in "kube-system" namespace has status "Ready":"False"
I0127 02:57:04.848693 3796111 pod_ready.go:103] pod "metrics-server-9975d5f86-mftgr" in "kube-system" namespace has status "Ready":"False"
I0127 02:57:07.347265 3796111 pod_ready.go:103] pod "metrics-server-9975d5f86-mftgr" in "kube-system" namespace has status "Ready":"False"
I0127 02:57:09.347525 3796111 pod_ready.go:103] pod "metrics-server-9975d5f86-mftgr" in "kube-system" namespace has status "Ready":"False"
I0127 02:57:11.348241 3796111 pod_ready.go:103] pod "metrics-server-9975d5f86-mftgr" in "kube-system" namespace has status "Ready":"False"
I0127 02:57:13.848063 3796111 pod_ready.go:103] pod "metrics-server-9975d5f86-mftgr" in "kube-system" namespace has status "Ready":"False"
I0127 02:57:16.347935 3796111 pod_ready.go:103] pod "metrics-server-9975d5f86-mftgr" in "kube-system" namespace has status "Ready":"False"
I0127 02:57:18.847592 3796111 pod_ready.go:103] pod "metrics-server-9975d5f86-mftgr" in "kube-system" namespace has status "Ready":"False"
I0127 02:57:21.347680 3796111 pod_ready.go:103] pod "metrics-server-9975d5f86-mftgr" in "kube-system" namespace has status "Ready":"False"
I0127 02:57:23.847407 3796111 pod_ready.go:103] pod "metrics-server-9975d5f86-mftgr" in "kube-system" namespace has status "Ready":"False"
I0127 02:57:26.347328 3796111 pod_ready.go:103] pod "metrics-server-9975d5f86-mftgr" in "kube-system" namespace has status "Ready":"False"
I0127 02:57:28.348648 3796111 pod_ready.go:103] pod "metrics-server-9975d5f86-mftgr" in "kube-system" namespace has status "Ready":"False"
I0127 02:57:30.847926 3796111 pod_ready.go:103] pod "metrics-server-9975d5f86-mftgr" in "kube-system" namespace has status "Ready":"False"
I0127 02:57:33.404035 3796111 pod_ready.go:103] pod "metrics-server-9975d5f86-mftgr" in "kube-system" namespace has status "Ready":"False"
I0127 02:57:35.848377 3796111 pod_ready.go:103] pod "metrics-server-9975d5f86-mftgr" in "kube-system" namespace has status "Ready":"False"
I0127 02:57:38.348244 3796111 pod_ready.go:103] pod "metrics-server-9975d5f86-mftgr" in "kube-system" namespace has status "Ready":"False"
I0127 02:57:40.365273 3796111 pod_ready.go:103] pod "metrics-server-9975d5f86-mftgr" in "kube-system" namespace has status "Ready":"False"
I0127 02:57:42.847561 3796111 pod_ready.go:103] pod "metrics-server-9975d5f86-mftgr" in "kube-system" namespace has status "Ready":"False"
I0127 02:57:45.347070 3796111 pod_ready.go:103] pod "metrics-server-9975d5f86-mftgr" in "kube-system" namespace has status "Ready":"False"
I0127 02:57:47.347580 3796111 pod_ready.go:103] pod "metrics-server-9975d5f86-mftgr" in "kube-system" namespace has status "Ready":"False"
I0127 02:57:49.348552 3796111 pod_ready.go:103] pod "metrics-server-9975d5f86-mftgr" in "kube-system" namespace has status "Ready":"False"
I0127 02:57:51.846676 3796111 pod_ready.go:103] pod "metrics-server-9975d5f86-mftgr" in "kube-system" namespace has status "Ready":"False"
I0127 02:57:53.848183 3796111 pod_ready.go:103] pod "metrics-server-9975d5f86-mftgr" in "kube-system" namespace has status "Ready":"False"
I0127 02:57:56.347696 3796111 pod_ready.go:103] pod "metrics-server-9975d5f86-mftgr" in "kube-system" namespace has status "Ready":"False"
I0127 02:57:58.847150 3796111 pod_ready.go:103] pod "metrics-server-9975d5f86-mftgr" in "kube-system" namespace has status "Ready":"False"
I0127 02:58:00.847916 3796111 pod_ready.go:103] pod "metrics-server-9975d5f86-mftgr" in "kube-system" namespace has status "Ready":"False"
I0127 02:58:03.347230 3796111 pod_ready.go:103] pod "metrics-server-9975d5f86-mftgr" in "kube-system" namespace has status "Ready":"False"
I0127 02:58:05.847528 3796111 pod_ready.go:103] pod "metrics-server-9975d5f86-mftgr" in "kube-system" namespace has status "Ready":"False"
I0127 02:58:08.349376 3796111 pod_ready.go:103] pod "metrics-server-9975d5f86-mftgr" in "kube-system" namespace has status "Ready":"False"
I0127 02:58:10.847628 3796111 pod_ready.go:103] pod "metrics-server-9975d5f86-mftgr" in "kube-system" namespace has status "Ready":"False"
I0127 02:58:12.848683 3796111 pod_ready.go:103] pod "metrics-server-9975d5f86-mftgr" in "kube-system" namespace has status "Ready":"False"
I0127 02:58:15.347418 3796111 pod_ready.go:103] pod "metrics-server-9975d5f86-mftgr" in "kube-system" namespace has status "Ready":"False"
I0127 02:58:17.348210 3796111 pod_ready.go:103] pod "metrics-server-9975d5f86-mftgr" in "kube-system" namespace has status "Ready":"False"
I0127 02:58:19.846925 3796111 pod_ready.go:103] pod "metrics-server-9975d5f86-mftgr" in "kube-system" namespace has status "Ready":"False"
I0127 02:58:22.347260 3796111 pod_ready.go:103] pod "metrics-server-9975d5f86-mftgr" in "kube-system" namespace has status "Ready":"False"
I0127 02:58:24.347682 3796111 pod_ready.go:103] pod "metrics-server-9975d5f86-mftgr" in "kube-system" namespace has status "Ready":"False"
I0127 02:58:26.848289 3796111 pod_ready.go:103] pod "metrics-server-9975d5f86-mftgr" in "kube-system" namespace has status "Ready":"False"
I0127 02:58:29.347499 3796111 pod_ready.go:103] pod "metrics-server-9975d5f86-mftgr" in "kube-system" namespace has status "Ready":"False"
I0127 02:58:31.347918 3796111 pod_ready.go:103] pod "metrics-server-9975d5f86-mftgr" in "kube-system" namespace has status "Ready":"False"
I0127 02:58:33.848640 3796111 pod_ready.go:103] pod "metrics-server-9975d5f86-mftgr" in "kube-system" namespace has status "Ready":"False"
I0127 02:58:36.348209 3796111 pod_ready.go:103] pod "metrics-server-9975d5f86-mftgr" in "kube-system" namespace has status "Ready":"False"
I0127 02:58:38.847716 3796111 pod_ready.go:103] pod "metrics-server-9975d5f86-mftgr" in "kube-system" namespace has status "Ready":"False"
I0127 02:58:41.347695 3796111 pod_ready.go:103] pod "metrics-server-9975d5f86-mftgr" in "kube-system" namespace has status "Ready":"False"
I0127 02:58:43.848243 3796111 pod_ready.go:103] pod "metrics-server-9975d5f86-mftgr" in "kube-system" namespace has status "Ready":"False"
I0127 02:58:46.350037 3796111 pod_ready.go:103] pod "metrics-server-9975d5f86-mftgr" in "kube-system" namespace has status "Ready":"False"
I0127 02:58:48.852359 3796111 pod_ready.go:103] pod "metrics-server-9975d5f86-mftgr" in "kube-system" namespace has status "Ready":"False"
I0127 02:58:51.348682 3796111 pod_ready.go:103] pod "metrics-server-9975d5f86-mftgr" in "kube-system" namespace has status "Ready":"False"
I0127 02:58:53.353671 3796111 pod_ready.go:103] pod "metrics-server-9975d5f86-mftgr" in "kube-system" namespace has status "Ready":"False"
I0127 02:58:55.850273 3796111 pod_ready.go:103] pod "metrics-server-9975d5f86-mftgr" in "kube-system" namespace has status "Ready":"False"
I0127 02:58:58.347216 3796111 pod_ready.go:103] pod "metrics-server-9975d5f86-mftgr" in "kube-system" namespace has status "Ready":"False"
I0127 02:59:00.348519 3796111 pod_ready.go:103] pod "metrics-server-9975d5f86-mftgr" in "kube-system" namespace has status "Ready":"False"
I0127 02:59:02.850554 3796111 pod_ready.go:103] pod "metrics-server-9975d5f86-mftgr" in "kube-system" namespace has status "Ready":"False"
I0127 02:59:04.869664 3796111 pod_ready.go:103] pod "metrics-server-9975d5f86-mftgr" in "kube-system" namespace has status "Ready":"False"
I0127 02:59:07.350731 3796111 pod_ready.go:103] pod "metrics-server-9975d5f86-mftgr" in "kube-system" namespace has status "Ready":"False"
I0127 02:59:09.849140 3796111 pod_ready.go:103] pod "metrics-server-9975d5f86-mftgr" in "kube-system" namespace has status "Ready":"False"
I0127 02:59:12.351772 3796111 pod_ready.go:103] pod "metrics-server-9975d5f86-mftgr" in "kube-system" namespace has status "Ready":"False"
I0127 02:59:12.849550 3796111 pod_ready.go:82] duration metric: took 4m0.00841246s for pod "metrics-server-9975d5f86-mftgr" in "kube-system" namespace to be "Ready" ...
E0127 02:59:12.849575 3796111 pod_ready.go:67] WaitExtra: waitPodCondition: context deadline exceeded
I0127 02:59:12.849585 3796111 pod_ready.go:39] duration metric: took 5m20.707129361s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0127 02:59:12.849601 3796111 api_server.go:52] waiting for apiserver process to appear ...
I0127 02:59:12.849632 3796111 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
I0127 02:59:12.849779 3796111 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0127 02:59:12.908698 3796111 cri.go:89] found id: "f1ff631138f971f0d0175bbdad8dae389b0bb6d344b9c6a0c0ee143eb981fd26"
I0127 02:59:12.908718 3796111 cri.go:89] found id: "ae3fb4241ae87bccf92d74ec50fcca30938fee4da6ee2129c5306d476811e810"
I0127 02:59:12.908724 3796111 cri.go:89] found id: ""
I0127 02:59:12.908731 3796111 logs.go:282] 2 containers: [f1ff631138f971f0d0175bbdad8dae389b0bb6d344b9c6a0c0ee143eb981fd26 ae3fb4241ae87bccf92d74ec50fcca30938fee4da6ee2129c5306d476811e810]
I0127 02:59:12.908789 3796111 ssh_runner.go:195] Run: which crictl
I0127 02:59:12.912398 3796111 ssh_runner.go:195] Run: which crictl
I0127 02:59:12.915700 3796111 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
I0127 02:59:12.915779 3796111 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0127 02:59:12.958472 3796111 cri.go:89] found id: "913dba7b3bede3cb8e1b77be0a25d981b94c7ef9011ec91d80f77d6b7afc771b"
I0127 02:59:12.958491 3796111 cri.go:89] found id: "8d9862575a02aedaa20cbdbc29f350c7d048f408b17d76e6899b001882f093b9"
I0127 02:59:12.958495 3796111 cri.go:89] found id: ""
I0127 02:59:12.958502 3796111 logs.go:282] 2 containers: [913dba7b3bede3cb8e1b77be0a25d981b94c7ef9011ec91d80f77d6b7afc771b 8d9862575a02aedaa20cbdbc29f350c7d048f408b17d76e6899b001882f093b9]
I0127 02:59:12.958559 3796111 ssh_runner.go:195] Run: which crictl
I0127 02:59:12.962269 3796111 ssh_runner.go:195] Run: which crictl
I0127 02:59:12.965683 3796111 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
I0127 02:59:12.965751 3796111 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0127 02:59:13.017093 3796111 cri.go:89] found id: "80de12a579f093bfca496c919408519334bb6b6962effaec3c52c2cef2014477"
I0127 02:59:13.017166 3796111 cri.go:89] found id: "2333f389a3e6eb63094687bfb2df8df33f3fdb8498fc24f92452e8fffd240cca"
I0127 02:59:13.017201 3796111 cri.go:89] found id: ""
I0127 02:59:13.017228 3796111 logs.go:282] 2 containers: [80de12a579f093bfca496c919408519334bb6b6962effaec3c52c2cef2014477 2333f389a3e6eb63094687bfb2df8df33f3fdb8498fc24f92452e8fffd240cca]
I0127 02:59:13.017327 3796111 ssh_runner.go:195] Run: which crictl
I0127 02:59:13.021516 3796111 ssh_runner.go:195] Run: which crictl
I0127 02:59:13.025341 3796111 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
I0127 02:59:13.025409 3796111 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0127 02:59:13.080460 3796111 cri.go:89] found id: "6868e5588e2518b2dbbee5fcdc288ff7639c3e6d27152b25c2d92a94144279e8"
I0127 02:59:13.080485 3796111 cri.go:89] found id: "d422478362adb4ddd09d8598be12970c37fc3c672548faefb895f3b8924598a3"
I0127 02:59:13.080493 3796111 cri.go:89] found id: ""
I0127 02:59:13.080502 3796111 logs.go:282] 2 containers: [6868e5588e2518b2dbbee5fcdc288ff7639c3e6d27152b25c2d92a94144279e8 d422478362adb4ddd09d8598be12970c37fc3c672548faefb895f3b8924598a3]
I0127 02:59:13.080571 3796111 ssh_runner.go:195] Run: which crictl
I0127 02:59:13.084534 3796111 ssh_runner.go:195] Run: which crictl
I0127 02:59:13.088803 3796111 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
I0127 02:59:13.088877 3796111 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0127 02:59:13.158618 3796111 cri.go:89] found id: "1eebf1b8ced6916d55f7a34166585a17437e60b2716ed0809ac349c450b4e754"
I0127 02:59:13.158644 3796111 cri.go:89] found id: "a7fa3720da9a726a9f6f8d791e969823b89c23d447e9434ee4a64f80336f7aa2"
I0127 02:59:13.158650 3796111 cri.go:89] found id: ""
I0127 02:59:13.158658 3796111 logs.go:282] 2 containers: [1eebf1b8ced6916d55f7a34166585a17437e60b2716ed0809ac349c450b4e754 a7fa3720da9a726a9f6f8d791e969823b89c23d447e9434ee4a64f80336f7aa2]
I0127 02:59:13.158745 3796111 ssh_runner.go:195] Run: which crictl
I0127 02:59:13.163024 3796111 ssh_runner.go:195] Run: which crictl
I0127 02:59:13.169387 3796111 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
I0127 02:59:13.169529 3796111 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0127 02:59:13.244336 3796111 cri.go:89] found id: "60bc065c8667a83052202f7fc37006df6160a0f60502485d3fe888d752f6e93e"
I0127 02:59:13.244366 3796111 cri.go:89] found id: "0f4ff9b6b17b830c0f2505936c14a703649af8de56a7960df790d5e970f75414"
I0127 02:59:13.244375 3796111 cri.go:89] found id: ""
I0127 02:59:13.244386 3796111 logs.go:282] 2 containers: [60bc065c8667a83052202f7fc37006df6160a0f60502485d3fe888d752f6e93e 0f4ff9b6b17b830c0f2505936c14a703649af8de56a7960df790d5e970f75414]
I0127 02:59:13.244469 3796111 ssh_runner.go:195] Run: which crictl
I0127 02:59:13.248667 3796111 ssh_runner.go:195] Run: which crictl
I0127 02:59:13.252725 3796111 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
I0127 02:59:13.252803 3796111 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0127 02:59:13.300743 3796111 cri.go:89] found id: "792e1bf0751e8fad4834403cd7db06cfbd9065c482e6c7b3bcf4c0c2b1a373d1"
I0127 02:59:13.300767 3796111 cri.go:89] found id: "17ad11f28e20777140f3d682704f30e56a34c3f85630bf0758795ca29f6f719a"
I0127 02:59:13.300773 3796111 cri.go:89] found id: ""
I0127 02:59:13.300781 3796111 logs.go:282] 2 containers: [792e1bf0751e8fad4834403cd7db06cfbd9065c482e6c7b3bcf4c0c2b1a373d1 17ad11f28e20777140f3d682704f30e56a34c3f85630bf0758795ca29f6f719a]
I0127 02:59:13.300838 3796111 ssh_runner.go:195] Run: which crictl
I0127 02:59:13.305143 3796111 ssh_runner.go:195] Run: which crictl
I0127 02:59:13.309056 3796111 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
I0127 02:59:13.309127 3796111 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0127 02:59:13.361247 3796111 cri.go:89] found id: "ca016e85c640cc59943efbf83715a2c4e1dcf8cc8020f4a480ba90214108c3ae"
I0127 02:59:13.361270 3796111 cri.go:89] found id: "5966fc744604d7bfd40d7701102f774e0d749dd772fdb69dbfbe01827d86cd21"
I0127 02:59:13.361278 3796111 cri.go:89] found id: ""
I0127 02:59:13.361285 3796111 logs.go:282] 2 containers: [ca016e85c640cc59943efbf83715a2c4e1dcf8cc8020f4a480ba90214108c3ae 5966fc744604d7bfd40d7701102f774e0d749dd772fdb69dbfbe01827d86cd21]
I0127 02:59:13.361343 3796111 ssh_runner.go:195] Run: which crictl
I0127 02:59:13.365558 3796111 ssh_runner.go:195] Run: which crictl
I0127 02:59:13.369392 3796111 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
I0127 02:59:13.369489 3796111 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I0127 02:59:13.420343 3796111 cri.go:89] found id: "3e757cf47e5bf46aadd2d0209c944ee653ff40decba0a43ed51c38657b7ac9a8"
I0127 02:59:13.420366 3796111 cri.go:89] found id: ""
I0127 02:59:13.420374 3796111 logs.go:282] 1 containers: [3e757cf47e5bf46aadd2d0209c944ee653ff40decba0a43ed51c38657b7ac9a8]
I0127 02:59:13.420433 3796111 ssh_runner.go:195] Run: which crictl
I0127 02:59:13.424585 3796111 logs.go:123] Gathering logs for coredns [80de12a579f093bfca496c919408519334bb6b6962effaec3c52c2cef2014477] ...
I0127 02:59:13.424611 3796111 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 80de12a579f093bfca496c919408519334bb6b6962effaec3c52c2cef2014477"
I0127 02:59:13.478057 3796111 logs.go:123] Gathering logs for coredns [2333f389a3e6eb63094687bfb2df8df33f3fdb8498fc24f92452e8fffd240cca] ...
I0127 02:59:13.478086 3796111 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 2333f389a3e6eb63094687bfb2df8df33f3fdb8498fc24f92452e8fffd240cca"
I0127 02:59:13.536134 3796111 logs.go:123] Gathering logs for kube-proxy [a7fa3720da9a726a9f6f8d791e969823b89c23d447e9434ee4a64f80336f7aa2] ...
I0127 02:59:13.536162 3796111 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 a7fa3720da9a726a9f6f8d791e969823b89c23d447e9434ee4a64f80336f7aa2"
I0127 02:59:13.604664 3796111 logs.go:123] Gathering logs for kubernetes-dashboard [3e757cf47e5bf46aadd2d0209c944ee653ff40decba0a43ed51c38657b7ac9a8] ...
I0127 02:59:13.604699 3796111 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 3e757cf47e5bf46aadd2d0209c944ee653ff40decba0a43ed51c38657b7ac9a8"
I0127 02:59:13.673791 3796111 logs.go:123] Gathering logs for describe nodes ...
I0127 02:59:13.673820 3796111 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0127 02:59:13.864687 3796111 logs.go:123] Gathering logs for kube-scheduler [d422478362adb4ddd09d8598be12970c37fc3c672548faefb895f3b8924598a3] ...
I0127 02:59:13.864722 3796111 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 d422478362adb4ddd09d8598be12970c37fc3c672548faefb895f3b8924598a3"
I0127 02:59:13.936957 3796111 logs.go:123] Gathering logs for kube-controller-manager [60bc065c8667a83052202f7fc37006df6160a0f60502485d3fe888d752f6e93e] ...
I0127 02:59:13.936988 3796111 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 60bc065c8667a83052202f7fc37006df6160a0f60502485d3fe888d752f6e93e"
I0127 02:59:14.024358 3796111 logs.go:123] Gathering logs for kube-apiserver [ae3fb4241ae87bccf92d74ec50fcca30938fee4da6ee2129c5306d476811e810] ...
I0127 02:59:14.024397 3796111 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 ae3fb4241ae87bccf92d74ec50fcca30938fee4da6ee2129c5306d476811e810"
I0127 02:59:14.103841 3796111 logs.go:123] Gathering logs for etcd [913dba7b3bede3cb8e1b77be0a25d981b94c7ef9011ec91d80f77d6b7afc771b] ...
I0127 02:59:14.103876 3796111 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 913dba7b3bede3cb8e1b77be0a25d981b94c7ef9011ec91d80f77d6b7afc771b"
I0127 02:59:14.203352 3796111 logs.go:123] Gathering logs for etcd [8d9862575a02aedaa20cbdbc29f350c7d048f408b17d76e6899b001882f093b9] ...
I0127 02:59:14.203460 3796111 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 8d9862575a02aedaa20cbdbc29f350c7d048f408b17d76e6899b001882f093b9"
I0127 02:59:14.275290 3796111 logs.go:123] Gathering logs for kube-proxy [1eebf1b8ced6916d55f7a34166585a17437e60b2716ed0809ac349c450b4e754] ...
I0127 02:59:14.275372 3796111 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 1eebf1b8ced6916d55f7a34166585a17437e60b2716ed0809ac349c450b4e754"
I0127 02:59:14.335204 3796111 logs.go:123] Gathering logs for kube-controller-manager [0f4ff9b6b17b830c0f2505936c14a703649af8de56a7960df790d5e970f75414] ...
I0127 02:59:14.335232 3796111 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 0f4ff9b6b17b830c0f2505936c14a703649af8de56a7960df790d5e970f75414"
I0127 02:59:14.451827 3796111 logs.go:123] Gathering logs for kindnet [792e1bf0751e8fad4834403cd7db06cfbd9065c482e6c7b3bcf4c0c2b1a373d1] ...
I0127 02:59:14.451917 3796111 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 792e1bf0751e8fad4834403cd7db06cfbd9065c482e6c7b3bcf4c0c2b1a373d1"
I0127 02:59:14.528838 3796111 logs.go:123] Gathering logs for container status ...
I0127 02:59:14.528919 3796111 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0127 02:59:14.607271 3796111 logs.go:123] Gathering logs for dmesg ...
I0127 02:59:14.607428 3796111 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0127 02:59:14.629049 3796111 logs.go:123] Gathering logs for kube-apiserver [f1ff631138f971f0d0175bbdad8dae389b0bb6d344b9c6a0c0ee143eb981fd26] ...
I0127 02:59:14.629129 3796111 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 f1ff631138f971f0d0175bbdad8dae389b0bb6d344b9c6a0c0ee143eb981fd26"
I0127 02:59:14.710645 3796111 logs.go:123] Gathering logs for kube-scheduler [6868e5588e2518b2dbbee5fcdc288ff7639c3e6d27152b25c2d92a94144279e8] ...
I0127 02:59:14.710736 3796111 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 6868e5588e2518b2dbbee5fcdc288ff7639c3e6d27152b25c2d92a94144279e8"
I0127 02:59:14.765480 3796111 logs.go:123] Gathering logs for kindnet [17ad11f28e20777140f3d682704f30e56a34c3f85630bf0758795ca29f6f719a] ...
I0127 02:59:14.765553 3796111 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 17ad11f28e20777140f3d682704f30e56a34c3f85630bf0758795ca29f6f719a"
I0127 02:59:14.828838 3796111 logs.go:123] Gathering logs for storage-provisioner [ca016e85c640cc59943efbf83715a2c4e1dcf8cc8020f4a480ba90214108c3ae] ...
I0127 02:59:14.828906 3796111 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 ca016e85c640cc59943efbf83715a2c4e1dcf8cc8020f4a480ba90214108c3ae"
I0127 02:59:14.888808 3796111 logs.go:123] Gathering logs for storage-provisioner [5966fc744604d7bfd40d7701102f774e0d749dd772fdb69dbfbe01827d86cd21] ...
I0127 02:59:14.888835 3796111 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 5966fc744604d7bfd40d7701102f774e0d749dd772fdb69dbfbe01827d86cd21"
I0127 02:59:14.940906 3796111 logs.go:123] Gathering logs for containerd ...
I0127 02:59:14.940931 3796111 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
I0127 02:59:15.014873 3796111 logs.go:123] Gathering logs for kubelet ...
I0127 02:59:15.014965 3796111 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0127 02:59:15.084568 3796111 logs.go:138] Found kubelet problem: Jan 27 02:53:51 old-k8s-version-949994 kubelet[660]: E0127 02:53:51.967126 660 reflector.go:138] object-"default"/"default-token-gqprk": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "default-token-gqprk" is forbidden: User "system:node:old-k8s-version-949994" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'old-k8s-version-949994' and this object
W0127 02:59:15.084862 3796111 logs.go:138] Found kubelet problem: Jan 27 02:53:51 old-k8s-version-949994 kubelet[660]: E0127 02:53:51.967200 660 reflector.go:138] object-"kube-system"/"coredns": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:old-k8s-version-949994" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-949994' and this object
W0127 02:59:15.085108 3796111 logs.go:138] Found kubelet problem: Jan 27 02:53:51 old-k8s-version-949994 kubelet[660]: E0127 02:53:51.967258 660 reflector.go:138] object-"kube-system"/"kindnet-token-ghd6s": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kindnet-token-ghd6s" is forbidden: User "system:node:old-k8s-version-949994" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-949994' and this object
W0127 02:59:15.085384 3796111 logs.go:138] Found kubelet problem: Jan 27 02:53:51 old-k8s-version-949994 kubelet[660]: E0127 02:53:51.967336 660 reflector.go:138] object-"kube-system"/"storage-provisioner-token-6zk7s": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "storage-provisioner-token-6zk7s" is forbidden: User "system:node:old-k8s-version-949994" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-949994' and this object
W0127 02:59:15.085625 3796111 logs.go:138] Found kubelet problem: Jan 27 02:53:51 old-k8s-version-949994 kubelet[660]: E0127 02:53:51.967387 660 reflector.go:138] object-"kube-system"/"coredns-token-l287g": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "coredns-token-l287g" is forbidden: User "system:node:old-k8s-version-949994" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-949994' and this object
W0127 02:59:15.085873 3796111 logs.go:138] Found kubelet problem: Jan 27 02:53:51 old-k8s-version-949994 kubelet[660]: E0127 02:53:51.967447 660 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:old-k8s-version-949994" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-949994' and this object
W0127 02:59:15.086176 3796111 logs.go:138] Found kubelet problem: Jan 27 02:53:51 old-k8s-version-949994 kubelet[660]: E0127 02:53:51.967496 660 reflector.go:138] object-"kube-system"/"kube-proxy-token-54qrt": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kube-proxy-token-54qrt" is forbidden: User "system:node:old-k8s-version-949994" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-949994' and this object
W0127 02:59:15.095025 3796111 logs.go:138] Found kubelet problem: Jan 27 02:53:53 old-k8s-version-949994 kubelet[660]: E0127 02:53:53.876531 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0127 02:59:15.095319 3796111 logs.go:138] Found kubelet problem: Jan 27 02:53:54 old-k8s-version-949994 kubelet[660]: E0127 02:53:54.021725 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0127 02:59:15.099091 3796111 logs.go:138] Found kubelet problem: Jan 27 02:54:09 old-k8s-version-949994 kubelet[660]: E0127 02:54:09.521072 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0127 02:59:15.101668 3796111 logs.go:138] Found kubelet problem: Jan 27 02:54:22 old-k8s-version-949994 kubelet[660]: E0127 02:54:22.278637 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
W0127 02:59:15.101911 3796111 logs.go:138] Found kubelet problem: Jan 27 02:54:22 old-k8s-version-949994 kubelet[660]: E0127 02:54:22.504207 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0127 02:59:15.102301 3796111 logs.go:138] Found kubelet problem: Jan 27 02:54:23 old-k8s-version-949994 kubelet[660]: E0127 02:54:23.282663 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
W0127 02:59:15.102683 3796111 logs.go:138] Found kubelet problem: Jan 27 02:54:24 old-k8s-version-949994 kubelet[660]: E0127 02:54:24.284977 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
W0127 02:59:15.103161 3796111 logs.go:138] Found kubelet problem: Jan 27 02:54:26 old-k8s-version-949994 kubelet[660]: E0127 02:54:26.292140 660 pod_workers.go:191] Error syncing pod 2b0aa32b-1180-4a97-8374-d786d139dc2c ("storage-provisioner_kube-system(2b0aa32b-1180-4a97-8374-d786d139dc2c)"), skipping: failed to "StartContainer" for "storage-provisioner" with CrashLoopBackOff: "back-off 10s restarting failed container=storage-provisioner pod=storage-provisioner_kube-system(2b0aa32b-1180-4a97-8374-d786d139dc2c)"
W0127 02:59:15.105983 3796111 logs.go:138] Found kubelet problem: Jan 27 02:54:37 old-k8s-version-949994 kubelet[660]: E0127 02:54:37.511569 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0127 02:59:15.106615 3796111 logs.go:138] Found kubelet problem: Jan 27 02:54:39 old-k8s-version-949994 kubelet[660]: E0127 02:54:39.335961 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
W0127 02:59:15.107194 3796111 logs.go:138] Found kubelet problem: Jan 27 02:54:42 old-k8s-version-949994 kubelet[660]: E0127 02:54:42.579255 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
W0127 02:59:15.107385 3796111 logs.go:138] Found kubelet problem: Jan 27 02:54:48 old-k8s-version-949994 kubelet[660]: E0127 02:54:48.501857 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0127 02:59:15.107709 3796111 logs.go:138] Found kubelet problem: Jan 27 02:54:53 old-k8s-version-949994 kubelet[660]: E0127 02:54:53.502843 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
W0127 02:59:15.107890 3796111 logs.go:138] Found kubelet problem: Jan 27 02:55:00 old-k8s-version-949994 kubelet[660]: E0127 02:55:00.501841 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0127 02:59:15.108480 3796111 logs.go:138] Found kubelet problem: Jan 27 02:55:07 old-k8s-version-949994 kubelet[660]: E0127 02:55:07.426639 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
W0127 02:59:15.108808 3796111 logs.go:138] Found kubelet problem: Jan 27 02:55:12 old-k8s-version-949994 kubelet[660]: E0127 02:55:12.579010 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
W0127 02:59:15.108989 3796111 logs.go:138] Found kubelet problem: Jan 27 02:55:13 old-k8s-version-949994 kubelet[660]: E0127 02:55:13.501799 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0127 02:59:15.111603 3796111 logs.go:138] Found kubelet problem: Jan 27 02:55:24 old-k8s-version-949994 kubelet[660]: E0127 02:55:24.528464 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0127 02:59:15.111990 3796111 logs.go:138] Found kubelet problem: Jan 27 02:55:25 old-k8s-version-949994 kubelet[660]: E0127 02:55:25.501540 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
W0127 02:59:15.112206 3796111 logs.go:138] Found kubelet problem: Jan 27 02:55:36 old-k8s-version-949994 kubelet[660]: E0127 02:55:36.501984 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0127 02:59:15.112600 3796111 logs.go:138] Found kubelet problem: Jan 27 02:55:37 old-k8s-version-949994 kubelet[660]: E0127 02:55:37.501584 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
W0127 02:59:15.112861 3796111 logs.go:138] Found kubelet problem: Jan 27 02:55:49 old-k8s-version-949994 kubelet[660]: E0127 02:55:49.505318 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0127 02:59:15.113505 3796111 logs.go:138] Found kubelet problem: Jan 27 02:55:51 old-k8s-version-949994 kubelet[660]: E0127 02:55:51.546741 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
W0127 02:59:15.113872 3796111 logs.go:138] Found kubelet problem: Jan 27 02:55:52 old-k8s-version-949994 kubelet[660]: E0127 02:55:52.578558 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
W0127 02:59:15.114103 3796111 logs.go:138] Found kubelet problem: Jan 27 02:56:03 old-k8s-version-949994 kubelet[660]: E0127 02:56:03.501771 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0127 02:59:15.114473 3796111 logs.go:138] Found kubelet problem: Jan 27 02:56:06 old-k8s-version-949994 kubelet[660]: E0127 02:56:06.501392 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
W0127 02:59:15.114689 3796111 logs.go:138] Found kubelet problem: Jan 27 02:56:14 old-k8s-version-949994 kubelet[660]: E0127 02:56:14.502372 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0127 02:59:15.115045 3796111 logs.go:138] Found kubelet problem: Jan 27 02:56:17 old-k8s-version-949994 kubelet[660]: E0127 02:56:17.501933 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
W0127 02:59:15.115268 3796111 logs.go:138] Found kubelet problem: Jan 27 02:56:26 old-k8s-version-949994 kubelet[660]: E0127 02:56:26.501683 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0127 02:59:15.115635 3796111 logs.go:138] Found kubelet problem: Jan 27 02:56:32 old-k8s-version-949994 kubelet[660]: E0127 02:56:32.501823 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
W0127 02:59:15.115859 3796111 logs.go:138] Found kubelet problem: Jan 27 02:56:40 old-k8s-version-949994 kubelet[660]: E0127 02:56:40.501634 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0127 02:59:15.116289 3796111 logs.go:138] Found kubelet problem: Jan 27 02:56:45 old-k8s-version-949994 kubelet[660]: E0127 02:56:45.502780 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
W0127 02:59:15.118822 3796111 logs.go:138] Found kubelet problem: Jan 27 02:56:55 old-k8s-version-949994 kubelet[660]: E0127 02:56:55.514866 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0127 02:59:15.119188 3796111 logs.go:138] Found kubelet problem: Jan 27 02:56:56 old-k8s-version-949994 kubelet[660]: E0127 02:56:56.501563 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
W0127 02:59:15.119541 3796111 logs.go:138] Found kubelet problem: Jan 27 02:57:07 old-k8s-version-949994 kubelet[660]: E0127 02:57:07.501947 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
W0127 02:59:15.119765 3796111 logs.go:138] Found kubelet problem: Jan 27 02:57:10 old-k8s-version-949994 kubelet[660]: E0127 02:57:10.502918 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0127 02:59:15.120388 3796111 logs.go:138] Found kubelet problem: Jan 27 02:57:21 old-k8s-version-949994 kubelet[660]: E0127 02:57:21.776454 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
W0127 02:59:15.120743 3796111 logs.go:138] Found kubelet problem: Jan 27 02:57:22 old-k8s-version-949994 kubelet[660]: E0127 02:57:22.780516 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
W0127 02:59:15.120978 3796111 logs.go:138] Found kubelet problem: Jan 27 02:57:23 old-k8s-version-949994 kubelet[660]: E0127 02:57:23.505620 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0127 02:59:15.121189 3796111 logs.go:138] Found kubelet problem: Jan 27 02:57:34 old-k8s-version-949994 kubelet[660]: E0127 02:57:34.501538 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0127 02:59:15.121545 3796111 logs.go:138] Found kubelet problem: Jan 27 02:57:35 old-k8s-version-949994 kubelet[660]: E0127 02:57:35.501481 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
W0127 02:59:15.121912 3796111 logs.go:138] Found kubelet problem: Jan 27 02:57:48 old-k8s-version-949994 kubelet[660]: E0127 02:57:48.503510 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
W0127 02:59:15.122150 3796111 logs.go:138] Found kubelet problem: Jan 27 02:57:49 old-k8s-version-949994 kubelet[660]: E0127 02:57:49.501969 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0127 02:59:15.122520 3796111 logs.go:138] Found kubelet problem: Jan 27 02:57:59 old-k8s-version-949994 kubelet[660]: E0127 02:57:59.502983 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
W0127 02:59:15.122734 3796111 logs.go:138] Found kubelet problem: Jan 27 02:58:00 old-k8s-version-949994 kubelet[660]: E0127 02:58:00.501586 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0127 02:59:15.123100 3796111 logs.go:138] Found kubelet problem: Jan 27 02:58:10 old-k8s-version-949994 kubelet[660]: E0127 02:58:10.501269 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
W0127 02:59:15.123321 3796111 logs.go:138] Found kubelet problem: Jan 27 02:58:15 old-k8s-version-949994 kubelet[660]: E0127 02:58:15.501889 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0127 02:59:15.123687 3796111 logs.go:138] Found kubelet problem: Jan 27 02:58:21 old-k8s-version-949994 kubelet[660]: E0127 02:58:21.501389 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
W0127 02:59:15.123897 3796111 logs.go:138] Found kubelet problem: Jan 27 02:58:28 old-k8s-version-949994 kubelet[660]: E0127 02:58:28.501733 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0127 02:59:15.124265 3796111 logs.go:138] Found kubelet problem: Jan 27 02:58:34 old-k8s-version-949994 kubelet[660]: E0127 02:58:34.501213 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
W0127 02:59:15.124475 3796111 logs.go:138] Found kubelet problem: Jan 27 02:58:43 old-k8s-version-949994 kubelet[660]: E0127 02:58:43.501567 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0127 02:59:15.124832 3796111 logs.go:138] Found kubelet problem: Jan 27 02:58:48 old-k8s-version-949994 kubelet[660]: E0127 02:58:48.502462 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
W0127 02:59:15.125042 3796111 logs.go:138] Found kubelet problem: Jan 27 02:58:55 old-k8s-version-949994 kubelet[660]: E0127 02:58:55.501821 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0127 02:59:15.125398 3796111 logs.go:138] Found kubelet problem: Jan 27 02:59:00 old-k8s-version-949994 kubelet[660]: E0127 02:59:00.502866 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
W0127 02:59:15.125620 3796111 logs.go:138] Found kubelet problem: Jan 27 02:59:07 old-k8s-version-949994 kubelet[660]: E0127 02:59:07.502977 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0127 02:59:15.125978 3796111 logs.go:138] Found kubelet problem: Jan 27 02:59:14 old-k8s-version-949994 kubelet[660]: E0127 02:59:14.501372 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
I0127 02:59:15.126008 3796111 out.go:358] Setting ErrFile to fd 2...
I0127 02:59:15.126996 3796111 out.go:392] TERM=,COLORTERM=, which probably does not support color
W0127 02:59:15.127126 3796111 out.go:270] X Problems detected in kubelet:
X Problems detected in kubelet:
W0127 02:59:15.127350 3796111 out.go:270] Jan 27 02:58:48 old-k8s-version-949994 kubelet[660]: E0127 02:58:48.502462 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
Jan 27 02:58:48 old-k8s-version-949994 kubelet[660]: E0127 02:58:48.502462 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
W0127 02:59:15.127379 3796111 out.go:270] Jan 27 02:58:55 old-k8s-version-949994 kubelet[660]: E0127 02:58:55.501821 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jan 27 02:58:55 old-k8s-version-949994 kubelet[660]: E0127 02:58:55.501821 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0127 02:59:15.127391 3796111 out.go:270] Jan 27 02:59:00 old-k8s-version-949994 kubelet[660]: E0127 02:59:00.502866 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
Jan 27 02:59:00 old-k8s-version-949994 kubelet[660]: E0127 02:59:00.502866 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
W0127 02:59:15.127397 3796111 out.go:270] Jan 27 02:59:07 old-k8s-version-949994 kubelet[660]: E0127 02:59:07.502977 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jan 27 02:59:07 old-k8s-version-949994 kubelet[660]: E0127 02:59:07.502977 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0127 02:59:15.127405 3796111 out.go:270] Jan 27 02:59:14 old-k8s-version-949994 kubelet[660]: E0127 02:59:14.501372 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
Jan 27 02:59:14 old-k8s-version-949994 kubelet[660]: E0127 02:59:14.501372 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
I0127 02:59:15.127424 3796111 out.go:358] Setting ErrFile to fd 2...
I0127 02:59:15.127438 3796111 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0127 02:59:25.128192 3796111 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0127 02:59:25.142509 3796111 api_server.go:72] duration metric: took 5m53.807437252s to wait for apiserver process to appear ...
I0127 02:59:25.142534 3796111 api_server.go:88] waiting for apiserver healthz status ...
I0127 02:59:25.142569 3796111 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
I0127 02:59:25.142630 3796111 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0127 02:59:25.218274 3796111 cri.go:89] found id: "f1ff631138f971f0d0175bbdad8dae389b0bb6d344b9c6a0c0ee143eb981fd26"
I0127 02:59:25.218294 3796111 cri.go:89] found id: "ae3fb4241ae87bccf92d74ec50fcca30938fee4da6ee2129c5306d476811e810"
I0127 02:59:25.218299 3796111 cri.go:89] found id: ""
I0127 02:59:25.218306 3796111 logs.go:282] 2 containers: [f1ff631138f971f0d0175bbdad8dae389b0bb6d344b9c6a0c0ee143eb981fd26 ae3fb4241ae87bccf92d74ec50fcca30938fee4da6ee2129c5306d476811e810]
I0127 02:59:25.218366 3796111 ssh_runner.go:195] Run: which crictl
I0127 02:59:25.223228 3796111 ssh_runner.go:195] Run: which crictl
I0127 02:59:25.233535 3796111 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
I0127 02:59:25.233608 3796111 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0127 02:59:25.287247 3796111 cri.go:89] found id: "913dba7b3bede3cb8e1b77be0a25d981b94c7ef9011ec91d80f77d6b7afc771b"
I0127 02:59:25.287268 3796111 cri.go:89] found id: "8d9862575a02aedaa20cbdbc29f350c7d048f408b17d76e6899b001882f093b9"
I0127 02:59:25.287273 3796111 cri.go:89] found id: ""
I0127 02:59:25.287281 3796111 logs.go:282] 2 containers: [913dba7b3bede3cb8e1b77be0a25d981b94c7ef9011ec91d80f77d6b7afc771b 8d9862575a02aedaa20cbdbc29f350c7d048f408b17d76e6899b001882f093b9]
I0127 02:59:25.287350 3796111 ssh_runner.go:195] Run: which crictl
I0127 02:59:25.291869 3796111 ssh_runner.go:195] Run: which crictl
I0127 02:59:25.296041 3796111 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
I0127 02:59:25.296114 3796111 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0127 02:59:25.353617 3796111 cri.go:89] found id: "80de12a579f093bfca496c919408519334bb6b6962effaec3c52c2cef2014477"
I0127 02:59:25.353636 3796111 cri.go:89] found id: "2333f389a3e6eb63094687bfb2df8df33f3fdb8498fc24f92452e8fffd240cca"
I0127 02:59:25.353641 3796111 cri.go:89] found id: ""
I0127 02:59:25.353648 3796111 logs.go:282] 2 containers: [80de12a579f093bfca496c919408519334bb6b6962effaec3c52c2cef2014477 2333f389a3e6eb63094687bfb2df8df33f3fdb8498fc24f92452e8fffd240cca]
I0127 02:59:25.353712 3796111 ssh_runner.go:195] Run: which crictl
I0127 02:59:25.358444 3796111 ssh_runner.go:195] Run: which crictl
I0127 02:59:25.362671 3796111 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
I0127 02:59:25.362745 3796111 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0127 02:59:25.420248 3796111 cri.go:89] found id: "6868e5588e2518b2dbbee5fcdc288ff7639c3e6d27152b25c2d92a94144279e8"
I0127 02:59:25.420268 3796111 cri.go:89] found id: "d422478362adb4ddd09d8598be12970c37fc3c672548faefb895f3b8924598a3"
I0127 02:59:25.420273 3796111 cri.go:89] found id: ""
I0127 02:59:25.420280 3796111 logs.go:282] 2 containers: [6868e5588e2518b2dbbee5fcdc288ff7639c3e6d27152b25c2d92a94144279e8 d422478362adb4ddd09d8598be12970c37fc3c672548faefb895f3b8924598a3]
I0127 02:59:25.420338 3796111 ssh_runner.go:195] Run: which crictl
I0127 02:59:25.425743 3796111 ssh_runner.go:195] Run: which crictl
I0127 02:59:25.432269 3796111 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
I0127 02:59:25.432340 3796111 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0127 02:59:25.493625 3796111 cri.go:89] found id: "1eebf1b8ced6916d55f7a34166585a17437e60b2716ed0809ac349c450b4e754"
I0127 02:59:25.493696 3796111 cri.go:89] found id: "a7fa3720da9a726a9f6f8d791e969823b89c23d447e9434ee4a64f80336f7aa2"
I0127 02:59:25.493715 3796111 cri.go:89] found id: ""
I0127 02:59:25.493738 3796111 logs.go:282] 2 containers: [1eebf1b8ced6916d55f7a34166585a17437e60b2716ed0809ac349c450b4e754 a7fa3720da9a726a9f6f8d791e969823b89c23d447e9434ee4a64f80336f7aa2]
I0127 02:59:25.493833 3796111 ssh_runner.go:195] Run: which crictl
I0127 02:59:25.499566 3796111 ssh_runner.go:195] Run: which crictl
I0127 02:59:25.504443 3796111 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
I0127 02:59:25.504514 3796111 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0127 02:59:25.580657 3796111 cri.go:89] found id: "60bc065c8667a83052202f7fc37006df6160a0f60502485d3fe888d752f6e93e"
I0127 02:59:25.580678 3796111 cri.go:89] found id: "0f4ff9b6b17b830c0f2505936c14a703649af8de56a7960df790d5e970f75414"
I0127 02:59:25.580683 3796111 cri.go:89] found id: ""
I0127 02:59:25.580690 3796111 logs.go:282] 2 containers: [60bc065c8667a83052202f7fc37006df6160a0f60502485d3fe888d752f6e93e 0f4ff9b6b17b830c0f2505936c14a703649af8de56a7960df790d5e970f75414]
I0127 02:59:25.580745 3796111 ssh_runner.go:195] Run: which crictl
I0127 02:59:25.587524 3796111 ssh_runner.go:195] Run: which crictl
I0127 02:59:25.592431 3796111 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
I0127 02:59:25.592584 3796111 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0127 02:59:25.652963 3796111 cri.go:89] found id: "792e1bf0751e8fad4834403cd7db06cfbd9065c482e6c7b3bcf4c0c2b1a373d1"
I0127 02:59:25.653037 3796111 cri.go:89] found id: "17ad11f28e20777140f3d682704f30e56a34c3f85630bf0758795ca29f6f719a"
I0127 02:59:25.653056 3796111 cri.go:89] found id: ""
I0127 02:59:25.653080 3796111 logs.go:282] 2 containers: [792e1bf0751e8fad4834403cd7db06cfbd9065c482e6c7b3bcf4c0c2b1a373d1 17ad11f28e20777140f3d682704f30e56a34c3f85630bf0758795ca29f6f719a]
I0127 02:59:25.653174 3796111 ssh_runner.go:195] Run: which crictl
I0127 02:59:25.658424 3796111 ssh_runner.go:195] Run: which crictl
I0127 02:59:25.664336 3796111 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
I0127 02:59:25.664466 3796111 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I0127 02:59:25.739132 3796111 cri.go:89] found id: "3e757cf47e5bf46aadd2d0209c944ee653ff40decba0a43ed51c38657b7ac9a8"
I0127 02:59:25.739205 3796111 cri.go:89] found id: ""
I0127 02:59:25.739229 3796111 logs.go:282] 1 containers: [3e757cf47e5bf46aadd2d0209c944ee653ff40decba0a43ed51c38657b7ac9a8]
I0127 02:59:25.739320 3796111 ssh_runner.go:195] Run: which crictl
I0127 02:59:25.743622 3796111 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
I0127 02:59:25.743746 3796111 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0127 02:59:25.846595 3796111 cri.go:89] found id: "ca016e85c640cc59943efbf83715a2c4e1dcf8cc8020f4a480ba90214108c3ae"
I0127 02:59:25.846658 3796111 cri.go:89] found id: "5966fc744604d7bfd40d7701102f774e0d749dd772fdb69dbfbe01827d86cd21"
I0127 02:59:25.846686 3796111 cri.go:89] found id: ""
I0127 02:59:25.846705 3796111 logs.go:282] 2 containers: [ca016e85c640cc59943efbf83715a2c4e1dcf8cc8020f4a480ba90214108c3ae 5966fc744604d7bfd40d7701102f774e0d749dd772fdb69dbfbe01827d86cd21]
I0127 02:59:25.846798 3796111 ssh_runner.go:195] Run: which crictl
I0127 02:59:25.851520 3796111 ssh_runner.go:195] Run: which crictl
I0127 02:59:25.856633 3796111 logs.go:123] Gathering logs for kindnet [17ad11f28e20777140f3d682704f30e56a34c3f85630bf0758795ca29f6f719a] ...
I0127 02:59:25.856708 3796111 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 17ad11f28e20777140f3d682704f30e56a34c3f85630bf0758795ca29f6f719a"
I0127 02:59:25.916964 3796111 logs.go:123] Gathering logs for storage-provisioner [ca016e85c640cc59943efbf83715a2c4e1dcf8cc8020f4a480ba90214108c3ae] ...
I0127 02:59:25.917144 3796111 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 ca016e85c640cc59943efbf83715a2c4e1dcf8cc8020f4a480ba90214108c3ae"
I0127 02:59:25.972487 3796111 logs.go:123] Gathering logs for containerd ...
I0127 02:59:25.972512 3796111 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
I0127 02:59:26.054510 3796111 logs.go:123] Gathering logs for describe nodes ...
I0127 02:59:26.054548 3796111 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0127 02:59:26.207339 3796111 logs.go:123] Gathering logs for kube-apiserver [f1ff631138f971f0d0175bbdad8dae389b0bb6d344b9c6a0c0ee143eb981fd26] ...
I0127 02:59:26.207370 3796111 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 f1ff631138f971f0d0175bbdad8dae389b0bb6d344b9c6a0c0ee143eb981fd26"
I0127 02:59:26.265602 3796111 logs.go:123] Gathering logs for etcd [913dba7b3bede3cb8e1b77be0a25d981b94c7ef9011ec91d80f77d6b7afc771b] ...
I0127 02:59:26.265637 3796111 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 913dba7b3bede3cb8e1b77be0a25d981b94c7ef9011ec91d80f77d6b7afc771b"
I0127 02:59:26.318707 3796111 logs.go:123] Gathering logs for kube-scheduler [6868e5588e2518b2dbbee5fcdc288ff7639c3e6d27152b25c2d92a94144279e8] ...
I0127 02:59:26.318739 3796111 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 6868e5588e2518b2dbbee5fcdc288ff7639c3e6d27152b25c2d92a94144279e8"
I0127 02:59:26.361129 3796111 logs.go:123] Gathering logs for kube-proxy [1eebf1b8ced6916d55f7a34166585a17437e60b2716ed0809ac349c450b4e754] ...
I0127 02:59:26.361156 3796111 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 1eebf1b8ced6916d55f7a34166585a17437e60b2716ed0809ac349c450b4e754"
I0127 02:59:26.413909 3796111 logs.go:123] Gathering logs for kube-controller-manager [0f4ff9b6b17b830c0f2505936c14a703649af8de56a7960df790d5e970f75414] ...
I0127 02:59:26.413937 3796111 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 0f4ff9b6b17b830c0f2505936c14a703649af8de56a7960df790d5e970f75414"
I0127 02:59:26.493497 3796111 logs.go:123] Gathering logs for kindnet [792e1bf0751e8fad4834403cd7db06cfbd9065c482e6c7b3bcf4c0c2b1a373d1] ...
I0127 02:59:26.493585 3796111 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 792e1bf0751e8fad4834403cd7db06cfbd9065c482e6c7b3bcf4c0c2b1a373d1"
I0127 02:59:26.544762 3796111 logs.go:123] Gathering logs for kubernetes-dashboard [3e757cf47e5bf46aadd2d0209c944ee653ff40decba0a43ed51c38657b7ac9a8] ...
I0127 02:59:26.544794 3796111 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 3e757cf47e5bf46aadd2d0209c944ee653ff40decba0a43ed51c38657b7ac9a8"
I0127 02:59:26.595658 3796111 logs.go:123] Gathering logs for dmesg ...
I0127 02:59:26.595688 3796111 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0127 02:59:26.613129 3796111 logs.go:123] Gathering logs for kube-apiserver [ae3fb4241ae87bccf92d74ec50fcca30938fee4da6ee2129c5306d476811e810] ...
I0127 02:59:26.613204 3796111 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 ae3fb4241ae87bccf92d74ec50fcca30938fee4da6ee2129c5306d476811e810"
I0127 02:59:26.669414 3796111 logs.go:123] Gathering logs for coredns [80de12a579f093bfca496c919408519334bb6b6962effaec3c52c2cef2014477] ...
I0127 02:59:26.669490 3796111 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 80de12a579f093bfca496c919408519334bb6b6962effaec3c52c2cef2014477"
I0127 02:59:26.717840 3796111 logs.go:123] Gathering logs for coredns [2333f389a3e6eb63094687bfb2df8df33f3fdb8498fc24f92452e8fffd240cca] ...
I0127 02:59:26.717869 3796111 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 2333f389a3e6eb63094687bfb2df8df33f3fdb8498fc24f92452e8fffd240cca"
I0127 02:59:26.757167 3796111 logs.go:123] Gathering logs for kube-proxy [a7fa3720da9a726a9f6f8d791e969823b89c23d447e9434ee4a64f80336f7aa2] ...
I0127 02:59:26.757196 3796111 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 a7fa3720da9a726a9f6f8d791e969823b89c23d447e9434ee4a64f80336f7aa2"
I0127 02:59:26.798051 3796111 logs.go:123] Gathering logs for container status ...
I0127 02:59:26.798086 3796111 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0127 02:59:26.845207 3796111 logs.go:123] Gathering logs for kubelet ...
I0127 02:59:26.845236 3796111 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0127 02:59:26.909018 3796111 logs.go:138] Found kubelet problem: Jan 27 02:53:51 old-k8s-version-949994 kubelet[660]: E0127 02:53:51.967126 660 reflector.go:138] object-"default"/"default-token-gqprk": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "default-token-gqprk" is forbidden: User "system:node:old-k8s-version-949994" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'old-k8s-version-949994' and this object
W0127 02:59:26.909268 3796111 logs.go:138] Found kubelet problem: Jan 27 02:53:51 old-k8s-version-949994 kubelet[660]: E0127 02:53:51.967200 660 reflector.go:138] object-"kube-system"/"coredns": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:old-k8s-version-949994" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-949994' and this object
W0127 02:59:26.909505 3796111 logs.go:138] Found kubelet problem: Jan 27 02:53:51 old-k8s-version-949994 kubelet[660]: E0127 02:53:51.967258 660 reflector.go:138] object-"kube-system"/"kindnet-token-ghd6s": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kindnet-token-ghd6s" is forbidden: User "system:node:old-k8s-version-949994" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-949994' and this object
W0127 02:59:26.909756 3796111 logs.go:138] Found kubelet problem: Jan 27 02:53:51 old-k8s-version-949994 kubelet[660]: E0127 02:53:51.967336 660 reflector.go:138] object-"kube-system"/"storage-provisioner-token-6zk7s": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "storage-provisioner-token-6zk7s" is forbidden: User "system:node:old-k8s-version-949994" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-949994' and this object
W0127 02:59:26.909988 3796111 logs.go:138] Found kubelet problem: Jan 27 02:53:51 old-k8s-version-949994 kubelet[660]: E0127 02:53:51.967387 660 reflector.go:138] object-"kube-system"/"coredns-token-l287g": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "coredns-token-l287g" is forbidden: User "system:node:old-k8s-version-949994" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-949994' and this object
W0127 02:59:26.910228 3796111 logs.go:138] Found kubelet problem: Jan 27 02:53:51 old-k8s-version-949994 kubelet[660]: E0127 02:53:51.967447 660 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:old-k8s-version-949994" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-949994' and this object
W0127 02:59:26.910466 3796111 logs.go:138] Found kubelet problem: Jan 27 02:53:51 old-k8s-version-949994 kubelet[660]: E0127 02:53:51.967496 660 reflector.go:138] object-"kube-system"/"kube-proxy-token-54qrt": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kube-proxy-token-54qrt" is forbidden: User "system:node:old-k8s-version-949994" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-949994' and this object
W0127 02:59:26.918459 3796111 logs.go:138] Found kubelet problem: Jan 27 02:53:53 old-k8s-version-949994 kubelet[660]: E0127 02:53:53.876531 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0127 02:59:26.918698 3796111 logs.go:138] Found kubelet problem: Jan 27 02:53:54 old-k8s-version-949994 kubelet[660]: E0127 02:53:54.021725 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0127 02:59:26.925130 3796111 logs.go:138] Found kubelet problem: Jan 27 02:54:09 old-k8s-version-949994 kubelet[660]: E0127 02:54:09.521072 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0127 02:59:26.927635 3796111 logs.go:138] Found kubelet problem: Jan 27 02:54:22 old-k8s-version-949994 kubelet[660]: E0127 02:54:22.278637 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
W0127 02:59:26.927828 3796111 logs.go:138] Found kubelet problem: Jan 27 02:54:22 old-k8s-version-949994 kubelet[660]: E0127 02:54:22.504207 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0127 02:59:26.928157 3796111 logs.go:138] Found kubelet problem: Jan 27 02:54:23 old-k8s-version-949994 kubelet[660]: E0127 02:54:23.282663 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
W0127 02:59:26.928494 3796111 logs.go:138] Found kubelet problem: Jan 27 02:54:24 old-k8s-version-949994 kubelet[660]: E0127 02:54:24.284977 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
W0127 02:59:26.929099 3796111 logs.go:138] Found kubelet problem: Jan 27 02:54:26 old-k8s-version-949994 kubelet[660]: E0127 02:54:26.292140 660 pod_workers.go:191] Error syncing pod 2b0aa32b-1180-4a97-8374-d786d139dc2c ("storage-provisioner_kube-system(2b0aa32b-1180-4a97-8374-d786d139dc2c)"), skipping: failed to "StartContainer" for "storage-provisioner" with CrashLoopBackOff: "back-off 10s restarting failed container=storage-provisioner pod=storage-provisioner_kube-system(2b0aa32b-1180-4a97-8374-d786d139dc2c)"
W0127 02:59:26.932158 3796111 logs.go:138] Found kubelet problem: Jan 27 02:54:37 old-k8s-version-949994 kubelet[660]: E0127 02:54:37.511569 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0127 02:59:26.932846 3796111 logs.go:138] Found kubelet problem: Jan 27 02:54:39 old-k8s-version-949994 kubelet[660]: E0127 02:54:39.335961 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
W0127 02:59:26.933330 3796111 logs.go:138] Found kubelet problem: Jan 27 02:54:42 old-k8s-version-949994 kubelet[660]: E0127 02:54:42.579255 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
W0127 02:59:26.933538 3796111 logs.go:138] Found kubelet problem: Jan 27 02:54:48 old-k8s-version-949994 kubelet[660]: E0127 02:54:48.501857 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0127 02:59:26.933886 3796111 logs.go:138] Found kubelet problem: Jan 27 02:54:53 old-k8s-version-949994 kubelet[660]: E0127 02:54:53.502843 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
W0127 02:59:26.934090 3796111 logs.go:138] Found kubelet problem: Jan 27 02:55:00 old-k8s-version-949994 kubelet[660]: E0127 02:55:00.501841 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0127 02:59:26.934727 3796111 logs.go:138] Found kubelet problem: Jan 27 02:55:07 old-k8s-version-949994 kubelet[660]: E0127 02:55:07.426639 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
W0127 02:59:26.935133 3796111 logs.go:138] Found kubelet problem: Jan 27 02:55:12 old-k8s-version-949994 kubelet[660]: E0127 02:55:12.579010 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
W0127 02:59:26.935339 3796111 logs.go:138] Found kubelet problem: Jan 27 02:55:13 old-k8s-version-949994 kubelet[660]: E0127 02:55:13.501799 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0127 02:59:26.938047 3796111 logs.go:138] Found kubelet problem: Jan 27 02:55:24 old-k8s-version-949994 kubelet[660]: E0127 02:55:24.528464 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0127 02:59:26.938415 3796111 logs.go:138] Found kubelet problem: Jan 27 02:55:25 old-k8s-version-949994 kubelet[660]: E0127 02:55:25.501540 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
W0127 02:59:26.938630 3796111 logs.go:138] Found kubelet problem: Jan 27 02:55:36 old-k8s-version-949994 kubelet[660]: E0127 02:55:36.501984 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0127 02:59:26.938994 3796111 logs.go:138] Found kubelet problem: Jan 27 02:55:37 old-k8s-version-949994 kubelet[660]: E0127 02:55:37.501584 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
W0127 02:59:26.939204 3796111 logs.go:138] Found kubelet problem: Jan 27 02:55:49 old-k8s-version-949994 kubelet[660]: E0127 02:55:49.505318 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0127 02:59:26.939825 3796111 logs.go:138] Found kubelet problem: Jan 27 02:55:51 old-k8s-version-949994 kubelet[660]: E0127 02:55:51.546741 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
W0127 02:59:26.940171 3796111 logs.go:138] Found kubelet problem: Jan 27 02:55:52 old-k8s-version-949994 kubelet[660]: E0127 02:55:52.578558 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
W0127 02:59:26.940412 3796111 logs.go:138] Found kubelet problem: Jan 27 02:56:03 old-k8s-version-949994 kubelet[660]: E0127 02:56:03.501771 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0127 02:59:26.940764 3796111 logs.go:138] Found kubelet problem: Jan 27 02:56:06 old-k8s-version-949994 kubelet[660]: E0127 02:56:06.501392 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
W0127 02:59:26.940981 3796111 logs.go:138] Found kubelet problem: Jan 27 02:56:14 old-k8s-version-949994 kubelet[660]: E0127 02:56:14.502372 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0127 02:59:26.941335 3796111 logs.go:138] Found kubelet problem: Jan 27 02:56:17 old-k8s-version-949994 kubelet[660]: E0127 02:56:17.501933 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
W0127 02:59:26.941568 3796111 logs.go:138] Found kubelet problem: Jan 27 02:56:26 old-k8s-version-949994 kubelet[660]: E0127 02:56:26.501683 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0127 02:59:26.941996 3796111 logs.go:138] Found kubelet problem: Jan 27 02:56:32 old-k8s-version-949994 kubelet[660]: E0127 02:56:32.501823 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
W0127 02:59:26.942196 3796111 logs.go:138] Found kubelet problem: Jan 27 02:56:40 old-k8s-version-949994 kubelet[660]: E0127 02:56:40.501634 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0127 02:59:26.942555 3796111 logs.go:138] Found kubelet problem: Jan 27 02:56:45 old-k8s-version-949994 kubelet[660]: E0127 02:56:45.502780 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
W0127 02:59:26.945106 3796111 logs.go:138] Found kubelet problem: Jan 27 02:56:55 old-k8s-version-949994 kubelet[660]: E0127 02:56:55.514866 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0127 02:59:26.945463 3796111 logs.go:138] Found kubelet problem: Jan 27 02:56:56 old-k8s-version-949994 kubelet[660]: E0127 02:56:56.501563 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
W0127 02:59:26.945853 3796111 logs.go:138] Found kubelet problem: Jan 27 02:57:07 old-k8s-version-949994 kubelet[660]: E0127 02:57:07.501947 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
W0127 02:59:26.946094 3796111 logs.go:138] Found kubelet problem: Jan 27 02:57:10 old-k8s-version-949994 kubelet[660]: E0127 02:57:10.502918 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0127 02:59:26.946801 3796111 logs.go:138] Found kubelet problem: Jan 27 02:57:21 old-k8s-version-949994 kubelet[660]: E0127 02:57:21.776454 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
W0127 02:59:26.947158 3796111 logs.go:138] Found kubelet problem: Jan 27 02:57:22 old-k8s-version-949994 kubelet[660]: E0127 02:57:22.780516 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
W0127 02:59:26.947364 3796111 logs.go:138] Found kubelet problem: Jan 27 02:57:23 old-k8s-version-949994 kubelet[660]: E0127 02:57:23.505620 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0127 02:59:26.947572 3796111 logs.go:138] Found kubelet problem: Jan 27 02:57:34 old-k8s-version-949994 kubelet[660]: E0127 02:57:34.501538 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0127 02:59:26.947920 3796111 logs.go:138] Found kubelet problem: Jan 27 02:57:35 old-k8s-version-949994 kubelet[660]: E0127 02:57:35.501481 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
W0127 02:59:26.948269 3796111 logs.go:138] Found kubelet problem: Jan 27 02:57:48 old-k8s-version-949994 kubelet[660]: E0127 02:57:48.503510 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
W0127 02:59:26.948518 3796111 logs.go:138] Found kubelet problem: Jan 27 02:57:49 old-k8s-version-949994 kubelet[660]: E0127 02:57:49.501969 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0127 02:59:26.949022 3796111 logs.go:138] Found kubelet problem: Jan 27 02:57:59 old-k8s-version-949994 kubelet[660]: E0127 02:57:59.502983 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
W0127 02:59:26.949233 3796111 logs.go:138] Found kubelet problem: Jan 27 02:58:00 old-k8s-version-949994 kubelet[660]: E0127 02:58:00.501586 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0127 02:59:26.949595 3796111 logs.go:138] Found kubelet problem: Jan 27 02:58:10 old-k8s-version-949994 kubelet[660]: E0127 02:58:10.501269 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
W0127 02:59:26.949802 3796111 logs.go:138] Found kubelet problem: Jan 27 02:58:15 old-k8s-version-949994 kubelet[660]: E0127 02:58:15.501889 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0127 02:59:26.950158 3796111 logs.go:138] Found kubelet problem: Jan 27 02:58:21 old-k8s-version-949994 kubelet[660]: E0127 02:58:21.501389 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
W0127 02:59:26.950395 3796111 logs.go:138] Found kubelet problem: Jan 27 02:58:28 old-k8s-version-949994 kubelet[660]: E0127 02:58:28.501733 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0127 02:59:26.950751 3796111 logs.go:138] Found kubelet problem: Jan 27 02:58:34 old-k8s-version-949994 kubelet[660]: E0127 02:58:34.501213 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
W0127 02:59:26.950961 3796111 logs.go:138] Found kubelet problem: Jan 27 02:58:43 old-k8s-version-949994 kubelet[660]: E0127 02:58:43.501567 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0127 02:59:26.951309 3796111 logs.go:138] Found kubelet problem: Jan 27 02:58:48 old-k8s-version-949994 kubelet[660]: E0127 02:58:48.502462 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
W0127 02:59:26.951528 3796111 logs.go:138] Found kubelet problem: Jan 27 02:58:55 old-k8s-version-949994 kubelet[660]: E0127 02:58:55.501821 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0127 02:59:26.951914 3796111 logs.go:138] Found kubelet problem: Jan 27 02:59:00 old-k8s-version-949994 kubelet[660]: E0127 02:59:00.502866 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
W0127 02:59:26.952124 3796111 logs.go:138] Found kubelet problem: Jan 27 02:59:07 old-k8s-version-949994 kubelet[660]: E0127 02:59:07.502977 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0127 02:59:26.952532 3796111 logs.go:138] Found kubelet problem: Jan 27 02:59:14 old-k8s-version-949994 kubelet[660]: E0127 02:59:14.501372 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
W0127 02:59:26.953020 3796111 logs.go:138] Found kubelet problem: Jan 27 02:59:18 old-k8s-version-949994 kubelet[660]: E0127 02:59:18.502650 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0127 02:59:26.953379 3796111 logs.go:138] Found kubelet problem: Jan 27 02:59:26 old-k8s-version-949994 kubelet[660]: E0127 02:59:26.501368 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
I0127 02:59:26.953395 3796111 logs.go:123] Gathering logs for etcd [8d9862575a02aedaa20cbdbc29f350c7d048f408b17d76e6899b001882f093b9] ...
I0127 02:59:26.953420 3796111 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 8d9862575a02aedaa20cbdbc29f350c7d048f408b17d76e6899b001882f093b9"
I0127 02:59:27.014044 3796111 logs.go:123] Gathering logs for kube-scheduler [d422478362adb4ddd09d8598be12970c37fc3c672548faefb895f3b8924598a3] ...
I0127 02:59:27.014093 3796111 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 d422478362adb4ddd09d8598be12970c37fc3c672548faefb895f3b8924598a3"
I0127 02:59:27.059697 3796111 logs.go:123] Gathering logs for kube-controller-manager [60bc065c8667a83052202f7fc37006df6160a0f60502485d3fe888d752f6e93e] ...
I0127 02:59:27.059730 3796111 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 60bc065c8667a83052202f7fc37006df6160a0f60502485d3fe888d752f6e93e"
I0127 02:59:27.129429 3796111 logs.go:123] Gathering logs for storage-provisioner [5966fc744604d7bfd40d7701102f774e0d749dd772fdb69dbfbe01827d86cd21] ...
I0127 02:59:27.129470 3796111 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 5966fc744604d7bfd40d7701102f774e0d749dd772fdb69dbfbe01827d86cd21"
I0127 02:59:27.169921 3796111 out.go:358] Setting ErrFile to fd 2...
I0127 02:59:27.169952 3796111 out.go:392] TERM=,COLORTERM=, which probably does not support color
W0127 02:59:27.170000 3796111 out.go:270] X Problems detected in kubelet:
X Problems detected in kubelet:
W0127 02:59:27.170013 3796111 out.go:270] Jan 27 02:59:00 old-k8s-version-949994 kubelet[660]: E0127 02:59:00.502866 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
Jan 27 02:59:00 old-k8s-version-949994 kubelet[660]: E0127 02:59:00.502866 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
W0127 02:59:27.170021 3796111 out.go:270] Jan 27 02:59:07 old-k8s-version-949994 kubelet[660]: E0127 02:59:07.502977 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jan 27 02:59:07 old-k8s-version-949994 kubelet[660]: E0127 02:59:07.502977 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0127 02:59:27.170035 3796111 out.go:270] Jan 27 02:59:14 old-k8s-version-949994 kubelet[660]: E0127 02:59:14.501372 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
Jan 27 02:59:14 old-k8s-version-949994 kubelet[660]: E0127 02:59:14.501372 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
W0127 02:59:27.170041 3796111 out.go:270] Jan 27 02:59:18 old-k8s-version-949994 kubelet[660]: E0127 02:59:18.502650 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jan 27 02:59:18 old-k8s-version-949994 kubelet[660]: E0127 02:59:18.502650 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0127 02:59:27.170051 3796111 out.go:270] Jan 27 02:59:26 old-k8s-version-949994 kubelet[660]: E0127 02:59:26.501368 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
Jan 27 02:59:26 old-k8s-version-949994 kubelet[660]: E0127 02:59:26.501368 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
I0127 02:59:27.170057 3796111 out.go:358] Setting ErrFile to fd 2...
I0127 02:59:27.170066 3796111 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0127 02:59:37.172121 3796111 api_server.go:253] Checking apiserver healthz at https://192.168.76.2:8443/healthz ...
I0127 02:59:37.181232 3796111 api_server.go:279] https://192.168.76.2:8443/healthz returned 200:
ok
I0127 02:59:37.184443 3796111 out.go:201]
W0127 02:59:37.187360 3796111 out.go:270] X Exiting due to K8S_UNHEALTHY_CONTROL_PLANE: wait 6m0s for node: wait for healthy API server: controlPlane never updated to v1.20.0
X Exiting due to K8S_UNHEALTHY_CONTROL_PLANE: wait 6m0s for node: wait for healthy API server: controlPlane never updated to v1.20.0
W0127 02:59:37.187406 3796111 out.go:270] * Suggestion: Control Plane could not update, try minikube delete --all --purge
* Suggestion: Control Plane could not update, try minikube delete --all --purge
W0127 02:59:37.187429 3796111 out.go:270] * Related issue: https://github.com/kubernetes/minikube/issues/11417
* Related issue: https://github.com/kubernetes/minikube/issues/11417
W0127 02:59:37.187435 3796111 out.go:270] *
*
W0127 02:59:37.188343 3796111 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0127 02:59:37.192140 3796111 out.go:201]
** /stderr **
start_stop_delete_test.go:257: failed to start minikube post-stop. args "out/minikube-linux-arm64 start -p old-k8s-version-949994 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=containerd --kubernetes-version=v1.20.0": exit status 102
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: docker inspect <======
helpers_test.go:231: (dbg) Run: docker inspect old-k8s-version-949994
helpers_test.go:235: (dbg) docker inspect old-k8s-version-949994:
-- stdout --
[
{
"Id": "54e1e12125451246b331facfd52770079e3feae8cf83690d92a1247929e10347",
"Created": "2025-01-27T02:50:10.877395828Z",
"Path": "/usr/local/bin/entrypoint",
"Args": [
"/sbin/init"
],
"State": {
"Status": "running",
"Running": true,
"Paused": false,
"Restarting": false,
"OOMKilled": false,
"Dead": false,
"Pid": 3796311,
"ExitCode": 0,
"Error": "",
"StartedAt": "2025-01-27T02:53:23.700578891Z",
"FinishedAt": "2025-01-27T02:53:22.786534989Z"
},
"Image": "sha256:0434cf58b6dbace281e5de753aa4b2e3fe33dc9a3be53021531403743c3f155a",
"ResolvConfPath": "/var/lib/docker/containers/54e1e12125451246b331facfd52770079e3feae8cf83690d92a1247929e10347/resolv.conf",
"HostnamePath": "/var/lib/docker/containers/54e1e12125451246b331facfd52770079e3feae8cf83690d92a1247929e10347/hostname",
"HostsPath": "/var/lib/docker/containers/54e1e12125451246b331facfd52770079e3feae8cf83690d92a1247929e10347/hosts",
"LogPath": "/var/lib/docker/containers/54e1e12125451246b331facfd52770079e3feae8cf83690d92a1247929e10347/54e1e12125451246b331facfd52770079e3feae8cf83690d92a1247929e10347-json.log",
"Name": "/old-k8s-version-949994",
"RestartCount": 0,
"Driver": "overlay2",
"Platform": "linux",
"MountLabel": "",
"ProcessLabel": "",
"AppArmorProfile": "unconfined",
"ExecIDs": null,
"HostConfig": {
"Binds": [
"/lib/modules:/lib/modules:ro",
"old-k8s-version-949994:/var"
],
"ContainerIDFile": "",
"LogConfig": {
"Type": "json-file",
"Config": {}
},
"NetworkMode": "old-k8s-version-949994",
"PortBindings": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
]
},
"RestartPolicy": {
"Name": "no",
"MaximumRetryCount": 0
},
"AutoRemove": false,
"VolumeDriver": "",
"VolumesFrom": null,
"ConsoleSize": [
0,
0
],
"CapAdd": null,
"CapDrop": null,
"CgroupnsMode": "host",
"Dns": [],
"DnsOptions": [],
"DnsSearch": [],
"ExtraHosts": null,
"GroupAdd": null,
"IpcMode": "private",
"Cgroup": "",
"Links": null,
"OomScoreAdj": 0,
"PidMode": "",
"Privileged": true,
"PublishAllPorts": false,
"ReadonlyRootfs": false,
"SecurityOpt": [
"seccomp=unconfined",
"apparmor=unconfined",
"label=disable"
],
"Tmpfs": {
"/run": "",
"/tmp": ""
},
"UTSMode": "",
"UsernsMode": "",
"ShmSize": 67108864,
"Runtime": "runc",
"Isolation": "",
"CpuShares": 0,
"Memory": 2306867200,
"NanoCpus": 2000000000,
"CgroupParent": "",
"BlkioWeight": 0,
"BlkioWeightDevice": [],
"BlkioDeviceReadBps": [],
"BlkioDeviceWriteBps": [],
"BlkioDeviceReadIOps": [],
"BlkioDeviceWriteIOps": [],
"CpuPeriod": 0,
"CpuQuota": 0,
"CpuRealtimePeriod": 0,
"CpuRealtimeRuntime": 0,
"CpusetCpus": "",
"CpusetMems": "",
"Devices": [],
"DeviceCgroupRules": null,
"DeviceRequests": null,
"MemoryReservation": 0,
"MemorySwap": 4613734400,
"MemorySwappiness": null,
"OomKillDisable": false,
"PidsLimit": null,
"Ulimits": [],
"CpuCount": 0,
"CpuPercent": 0,
"IOMaximumIOps": 0,
"IOMaximumBandwidth": 0,
"MaskedPaths": null,
"ReadonlyPaths": null
},
"GraphDriver": {
"Data": {
"LowerDir": "/var/lib/docker/overlay2/74ea1f8c26d587233924644a4ddd909a62628df16b47c7de36614594b527a0d8-init/diff:/var/lib/docker/overlay2/5296668a0a30b38feb9159e191c47d5587ed9f36bb9a48e894c12f88095e8aab/diff",
"MergedDir": "/var/lib/docker/overlay2/74ea1f8c26d587233924644a4ddd909a62628df16b47c7de36614594b527a0d8/merged",
"UpperDir": "/var/lib/docker/overlay2/74ea1f8c26d587233924644a4ddd909a62628df16b47c7de36614594b527a0d8/diff",
"WorkDir": "/var/lib/docker/overlay2/74ea1f8c26d587233924644a4ddd909a62628df16b47c7de36614594b527a0d8/work"
},
"Name": "overlay2"
},
"Mounts": [
{
"Type": "bind",
"Source": "/lib/modules",
"Destination": "/lib/modules",
"Mode": "ro",
"RW": false,
"Propagation": "rprivate"
},
{
"Type": "volume",
"Name": "old-k8s-version-949994",
"Source": "/var/lib/docker/volumes/old-k8s-version-949994/_data",
"Destination": "/var",
"Driver": "local",
"Mode": "z",
"RW": true,
"Propagation": ""
}
],
"Config": {
"Hostname": "old-k8s-version-949994",
"Domainname": "",
"User": "",
"AttachStdin": false,
"AttachStdout": false,
"AttachStderr": false,
"ExposedPorts": {
"22/tcp": {},
"2376/tcp": {},
"32443/tcp": {},
"5000/tcp": {},
"8443/tcp": {}
},
"Tty": true,
"OpenStdin": false,
"StdinOnce": false,
"Env": [
"container=docker",
"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
],
"Cmd": null,
"Image": "gcr.io/k8s-minikube/kicbase:v0.0.46@sha256:fd2d445ddcc33ebc5c6b68a17e6219ea207ce63c005095ea1525296da2d1a279",
"Volumes": null,
"WorkingDir": "/",
"Entrypoint": [
"/usr/local/bin/entrypoint",
"/sbin/init"
],
"OnBuild": null,
"Labels": {
"created_by.minikube.sigs.k8s.io": "true",
"mode.minikube.sigs.k8s.io": "old-k8s-version-949994",
"name.minikube.sigs.k8s.io": "old-k8s-version-949994",
"role.minikube.sigs.k8s.io": ""
},
"StopSignal": "SIGRTMIN+3"
},
"NetworkSettings": {
"Bridge": "",
"SandboxID": "88a2f5ccb4f555a9bf7faed4d9bec52173596e2820bd4350a46e9ef61a352e51",
"SandboxKey": "/var/run/docker/netns/88a2f5ccb4f5",
"Ports": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "37781"
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "37782"
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "37785"
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "37783"
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "37784"
}
]
},
"HairpinMode": false,
"LinkLocalIPv6Address": "",
"LinkLocalIPv6PrefixLen": 0,
"SecondaryIPAddresses": null,
"SecondaryIPv6Addresses": null,
"EndpointID": "",
"Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"IPAddress": "",
"IPPrefixLen": 0,
"IPv6Gateway": "",
"MacAddress": "",
"Networks": {
"old-k8s-version-949994": {
"IPAMConfig": {
"IPv4Address": "192.168.76.2"
},
"Links": null,
"Aliases": null,
"MacAddress": "02:42:c0:a8:4c:02",
"DriverOpts": null,
"NetworkID": "782c8980703d704b27a09304a8a1fc23fa40e46d0d2e7c713bd35610e7868c27",
"EndpointID": "10e1adc144cd2ebcf168d0e27ea747d8bd31fd3c08d1b3feaa0edc1d884fbcfc",
"Gateway": "192.168.76.1",
"IPAddress": "192.168.76.2",
"IPPrefixLen": 24,
"IPv6Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"DNSNames": [
"old-k8s-version-949994",
"54e1e1212545"
]
}
}
}
}
]
-- /stdout --
helpers_test.go:239: (dbg) Run: out/minikube-linux-arm64 status --format={{.Host}} -p old-k8s-version-949994 -n old-k8s-version-949994
helpers_test.go:244: <<< TestStartStop/group/old-k8s-version/serial/SecondStart FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: minikube logs <======
helpers_test.go:247: (dbg) Run: out/minikube-linux-arm64 -p old-k8s-version-949994 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-arm64 -p old-k8s-version-949994 logs -n 25: (2.079152038s)
helpers_test.go:252: TestStartStop/group/old-k8s-version/serial/SecondStart logs:
-- stdout --
==> Audit <==
|---------|--------------------------------------------------------|---------------------------|---------|---------|---------------------|---------------------|
| Command | Args | Profile | User | Version | Start Time | End Time |
|---------|--------------------------------------------------------|---------------------------|---------|---------|---------------------|---------------------|
| start | -p force-systemd-flag-458112 | force-systemd-flag-458112 | jenkins | v1.35.0 | 27 Jan 25 02:48 UTC | 27 Jan 25 02:49 UTC |
| | --memory=2048 --force-systemd | | | | | |
| | --alsologtostderr | | | | | |
| | -v=5 --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| ssh | force-systemd-flag-458112 | force-systemd-flag-458112 | jenkins | v1.35.0 | 27 Jan 25 02:49 UTC | 27 Jan 25 02:49 UTC |
| | ssh cat | | | | | |
| | /etc/containerd/config.toml | | | | | |
| delete | -p force-systemd-flag-458112 | force-systemd-flag-458112 | jenkins | v1.35.0 | 27 Jan 25 02:49 UTC | 27 Jan 25 02:49 UTC |
| start | -p cert-options-703948 | cert-options-703948 | jenkins | v1.35.0 | 27 Jan 25 02:49 UTC | 27 Jan 25 02:49 UTC |
| | --memory=2048 | | | | | |
| | --apiserver-ips=127.0.0.1 | | | | | |
| | --apiserver-ips=192.168.15.15 | | | | | |
| | --apiserver-names=localhost | | | | | |
| | --apiserver-names=www.google.com | | | | | |
| | --apiserver-port=8555 | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| ssh | cert-options-703948 ssh | cert-options-703948 | jenkins | v1.35.0 | 27 Jan 25 02:50 UTC | 27 Jan 25 02:50 UTC |
| | openssl x509 -text -noout -in | | | | | |
| | /var/lib/minikube/certs/apiserver.crt | | | | | |
| ssh | -p cert-options-703948 -- sudo | cert-options-703948 | jenkins | v1.35.0 | 27 Jan 25 02:50 UTC | 27 Jan 25 02:50 UTC |
| | cat /etc/kubernetes/admin.conf | | | | | |
| delete | -p cert-options-703948 | cert-options-703948 | jenkins | v1.35.0 | 27 Jan 25 02:50 UTC | 27 Jan 25 02:50 UTC |
| start | -p old-k8s-version-949994 | old-k8s-version-949994 | jenkins | v1.35.0 | 27 Jan 25 02:50 UTC | 27 Jan 25 02:53 UTC |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --kvm-network=default | | | | | |
| | --kvm-qemu-uri=qemu:///system | | | | | |
| | --disable-driver-mounts | | | | | |
| | --keep-context=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --kubernetes-version=v1.20.0 | | | | | |
| start | -p cert-expiration-393434 | cert-expiration-393434 | jenkins | v1.35.0 | 27 Jan 25 02:51 UTC | 27 Jan 25 02:51 UTC |
| | --memory=2048 | | | | | |
| | --cert-expiration=8760h | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| delete | -p cert-expiration-393434 | cert-expiration-393434 | jenkins | v1.35.0 | 27 Jan 25 02:51 UTC | 27 Jan 25 02:51 UTC |
| start | -p no-preload-715478 | no-preload-715478 | jenkins | v1.35.0 | 27 Jan 25 02:51 UTC | 27 Jan 25 02:53 UTC |
| | --memory=2200 | | | | | |
| | --alsologtostderr | | | | | |
| | --wait=true --preload=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --kubernetes-version=v1.32.1 | | | | | |
| addons | enable metrics-server -p old-k8s-version-949994 | old-k8s-version-949994 | jenkins | v1.35.0 | 27 Jan 25 02:53 UTC | 27 Jan 25 02:53 UTC |
| | --images=MetricsServer=registry.k8s.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| stop | -p old-k8s-version-949994 | old-k8s-version-949994 | jenkins | v1.35.0 | 27 Jan 25 02:53 UTC | 27 Jan 25 02:53 UTC |
| | --alsologtostderr -v=3 | | | | | |
| addons | enable metrics-server -p no-preload-715478 | no-preload-715478 | jenkins | v1.35.0 | 27 Jan 25 02:53 UTC | 27 Jan 25 02:53 UTC |
| | --images=MetricsServer=registry.k8s.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| stop | -p no-preload-715478 | no-preload-715478 | jenkins | v1.35.0 | 27 Jan 25 02:53 UTC | 27 Jan 25 02:53 UTC |
| | --alsologtostderr -v=3 | | | | | |
| addons | enable dashboard -p old-k8s-version-949994 | old-k8s-version-949994 | jenkins | v1.35.0 | 27 Jan 25 02:53 UTC | 27 Jan 25 02:53 UTC |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| start | -p old-k8s-version-949994 | old-k8s-version-949994 | jenkins | v1.35.0 | 27 Jan 25 02:53 UTC | |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --kvm-network=default | | | | | |
| | --kvm-qemu-uri=qemu:///system | | | | | |
| | --disable-driver-mounts | | | | | |
| | --keep-context=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --kubernetes-version=v1.20.0 | | | | | |
| addons | enable dashboard -p no-preload-715478 | no-preload-715478 | jenkins | v1.35.0 | 27 Jan 25 02:53 UTC | 27 Jan 25 02:53 UTC |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| start | -p no-preload-715478 | no-preload-715478 | jenkins | v1.35.0 | 27 Jan 25 02:53 UTC | 27 Jan 25 02:58 UTC |
| | --memory=2200 | | | | | |
| | --alsologtostderr | | | | | |
| | --wait=true --preload=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --kubernetes-version=v1.32.1 | | | | | |
| image | no-preload-715478 image list | no-preload-715478 | jenkins | v1.35.0 | 27 Jan 25 02:58 UTC | 27 Jan 25 02:58 UTC |
| | --format=json | | | | | |
| pause | -p no-preload-715478 | no-preload-715478 | jenkins | v1.35.0 | 27 Jan 25 02:58 UTC | 27 Jan 25 02:58 UTC |
| | --alsologtostderr -v=1 | | | | | |
| unpause | -p no-preload-715478 | no-preload-715478 | jenkins | v1.35.0 | 27 Jan 25 02:58 UTC | 27 Jan 25 02:58 UTC |
| | --alsologtostderr -v=1 | | | | | |
| delete | -p no-preload-715478 | no-preload-715478 | jenkins | v1.35.0 | 27 Jan 25 02:58 UTC | 27 Jan 25 02:58 UTC |
| delete | -p no-preload-715478 | no-preload-715478 | jenkins | v1.35.0 | 27 Jan 25 02:58 UTC | 27 Jan 25 02:58 UTC |
| start | -p embed-certs-579827 | embed-certs-579827 | jenkins | v1.35.0 | 27 Jan 25 02:58 UTC | |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --embed-certs --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --kubernetes-version=v1.32.1 | | | | | |
|---------|--------------------------------------------------------|---------------------------|---------|---------|---------------------|---------------------|
==> Last Start <==
Log file created at: 2025/01/27 02:58:49
Running on machine: ip-172-31-21-244
Binary: Built with gc go1.23.4 for linux/arm64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I0127 02:58:49.402146 3805055 out.go:345] Setting OutFile to fd 1 ...
I0127 02:58:49.403069 3805055 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0127 02:58:49.403107 3805055 out.go:358] Setting ErrFile to fd 2...
I0127 02:58:49.403127 3805055 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0127 02:58:49.403410 3805055 root.go:338] Updating PATH: /home/jenkins/minikube-integration/20316-3581420/.minikube/bin
I0127 02:58:49.403871 3805055 out.go:352] Setting JSON to false
I0127 02:58:49.404967 3805055 start.go:129] hostinfo: {"hostname":"ip-172-31-21-244","uptime":92473,"bootTime":1737854256,"procs":217,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1075-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"da8ac1fd-6236-412a-a346-95873c98230d"}
I0127 02:58:49.405083 3805055 start.go:139] virtualization:
I0127 02:58:49.409122 3805055 out.go:177] * [embed-certs-579827] minikube v1.35.0 on Ubuntu 20.04 (arm64)
I0127 02:58:49.413412 3805055 out.go:177] - MINIKUBE_LOCATION=20316
I0127 02:58:49.413569 3805055 notify.go:220] Checking for updates...
I0127 02:58:49.419653 3805055 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0127 02:58:49.422795 3805055 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/20316-3581420/kubeconfig
I0127 02:58:49.425913 3805055 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/20316-3581420/.minikube
I0127 02:58:49.428976 3805055 out.go:177] - MINIKUBE_BIN=out/minikube-linux-arm64
I0127 02:58:49.432023 3805055 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0127 02:58:49.435747 3805055 config.go:182] Loaded profile config "old-k8s-version-949994": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0
I0127 02:58:49.435901 3805055 driver.go:394] Setting default libvirt URI to qemu:///system
I0127 02:58:49.462644 3805055 docker.go:123] docker version: linux-27.5.1:Docker Engine - Community
I0127 02:58:49.462797 3805055 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0127 02:58:49.537640 3805055 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:33 OomKillDisable:true NGoroutines:53 SystemTime:2025-01-27 02:58:49.528121369 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1075-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:a
arch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214835200 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:27.5.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:bcc810d6b9066471b0b6fa75f557a15a1cbf31bb Expected:bcc810d6b9066471b0b6fa75f557a15a1cbf31bb} RuncCommit:{ID:v1.2.4-0-g6c52b3f Expected:v1.2.4-0-g6c52b3f} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.20.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.32.4]] Warnings:<nil>}}
I0127 02:58:49.537755 3805055 docker.go:318] overlay module found
I0127 02:58:49.540968 3805055 out.go:177] * Using the docker driver based on user configuration
I0127 02:58:49.543886 3805055 start.go:297] selected driver: docker
I0127 02:58:49.543909 3805055 start.go:901] validating driver "docker" against <nil>
I0127 02:58:49.543924 3805055 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0127 02:58:49.544696 3805055 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0127 02:58:49.602882 3805055 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:33 OomKillDisable:true NGoroutines:53 SystemTime:2025-01-27 02:58:49.593180143 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1075-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:a
arch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214835200 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:27.5.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:bcc810d6b9066471b0b6fa75f557a15a1cbf31bb Expected:bcc810d6b9066471b0b6fa75f557a15a1cbf31bb} RuncCommit:{ID:v1.2.4-0-g6c52b3f Expected:v1.2.4-0-g6c52b3f} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.20.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.32.4]] Warnings:<nil>}}
I0127 02:58:49.603083 3805055 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0127 02:58:49.603367 3805055 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0127 02:58:49.606301 3805055 out.go:177] * Using Docker driver with root privileges
I0127 02:58:49.609175 3805055 cni.go:84] Creating CNI manager for ""
I0127 02:58:49.609237 3805055 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0127 02:58:49.609251 3805055 start_flags.go:319] Found "CNI" CNI - setting NetworkPlugin=cni
I0127 02:58:49.609327 3805055 start.go:340] cluster config:
{Name:embed-certs-579827 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.46@sha256:fd2d445ddcc33ebc5c6b68a17e6219ea207ce63c005095ea1525296da2d1a279 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.32.1 ClusterName:embed-certs-579827 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRI
Socket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.32.1 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAge
ntPID:0 GPUs: AutoPauseInterval:1m0s}
I0127 02:58:49.612479 3805055 out.go:177] * Starting "embed-certs-579827" primary control-plane node in "embed-certs-579827" cluster
I0127 02:58:49.615367 3805055 cache.go:121] Beginning downloading kic base image for docker with containerd
I0127 02:58:49.618343 3805055 out.go:177] * Pulling base image v0.0.46 ...
I0127 02:58:49.621156 3805055 preload.go:131] Checking if preload exists for k8s version v1.32.1 and runtime containerd
I0127 02:58:49.621227 3805055 preload.go:146] Found local preload: /home/jenkins/minikube-integration/20316-3581420/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.32.1-containerd-overlay2-arm64.tar.lz4
I0127 02:58:49.621246 3805055 cache.go:56] Caching tarball of preloaded images
I0127 02:58:49.621248 3805055 image.go:81] Checking for gcr.io/k8s-minikube/kicbase:v0.0.46@sha256:fd2d445ddcc33ebc5c6b68a17e6219ea207ce63c005095ea1525296da2d1a279 in local docker daemon
I0127 02:58:49.621331 3805055 preload.go:172] Found /home/jenkins/minikube-integration/20316-3581420/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.32.1-containerd-overlay2-arm64.tar.lz4 in cache, skipping download
I0127 02:58:49.621342 3805055 cache.go:59] Finished verifying existence of preloaded tar for v1.32.1 on containerd
I0127 02:58:49.621456 3805055 profile.go:143] Saving config to /home/jenkins/minikube-integration/20316-3581420/.minikube/profiles/embed-certs-579827/config.json ...
I0127 02:58:49.621478 3805055 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20316-3581420/.minikube/profiles/embed-certs-579827/config.json: {Name:mkb6a7540171776d100e263c2d77dd2c905babfa Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0127 02:58:49.641524 3805055 image.go:100] Found gcr.io/k8s-minikube/kicbase:v0.0.46@sha256:fd2d445ddcc33ebc5c6b68a17e6219ea207ce63c005095ea1525296da2d1a279 in local docker daemon, skipping pull
I0127 02:58:49.641548 3805055 cache.go:145] gcr.io/k8s-minikube/kicbase:v0.0.46@sha256:fd2d445ddcc33ebc5c6b68a17e6219ea207ce63c005095ea1525296da2d1a279 exists in daemon, skipping load
I0127 02:58:49.641566 3805055 cache.go:230] Successfully downloaded all kic artifacts
I0127 02:58:49.641596 3805055 start.go:360] acquireMachinesLock for embed-certs-579827: {Name:mkea4cc5245d0e9a87d703d4a70fce362b1dba11 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0127 02:58:49.641704 3805055 start.go:364] duration metric: took 86.357µs to acquireMachinesLock for "embed-certs-579827"
I0127 02:58:49.641735 3805055 start.go:93] Provisioning new machine with config: &{Name:embed-certs-579827 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.46@sha256:fd2d445ddcc33ebc5c6b68a17e6219ea207ce63c005095ea1525296da2d1a279 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.32.1 ClusterName:embed-certs-579827 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServ
erNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.32.1 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuF
irmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.32.1 ContainerRuntime:containerd ControlPlane:true Worker:true}
I0127 02:58:49.641827 3805055 start.go:125] createHost starting for "" (driver="docker")
I0127 02:58:48.852359 3796111 pod_ready.go:103] pod "metrics-server-9975d5f86-mftgr" in "kube-system" namespace has status "Ready":"False"
I0127 02:58:51.348682 3796111 pod_ready.go:103] pod "metrics-server-9975d5f86-mftgr" in "kube-system" namespace has status "Ready":"False"
I0127 02:58:49.645462 3805055 out.go:235] * Creating docker container (CPUs=2, Memory=2200MB) ...
I0127 02:58:49.645722 3805055 start.go:159] libmachine.API.Create for "embed-certs-579827" (driver="docker")
I0127 02:58:49.645753 3805055 client.go:168] LocalClient.Create starting
I0127 02:58:49.645830 3805055 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/20316-3581420/.minikube/certs/ca.pem
I0127 02:58:49.645872 3805055 main.go:141] libmachine: Decoding PEM data...
I0127 02:58:49.645891 3805055 main.go:141] libmachine: Parsing certificate...
I0127 02:58:49.645955 3805055 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/20316-3581420/.minikube/certs/cert.pem
I0127 02:58:49.645985 3805055 main.go:141] libmachine: Decoding PEM data...
I0127 02:58:49.645998 3805055 main.go:141] libmachine: Parsing certificate...
I0127 02:58:49.646402 3805055 cli_runner.go:164] Run: docker network inspect embed-certs-579827 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
W0127 02:58:49.662863 3805055 cli_runner.go:211] docker network inspect embed-certs-579827 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
I0127 02:58:49.663091 3805055 network_create.go:284] running [docker network inspect embed-certs-579827] to gather additional debugging logs...
I0127 02:58:49.663118 3805055 cli_runner.go:164] Run: docker network inspect embed-certs-579827
W0127 02:58:49.678969 3805055 cli_runner.go:211] docker network inspect embed-certs-579827 returned with exit code 1
I0127 02:58:49.679002 3805055 network_create.go:287] error running [docker network inspect embed-certs-579827]: docker network inspect embed-certs-579827: exit status 1
stdout:
[]
stderr:
Error response from daemon: network embed-certs-579827 not found
I0127 02:58:49.679015 3805055 network_create.go:289] output of [docker network inspect embed-certs-579827]: -- stdout --
[]
-- /stdout --
** stderr **
Error response from daemon: network embed-certs-579827 not found
** /stderr **
I0127 02:58:49.679117 3805055 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0127 02:58:49.697421 3805055 network.go:211] skipping subnet 192.168.49.0/24 that is taken: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName:br-20c6b9faf740 IfaceIPv4:192.168.49.1 IfaceMTU:1500 IfaceMAC:02:42:a5:84:e8:b3} reservation:<nil>}
I0127 02:58:49.697860 3805055 network.go:211] skipping subnet 192.168.58.0/24 that is taken: &{IP:192.168.58.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.58.0/24 Gateway:192.168.58.1 ClientMin:192.168.58.2 ClientMax:192.168.58.254 Broadcast:192.168.58.255 IsPrivate:true Interface:{IfaceName:br-ed55a6afcd29 IfaceIPv4:192.168.58.1 IfaceMTU:1500 IfaceMAC:02:42:ae:45:09:f0} reservation:<nil>}
I0127 02:58:49.698415 3805055 network.go:211] skipping subnet 192.168.67.0/24 that is taken: &{IP:192.168.67.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.67.0/24 Gateway:192.168.67.1 ClientMin:192.168.67.2 ClientMax:192.168.67.254 Broadcast:192.168.67.255 IsPrivate:true Interface:{IfaceName:br-6d1bfb053f15 IfaceIPv4:192.168.67.1 IfaceMTU:1500 IfaceMAC:02:42:0f:00:a9:30} reservation:<nil>}
I0127 02:58:49.698769 3805055 network.go:211] skipping subnet 192.168.76.0/24 that is taken: &{IP:192.168.76.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.76.0/24 Gateway:192.168.76.1 ClientMin:192.168.76.2 ClientMax:192.168.76.254 Broadcast:192.168.76.255 IsPrivate:true Interface:{IfaceName:br-782c8980703d IfaceIPv4:192.168.76.1 IfaceMTU:1500 IfaceMAC:02:42:90:1f:74:aa} reservation:<nil>}
I0127 02:58:49.699327 3805055 network.go:206] using free private subnet 192.168.85.0/24: &{IP:192.168.85.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.85.0/24 Gateway:192.168.85.1 ClientMin:192.168.85.2 ClientMax:192.168.85.254 Broadcast:192.168.85.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0x40019f6420}
I0127 02:58:49.699353 3805055 network_create.go:124] attempt to create docker network embed-certs-579827 192.168.85.0/24 with gateway 192.168.85.1 and MTU of 1500 ...
I0127 02:58:49.699414 3805055 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.85.0/24 --gateway=192.168.85.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=embed-certs-579827 embed-certs-579827
I0127 02:58:49.775654 3805055 network_create.go:108] docker network embed-certs-579827 192.168.85.0/24 created
I0127 02:58:49.775686 3805055 kic.go:121] calculated static IP "192.168.85.2" for the "embed-certs-579827" container
I0127 02:58:49.775798 3805055 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
I0127 02:58:49.792993 3805055 cli_runner.go:164] Run: docker volume create embed-certs-579827 --label name.minikube.sigs.k8s.io=embed-certs-579827 --label created_by.minikube.sigs.k8s.io=true
I0127 02:58:49.812010 3805055 oci.go:103] Successfully created a docker volume embed-certs-579827
I0127 02:58:49.812097 3805055 cli_runner.go:164] Run: docker run --rm --name embed-certs-579827-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=embed-certs-579827 --entrypoint /usr/bin/test -v embed-certs-579827:/var gcr.io/k8s-minikube/kicbase:v0.0.46@sha256:fd2d445ddcc33ebc5c6b68a17e6219ea207ce63c005095ea1525296da2d1a279 -d /var/lib
I0127 02:58:50.499717 3805055 oci.go:107] Successfully prepared a docker volume embed-certs-579827
I0127 02:58:50.499776 3805055 preload.go:131] Checking if preload exists for k8s version v1.32.1 and runtime containerd
I0127 02:58:50.499795 3805055 kic.go:194] Starting extracting preloaded images to volume ...
I0127 02:58:50.499878 3805055 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/20316-3581420/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.32.1-containerd-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v embed-certs-579827:/extractDir gcr.io/k8s-minikube/kicbase:v0.0.46@sha256:fd2d445ddcc33ebc5c6b68a17e6219ea207ce63c005095ea1525296da2d1a279 -I lz4 -xf /preloaded.tar -C /extractDir
I0127 02:58:53.353671 3796111 pod_ready.go:103] pod "metrics-server-9975d5f86-mftgr" in "kube-system" namespace has status "Ready":"False"
I0127 02:58:55.850273 3796111 pod_ready.go:103] pod "metrics-server-9975d5f86-mftgr" in "kube-system" namespace has status "Ready":"False"
I0127 02:58:55.525092 3805055 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/20316-3581420/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.32.1-containerd-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v embed-certs-579827:/extractDir gcr.io/k8s-minikube/kicbase:v0.0.46@sha256:fd2d445ddcc33ebc5c6b68a17e6219ea207ce63c005095ea1525296da2d1a279 -I lz4 -xf /preloaded.tar -C /extractDir: (5.025154755s)
I0127 02:58:55.525123 3805055 kic.go:203] duration metric: took 5.02532454s to extract preloaded images to volume ...
W0127 02:58:55.525268 3805055 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
I0127 02:58:55.525388 3805055 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
I0127 02:58:55.582219 3805055 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname embed-certs-579827 --name embed-certs-579827 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=embed-certs-579827 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=embed-certs-579827 --network embed-certs-579827 --ip 192.168.85.2 --volume embed-certs-579827:/var --security-opt apparmor=unconfined --memory=2200mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase:v0.0.46@sha256:fd2d445ddcc33ebc5c6b68a17e6219ea207ce63c005095ea1525296da2d1a279
I0127 02:58:55.930220 3805055 cli_runner.go:164] Run: docker container inspect embed-certs-579827 --format={{.State.Running}}
I0127 02:58:55.952515 3805055 cli_runner.go:164] Run: docker container inspect embed-certs-579827 --format={{.State.Status}}
I0127 02:58:55.977592 3805055 cli_runner.go:164] Run: docker exec embed-certs-579827 stat /var/lib/dpkg/alternatives/iptables
I0127 02:58:56.031629 3805055 oci.go:144] the created container "embed-certs-579827" has a running status.
I0127 02:58:56.031657 3805055 kic.go:225] Creating ssh key for kic: /home/jenkins/minikube-integration/20316-3581420/.minikube/machines/embed-certs-579827/id_rsa...
I0127 02:58:56.268746 3805055 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/20316-3581420/.minikube/machines/embed-certs-579827/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
I0127 02:58:56.297078 3805055 cli_runner.go:164] Run: docker container inspect embed-certs-579827 --format={{.State.Status}}
I0127 02:58:56.326079 3805055 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
I0127 02:58:56.326973 3805055 kic_runner.go:114] Args: [docker exec --privileged embed-certs-579827 chown docker:docker /home/docker/.ssh/authorized_keys]
I0127 02:58:56.390682 3805055 cli_runner.go:164] Run: docker container inspect embed-certs-579827 --format={{.State.Status}}
I0127 02:58:56.417904 3805055 machine.go:93] provisionDockerMachine start ...
I0127 02:58:56.418069 3805055 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-579827
I0127 02:58:56.456396 3805055 main.go:141] libmachine: Using SSH client type: native
I0127 02:58:56.456709 3805055 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x4132a0] 0x415ae0 <nil> [] 0s} 127.0.0.1 37791 <nil> <nil>}
I0127 02:58:56.456719 3805055 main.go:141] libmachine: About to run SSH command:
hostname
I0127 02:58:56.460932 3805055 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: EOF
I0127 02:58:59.593636 3805055 main.go:141] libmachine: SSH cmd err, output: <nil>: embed-certs-579827
I0127 02:58:59.593662 3805055 ubuntu.go:169] provisioning hostname "embed-certs-579827"
I0127 02:58:59.593746 3805055 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-579827
I0127 02:58:59.612166 3805055 main.go:141] libmachine: Using SSH client type: native
I0127 02:58:59.612419 3805055 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x4132a0] 0x415ae0 <nil> [] 0s} 127.0.0.1 37791 <nil> <nil>}
I0127 02:58:59.612436 3805055 main.go:141] libmachine: About to run SSH command:
sudo hostname embed-certs-579827 && echo "embed-certs-579827" | sudo tee /etc/hostname
I0127 02:58:59.747049 3805055 main.go:141] libmachine: SSH cmd err, output: <nil>: embed-certs-579827
I0127 02:58:59.747201 3805055 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-579827
I0127 02:58:59.764780 3805055 main.go:141] libmachine: Using SSH client type: native
I0127 02:58:59.765031 3805055 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x4132a0] 0x415ae0 <nil> [] 0s} 127.0.0.1 37791 <nil> <nil>}
I0127 02:58:59.765048 3805055 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sembed-certs-579827' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 embed-certs-579827/g' /etc/hosts;
else
echo '127.0.1.1 embed-certs-579827' | sudo tee -a /etc/hosts;
fi
fi
I0127 02:58:59.886263 3805055 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0127 02:58:59.886291 3805055 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/20316-3581420/.minikube CaCertPath:/home/jenkins/minikube-integration/20316-3581420/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/20316-3581420/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/20316-3581420/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/20316-3581420/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/20316-3581420/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/20316-3581420/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/20316-3581420/.minikube}
I0127 02:58:59.886330 3805055 ubuntu.go:177] setting up certificates
I0127 02:58:59.886340 3805055 provision.go:84] configureAuth start
I0127 02:58:59.886413 3805055 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-579827
I0127 02:58:59.909871 3805055 provision.go:143] copyHostCerts
I0127 02:58:59.909950 3805055 exec_runner.go:144] found /home/jenkins/minikube-integration/20316-3581420/.minikube/ca.pem, removing ...
I0127 02:58:59.909964 3805055 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20316-3581420/.minikube/ca.pem
I0127 02:58:59.910046 3805055 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20316-3581420/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20316-3581420/.minikube/ca.pem (1078 bytes)
I0127 02:58:59.910187 3805055 exec_runner.go:144] found /home/jenkins/minikube-integration/20316-3581420/.minikube/cert.pem, removing ...
I0127 02:58:59.910201 3805055 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20316-3581420/.minikube/cert.pem
I0127 02:58:59.910231 3805055 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20316-3581420/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20316-3581420/.minikube/cert.pem (1123 bytes)
I0127 02:58:59.910292 3805055 exec_runner.go:144] found /home/jenkins/minikube-integration/20316-3581420/.minikube/key.pem, removing ...
I0127 02:58:59.910300 3805055 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20316-3581420/.minikube/key.pem
I0127 02:58:59.910325 3805055 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20316-3581420/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20316-3581420/.minikube/key.pem (1679 bytes)
I0127 02:58:59.910379 3805055 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20316-3581420/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20316-3581420/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20316-3581420/.minikube/certs/ca-key.pem org=jenkins.embed-certs-579827 san=[127.0.0.1 192.168.85.2 embed-certs-579827 localhost minikube]
I0127 02:59:00.273194 3805055 provision.go:177] copyRemoteCerts
I0127 02:59:00.273298 3805055 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0127 02:59:00.273364 3805055 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-579827
I0127 02:59:00.294209 3805055 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:37791 SSHKeyPath:/home/jenkins/minikube-integration/20316-3581420/.minikube/machines/embed-certs-579827/id_rsa Username:docker}
I0127 02:59:00.390566 3805055 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20316-3581420/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0127 02:59:00.419486 3805055 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20316-3581420/.minikube/machines/server.pem --> /etc/docker/server.pem (1224 bytes)
I0127 02:59:00.446152 3805055 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20316-3581420/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0127 02:59:00.473260 3805055 provision.go:87] duration metric: took 586.904207ms to configureAuth
I0127 02:59:00.473289 3805055 ubuntu.go:193] setting minikube options for container-runtime
I0127 02:59:00.473478 3805055 config.go:182] Loaded profile config "embed-certs-579827": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.32.1
I0127 02:59:00.473494 3805055 machine.go:96] duration metric: took 4.055572379s to provisionDockerMachine
I0127 02:59:00.473501 3805055 client.go:171] duration metric: took 10.827737248s to LocalClient.Create
I0127 02:59:00.473515 3805055 start.go:167] duration metric: took 10.827794642s to libmachine.API.Create "embed-certs-579827"
I0127 02:59:00.473523 3805055 start.go:293] postStartSetup for "embed-certs-579827" (driver="docker")
I0127 02:59:00.473532 3805055 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0127 02:59:00.473589 3805055 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0127 02:59:00.473633 3805055 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-579827
I0127 02:59:00.511827 3805055 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:37791 SSHKeyPath:/home/jenkins/minikube-integration/20316-3581420/.minikube/machines/embed-certs-579827/id_rsa Username:docker}
I0127 02:59:00.604896 3805055 ssh_runner.go:195] Run: cat /etc/os-release
I0127 02:59:00.608455 3805055 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0127 02:59:00.608494 3805055 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0127 02:59:00.608514 3805055 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0127 02:59:00.608522 3805055 info.go:137] Remote host: Ubuntu 22.04.5 LTS
I0127 02:59:00.608533 3805055 filesync.go:126] Scanning /home/jenkins/minikube-integration/20316-3581420/.minikube/addons for local assets ...
I0127 02:59:00.608597 3805055 filesync.go:126] Scanning /home/jenkins/minikube-integration/20316-3581420/.minikube/files for local assets ...
I0127 02:59:00.608678 3805055 filesync.go:149] local asset: /home/jenkins/minikube-integration/20316-3581420/.minikube/files/etc/ssl/certs/35868002.pem -> 35868002.pem in /etc/ssl/certs
I0127 02:59:00.608791 3805055 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0127 02:59:00.617888 3805055 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20316-3581420/.minikube/files/etc/ssl/certs/35868002.pem --> /etc/ssl/certs/35868002.pem (1708 bytes)
I0127 02:59:00.643868 3805055 start.go:296] duration metric: took 170.330321ms for postStartSetup
I0127 02:59:00.644265 3805055 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-579827
I0127 02:59:00.661187 3805055 profile.go:143] Saving config to /home/jenkins/minikube-integration/20316-3581420/.minikube/profiles/embed-certs-579827/config.json ...
I0127 02:59:00.661470 3805055 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0127 02:59:00.661512 3805055 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-579827
I0127 02:59:00.678615 3805055 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:37791 SSHKeyPath:/home/jenkins/minikube-integration/20316-3581420/.minikube/machines/embed-certs-579827/id_rsa Username:docker}
I0127 02:59:00.767241 3805055 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I0127 02:59:00.771956 3805055 start.go:128] duration metric: took 11.130113931s to createHost
I0127 02:59:00.771983 3805055 start.go:83] releasing machines lock for "embed-certs-579827", held for 11.130264821s
I0127 02:59:00.772068 3805055 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-579827
I0127 02:59:00.789166 3805055 ssh_runner.go:195] Run: cat /version.json
I0127 02:59:00.789223 3805055 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-579827
I0127 02:59:00.789287 3805055 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0127 02:59:00.789368 3805055 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-579827
I0127 02:59:00.814142 3805055 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:37791 SSHKeyPath:/home/jenkins/minikube-integration/20316-3581420/.minikube/machines/embed-certs-579827/id_rsa Username:docker}
I0127 02:59:00.816047 3805055 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:37791 SSHKeyPath:/home/jenkins/minikube-integration/20316-3581420/.minikube/machines/embed-certs-579827/id_rsa Username:docker}
I0127 02:59:01.042940 3805055 ssh_runner.go:195] Run: systemctl --version
I0127 02:59:01.047440 3805055 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I0127 02:59:01.052032 3805055 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
I0127 02:59:01.081137 3805055 cni.go:230] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
I0127 02:59:01.081275 3805055 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0127 02:59:01.128589 3805055 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist, /etc/cni/net.d/100-crio-bridge.conf] bridge cni config(s)
I0127 02:59:01.128659 3805055 start.go:495] detecting cgroup driver to use...
I0127 02:59:01.128709 3805055 detect.go:187] detected "cgroupfs" cgroup driver on host os
I0127 02:59:01.128790 3805055 ssh_runner.go:195] Run: sudo systemctl stop -f crio
I0127 02:59:01.143321 3805055 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I0127 02:59:01.160815 3805055 docker.go:217] disabling cri-docker service (if available) ...
I0127 02:59:01.160959 3805055 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0127 02:59:01.176836 3805055 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0127 02:59:01.192847 3805055 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0127 02:59:01.283281 3805055 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0127 02:59:01.395721 3805055 docker.go:233] disabling docker service ...
I0127 02:59:01.395836 3805055 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0127 02:59:01.422213 3805055 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0127 02:59:01.436851 3805055 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0127 02:59:01.535609 3805055 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0127 02:59:01.641294 3805055 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0127 02:59:01.653970 3805055 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock
" | sudo tee /etc/crictl.yaml"
I0127 02:59:01.673075 3805055 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.10"|' /etc/containerd/config.toml"
I0127 02:59:01.684308 3805055 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
I0127 02:59:01.696310 3805055 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...
I0127 02:59:01.696409 3805055 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
I0127 02:59:01.708347 3805055 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0127 02:59:01.720044 3805055 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
I0127 02:59:01.730981 3805055 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0127 02:59:01.742186 3805055 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0127 02:59:01.768099 3805055 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
I0127 02:59:01.779951 3805055 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *enable_unprivileged_ports = .*/d' /etc/containerd/config.toml"
I0127 02:59:01.791710 3805055 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)\[plugins."io.containerd.grpc.v1.cri"\]|&\n\1 enable_unprivileged_ports = true|' /etc/containerd/config.toml"
I0127 02:59:01.804689 3805055 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0127 02:59:01.816592 3805055 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0127 02:59:01.828100 3805055 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0127 02:59:01.916457 3805055 ssh_runner.go:195] Run: sudo systemctl restart containerd
I0127 02:59:02.108620 3805055 start.go:542] Will wait 60s for socket path /run/containerd/containerd.sock
I0127 02:59:02.108713 3805055 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
I0127 02:59:02.112833 3805055 start.go:563] Will wait 60s for crictl version
I0127 02:59:02.112917 3805055 ssh_runner.go:195] Run: which crictl
I0127 02:59:02.116710 3805055 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0127 02:59:02.159616 3805055 start.go:579] Version: 0.1.0
RuntimeName: containerd
RuntimeVersion: 1.7.24
RuntimeApiVersion: v1
I0127 02:59:02.159704 3805055 ssh_runner.go:195] Run: containerd --version
I0127 02:59:02.187826 3805055 ssh_runner.go:195] Run: containerd --version
I0127 02:59:02.217457 3805055 out.go:177] * Preparing Kubernetes v1.32.1 on containerd 1.7.24 ...
I0127 02:58:58.347216 3796111 pod_ready.go:103] pod "metrics-server-9975d5f86-mftgr" in "kube-system" namespace has status "Ready":"False"
I0127 02:59:00.348519 3796111 pod_ready.go:103] pod "metrics-server-9975d5f86-mftgr" in "kube-system" namespace has status "Ready":"False"
I0127 02:59:02.850554 3796111 pod_ready.go:103] pod "metrics-server-9975d5f86-mftgr" in "kube-system" namespace has status "Ready":"False"
I0127 02:59:02.220565 3805055 cli_runner.go:164] Run: docker network inspect embed-certs-579827 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0127 02:59:02.239384 3805055 ssh_runner.go:195] Run: grep 192.168.85.1 host.minikube.internal$ /etc/hosts
I0127 02:59:02.249049 3805055 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.85.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0127 02:59:02.267091 3805055 kubeadm.go:883] updating cluster {Name:embed-certs-579827 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.46@sha256:fd2d445ddcc33ebc5c6b68a17e6219ea207ce63c005095ea1525296da2d1a279 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.32.1 ClusterName:embed-certs-579827 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServe
rIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.32.1 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmware
Path: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0127 02:59:02.267220 3805055 preload.go:131] Checking if preload exists for k8s version v1.32.1 and runtime containerd
I0127 02:59:02.267289 3805055 ssh_runner.go:195] Run: sudo crictl images --output json
I0127 02:59:02.309732 3805055 containerd.go:627] all images are preloaded for containerd runtime.
I0127 02:59:02.309756 3805055 containerd.go:534] Images already preloaded, skipping extraction
I0127 02:59:02.309824 3805055 ssh_runner.go:195] Run: sudo crictl images --output json
I0127 02:59:02.353113 3805055 containerd.go:627] all images are preloaded for containerd runtime.
I0127 02:59:02.353137 3805055 cache_images.go:84] Images are preloaded, skipping loading
I0127 02:59:02.353146 3805055 kubeadm.go:934] updating node { 192.168.85.2 8443 v1.32.1 containerd true true} ...
I0127 02:59:02.353246 3805055 kubeadm.go:946] kubelet [Unit]
Wants=containerd.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.32.1/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=embed-certs-579827 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.85.2
[Install]
config:
{KubernetesVersion:v1.32.1 ClusterName:embed-certs-579827 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0127 02:59:02.353314 3805055 ssh_runner.go:195] Run: sudo crictl info
I0127 02:59:02.389994 3805055 cni.go:84] Creating CNI manager for ""
I0127 02:59:02.390019 3805055 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0127 02:59:02.390029 3805055 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0127 02:59:02.390054 3805055 kubeadm.go:189] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.85.2 APIServerPort:8443 KubernetesVersion:v1.32.1 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:embed-certs-579827 NodeName:embed-certs-579827 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.85.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.85.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPo
dPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///run/containerd/containerd.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I0127 02:59:02.390236 3805055 kubeadm.go:195] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta4
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.85.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///run/containerd/containerd.sock
name: "embed-certs-579827"
kubeletExtraArgs:
- name: "node-ip"
value: "192.168.85.2"
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta4
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.85.2"]
extraArgs:
- name: "enable-admission-plugins"
value: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
- name: "allocate-node-cidrs"
value: "true"
- name: "leader-elect"
value: "false"
scheduler:
extraArgs:
- name: "leader-elect"
value: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
- name: "proxy-refresh-interval"
value: "70000"
kubernetesVersion: v1.32.1
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
containerRuntimeEndpoint: unix:///run/containerd/containerd.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0127 02:59:02.390313 3805055 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.32.1
I0127 02:59:02.399436 3805055 binaries.go:44] Found k8s binaries, skipping transfer
I0127 02:59:02.399506 3805055 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0127 02:59:02.407941 3805055 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (322 bytes)
I0127 02:59:02.425501 3805055 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0127 02:59:02.445299 3805055 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2308 bytes)
I0127 02:59:02.465491 3805055 ssh_runner.go:195] Run: grep 192.168.85.2 control-plane.minikube.internal$ /etc/hosts
I0127 02:59:02.469104 3805055 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.85.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0127 02:59:02.480061 3805055 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0127 02:59:02.568853 3805055 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0127 02:59:02.587507 3805055 certs.go:68] Setting up /home/jenkins/minikube-integration/20316-3581420/.minikube/profiles/embed-certs-579827 for IP: 192.168.85.2
I0127 02:59:02.587529 3805055 certs.go:194] generating shared ca certs ...
I0127 02:59:02.587547 3805055 certs.go:226] acquiring lock for ca certs: {Name:mk1bae14ef6af74439063c8478bc03213541b880 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0127 02:59:02.587706 3805055 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/20316-3581420/.minikube/ca.key
I0127 02:59:02.587763 3805055 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/20316-3581420/.minikube/proxy-client-ca.key
I0127 02:59:02.587777 3805055 certs.go:256] generating profile certs ...
I0127 02:59:02.587832 3805055 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/20316-3581420/.minikube/profiles/embed-certs-579827/client.key
I0127 02:59:02.587863 3805055 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20316-3581420/.minikube/profiles/embed-certs-579827/client.crt with IP's: []
I0127 02:59:03.004859 3805055 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20316-3581420/.minikube/profiles/embed-certs-579827/client.crt ...
I0127 02:59:03.004898 3805055 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20316-3581420/.minikube/profiles/embed-certs-579827/client.crt: {Name:mk2349337b04cc796d0ccd01c7e7f52567bf5ba6 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0127 02:59:03.005853 3805055 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20316-3581420/.minikube/profiles/embed-certs-579827/client.key ...
I0127 02:59:03.005889 3805055 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20316-3581420/.minikube/profiles/embed-certs-579827/client.key: {Name:mkd36f59bfa0511f2108228285c84f37d7291395 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0127 02:59:03.006048 3805055 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/20316-3581420/.minikube/profiles/embed-certs-579827/apiserver.key.5fdd9838
I0127 02:59:03.006073 3805055 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20316-3581420/.minikube/profiles/embed-certs-579827/apiserver.crt.5fdd9838 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.85.2]
I0127 02:59:03.754136 3805055 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20316-3581420/.minikube/profiles/embed-certs-579827/apiserver.crt.5fdd9838 ...
I0127 02:59:03.754170 3805055 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20316-3581420/.minikube/profiles/embed-certs-579827/apiserver.crt.5fdd9838: {Name:mkcf3478eb40e9e410dc985be0d692761f1dde13 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0127 02:59:03.754969 3805055 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20316-3581420/.minikube/profiles/embed-certs-579827/apiserver.key.5fdd9838 ...
I0127 02:59:03.754998 3805055 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20316-3581420/.minikube/profiles/embed-certs-579827/apiserver.key.5fdd9838: {Name:mka2ddcf7c67e115239a50ce4f6f709436c73708 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0127 02:59:03.755108 3805055 certs.go:381] copying /home/jenkins/minikube-integration/20316-3581420/.minikube/profiles/embed-certs-579827/apiserver.crt.5fdd9838 -> /home/jenkins/minikube-integration/20316-3581420/.minikube/profiles/embed-certs-579827/apiserver.crt
I0127 02:59:03.755189 3805055 certs.go:385] copying /home/jenkins/minikube-integration/20316-3581420/.minikube/profiles/embed-certs-579827/apiserver.key.5fdd9838 -> /home/jenkins/minikube-integration/20316-3581420/.minikube/profiles/embed-certs-579827/apiserver.key
I0127 02:59:03.755254 3805055 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/20316-3581420/.minikube/profiles/embed-certs-579827/proxy-client.key
I0127 02:59:03.755272 3805055 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20316-3581420/.minikube/profiles/embed-certs-579827/proxy-client.crt with IP's: []
I0127 02:59:05.174318 3805055 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20316-3581420/.minikube/profiles/embed-certs-579827/proxy-client.crt ...
I0127 02:59:05.174355 3805055 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20316-3581420/.minikube/profiles/embed-certs-579827/proxy-client.crt: {Name:mk58fb4d2c3b6b4c53d68994e01a7884d31fdf1b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0127 02:59:05.174565 3805055 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20316-3581420/.minikube/profiles/embed-certs-579827/proxy-client.key ...
I0127 02:59:05.174581 3805055 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20316-3581420/.minikube/profiles/embed-certs-579827/proxy-client.key: {Name:mk7d9926f4f7d9db2ec4914a5b93168f3f167834 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0127 02:59:05.175453 3805055 certs.go:484] found cert: /home/jenkins/minikube-integration/20316-3581420/.minikube/certs/3586800.pem (1338 bytes)
W0127 02:59:05.175504 3805055 certs.go:480] ignoring /home/jenkins/minikube-integration/20316-3581420/.minikube/certs/3586800_empty.pem, impossibly tiny 0 bytes
I0127 02:59:05.175514 3805055 certs.go:484] found cert: /home/jenkins/minikube-integration/20316-3581420/.minikube/certs/ca-key.pem (1675 bytes)
I0127 02:59:05.175539 3805055 certs.go:484] found cert: /home/jenkins/minikube-integration/20316-3581420/.minikube/certs/ca.pem (1078 bytes)
I0127 02:59:05.175569 3805055 certs.go:484] found cert: /home/jenkins/minikube-integration/20316-3581420/.minikube/certs/cert.pem (1123 bytes)
I0127 02:59:05.175597 3805055 certs.go:484] found cert: /home/jenkins/minikube-integration/20316-3581420/.minikube/certs/key.pem (1679 bytes)
I0127 02:59:05.175643 3805055 certs.go:484] found cert: /home/jenkins/minikube-integration/20316-3581420/.minikube/files/etc/ssl/certs/35868002.pem (1708 bytes)
I0127 02:59:05.176303 3805055 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20316-3581420/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0127 02:59:05.204808 3805055 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20316-3581420/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0127 02:59:05.229790 3805055 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20316-3581420/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0127 02:59:05.255953 3805055 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20316-3581420/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0127 02:59:05.283630 3805055 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20316-3581420/.minikube/profiles/embed-certs-579827/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1428 bytes)
I0127 02:59:05.308931 3805055 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20316-3581420/.minikube/profiles/embed-certs-579827/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0127 02:59:05.333792 3805055 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20316-3581420/.minikube/profiles/embed-certs-579827/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0127 02:59:05.362179 3805055 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20316-3581420/.minikube/profiles/embed-certs-579827/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0127 02:59:05.386665 3805055 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20316-3581420/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0127 02:59:05.416572 3805055 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20316-3581420/.minikube/certs/3586800.pem --> /usr/share/ca-certificates/3586800.pem (1338 bytes)
I0127 02:59:05.443812 3805055 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20316-3581420/.minikube/files/etc/ssl/certs/35868002.pem --> /usr/share/ca-certificates/35868002.pem (1708 bytes)
I0127 02:59:05.474399 3805055 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0127 02:59:05.493725 3805055 ssh_runner.go:195] Run: openssl version
I0127 02:59:05.499674 3805055 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0127 02:59:05.514527 3805055 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0127 02:59:05.518159 3805055 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Jan 27 02:08 /usr/share/ca-certificates/minikubeCA.pem
I0127 02:59:05.518272 3805055 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0127 02:59:05.525200 3805055 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0127 02:59:05.535184 3805055 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/3586800.pem && ln -fs /usr/share/ca-certificates/3586800.pem /etc/ssl/certs/3586800.pem"
I0127 02:59:05.545543 3805055 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/3586800.pem
I0127 02:59:05.549494 3805055 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Jan 27 02:16 /usr/share/ca-certificates/3586800.pem
I0127 02:59:05.549624 3805055 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/3586800.pem
I0127 02:59:05.556874 3805055 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/3586800.pem /etc/ssl/certs/51391683.0"
I0127 02:59:05.568939 3805055 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/35868002.pem && ln -fs /usr/share/ca-certificates/35868002.pem /etc/ssl/certs/35868002.pem"
I0127 02:59:05.579616 3805055 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/35868002.pem
I0127 02:59:05.584010 3805055 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Jan 27 02:16 /usr/share/ca-certificates/35868002.pem
I0127 02:59:05.584088 3805055 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/35868002.pem
I0127 02:59:05.593570 3805055 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/35868002.pem /etc/ssl/certs/3ec20f2e.0"
I0127 02:59:05.605837 3805055 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0127 02:59:05.610198 3805055 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0127 02:59:05.610258 3805055 kubeadm.go:392] StartCluster: {Name:embed-certs-579827 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.46@sha256:fd2d445ddcc33ebc5c6b68a17e6219ea207ce63c005095ea1525296da2d1a279 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.32.1 ClusterName:embed-certs-579827 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIP
s:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.32.1 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePat
h: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0127 02:59:05.610349 3805055 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}
I0127 02:59:05.610424 3805055 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0127 02:59:05.662338 3805055 cri.go:89] found id: ""
I0127 02:59:05.662447 3805055 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0127 02:59:05.672025 3805055 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0127 02:59:05.681063 3805055 kubeadm.go:214] ignoring SystemVerification for kubeadm because of docker driver
I0127 02:59:05.681171 3805055 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0127 02:59:05.690176 3805055 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0127 02:59:05.690239 3805055 kubeadm.go:157] found existing configuration files:
I0127 02:59:05.690320 3805055 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0127 02:59:05.699478 3805055 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0127 02:59:05.699591 3805055 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0127 02:59:05.708529 3805055 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0127 02:59:05.717440 3805055 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0127 02:59:05.717507 3805055 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0127 02:59:05.726156 3805055 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0127 02:59:05.735798 3805055 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0127 02:59:05.735873 3805055 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0127 02:59:05.744500 3805055 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0127 02:59:05.753702 3805055 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0127 02:59:05.753767 3805055 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0127 02:59:05.762586 3805055 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.32.1:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
I0127 02:59:05.810861 3805055 kubeadm.go:310] [init] Using Kubernetes version: v1.32.1
I0127 02:59:05.810954 3805055 kubeadm.go:310] [preflight] Running pre-flight checks
I0127 02:59:05.832396 3805055 kubeadm.go:310] [preflight] The system verification failed. Printing the output from the verification:
I0127 02:59:05.832477 3805055 kubeadm.go:310] [0;37mKERNEL_VERSION[0m: [0;32m5.15.0-1075-aws[0m
I0127 02:59:05.832530 3805055 kubeadm.go:310] [0;37mOS[0m: [0;32mLinux[0m
I0127 02:59:05.832582 3805055 kubeadm.go:310] [0;37mCGROUPS_CPU[0m: [0;32menabled[0m
I0127 02:59:05.832634 3805055 kubeadm.go:310] [0;37mCGROUPS_CPUACCT[0m: [0;32menabled[0m
I0127 02:59:05.832689 3805055 kubeadm.go:310] [0;37mCGROUPS_CPUSET[0m: [0;32menabled[0m
I0127 02:59:05.832741 3805055 kubeadm.go:310] [0;37mCGROUPS_DEVICES[0m: [0;32menabled[0m
I0127 02:59:05.832792 3805055 kubeadm.go:310] [0;37mCGROUPS_FREEZER[0m: [0;32menabled[0m
I0127 02:59:05.832845 3805055 kubeadm.go:310] [0;37mCGROUPS_MEMORY[0m: [0;32menabled[0m
I0127 02:59:05.832894 3805055 kubeadm.go:310] [0;37mCGROUPS_PIDS[0m: [0;32menabled[0m
I0127 02:59:05.832945 3805055 kubeadm.go:310] [0;37mCGROUPS_HUGETLB[0m: [0;32menabled[0m
I0127 02:59:05.832994 3805055 kubeadm.go:310] [0;37mCGROUPS_BLKIO[0m: [0;32menabled[0m
I0127 02:59:05.903125 3805055 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0127 02:59:05.903308 3805055 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0127 02:59:05.903441 3805055 kubeadm.go:310] [preflight] You can also perform this action beforehand using 'kubeadm config images pull'
I0127 02:59:05.914782 3805055 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0127 02:59:04.869664 3796111 pod_ready.go:103] pod "metrics-server-9975d5f86-mftgr" in "kube-system" namespace has status "Ready":"False"
I0127 02:59:07.350731 3796111 pod_ready.go:103] pod "metrics-server-9975d5f86-mftgr" in "kube-system" namespace has status "Ready":"False"
I0127 02:59:05.918233 3805055 out.go:235] - Generating certificates and keys ...
I0127 02:59:05.918462 3805055 kubeadm.go:310] [certs] Using existing ca certificate authority
I0127 02:59:05.918570 3805055 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0127 02:59:06.188915 3805055 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
I0127 02:59:07.222392 3805055 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
I0127 02:59:08.279331 3805055 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
I0127 02:59:08.578156 3805055 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
I0127 02:59:09.007871 3805055 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
I0127 02:59:09.008250 3805055 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [embed-certs-579827 localhost] and IPs [192.168.85.2 127.0.0.1 ::1]
I0127 02:59:09.849140 3796111 pod_ready.go:103] pod "metrics-server-9975d5f86-mftgr" in "kube-system" namespace has status "Ready":"False"
I0127 02:59:12.351772 3796111 pod_ready.go:103] pod "metrics-server-9975d5f86-mftgr" in "kube-system" namespace has status "Ready":"False"
I0127 02:59:12.849550 3796111 pod_ready.go:82] duration metric: took 4m0.00841246s for pod "metrics-server-9975d5f86-mftgr" in "kube-system" namespace to be "Ready" ...
E0127 02:59:12.849575 3796111 pod_ready.go:67] WaitExtra: waitPodCondition: context deadline exceeded
I0127 02:59:12.849585 3796111 pod_ready.go:39] duration metric: took 5m20.707129361s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0127 02:59:12.849601 3796111 api_server.go:52] waiting for apiserver process to appear ...
I0127 02:59:12.849632 3796111 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
I0127 02:59:12.849779 3796111 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0127 02:59:12.908698 3796111 cri.go:89] found id: "f1ff631138f971f0d0175bbdad8dae389b0bb6d344b9c6a0c0ee143eb981fd26"
I0127 02:59:12.908718 3796111 cri.go:89] found id: "ae3fb4241ae87bccf92d74ec50fcca30938fee4da6ee2129c5306d476811e810"
I0127 02:59:12.908724 3796111 cri.go:89] found id: ""
I0127 02:59:12.908731 3796111 logs.go:282] 2 containers: [f1ff631138f971f0d0175bbdad8dae389b0bb6d344b9c6a0c0ee143eb981fd26 ae3fb4241ae87bccf92d74ec50fcca30938fee4da6ee2129c5306d476811e810]
I0127 02:59:12.908789 3796111 ssh_runner.go:195] Run: which crictl
I0127 02:59:12.912398 3796111 ssh_runner.go:195] Run: which crictl
I0127 02:59:12.915700 3796111 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
I0127 02:59:12.915779 3796111 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0127 02:59:12.958472 3796111 cri.go:89] found id: "913dba7b3bede3cb8e1b77be0a25d981b94c7ef9011ec91d80f77d6b7afc771b"
I0127 02:59:12.958491 3796111 cri.go:89] found id: "8d9862575a02aedaa20cbdbc29f350c7d048f408b17d76e6899b001882f093b9"
I0127 02:59:12.958495 3796111 cri.go:89] found id: ""
I0127 02:59:12.958502 3796111 logs.go:282] 2 containers: [913dba7b3bede3cb8e1b77be0a25d981b94c7ef9011ec91d80f77d6b7afc771b 8d9862575a02aedaa20cbdbc29f350c7d048f408b17d76e6899b001882f093b9]
I0127 02:59:12.958559 3796111 ssh_runner.go:195] Run: which crictl
I0127 02:59:12.962269 3796111 ssh_runner.go:195] Run: which crictl
I0127 02:59:12.965683 3796111 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
I0127 02:59:12.965751 3796111 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0127 02:59:13.017093 3796111 cri.go:89] found id: "80de12a579f093bfca496c919408519334bb6b6962effaec3c52c2cef2014477"
I0127 02:59:13.017166 3796111 cri.go:89] found id: "2333f389a3e6eb63094687bfb2df8df33f3fdb8498fc24f92452e8fffd240cca"
I0127 02:59:13.017201 3796111 cri.go:89] found id: ""
I0127 02:59:13.017228 3796111 logs.go:282] 2 containers: [80de12a579f093bfca496c919408519334bb6b6962effaec3c52c2cef2014477 2333f389a3e6eb63094687bfb2df8df33f3fdb8498fc24f92452e8fffd240cca]
I0127 02:59:13.017327 3796111 ssh_runner.go:195] Run: which crictl
I0127 02:59:13.021516 3796111 ssh_runner.go:195] Run: which crictl
I0127 02:59:13.025341 3796111 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
I0127 02:59:13.025409 3796111 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0127 02:59:13.080460 3796111 cri.go:89] found id: "6868e5588e2518b2dbbee5fcdc288ff7639c3e6d27152b25c2d92a94144279e8"
I0127 02:59:13.080485 3796111 cri.go:89] found id: "d422478362adb4ddd09d8598be12970c37fc3c672548faefb895f3b8924598a3"
I0127 02:59:13.080493 3796111 cri.go:89] found id: ""
I0127 02:59:13.080502 3796111 logs.go:282] 2 containers: [6868e5588e2518b2dbbee5fcdc288ff7639c3e6d27152b25c2d92a94144279e8 d422478362adb4ddd09d8598be12970c37fc3c672548faefb895f3b8924598a3]
I0127 02:59:13.080571 3796111 ssh_runner.go:195] Run: which crictl
I0127 02:59:13.084534 3796111 ssh_runner.go:195] Run: which crictl
I0127 02:59:13.088803 3796111 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
I0127 02:59:13.088877 3796111 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0127 02:59:13.158618 3796111 cri.go:89] found id: "1eebf1b8ced6916d55f7a34166585a17437e60b2716ed0809ac349c450b4e754"
I0127 02:59:13.158644 3796111 cri.go:89] found id: "a7fa3720da9a726a9f6f8d791e969823b89c23d447e9434ee4a64f80336f7aa2"
I0127 02:59:13.158650 3796111 cri.go:89] found id: ""
I0127 02:59:13.158658 3796111 logs.go:282] 2 containers: [1eebf1b8ced6916d55f7a34166585a17437e60b2716ed0809ac349c450b4e754 a7fa3720da9a726a9f6f8d791e969823b89c23d447e9434ee4a64f80336f7aa2]
I0127 02:59:13.158745 3796111 ssh_runner.go:195] Run: which crictl
I0127 02:59:13.163024 3796111 ssh_runner.go:195] Run: which crictl
I0127 02:59:13.169387 3796111 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
I0127 02:59:13.169529 3796111 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0127 02:59:13.244336 3796111 cri.go:89] found id: "60bc065c8667a83052202f7fc37006df6160a0f60502485d3fe888d752f6e93e"
I0127 02:59:13.244366 3796111 cri.go:89] found id: "0f4ff9b6b17b830c0f2505936c14a703649af8de56a7960df790d5e970f75414"
I0127 02:59:13.244375 3796111 cri.go:89] found id: ""
I0127 02:59:13.244386 3796111 logs.go:282] 2 containers: [60bc065c8667a83052202f7fc37006df6160a0f60502485d3fe888d752f6e93e 0f4ff9b6b17b830c0f2505936c14a703649af8de56a7960df790d5e970f75414]
I0127 02:59:13.244469 3796111 ssh_runner.go:195] Run: which crictl
I0127 02:59:13.248667 3796111 ssh_runner.go:195] Run: which crictl
I0127 02:59:13.252725 3796111 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
I0127 02:59:13.252803 3796111 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0127 02:59:13.300743 3796111 cri.go:89] found id: "792e1bf0751e8fad4834403cd7db06cfbd9065c482e6c7b3bcf4c0c2b1a373d1"
I0127 02:59:13.300767 3796111 cri.go:89] found id: "17ad11f28e20777140f3d682704f30e56a34c3f85630bf0758795ca29f6f719a"
I0127 02:59:13.300773 3796111 cri.go:89] found id: ""
I0127 02:59:13.300781 3796111 logs.go:282] 2 containers: [792e1bf0751e8fad4834403cd7db06cfbd9065c482e6c7b3bcf4c0c2b1a373d1 17ad11f28e20777140f3d682704f30e56a34c3f85630bf0758795ca29f6f719a]
I0127 02:59:13.300838 3796111 ssh_runner.go:195] Run: which crictl
I0127 02:59:13.305143 3796111 ssh_runner.go:195] Run: which crictl
I0127 02:59:13.309056 3796111 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
I0127 02:59:13.309127 3796111 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0127 02:59:09.782201 3805055 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
I0127 02:59:09.782551 3805055 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [embed-certs-579827 localhost] and IPs [192.168.85.2 127.0.0.1 ::1]
I0127 02:59:09.958467 3805055 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
I0127 02:59:10.500355 3805055 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
I0127 02:59:11.073771 3805055 kubeadm.go:310] [certs] Generating "sa" key and public key
I0127 02:59:11.074066 3805055 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0127 02:59:11.804359 3805055 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0127 02:59:12.415719 3805055 kubeadm.go:310] [kubeconfig] Writing "super-admin.conf" kubeconfig file
I0127 02:59:13.301526 3805055 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0127 02:59:14.782627 3805055 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0127 02:59:15.447904 3805055 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0127 02:59:15.448933 3805055 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0127 02:59:15.452383 3805055 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0127 02:59:13.361247 3796111 cri.go:89] found id: "ca016e85c640cc59943efbf83715a2c4e1dcf8cc8020f4a480ba90214108c3ae"
I0127 02:59:13.361270 3796111 cri.go:89] found id: "5966fc744604d7bfd40d7701102f774e0d749dd772fdb69dbfbe01827d86cd21"
I0127 02:59:13.361278 3796111 cri.go:89] found id: ""
I0127 02:59:13.361285 3796111 logs.go:282] 2 containers: [ca016e85c640cc59943efbf83715a2c4e1dcf8cc8020f4a480ba90214108c3ae 5966fc744604d7bfd40d7701102f774e0d749dd772fdb69dbfbe01827d86cd21]
I0127 02:59:13.361343 3796111 ssh_runner.go:195] Run: which crictl
I0127 02:59:13.365558 3796111 ssh_runner.go:195] Run: which crictl
I0127 02:59:13.369392 3796111 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
I0127 02:59:13.369489 3796111 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I0127 02:59:13.420343 3796111 cri.go:89] found id: "3e757cf47e5bf46aadd2d0209c944ee653ff40decba0a43ed51c38657b7ac9a8"
I0127 02:59:13.420366 3796111 cri.go:89] found id: ""
I0127 02:59:13.420374 3796111 logs.go:282] 1 containers: [3e757cf47e5bf46aadd2d0209c944ee653ff40decba0a43ed51c38657b7ac9a8]
I0127 02:59:13.420433 3796111 ssh_runner.go:195] Run: which crictl
I0127 02:59:13.424585 3796111 logs.go:123] Gathering logs for coredns [80de12a579f093bfca496c919408519334bb6b6962effaec3c52c2cef2014477] ...
I0127 02:59:13.424611 3796111 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 80de12a579f093bfca496c919408519334bb6b6962effaec3c52c2cef2014477"
I0127 02:59:13.478057 3796111 logs.go:123] Gathering logs for coredns [2333f389a3e6eb63094687bfb2df8df33f3fdb8498fc24f92452e8fffd240cca] ...
I0127 02:59:13.478086 3796111 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 2333f389a3e6eb63094687bfb2df8df33f3fdb8498fc24f92452e8fffd240cca"
I0127 02:59:13.536134 3796111 logs.go:123] Gathering logs for kube-proxy [a7fa3720da9a726a9f6f8d791e969823b89c23d447e9434ee4a64f80336f7aa2] ...
I0127 02:59:13.536162 3796111 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 a7fa3720da9a726a9f6f8d791e969823b89c23d447e9434ee4a64f80336f7aa2"
I0127 02:59:13.604664 3796111 logs.go:123] Gathering logs for kubernetes-dashboard [3e757cf47e5bf46aadd2d0209c944ee653ff40decba0a43ed51c38657b7ac9a8] ...
I0127 02:59:13.604699 3796111 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 3e757cf47e5bf46aadd2d0209c944ee653ff40decba0a43ed51c38657b7ac9a8"
I0127 02:59:13.673791 3796111 logs.go:123] Gathering logs for describe nodes ...
I0127 02:59:13.673820 3796111 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0127 02:59:13.864687 3796111 logs.go:123] Gathering logs for kube-scheduler [d422478362adb4ddd09d8598be12970c37fc3c672548faefb895f3b8924598a3] ...
I0127 02:59:13.864722 3796111 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 d422478362adb4ddd09d8598be12970c37fc3c672548faefb895f3b8924598a3"
I0127 02:59:13.936957 3796111 logs.go:123] Gathering logs for kube-controller-manager [60bc065c8667a83052202f7fc37006df6160a0f60502485d3fe888d752f6e93e] ...
I0127 02:59:13.936988 3796111 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 60bc065c8667a83052202f7fc37006df6160a0f60502485d3fe888d752f6e93e"
I0127 02:59:14.024358 3796111 logs.go:123] Gathering logs for kube-apiserver [ae3fb4241ae87bccf92d74ec50fcca30938fee4da6ee2129c5306d476811e810] ...
I0127 02:59:14.024397 3796111 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 ae3fb4241ae87bccf92d74ec50fcca30938fee4da6ee2129c5306d476811e810"
I0127 02:59:14.103841 3796111 logs.go:123] Gathering logs for etcd [913dba7b3bede3cb8e1b77be0a25d981b94c7ef9011ec91d80f77d6b7afc771b] ...
I0127 02:59:14.103876 3796111 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 913dba7b3bede3cb8e1b77be0a25d981b94c7ef9011ec91d80f77d6b7afc771b"
I0127 02:59:14.203352 3796111 logs.go:123] Gathering logs for etcd [8d9862575a02aedaa20cbdbc29f350c7d048f408b17d76e6899b001882f093b9] ...
I0127 02:59:14.203460 3796111 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 8d9862575a02aedaa20cbdbc29f350c7d048f408b17d76e6899b001882f093b9"
I0127 02:59:14.275290 3796111 logs.go:123] Gathering logs for kube-proxy [1eebf1b8ced6916d55f7a34166585a17437e60b2716ed0809ac349c450b4e754] ...
I0127 02:59:14.275372 3796111 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 1eebf1b8ced6916d55f7a34166585a17437e60b2716ed0809ac349c450b4e754"
I0127 02:59:14.335204 3796111 logs.go:123] Gathering logs for kube-controller-manager [0f4ff9b6b17b830c0f2505936c14a703649af8de56a7960df790d5e970f75414] ...
I0127 02:59:14.335232 3796111 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 0f4ff9b6b17b830c0f2505936c14a703649af8de56a7960df790d5e970f75414"
I0127 02:59:14.451827 3796111 logs.go:123] Gathering logs for kindnet [792e1bf0751e8fad4834403cd7db06cfbd9065c482e6c7b3bcf4c0c2b1a373d1] ...
I0127 02:59:14.451917 3796111 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 792e1bf0751e8fad4834403cd7db06cfbd9065c482e6c7b3bcf4c0c2b1a373d1"
I0127 02:59:14.528838 3796111 logs.go:123] Gathering logs for container status ...
I0127 02:59:14.528919 3796111 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0127 02:59:14.607271 3796111 logs.go:123] Gathering logs for dmesg ...
I0127 02:59:14.607428 3796111 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0127 02:59:14.629049 3796111 logs.go:123] Gathering logs for kube-apiserver [f1ff631138f971f0d0175bbdad8dae389b0bb6d344b9c6a0c0ee143eb981fd26] ...
I0127 02:59:14.629129 3796111 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 f1ff631138f971f0d0175bbdad8dae389b0bb6d344b9c6a0c0ee143eb981fd26"
I0127 02:59:14.710645 3796111 logs.go:123] Gathering logs for kube-scheduler [6868e5588e2518b2dbbee5fcdc288ff7639c3e6d27152b25c2d92a94144279e8] ...
I0127 02:59:14.710736 3796111 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 6868e5588e2518b2dbbee5fcdc288ff7639c3e6d27152b25c2d92a94144279e8"
I0127 02:59:14.765480 3796111 logs.go:123] Gathering logs for kindnet [17ad11f28e20777140f3d682704f30e56a34c3f85630bf0758795ca29f6f719a] ...
I0127 02:59:14.765553 3796111 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 17ad11f28e20777140f3d682704f30e56a34c3f85630bf0758795ca29f6f719a"
I0127 02:59:14.828838 3796111 logs.go:123] Gathering logs for storage-provisioner [ca016e85c640cc59943efbf83715a2c4e1dcf8cc8020f4a480ba90214108c3ae] ...
I0127 02:59:14.828906 3796111 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 ca016e85c640cc59943efbf83715a2c4e1dcf8cc8020f4a480ba90214108c3ae"
I0127 02:59:14.888808 3796111 logs.go:123] Gathering logs for storage-provisioner [5966fc744604d7bfd40d7701102f774e0d749dd772fdb69dbfbe01827d86cd21] ...
I0127 02:59:14.888835 3796111 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 5966fc744604d7bfd40d7701102f774e0d749dd772fdb69dbfbe01827d86cd21"
I0127 02:59:14.940906 3796111 logs.go:123] Gathering logs for containerd ...
I0127 02:59:14.940931 3796111 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
I0127 02:59:15.014873 3796111 logs.go:123] Gathering logs for kubelet ...
I0127 02:59:15.014965 3796111 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0127 02:59:15.084568 3796111 logs.go:138] Found kubelet problem: Jan 27 02:53:51 old-k8s-version-949994 kubelet[660]: E0127 02:53:51.967126 660 reflector.go:138] object-"default"/"default-token-gqprk": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "default-token-gqprk" is forbidden: User "system:node:old-k8s-version-949994" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'old-k8s-version-949994' and this object
W0127 02:59:15.084862 3796111 logs.go:138] Found kubelet problem: Jan 27 02:53:51 old-k8s-version-949994 kubelet[660]: E0127 02:53:51.967200 660 reflector.go:138] object-"kube-system"/"coredns": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:old-k8s-version-949994" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-949994' and this object
W0127 02:59:15.085108 3796111 logs.go:138] Found kubelet problem: Jan 27 02:53:51 old-k8s-version-949994 kubelet[660]: E0127 02:53:51.967258 660 reflector.go:138] object-"kube-system"/"kindnet-token-ghd6s": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kindnet-token-ghd6s" is forbidden: User "system:node:old-k8s-version-949994" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-949994' and this object
W0127 02:59:15.085384 3796111 logs.go:138] Found kubelet problem: Jan 27 02:53:51 old-k8s-version-949994 kubelet[660]: E0127 02:53:51.967336 660 reflector.go:138] object-"kube-system"/"storage-provisioner-token-6zk7s": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "storage-provisioner-token-6zk7s" is forbidden: User "system:node:old-k8s-version-949994" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-949994' and this object
W0127 02:59:15.085625 3796111 logs.go:138] Found kubelet problem: Jan 27 02:53:51 old-k8s-version-949994 kubelet[660]: E0127 02:53:51.967387 660 reflector.go:138] object-"kube-system"/"coredns-token-l287g": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "coredns-token-l287g" is forbidden: User "system:node:old-k8s-version-949994" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-949994' and this object
W0127 02:59:15.085873 3796111 logs.go:138] Found kubelet problem: Jan 27 02:53:51 old-k8s-version-949994 kubelet[660]: E0127 02:53:51.967447 660 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:old-k8s-version-949994" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-949994' and this object
W0127 02:59:15.086176 3796111 logs.go:138] Found kubelet problem: Jan 27 02:53:51 old-k8s-version-949994 kubelet[660]: E0127 02:53:51.967496 660 reflector.go:138] object-"kube-system"/"kube-proxy-token-54qrt": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kube-proxy-token-54qrt" is forbidden: User "system:node:old-k8s-version-949994" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-949994' and this object
W0127 02:59:15.095025 3796111 logs.go:138] Found kubelet problem: Jan 27 02:53:53 old-k8s-version-949994 kubelet[660]: E0127 02:53:53.876531 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0127 02:59:15.095319 3796111 logs.go:138] Found kubelet problem: Jan 27 02:53:54 old-k8s-version-949994 kubelet[660]: E0127 02:53:54.021725 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0127 02:59:15.099091 3796111 logs.go:138] Found kubelet problem: Jan 27 02:54:09 old-k8s-version-949994 kubelet[660]: E0127 02:54:09.521072 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0127 02:59:15.101668 3796111 logs.go:138] Found kubelet problem: Jan 27 02:54:22 old-k8s-version-949994 kubelet[660]: E0127 02:54:22.278637 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
W0127 02:59:15.101911 3796111 logs.go:138] Found kubelet problem: Jan 27 02:54:22 old-k8s-version-949994 kubelet[660]: E0127 02:54:22.504207 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0127 02:59:15.102301 3796111 logs.go:138] Found kubelet problem: Jan 27 02:54:23 old-k8s-version-949994 kubelet[660]: E0127 02:54:23.282663 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
W0127 02:59:15.102683 3796111 logs.go:138] Found kubelet problem: Jan 27 02:54:24 old-k8s-version-949994 kubelet[660]: E0127 02:54:24.284977 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
W0127 02:59:15.103161 3796111 logs.go:138] Found kubelet problem: Jan 27 02:54:26 old-k8s-version-949994 kubelet[660]: E0127 02:54:26.292140 660 pod_workers.go:191] Error syncing pod 2b0aa32b-1180-4a97-8374-d786d139dc2c ("storage-provisioner_kube-system(2b0aa32b-1180-4a97-8374-d786d139dc2c)"), skipping: failed to "StartContainer" for "storage-provisioner" with CrashLoopBackOff: "back-off 10s restarting failed container=storage-provisioner pod=storage-provisioner_kube-system(2b0aa32b-1180-4a97-8374-d786d139dc2c)"
W0127 02:59:15.105983 3796111 logs.go:138] Found kubelet problem: Jan 27 02:54:37 old-k8s-version-949994 kubelet[660]: E0127 02:54:37.511569 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0127 02:59:15.106615 3796111 logs.go:138] Found kubelet problem: Jan 27 02:54:39 old-k8s-version-949994 kubelet[660]: E0127 02:54:39.335961 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
W0127 02:59:15.107194 3796111 logs.go:138] Found kubelet problem: Jan 27 02:54:42 old-k8s-version-949994 kubelet[660]: E0127 02:54:42.579255 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
W0127 02:59:15.107385 3796111 logs.go:138] Found kubelet problem: Jan 27 02:54:48 old-k8s-version-949994 kubelet[660]: E0127 02:54:48.501857 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0127 02:59:15.107709 3796111 logs.go:138] Found kubelet problem: Jan 27 02:54:53 old-k8s-version-949994 kubelet[660]: E0127 02:54:53.502843 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
W0127 02:59:15.107890 3796111 logs.go:138] Found kubelet problem: Jan 27 02:55:00 old-k8s-version-949994 kubelet[660]: E0127 02:55:00.501841 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0127 02:59:15.108480 3796111 logs.go:138] Found kubelet problem: Jan 27 02:55:07 old-k8s-version-949994 kubelet[660]: E0127 02:55:07.426639 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
W0127 02:59:15.108808 3796111 logs.go:138] Found kubelet problem: Jan 27 02:55:12 old-k8s-version-949994 kubelet[660]: E0127 02:55:12.579010 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
W0127 02:59:15.108989 3796111 logs.go:138] Found kubelet problem: Jan 27 02:55:13 old-k8s-version-949994 kubelet[660]: E0127 02:55:13.501799 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0127 02:59:15.111603 3796111 logs.go:138] Found kubelet problem: Jan 27 02:55:24 old-k8s-version-949994 kubelet[660]: E0127 02:55:24.528464 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0127 02:59:15.111990 3796111 logs.go:138] Found kubelet problem: Jan 27 02:55:25 old-k8s-version-949994 kubelet[660]: E0127 02:55:25.501540 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
W0127 02:59:15.112206 3796111 logs.go:138] Found kubelet problem: Jan 27 02:55:36 old-k8s-version-949994 kubelet[660]: E0127 02:55:36.501984 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0127 02:59:15.112600 3796111 logs.go:138] Found kubelet problem: Jan 27 02:55:37 old-k8s-version-949994 kubelet[660]: E0127 02:55:37.501584 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
W0127 02:59:15.112861 3796111 logs.go:138] Found kubelet problem: Jan 27 02:55:49 old-k8s-version-949994 kubelet[660]: E0127 02:55:49.505318 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0127 02:59:15.113505 3796111 logs.go:138] Found kubelet problem: Jan 27 02:55:51 old-k8s-version-949994 kubelet[660]: E0127 02:55:51.546741 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
W0127 02:59:15.113872 3796111 logs.go:138] Found kubelet problem: Jan 27 02:55:52 old-k8s-version-949994 kubelet[660]: E0127 02:55:52.578558 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
W0127 02:59:15.114103 3796111 logs.go:138] Found kubelet problem: Jan 27 02:56:03 old-k8s-version-949994 kubelet[660]: E0127 02:56:03.501771 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0127 02:59:15.114473 3796111 logs.go:138] Found kubelet problem: Jan 27 02:56:06 old-k8s-version-949994 kubelet[660]: E0127 02:56:06.501392 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
W0127 02:59:15.114689 3796111 logs.go:138] Found kubelet problem: Jan 27 02:56:14 old-k8s-version-949994 kubelet[660]: E0127 02:56:14.502372 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0127 02:59:15.115045 3796111 logs.go:138] Found kubelet problem: Jan 27 02:56:17 old-k8s-version-949994 kubelet[660]: E0127 02:56:17.501933 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
W0127 02:59:15.115268 3796111 logs.go:138] Found kubelet problem: Jan 27 02:56:26 old-k8s-version-949994 kubelet[660]: E0127 02:56:26.501683 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0127 02:59:15.115635 3796111 logs.go:138] Found kubelet problem: Jan 27 02:56:32 old-k8s-version-949994 kubelet[660]: E0127 02:56:32.501823 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
W0127 02:59:15.115859 3796111 logs.go:138] Found kubelet problem: Jan 27 02:56:40 old-k8s-version-949994 kubelet[660]: E0127 02:56:40.501634 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0127 02:59:15.116289 3796111 logs.go:138] Found kubelet problem: Jan 27 02:56:45 old-k8s-version-949994 kubelet[660]: E0127 02:56:45.502780 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
W0127 02:59:15.118822 3796111 logs.go:138] Found kubelet problem: Jan 27 02:56:55 old-k8s-version-949994 kubelet[660]: E0127 02:56:55.514866 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0127 02:59:15.119188 3796111 logs.go:138] Found kubelet problem: Jan 27 02:56:56 old-k8s-version-949994 kubelet[660]: E0127 02:56:56.501563 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
W0127 02:59:15.119541 3796111 logs.go:138] Found kubelet problem: Jan 27 02:57:07 old-k8s-version-949994 kubelet[660]: E0127 02:57:07.501947 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
W0127 02:59:15.119765 3796111 logs.go:138] Found kubelet problem: Jan 27 02:57:10 old-k8s-version-949994 kubelet[660]: E0127 02:57:10.502918 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0127 02:59:15.120388 3796111 logs.go:138] Found kubelet problem: Jan 27 02:57:21 old-k8s-version-949994 kubelet[660]: E0127 02:57:21.776454 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
W0127 02:59:15.120743 3796111 logs.go:138] Found kubelet problem: Jan 27 02:57:22 old-k8s-version-949994 kubelet[660]: E0127 02:57:22.780516 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
W0127 02:59:15.120978 3796111 logs.go:138] Found kubelet problem: Jan 27 02:57:23 old-k8s-version-949994 kubelet[660]: E0127 02:57:23.505620 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0127 02:59:15.121189 3796111 logs.go:138] Found kubelet problem: Jan 27 02:57:34 old-k8s-version-949994 kubelet[660]: E0127 02:57:34.501538 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0127 02:59:15.121545 3796111 logs.go:138] Found kubelet problem: Jan 27 02:57:35 old-k8s-version-949994 kubelet[660]: E0127 02:57:35.501481 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
W0127 02:59:15.121912 3796111 logs.go:138] Found kubelet problem: Jan 27 02:57:48 old-k8s-version-949994 kubelet[660]: E0127 02:57:48.503510 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
W0127 02:59:15.122150 3796111 logs.go:138] Found kubelet problem: Jan 27 02:57:49 old-k8s-version-949994 kubelet[660]: E0127 02:57:49.501969 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0127 02:59:15.122520 3796111 logs.go:138] Found kubelet problem: Jan 27 02:57:59 old-k8s-version-949994 kubelet[660]: E0127 02:57:59.502983 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
W0127 02:59:15.122734 3796111 logs.go:138] Found kubelet problem: Jan 27 02:58:00 old-k8s-version-949994 kubelet[660]: E0127 02:58:00.501586 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0127 02:59:15.123100 3796111 logs.go:138] Found kubelet problem: Jan 27 02:58:10 old-k8s-version-949994 kubelet[660]: E0127 02:58:10.501269 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
W0127 02:59:15.123321 3796111 logs.go:138] Found kubelet problem: Jan 27 02:58:15 old-k8s-version-949994 kubelet[660]: E0127 02:58:15.501889 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0127 02:59:15.123687 3796111 logs.go:138] Found kubelet problem: Jan 27 02:58:21 old-k8s-version-949994 kubelet[660]: E0127 02:58:21.501389 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
W0127 02:59:15.123897 3796111 logs.go:138] Found kubelet problem: Jan 27 02:58:28 old-k8s-version-949994 kubelet[660]: E0127 02:58:28.501733 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0127 02:59:15.124265 3796111 logs.go:138] Found kubelet problem: Jan 27 02:58:34 old-k8s-version-949994 kubelet[660]: E0127 02:58:34.501213 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
W0127 02:59:15.124475 3796111 logs.go:138] Found kubelet problem: Jan 27 02:58:43 old-k8s-version-949994 kubelet[660]: E0127 02:58:43.501567 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0127 02:59:15.124832 3796111 logs.go:138] Found kubelet problem: Jan 27 02:58:48 old-k8s-version-949994 kubelet[660]: E0127 02:58:48.502462 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
W0127 02:59:15.125042 3796111 logs.go:138] Found kubelet problem: Jan 27 02:58:55 old-k8s-version-949994 kubelet[660]: E0127 02:58:55.501821 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0127 02:59:15.125398 3796111 logs.go:138] Found kubelet problem: Jan 27 02:59:00 old-k8s-version-949994 kubelet[660]: E0127 02:59:00.502866 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
W0127 02:59:15.125620 3796111 logs.go:138] Found kubelet problem: Jan 27 02:59:07 old-k8s-version-949994 kubelet[660]: E0127 02:59:07.502977 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0127 02:59:15.125978 3796111 logs.go:138] Found kubelet problem: Jan 27 02:59:14 old-k8s-version-949994 kubelet[660]: E0127 02:59:14.501372 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
I0127 02:59:15.126008 3796111 out.go:358] Setting ErrFile to fd 2...
I0127 02:59:15.126996 3796111 out.go:392] TERM=,COLORTERM=, which probably does not support color
W0127 02:59:15.127126 3796111 out.go:270] X Problems detected in kubelet:
W0127 02:59:15.127350 3796111 out.go:270] Jan 27 02:58:48 old-k8s-version-949994 kubelet[660]: E0127 02:58:48.502462 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
W0127 02:59:15.127379 3796111 out.go:270] Jan 27 02:58:55 old-k8s-version-949994 kubelet[660]: E0127 02:58:55.501821 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0127 02:59:15.127391 3796111 out.go:270] Jan 27 02:59:00 old-k8s-version-949994 kubelet[660]: E0127 02:59:00.502866 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
W0127 02:59:15.127397 3796111 out.go:270] Jan 27 02:59:07 old-k8s-version-949994 kubelet[660]: E0127 02:59:07.502977 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0127 02:59:15.127405 3796111 out.go:270] Jan 27 02:59:14 old-k8s-version-949994 kubelet[660]: E0127 02:59:14.501372 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
I0127 02:59:15.127424 3796111 out.go:358] Setting ErrFile to fd 2...
I0127 02:59:15.127438 3796111 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0127 02:59:15.455693 3805055 out.go:235] - Booting up control plane ...
I0127 02:59:15.455813 3805055 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0127 02:59:15.455890 3805055 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0127 02:59:15.457175 3805055 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0127 02:59:15.471316 3805055 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0127 02:59:15.477835 3805055 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0127 02:59:15.478250 3805055 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0127 02:59:15.588768 3805055 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests"
I0127 02:59:15.588890 3805055 kubeadm.go:310] [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s
I0127 02:59:17.090255 3805055 kubeadm.go:310] [kubelet-check] The kubelet is healthy after 1.501460595s
I0127 02:59:17.090343 3805055 kubeadm.go:310] [api-check] Waiting for a healthy API server. This can take up to 4m0s
I0127 02:59:23.591357 3805055 kubeadm.go:310] [api-check] The API server is healthy after 6.501463857s
I0127 02:59:23.611950 3805055 kubeadm.go:310] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
I0127 02:59:23.627695 3805055 kubeadm.go:310] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster
I0127 02:59:23.655095 3805055 kubeadm.go:310] [upload-certs] Skipping phase. Please see --upload-certs
I0127 02:59:23.655291 3805055 kubeadm.go:310] [mark-control-plane] Marking the node embed-certs-579827 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
I0127 02:59:23.667262 3805055 kubeadm.go:310] [bootstrap-token] Using token: iy101u.cl9rxc7eln6chzaj
I0127 02:59:23.670177 3805055 out.go:235] - Configuring RBAC rules ...
I0127 02:59:23.670306 3805055 kubeadm.go:310] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
I0127 02:59:23.674650 3805055 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes
I0127 02:59:23.686426 3805055 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
I0127 02:59:23.690406 3805055 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
I0127 02:59:23.696577 3805055 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
I0127 02:59:23.700991 3805055 kubeadm.go:310] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
I0127 02:59:24.001161 3805055 kubeadm.go:310] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
I0127 02:59:24.446621 3805055 kubeadm.go:310] [addons] Applied essential addon: CoreDNS
I0127 02:59:25.002579 3805055 kubeadm.go:310] [addons] Applied essential addon: kube-proxy
I0127 02:59:25.002603 3805055 kubeadm.go:310]
I0127 02:59:25.002665 3805055 kubeadm.go:310] Your Kubernetes control-plane has initialized successfully!
I0127 02:59:25.002671 3805055 kubeadm.go:310]
I0127 02:59:25.002748 3805055 kubeadm.go:310] To start using your cluster, you need to run the following as a regular user:
I0127 02:59:25.002753 3805055 kubeadm.go:310]
I0127 02:59:25.002779 3805055 kubeadm.go:310] mkdir -p $HOME/.kube
I0127 02:59:25.002838 3805055 kubeadm.go:310] sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
I0127 02:59:25.002897 3805055 kubeadm.go:310] sudo chown $(id -u):$(id -g) $HOME/.kube/config
I0127 02:59:25.002903 3805055 kubeadm.go:310]
I0127 02:59:25.002974 3805055 kubeadm.go:310] Alternatively, if you are the root user, you can run:
I0127 02:59:25.002980 3805055 kubeadm.go:310]
I0127 02:59:25.003027 3805055 kubeadm.go:310] export KUBECONFIG=/etc/kubernetes/admin.conf
I0127 02:59:25.003035 3805055 kubeadm.go:310]
I0127 02:59:25.003087 3805055 kubeadm.go:310] You should now deploy a pod network to the cluster.
I0127 02:59:25.003163 3805055 kubeadm.go:310] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
I0127 02:59:25.003231 3805055 kubeadm.go:310] https://kubernetes.io/docs/concepts/cluster-administration/addons/
I0127 02:59:25.003237 3805055 kubeadm.go:310]
I0127 02:59:25.003321 3805055 kubeadm.go:310] You can now join any number of control-plane nodes by copying certificate authorities
I0127 02:59:25.003399 3805055 kubeadm.go:310] and service account keys on each node and then running the following as root:
I0127 02:59:25.003404 3805055 kubeadm.go:310]
I0127 02:59:25.003489 3805055 kubeadm.go:310] kubeadm join control-plane.minikube.internal:8443 --token iy101u.cl9rxc7eln6chzaj \
I0127 02:59:25.003593 3805055 kubeadm.go:310] --discovery-token-ca-cert-hash sha256:83891a1b2b837c79fabbfd6fe62cd9786dc4221059a44014b5acb94babe950cd \
I0127 02:59:25.003614 3805055 kubeadm.go:310] --control-plane
I0127 02:59:25.003618 3805055 kubeadm.go:310]
I0127 02:59:25.003716 3805055 kubeadm.go:310] Then you can join any number of worker nodes by running the following on each as root:
I0127 02:59:25.003722 3805055 kubeadm.go:310]
I0127 02:59:25.003805 3805055 kubeadm.go:310] kubeadm join control-plane.minikube.internal:8443 --token iy101u.cl9rxc7eln6chzaj \
I0127 02:59:25.003907 3805055 kubeadm.go:310] --discovery-token-ca-cert-hash sha256:83891a1b2b837c79fabbfd6fe62cd9786dc4221059a44014b5acb94babe950cd
I0127 02:59:25.009437 3805055 kubeadm.go:310] [WARNING SystemVerification]: cgroups v1 support is in maintenance mode, please migrate to cgroups v2
I0127 02:59:25.009666 3805055 kubeadm.go:310] [WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/5.15.0-1075-aws\n", err: exit status 1
I0127 02:59:25.009772 3805055 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0127 02:59:25.009790 3805055 cni.go:84] Creating CNI manager for ""
I0127 02:59:25.009798 3805055 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0127 02:59:25.013126 3805055 out.go:177] * Configuring CNI (Container Networking Interface) ...
I0127 02:59:25.128192 3796111 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0127 02:59:25.142509 3796111 api_server.go:72] duration metric: took 5m53.807437252s to wait for apiserver process to appear ...
I0127 02:59:25.142534 3796111 api_server.go:88] waiting for apiserver healthz status ...
I0127 02:59:25.142569 3796111 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
I0127 02:59:25.142630 3796111 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0127 02:59:25.218274 3796111 cri.go:89] found id: "f1ff631138f971f0d0175bbdad8dae389b0bb6d344b9c6a0c0ee143eb981fd26"
I0127 02:59:25.218294 3796111 cri.go:89] found id: "ae3fb4241ae87bccf92d74ec50fcca30938fee4da6ee2129c5306d476811e810"
I0127 02:59:25.218299 3796111 cri.go:89] found id: ""
I0127 02:59:25.218306 3796111 logs.go:282] 2 containers: [f1ff631138f971f0d0175bbdad8dae389b0bb6d344b9c6a0c0ee143eb981fd26 ae3fb4241ae87bccf92d74ec50fcca30938fee4da6ee2129c5306d476811e810]
I0127 02:59:25.218366 3796111 ssh_runner.go:195] Run: which crictl
I0127 02:59:25.223228 3796111 ssh_runner.go:195] Run: which crictl
I0127 02:59:25.233535 3796111 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
I0127 02:59:25.233608 3796111 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0127 02:59:25.287247 3796111 cri.go:89] found id: "913dba7b3bede3cb8e1b77be0a25d981b94c7ef9011ec91d80f77d6b7afc771b"
I0127 02:59:25.287268 3796111 cri.go:89] found id: "8d9862575a02aedaa20cbdbc29f350c7d048f408b17d76e6899b001882f093b9"
I0127 02:59:25.287273 3796111 cri.go:89] found id: ""
I0127 02:59:25.287281 3796111 logs.go:282] 2 containers: [913dba7b3bede3cb8e1b77be0a25d981b94c7ef9011ec91d80f77d6b7afc771b 8d9862575a02aedaa20cbdbc29f350c7d048f408b17d76e6899b001882f093b9]
I0127 02:59:25.287350 3796111 ssh_runner.go:195] Run: which crictl
I0127 02:59:25.291869 3796111 ssh_runner.go:195] Run: which crictl
I0127 02:59:25.296041 3796111 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
I0127 02:59:25.296114 3796111 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0127 02:59:25.353617 3796111 cri.go:89] found id: "80de12a579f093bfca496c919408519334bb6b6962effaec3c52c2cef2014477"
I0127 02:59:25.353636 3796111 cri.go:89] found id: "2333f389a3e6eb63094687bfb2df8df33f3fdb8498fc24f92452e8fffd240cca"
I0127 02:59:25.353641 3796111 cri.go:89] found id: ""
I0127 02:59:25.353648 3796111 logs.go:282] 2 containers: [80de12a579f093bfca496c919408519334bb6b6962effaec3c52c2cef2014477 2333f389a3e6eb63094687bfb2df8df33f3fdb8498fc24f92452e8fffd240cca]
I0127 02:59:25.353712 3796111 ssh_runner.go:195] Run: which crictl
I0127 02:59:25.358444 3796111 ssh_runner.go:195] Run: which crictl
I0127 02:59:25.362671 3796111 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
I0127 02:59:25.362745 3796111 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0127 02:59:25.420248 3796111 cri.go:89] found id: "6868e5588e2518b2dbbee5fcdc288ff7639c3e6d27152b25c2d92a94144279e8"
I0127 02:59:25.420268 3796111 cri.go:89] found id: "d422478362adb4ddd09d8598be12970c37fc3c672548faefb895f3b8924598a3"
I0127 02:59:25.420273 3796111 cri.go:89] found id: ""
I0127 02:59:25.420280 3796111 logs.go:282] 2 containers: [6868e5588e2518b2dbbee5fcdc288ff7639c3e6d27152b25c2d92a94144279e8 d422478362adb4ddd09d8598be12970c37fc3c672548faefb895f3b8924598a3]
I0127 02:59:25.420338 3796111 ssh_runner.go:195] Run: which crictl
I0127 02:59:25.425743 3796111 ssh_runner.go:195] Run: which crictl
I0127 02:59:25.432269 3796111 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
I0127 02:59:25.432340 3796111 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0127 02:59:25.493625 3796111 cri.go:89] found id: "1eebf1b8ced6916d55f7a34166585a17437e60b2716ed0809ac349c450b4e754"
I0127 02:59:25.493696 3796111 cri.go:89] found id: "a7fa3720da9a726a9f6f8d791e969823b89c23d447e9434ee4a64f80336f7aa2"
I0127 02:59:25.493715 3796111 cri.go:89] found id: ""
I0127 02:59:25.493738 3796111 logs.go:282] 2 containers: [1eebf1b8ced6916d55f7a34166585a17437e60b2716ed0809ac349c450b4e754 a7fa3720da9a726a9f6f8d791e969823b89c23d447e9434ee4a64f80336f7aa2]
I0127 02:59:25.493833 3796111 ssh_runner.go:195] Run: which crictl
I0127 02:59:25.499566 3796111 ssh_runner.go:195] Run: which crictl
I0127 02:59:25.504443 3796111 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
I0127 02:59:25.504514 3796111 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0127 02:59:25.580657 3796111 cri.go:89] found id: "60bc065c8667a83052202f7fc37006df6160a0f60502485d3fe888d752f6e93e"
I0127 02:59:25.580678 3796111 cri.go:89] found id: "0f4ff9b6b17b830c0f2505936c14a703649af8de56a7960df790d5e970f75414"
I0127 02:59:25.580683 3796111 cri.go:89] found id: ""
I0127 02:59:25.580690 3796111 logs.go:282] 2 containers: [60bc065c8667a83052202f7fc37006df6160a0f60502485d3fe888d752f6e93e 0f4ff9b6b17b830c0f2505936c14a703649af8de56a7960df790d5e970f75414]
I0127 02:59:25.580745 3796111 ssh_runner.go:195] Run: which crictl
I0127 02:59:25.587524 3796111 ssh_runner.go:195] Run: which crictl
I0127 02:59:25.592431 3796111 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
I0127 02:59:25.592584 3796111 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0127 02:59:25.652963 3796111 cri.go:89] found id: "792e1bf0751e8fad4834403cd7db06cfbd9065c482e6c7b3bcf4c0c2b1a373d1"
I0127 02:59:25.653037 3796111 cri.go:89] found id: "17ad11f28e20777140f3d682704f30e56a34c3f85630bf0758795ca29f6f719a"
I0127 02:59:25.653056 3796111 cri.go:89] found id: ""
I0127 02:59:25.653080 3796111 logs.go:282] 2 containers: [792e1bf0751e8fad4834403cd7db06cfbd9065c482e6c7b3bcf4c0c2b1a373d1 17ad11f28e20777140f3d682704f30e56a34c3f85630bf0758795ca29f6f719a]
I0127 02:59:25.653174 3796111 ssh_runner.go:195] Run: which crictl
I0127 02:59:25.658424 3796111 ssh_runner.go:195] Run: which crictl
I0127 02:59:25.664336 3796111 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
I0127 02:59:25.664466 3796111 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I0127 02:59:25.739132 3796111 cri.go:89] found id: "3e757cf47e5bf46aadd2d0209c944ee653ff40decba0a43ed51c38657b7ac9a8"
I0127 02:59:25.739205 3796111 cri.go:89] found id: ""
I0127 02:59:25.739229 3796111 logs.go:282] 1 containers: [3e757cf47e5bf46aadd2d0209c944ee653ff40decba0a43ed51c38657b7ac9a8]
I0127 02:59:25.739320 3796111 ssh_runner.go:195] Run: which crictl
I0127 02:59:25.743622 3796111 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
I0127 02:59:25.743746 3796111 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0127 02:59:25.846595 3796111 cri.go:89] found id: "ca016e85c640cc59943efbf83715a2c4e1dcf8cc8020f4a480ba90214108c3ae"
I0127 02:59:25.846658 3796111 cri.go:89] found id: "5966fc744604d7bfd40d7701102f774e0d749dd772fdb69dbfbe01827d86cd21"
I0127 02:59:25.846686 3796111 cri.go:89] found id: ""
I0127 02:59:25.846705 3796111 logs.go:282] 2 containers: [ca016e85c640cc59943efbf83715a2c4e1dcf8cc8020f4a480ba90214108c3ae 5966fc744604d7bfd40d7701102f774e0d749dd772fdb69dbfbe01827d86cd21]
I0127 02:59:25.846798 3796111 ssh_runner.go:195] Run: which crictl
I0127 02:59:25.851520 3796111 ssh_runner.go:195] Run: which crictl
I0127 02:59:25.856633 3796111 logs.go:123] Gathering logs for kindnet [17ad11f28e20777140f3d682704f30e56a34c3f85630bf0758795ca29f6f719a] ...
I0127 02:59:25.856708 3796111 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 17ad11f28e20777140f3d682704f30e56a34c3f85630bf0758795ca29f6f719a"
I0127 02:59:25.916964 3796111 logs.go:123] Gathering logs for storage-provisioner [ca016e85c640cc59943efbf83715a2c4e1dcf8cc8020f4a480ba90214108c3ae] ...
I0127 02:59:25.917144 3796111 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 ca016e85c640cc59943efbf83715a2c4e1dcf8cc8020f4a480ba90214108c3ae"
I0127 02:59:25.972487 3796111 logs.go:123] Gathering logs for containerd ...
I0127 02:59:25.972512 3796111 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
I0127 02:59:26.054510 3796111 logs.go:123] Gathering logs for describe nodes ...
I0127 02:59:26.054548 3796111 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0127 02:59:26.207339 3796111 logs.go:123] Gathering logs for kube-apiserver [f1ff631138f971f0d0175bbdad8dae389b0bb6d344b9c6a0c0ee143eb981fd26] ...
I0127 02:59:26.207370 3796111 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 f1ff631138f971f0d0175bbdad8dae389b0bb6d344b9c6a0c0ee143eb981fd26"
I0127 02:59:26.265602 3796111 logs.go:123] Gathering logs for etcd [913dba7b3bede3cb8e1b77be0a25d981b94c7ef9011ec91d80f77d6b7afc771b] ...
I0127 02:59:26.265637 3796111 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 913dba7b3bede3cb8e1b77be0a25d981b94c7ef9011ec91d80f77d6b7afc771b"
I0127 02:59:26.318707 3796111 logs.go:123] Gathering logs for kube-scheduler [6868e5588e2518b2dbbee5fcdc288ff7639c3e6d27152b25c2d92a94144279e8] ...
I0127 02:59:26.318739 3796111 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 6868e5588e2518b2dbbee5fcdc288ff7639c3e6d27152b25c2d92a94144279e8"
I0127 02:59:26.361129 3796111 logs.go:123] Gathering logs for kube-proxy [1eebf1b8ced6916d55f7a34166585a17437e60b2716ed0809ac349c450b4e754] ...
I0127 02:59:26.361156 3796111 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 1eebf1b8ced6916d55f7a34166585a17437e60b2716ed0809ac349c450b4e754"
I0127 02:59:26.413909 3796111 logs.go:123] Gathering logs for kube-controller-manager [0f4ff9b6b17b830c0f2505936c14a703649af8de56a7960df790d5e970f75414] ...
I0127 02:59:26.413937 3796111 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 0f4ff9b6b17b830c0f2505936c14a703649af8de56a7960df790d5e970f75414"
I0127 02:59:26.493497 3796111 logs.go:123] Gathering logs for kindnet [792e1bf0751e8fad4834403cd7db06cfbd9065c482e6c7b3bcf4c0c2b1a373d1] ...
I0127 02:59:26.493585 3796111 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 792e1bf0751e8fad4834403cd7db06cfbd9065c482e6c7b3bcf4c0c2b1a373d1"
I0127 02:59:26.544762 3796111 logs.go:123] Gathering logs for kubernetes-dashboard [3e757cf47e5bf46aadd2d0209c944ee653ff40decba0a43ed51c38657b7ac9a8] ...
I0127 02:59:26.544794 3796111 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 3e757cf47e5bf46aadd2d0209c944ee653ff40decba0a43ed51c38657b7ac9a8"
I0127 02:59:26.595658 3796111 logs.go:123] Gathering logs for dmesg ...
I0127 02:59:26.595688 3796111 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0127 02:59:26.613129 3796111 logs.go:123] Gathering logs for kube-apiserver [ae3fb4241ae87bccf92d74ec50fcca30938fee4da6ee2129c5306d476811e810] ...
I0127 02:59:26.613204 3796111 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 ae3fb4241ae87bccf92d74ec50fcca30938fee4da6ee2129c5306d476811e810"
I0127 02:59:26.669414 3796111 logs.go:123] Gathering logs for coredns [80de12a579f093bfca496c919408519334bb6b6962effaec3c52c2cef2014477] ...
I0127 02:59:26.669490 3796111 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 80de12a579f093bfca496c919408519334bb6b6962effaec3c52c2cef2014477"
I0127 02:59:26.717840 3796111 logs.go:123] Gathering logs for coredns [2333f389a3e6eb63094687bfb2df8df33f3fdb8498fc24f92452e8fffd240cca] ...
I0127 02:59:26.717869 3796111 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 2333f389a3e6eb63094687bfb2df8df33f3fdb8498fc24f92452e8fffd240cca"
I0127 02:59:26.757167 3796111 logs.go:123] Gathering logs for kube-proxy [a7fa3720da9a726a9f6f8d791e969823b89c23d447e9434ee4a64f80336f7aa2] ...
I0127 02:59:26.757196 3796111 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 a7fa3720da9a726a9f6f8d791e969823b89c23d447e9434ee4a64f80336f7aa2"
I0127 02:59:26.798051 3796111 logs.go:123] Gathering logs for container status ...
I0127 02:59:26.798086 3796111 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0127 02:59:26.845207 3796111 logs.go:123] Gathering logs for kubelet ...
I0127 02:59:26.845236 3796111 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0127 02:59:26.909018 3796111 logs.go:138] Found kubelet problem: Jan 27 02:53:51 old-k8s-version-949994 kubelet[660]: E0127 02:53:51.967126 660 reflector.go:138] object-"default"/"default-token-gqprk": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "default-token-gqprk" is forbidden: User "system:node:old-k8s-version-949994" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'old-k8s-version-949994' and this object
W0127 02:59:26.909268 3796111 logs.go:138] Found kubelet problem: Jan 27 02:53:51 old-k8s-version-949994 kubelet[660]: E0127 02:53:51.967200 660 reflector.go:138] object-"kube-system"/"coredns": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:old-k8s-version-949994" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-949994' and this object
W0127 02:59:26.909505 3796111 logs.go:138] Found kubelet problem: Jan 27 02:53:51 old-k8s-version-949994 kubelet[660]: E0127 02:53:51.967258 660 reflector.go:138] object-"kube-system"/"kindnet-token-ghd6s": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kindnet-token-ghd6s" is forbidden: User "system:node:old-k8s-version-949994" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-949994' and this object
W0127 02:59:26.909756 3796111 logs.go:138] Found kubelet problem: Jan 27 02:53:51 old-k8s-version-949994 kubelet[660]: E0127 02:53:51.967336 660 reflector.go:138] object-"kube-system"/"storage-provisioner-token-6zk7s": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "storage-provisioner-token-6zk7s" is forbidden: User "system:node:old-k8s-version-949994" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-949994' and this object
W0127 02:59:26.909988 3796111 logs.go:138] Found kubelet problem: Jan 27 02:53:51 old-k8s-version-949994 kubelet[660]: E0127 02:53:51.967387 660 reflector.go:138] object-"kube-system"/"coredns-token-l287g": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "coredns-token-l287g" is forbidden: User "system:node:old-k8s-version-949994" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-949994' and this object
W0127 02:59:26.910228 3796111 logs.go:138] Found kubelet problem: Jan 27 02:53:51 old-k8s-version-949994 kubelet[660]: E0127 02:53:51.967447 660 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:old-k8s-version-949994" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-949994' and this object
W0127 02:59:26.910466 3796111 logs.go:138] Found kubelet problem: Jan 27 02:53:51 old-k8s-version-949994 kubelet[660]: E0127 02:53:51.967496 660 reflector.go:138] object-"kube-system"/"kube-proxy-token-54qrt": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kube-proxy-token-54qrt" is forbidden: User "system:node:old-k8s-version-949994" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-949994' and this object
W0127 02:59:26.918459 3796111 logs.go:138] Found kubelet problem: Jan 27 02:53:53 old-k8s-version-949994 kubelet[660]: E0127 02:53:53.876531 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0127 02:59:26.918698 3796111 logs.go:138] Found kubelet problem: Jan 27 02:53:54 old-k8s-version-949994 kubelet[660]: E0127 02:53:54.021725 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0127 02:59:26.925130 3796111 logs.go:138] Found kubelet problem: Jan 27 02:54:09 old-k8s-version-949994 kubelet[660]: E0127 02:54:09.521072 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0127 02:59:26.927635 3796111 logs.go:138] Found kubelet problem: Jan 27 02:54:22 old-k8s-version-949994 kubelet[660]: E0127 02:54:22.278637 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
W0127 02:59:26.927828 3796111 logs.go:138] Found kubelet problem: Jan 27 02:54:22 old-k8s-version-949994 kubelet[660]: E0127 02:54:22.504207 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0127 02:59:26.928157 3796111 logs.go:138] Found kubelet problem: Jan 27 02:54:23 old-k8s-version-949994 kubelet[660]: E0127 02:54:23.282663 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
W0127 02:59:26.928494 3796111 logs.go:138] Found kubelet problem: Jan 27 02:54:24 old-k8s-version-949994 kubelet[660]: E0127 02:54:24.284977 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
W0127 02:59:26.929099 3796111 logs.go:138] Found kubelet problem: Jan 27 02:54:26 old-k8s-version-949994 kubelet[660]: E0127 02:54:26.292140 660 pod_workers.go:191] Error syncing pod 2b0aa32b-1180-4a97-8374-d786d139dc2c ("storage-provisioner_kube-system(2b0aa32b-1180-4a97-8374-d786d139dc2c)"), skipping: failed to "StartContainer" for "storage-provisioner" with CrashLoopBackOff: "back-off 10s restarting failed container=storage-provisioner pod=storage-provisioner_kube-system(2b0aa32b-1180-4a97-8374-d786d139dc2c)"
W0127 02:59:26.932158 3796111 logs.go:138] Found kubelet problem: Jan 27 02:54:37 old-k8s-version-949994 kubelet[660]: E0127 02:54:37.511569 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0127 02:59:26.932846 3796111 logs.go:138] Found kubelet problem: Jan 27 02:54:39 old-k8s-version-949994 kubelet[660]: E0127 02:54:39.335961 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
W0127 02:59:26.933330 3796111 logs.go:138] Found kubelet problem: Jan 27 02:54:42 old-k8s-version-949994 kubelet[660]: E0127 02:54:42.579255 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
W0127 02:59:26.933538 3796111 logs.go:138] Found kubelet problem: Jan 27 02:54:48 old-k8s-version-949994 kubelet[660]: E0127 02:54:48.501857 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0127 02:59:26.933886 3796111 logs.go:138] Found kubelet problem: Jan 27 02:54:53 old-k8s-version-949994 kubelet[660]: E0127 02:54:53.502843 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
W0127 02:59:26.934090 3796111 logs.go:138] Found kubelet problem: Jan 27 02:55:00 old-k8s-version-949994 kubelet[660]: E0127 02:55:00.501841 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0127 02:59:26.934727 3796111 logs.go:138] Found kubelet problem: Jan 27 02:55:07 old-k8s-version-949994 kubelet[660]: E0127 02:55:07.426639 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
W0127 02:59:26.935133 3796111 logs.go:138] Found kubelet problem: Jan 27 02:55:12 old-k8s-version-949994 kubelet[660]: E0127 02:55:12.579010 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
W0127 02:59:26.935339 3796111 logs.go:138] Found kubelet problem: Jan 27 02:55:13 old-k8s-version-949994 kubelet[660]: E0127 02:55:13.501799 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0127 02:59:26.938047 3796111 logs.go:138] Found kubelet problem: Jan 27 02:55:24 old-k8s-version-949994 kubelet[660]: E0127 02:55:24.528464 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0127 02:59:26.938415 3796111 logs.go:138] Found kubelet problem: Jan 27 02:55:25 old-k8s-version-949994 kubelet[660]: E0127 02:55:25.501540 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
W0127 02:59:26.938630 3796111 logs.go:138] Found kubelet problem: Jan 27 02:55:36 old-k8s-version-949994 kubelet[660]: E0127 02:55:36.501984 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0127 02:59:26.938994 3796111 logs.go:138] Found kubelet problem: Jan 27 02:55:37 old-k8s-version-949994 kubelet[660]: E0127 02:55:37.501584 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
W0127 02:59:26.939204 3796111 logs.go:138] Found kubelet problem: Jan 27 02:55:49 old-k8s-version-949994 kubelet[660]: E0127 02:55:49.505318 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0127 02:59:26.939825 3796111 logs.go:138] Found kubelet problem: Jan 27 02:55:51 old-k8s-version-949994 kubelet[660]: E0127 02:55:51.546741 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
W0127 02:59:26.940171 3796111 logs.go:138] Found kubelet problem: Jan 27 02:55:52 old-k8s-version-949994 kubelet[660]: E0127 02:55:52.578558 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
W0127 02:59:26.940412 3796111 logs.go:138] Found kubelet problem: Jan 27 02:56:03 old-k8s-version-949994 kubelet[660]: E0127 02:56:03.501771 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0127 02:59:26.940764 3796111 logs.go:138] Found kubelet problem: Jan 27 02:56:06 old-k8s-version-949994 kubelet[660]: E0127 02:56:06.501392 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
W0127 02:59:26.940981 3796111 logs.go:138] Found kubelet problem: Jan 27 02:56:14 old-k8s-version-949994 kubelet[660]: E0127 02:56:14.502372 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0127 02:59:26.941335 3796111 logs.go:138] Found kubelet problem: Jan 27 02:56:17 old-k8s-version-949994 kubelet[660]: E0127 02:56:17.501933 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
W0127 02:59:26.941568 3796111 logs.go:138] Found kubelet problem: Jan 27 02:56:26 old-k8s-version-949994 kubelet[660]: E0127 02:56:26.501683 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0127 02:59:26.941996 3796111 logs.go:138] Found kubelet problem: Jan 27 02:56:32 old-k8s-version-949994 kubelet[660]: E0127 02:56:32.501823 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
W0127 02:59:26.942196 3796111 logs.go:138] Found kubelet problem: Jan 27 02:56:40 old-k8s-version-949994 kubelet[660]: E0127 02:56:40.501634 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0127 02:59:26.942555 3796111 logs.go:138] Found kubelet problem: Jan 27 02:56:45 old-k8s-version-949994 kubelet[660]: E0127 02:56:45.502780 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
W0127 02:59:26.945106 3796111 logs.go:138] Found kubelet problem: Jan 27 02:56:55 old-k8s-version-949994 kubelet[660]: E0127 02:56:55.514866 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
W0127 02:59:26.945463 3796111 logs.go:138] Found kubelet problem: Jan 27 02:56:56 old-k8s-version-949994 kubelet[660]: E0127 02:56:56.501563 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
W0127 02:59:26.945853 3796111 logs.go:138] Found kubelet problem: Jan 27 02:57:07 old-k8s-version-949994 kubelet[660]: E0127 02:57:07.501947 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
W0127 02:59:26.946094 3796111 logs.go:138] Found kubelet problem: Jan 27 02:57:10 old-k8s-version-949994 kubelet[660]: E0127 02:57:10.502918 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0127 02:59:26.946801 3796111 logs.go:138] Found kubelet problem: Jan 27 02:57:21 old-k8s-version-949994 kubelet[660]: E0127 02:57:21.776454 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
W0127 02:59:26.947158 3796111 logs.go:138] Found kubelet problem: Jan 27 02:57:22 old-k8s-version-949994 kubelet[660]: E0127 02:57:22.780516 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
W0127 02:59:26.947364 3796111 logs.go:138] Found kubelet problem: Jan 27 02:57:23 old-k8s-version-949994 kubelet[660]: E0127 02:57:23.505620 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0127 02:59:26.947572 3796111 logs.go:138] Found kubelet problem: Jan 27 02:57:34 old-k8s-version-949994 kubelet[660]: E0127 02:57:34.501538 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0127 02:59:26.947920 3796111 logs.go:138] Found kubelet problem: Jan 27 02:57:35 old-k8s-version-949994 kubelet[660]: E0127 02:57:35.501481 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
W0127 02:59:26.948269 3796111 logs.go:138] Found kubelet problem: Jan 27 02:57:48 old-k8s-version-949994 kubelet[660]: E0127 02:57:48.503510 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
W0127 02:59:26.948518 3796111 logs.go:138] Found kubelet problem: Jan 27 02:57:49 old-k8s-version-949994 kubelet[660]: E0127 02:57:49.501969 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0127 02:59:26.949022 3796111 logs.go:138] Found kubelet problem: Jan 27 02:57:59 old-k8s-version-949994 kubelet[660]: E0127 02:57:59.502983 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
W0127 02:59:26.949233 3796111 logs.go:138] Found kubelet problem: Jan 27 02:58:00 old-k8s-version-949994 kubelet[660]: E0127 02:58:00.501586 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0127 02:59:26.949595 3796111 logs.go:138] Found kubelet problem: Jan 27 02:58:10 old-k8s-version-949994 kubelet[660]: E0127 02:58:10.501269 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
W0127 02:59:26.949802 3796111 logs.go:138] Found kubelet problem: Jan 27 02:58:15 old-k8s-version-949994 kubelet[660]: E0127 02:58:15.501889 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0127 02:59:26.950158 3796111 logs.go:138] Found kubelet problem: Jan 27 02:58:21 old-k8s-version-949994 kubelet[660]: E0127 02:58:21.501389 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
W0127 02:59:26.950395 3796111 logs.go:138] Found kubelet problem: Jan 27 02:58:28 old-k8s-version-949994 kubelet[660]: E0127 02:58:28.501733 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0127 02:59:26.950751 3796111 logs.go:138] Found kubelet problem: Jan 27 02:58:34 old-k8s-version-949994 kubelet[660]: E0127 02:58:34.501213 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
W0127 02:59:26.950961 3796111 logs.go:138] Found kubelet problem: Jan 27 02:58:43 old-k8s-version-949994 kubelet[660]: E0127 02:58:43.501567 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0127 02:59:26.951309 3796111 logs.go:138] Found kubelet problem: Jan 27 02:58:48 old-k8s-version-949994 kubelet[660]: E0127 02:58:48.502462 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
W0127 02:59:26.951528 3796111 logs.go:138] Found kubelet problem: Jan 27 02:58:55 old-k8s-version-949994 kubelet[660]: E0127 02:58:55.501821 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0127 02:59:26.951914 3796111 logs.go:138] Found kubelet problem: Jan 27 02:59:00 old-k8s-version-949994 kubelet[660]: E0127 02:59:00.502866 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
W0127 02:59:26.952124 3796111 logs.go:138] Found kubelet problem: Jan 27 02:59:07 old-k8s-version-949994 kubelet[660]: E0127 02:59:07.502977 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0127 02:59:26.952532 3796111 logs.go:138] Found kubelet problem: Jan 27 02:59:14 old-k8s-version-949994 kubelet[660]: E0127 02:59:14.501372 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
W0127 02:59:26.953020 3796111 logs.go:138] Found kubelet problem: Jan 27 02:59:18 old-k8s-version-949994 kubelet[660]: E0127 02:59:18.502650 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0127 02:59:26.953379 3796111 logs.go:138] Found kubelet problem: Jan 27 02:59:26 old-k8s-version-949994 kubelet[660]: E0127 02:59:26.501368 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
I0127 02:59:26.953395 3796111 logs.go:123] Gathering logs for etcd [8d9862575a02aedaa20cbdbc29f350c7d048f408b17d76e6899b001882f093b9] ...
I0127 02:59:26.953420 3796111 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 8d9862575a02aedaa20cbdbc29f350c7d048f408b17d76e6899b001882f093b9"
I0127 02:59:27.014044 3796111 logs.go:123] Gathering logs for kube-scheduler [d422478362adb4ddd09d8598be12970c37fc3c672548faefb895f3b8924598a3] ...
I0127 02:59:27.014093 3796111 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 d422478362adb4ddd09d8598be12970c37fc3c672548faefb895f3b8924598a3"
I0127 02:59:27.059697 3796111 logs.go:123] Gathering logs for kube-controller-manager [60bc065c8667a83052202f7fc37006df6160a0f60502485d3fe888d752f6e93e] ...
I0127 02:59:27.059730 3796111 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 60bc065c8667a83052202f7fc37006df6160a0f60502485d3fe888d752f6e93e"
I0127 02:59:27.129429 3796111 logs.go:123] Gathering logs for storage-provisioner [5966fc744604d7bfd40d7701102f774e0d749dd772fdb69dbfbe01827d86cd21] ...
I0127 02:59:27.129470 3796111 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 5966fc744604d7bfd40d7701102f774e0d749dd772fdb69dbfbe01827d86cd21"
I0127 02:59:27.169921 3796111 out.go:358] Setting ErrFile to fd 2...
I0127 02:59:27.169952 3796111 out.go:392] TERM=,COLORTERM=, which probably does not support color
W0127 02:59:27.170000 3796111 out.go:270] X Problems detected in kubelet:
W0127 02:59:27.170013 3796111 out.go:270] Jan 27 02:59:00 old-k8s-version-949994 kubelet[660]: E0127 02:59:00.502866 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
W0127 02:59:27.170021 3796111 out.go:270] Jan 27 02:59:07 old-k8s-version-949994 kubelet[660]: E0127 02:59:07.502977 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0127 02:59:27.170035 3796111 out.go:270] Jan 27 02:59:14 old-k8s-version-949994 kubelet[660]: E0127 02:59:14.501372 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
W0127 02:59:27.170041 3796111 out.go:270] Jan 27 02:59:18 old-k8s-version-949994 kubelet[660]: E0127 02:59:18.502650 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0127 02:59:27.170051 3796111 out.go:270] Jan 27 02:59:26 old-k8s-version-949994 kubelet[660]: E0127 02:59:26.501368 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
I0127 02:59:27.170057 3796111 out.go:358] Setting ErrFile to fd 2...
I0127 02:59:27.170066 3796111 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0127 02:59:25.016018 3805055 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap
I0127 02:59:25.020386 3805055 cni.go:182] applying CNI manifest using /var/lib/minikube/binaries/v1.32.1/kubectl ...
I0127 02:59:25.020408 3805055 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2601 bytes)
I0127 02:59:25.041216 3805055 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.32.1/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
I0127 02:59:25.547951 3805055 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
I0127 02:59:25.548107 3805055 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.32.1/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
I0127 02:59:25.548155 3805055 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.32.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes embed-certs-579827 minikube.k8s.io/updated_at=2025_01_27T02_59_25_0700 minikube.k8s.io/version=v1.35.0 minikube.k8s.io/commit=6bb462d349d93b9bf1c5a4f87817e5e9ea11cc95 minikube.k8s.io/name=embed-certs-579827 minikube.k8s.io/primary=true
I0127 02:59:25.869409 3805055 ops.go:34] apiserver oom_adj: -16
I0127 02:59:25.869529 3805055 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.32.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0127 02:59:26.370214 3805055 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.32.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0127 02:59:26.869629 3805055 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.32.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0127 02:59:27.369565 3805055 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.32.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0127 02:59:27.870408 3805055 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.32.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0127 02:59:28.369634 3805055 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.32.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0127 02:59:28.870528 3805055 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.32.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0127 02:59:29.370301 3805055 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.32.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0127 02:59:29.496179 3805055 kubeadm.go:1113] duration metric: took 3.948138748s to wait for elevateKubeSystemPrivileges
I0127 02:59:29.496205 3805055 kubeadm.go:394] duration metric: took 23.885958547s to StartCluster
I0127 02:59:29.496222 3805055 settings.go:142] acquiring lock: {Name:mk735c76882f337c2ca62b3dd2d1bbcced4c92cb Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0127 02:59:29.496282 3805055 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/20316-3581420/kubeconfig
I0127 02:59:29.497684 3805055 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20316-3581420/kubeconfig: {Name:mkc8ad8c78feebc7c27d31aea066c6fc5e1767bd Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0127 02:59:29.497897 3805055 start.go:235] Will wait 6m0s for node &{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.32.1 ContainerRuntime:containerd ControlPlane:true Worker:true}
I0127 02:59:29.498034 3805055 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.32.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
I0127 02:59:29.498408 3805055 config.go:182] Loaded profile config "embed-certs-579827": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.32.1
I0127 02:59:29.498457 3805055 addons.go:511] enable addons start: toEnable=map[ambassador:false amd-gpu-device-plugin:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]
I0127 02:59:29.498534 3805055 addons.go:69] Setting storage-provisioner=true in profile "embed-certs-579827"
I0127 02:59:29.498555 3805055 addons.go:238] Setting addon storage-provisioner=true in "embed-certs-579827"
I0127 02:59:29.498580 3805055 host.go:66] Checking if "embed-certs-579827" exists ...
I0127 02:59:29.498961 3805055 addons.go:69] Setting default-storageclass=true in profile "embed-certs-579827"
I0127 02:59:29.498984 3805055 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "embed-certs-579827"
I0127 02:59:29.499190 3805055 cli_runner.go:164] Run: docker container inspect embed-certs-579827 --format={{.State.Status}}
I0127 02:59:29.499310 3805055 cli_runner.go:164] Run: docker container inspect embed-certs-579827 --format={{.State.Status}}
I0127 02:59:29.500958 3805055 out.go:177] * Verifying Kubernetes components...
I0127 02:59:29.505053 3805055 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0127 02:59:29.538004 3805055 addons.go:238] Setting addon default-storageclass=true in "embed-certs-579827"
I0127 02:59:29.538045 3805055 host.go:66] Checking if "embed-certs-579827" exists ...
I0127 02:59:29.538614 3805055 cli_runner.go:164] Run: docker container inspect embed-certs-579827 --format={{.State.Status}}
I0127 02:59:29.547151 3805055 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0127 02:59:29.550120 3805055 addons.go:435] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0127 02:59:29.550147 3805055 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0127 02:59:29.550214 3805055 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-579827
I0127 02:59:29.586961 3805055 addons.go:435] installing /etc/kubernetes/addons/storageclass.yaml
I0127 02:59:29.586984 3805055 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0127 02:59:29.587046 3805055 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-579827
I0127 02:59:29.592981 3805055 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:37791 SSHKeyPath:/home/jenkins/minikube-integration/20316-3581420/.minikube/machines/embed-certs-579827/id_rsa Username:docker}
I0127 02:59:29.618740 3805055 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:37791 SSHKeyPath:/home/jenkins/minikube-integration/20316-3581420/.minikube/machines/embed-certs-579827/id_rsa Username:docker}
I0127 02:59:29.854998 3805055 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0127 02:59:29.884895 3805055 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.32.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^ forward . \/etc\/resolv.conf.*/i \ hosts {\n 192.168.85.1 host.minikube.internal\n fallthrough\n }' -e '/^ errors *$/i \ log' | sudo /var/lib/minikube/binaries/v1.32.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
I0127 02:59:29.884999 3805055 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0127 02:59:29.889554 3805055 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0127 02:59:30.915508 3805055 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (1.060474429s)
I0127 02:59:30.915624 3805055 ssh_runner.go:235] Completed: sudo systemctl start kubelet: (1.030606968s)
I0127 02:59:30.915682 3805055 ssh_runner.go:235] Completed: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.32.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^ forward . \/etc\/resolv.conf.*/i \ hosts {\n 192.168.85.1 host.minikube.internal\n fallthrough\n }' -e '/^ errors *$/i \ log' | sudo /var/lib/minikube/binaries/v1.32.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -": (1.030764224s)
I0127 02:59:30.915836 3805055 start.go:971] {"host.minikube.internal": 192.168.85.1} host record injected into CoreDNS's ConfigMap
I0127 02:59:30.915703 3805055 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (1.026131813s)
I0127 02:59:30.918265 3805055 node_ready.go:35] waiting up to 6m0s for node "embed-certs-579827" to be "Ready" ...
I0127 02:59:30.966839 3805055 node_ready.go:49] node "embed-certs-579827" has status "Ready":"True"
I0127 02:59:30.966914 3805055 node_ready.go:38] duration metric: took 48.525691ms for node "embed-certs-579827" to be "Ready" ...
I0127 02:59:30.966941 3805055 pod_ready.go:36] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0127 02:59:30.983581 3805055 pod_ready.go:79] waiting up to 6m0s for pod "coredns-668d6bf9bc-frvqr" in "kube-system" namespace to be "Ready" ...
I0127 02:59:30.993289 3805055 out.go:177] * Enabled addons: storage-provisioner, default-storageclass
I0127 02:59:30.996202 3805055 addons.go:514] duration metric: took 1.497733224s for enable addons: enabled=[storage-provisioner default-storageclass]
I0127 02:59:31.425521 3805055 kapi.go:214] "coredns" deployment in "kube-system" namespace and "embed-certs-579827" context rescaled to 1 replicas
I0127 02:59:32.989678 3805055 pod_ready.go:103] pod "coredns-668d6bf9bc-frvqr" in "kube-system" namespace has status "Ready":"False"
I0127 02:59:37.172121 3796111 api_server.go:253] Checking apiserver healthz at https://192.168.76.2:8443/healthz ...
I0127 02:59:37.181232 3796111 api_server.go:279] https://192.168.76.2:8443/healthz returned 200:
ok
I0127 02:59:37.184443 3796111 out.go:201]
W0127 02:59:37.187360 3796111 out.go:270] X Exiting due to K8S_UNHEALTHY_CONTROL_PLANE: wait 6m0s for node: wait for healthy API server: controlPlane never updated to v1.20.0
W0127 02:59:37.187406 3796111 out.go:270] * Suggestion: Control Plane could not update, try minikube delete --all --purge
W0127 02:59:37.187429 3796111 out.go:270] * Related issue: https://github.com/kubernetes/minikube/issues/11417
W0127 02:59:37.187435 3796111 out.go:270] *
W0127 02:59:37.188343 3796111 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0127 02:59:37.192140 3796111 out.go:201]
==> container status <==
CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID POD
8e12f3bd92557 523cad1a4df73 2 minutes ago Exited dashboard-metrics-scraper 5 f91133a68a94e dashboard-metrics-scraper-8d5bb5db8-wvx62
ca016e85c640c ba04bb24b9575 4 minutes ago Running storage-provisioner 3 e5efb2d9c6319 storage-provisioner
3e757cf47e5bf 20b332c9a70d8 5 minutes ago Running kubernetes-dashboard 0 c7ce7653d9b35 kubernetes-dashboard-cd95d586-9bnwh
792e1bf0751e8 2be0bcf609c65 5 minutes ago Running kindnet-cni 1 a335d5e635a4a kindnet-bcq52
5a9b35cdfa2e3 1611cd07b61d5 5 minutes ago Running busybox 1 a0efc575c5ac5 busybox
1eebf1b8ced69 25a5233254979 5 minutes ago Running kube-proxy 1 db6072908f129 kube-proxy-5hzlg
80de12a579f09 db91994f4ee8f 5 minutes ago Running coredns 1 ec3d66ddfd0e1 coredns-74ff55c5b-fbwzt
5966fc744604d ba04bb24b9575 5 minutes ago Exited storage-provisioner 2 e5efb2d9c6319 storage-provisioner
6868e5588e251 e7605f88f17d6 5 minutes ago Running kube-scheduler 1 d5fd4e74286f7 kube-scheduler-old-k8s-version-949994
913dba7b3bede 05b738aa1bc63 5 minutes ago Running etcd 1 c8ab2292cc8e0 etcd-old-k8s-version-949994
60bc065c8667a 1df8a2b116bd1 5 minutes ago Running kube-controller-manager 1 4ba1d572c629b kube-controller-manager-old-k8s-version-949994
f1ff631138f97 2c08bbbc02d3a 5 minutes ago Running kube-apiserver 1 6e298968924d7 kube-apiserver-old-k8s-version-949994
70b45a2ee4146 1611cd07b61d5 6 minutes ago Exited busybox 0 52dca43cebcb2 busybox
2333f389a3e6e db91994f4ee8f 8 minutes ago Exited coredns 0 5c3278ebdcc94 coredns-74ff55c5b-fbwzt
17ad11f28e207 2be0bcf609c65 8 minutes ago Exited kindnet-cni 0 f789da568db34 kindnet-bcq52
a7fa3720da9a7 25a5233254979 8 minutes ago Exited kube-proxy 0 a6ca0b0ba5cd7 kube-proxy-5hzlg
d422478362adb e7605f88f17d6 9 minutes ago Exited kube-scheduler 0 9c150a719d661 kube-scheduler-old-k8s-version-949994
8d9862575a02a 05b738aa1bc63 9 minutes ago Exited etcd 0 fa9d5d288f999 etcd-old-k8s-version-949994
0f4ff9b6b17b8 1df8a2b116bd1 9 minutes ago Exited kube-controller-manager 0 804bea710a235 kube-controller-manager-old-k8s-version-949994
ae3fb4241ae87 2c08bbbc02d3a 9 minutes ago Exited kube-apiserver 0 429c8054ccaae kube-apiserver-old-k8s-version-949994
==> containerd <==
Jan 27 02:55:24 old-k8s-version-949994 containerd[569]: time="2025-01-27T02:55:24.527176205Z" level=info msg="stop pulling image fake.domain/registry.k8s.io/echoserver:1.4: active requests=0, bytes read=0"
Jan 27 02:55:50 old-k8s-version-949994 containerd[569]: time="2025-01-27T02:55:50.519167064Z" level=info msg="CreateContainer within sandbox \"f91133a68a94ed3a34acfcf0d38823f434f11530b2b2abd3ad4e508df67feb08\" for container name:\"dashboard-metrics-scraper\" attempt:4"
Jan 27 02:55:50 old-k8s-version-949994 containerd[569]: time="2025-01-27T02:55:50.545408010Z" level=info msg="CreateContainer within sandbox \"f91133a68a94ed3a34acfcf0d38823f434f11530b2b2abd3ad4e508df67feb08\" for name:\"dashboard-metrics-scraper\" attempt:4 returns container id \"6ed7d41a0aae9c99029d583dfcde00a78d29b24b4f437bf4f802b1ef8b79cff9\""
Jan 27 02:55:50 old-k8s-version-949994 containerd[569]: time="2025-01-27T02:55:50.546472983Z" level=info msg="StartContainer for \"6ed7d41a0aae9c99029d583dfcde00a78d29b24b4f437bf4f802b1ef8b79cff9\""
Jan 27 02:55:50 old-k8s-version-949994 containerd[569]: time="2025-01-27T02:55:50.616540025Z" level=info msg="StartContainer for \"6ed7d41a0aae9c99029d583dfcde00a78d29b24b4f437bf4f802b1ef8b79cff9\" returns successfully"
Jan 27 02:55:50 old-k8s-version-949994 containerd[569]: time="2025-01-27T02:55:50.616776148Z" level=info msg="received exit event container_id:\"6ed7d41a0aae9c99029d583dfcde00a78d29b24b4f437bf4f802b1ef8b79cff9\" id:\"6ed7d41a0aae9c99029d583dfcde00a78d29b24b4f437bf4f802b1ef8b79cff9\" pid:3052 exit_status:255 exited_at:{seconds:1737946550 nanos:614414682}"
Jan 27 02:55:50 old-k8s-version-949994 containerd[569]: time="2025-01-27T02:55:50.643460155Z" level=info msg="shim disconnected" id=6ed7d41a0aae9c99029d583dfcde00a78d29b24b4f437bf4f802b1ef8b79cff9 namespace=k8s.io
Jan 27 02:55:50 old-k8s-version-949994 containerd[569]: time="2025-01-27T02:55:50.643667257Z" level=warning msg="cleaning up after shim disconnected" id=6ed7d41a0aae9c99029d583dfcde00a78d29b24b4f437bf4f802b1ef8b79cff9 namespace=k8s.io
Jan 27 02:55:50 old-k8s-version-949994 containerd[569]: time="2025-01-27T02:55:50.643695580Z" level=info msg="cleaning up dead shim" namespace=k8s.io
Jan 27 02:55:51 old-k8s-version-949994 containerd[569]: time="2025-01-27T02:55:51.548162552Z" level=info msg="RemoveContainer for \"0a7a8a94135bf89ed8f15bdee8e8a803456ec1d823f78707e4ca6237f4985b50\""
Jan 27 02:55:51 old-k8s-version-949994 containerd[569]: time="2025-01-27T02:55:51.554254639Z" level=info msg="RemoveContainer for \"0a7a8a94135bf89ed8f15bdee8e8a803456ec1d823f78707e4ca6237f4985b50\" returns successfully"
Jan 27 02:56:55 old-k8s-version-949994 containerd[569]: time="2025-01-27T02:56:55.507126436Z" level=info msg="PullImage \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jan 27 02:56:55 old-k8s-version-949994 containerd[569]: time="2025-01-27T02:56:55.512174067Z" level=info msg="trying next host" error="failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host" host=fake.domain
Jan 27 02:56:55 old-k8s-version-949994 containerd[569]: time="2025-01-27T02:56:55.514262600Z" level=info msg="stop pulling image fake.domain/registry.k8s.io/echoserver:1.4: active requests=0, bytes read=0"
Jan 27 02:56:55 old-k8s-version-949994 containerd[569]: time="2025-01-27T02:56:55.514261394Z" level=error msg="PullImage \"fake.domain/registry.k8s.io/echoserver:1.4\" failed" error="failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
Jan 27 02:57:21 old-k8s-version-949994 containerd[569]: time="2025-01-27T02:57:21.503591605Z" level=info msg="CreateContainer within sandbox \"f91133a68a94ed3a34acfcf0d38823f434f11530b2b2abd3ad4e508df67feb08\" for container name:\"dashboard-metrics-scraper\" attempt:5"
Jan 27 02:57:21 old-k8s-version-949994 containerd[569]: time="2025-01-27T02:57:21.523275531Z" level=info msg="CreateContainer within sandbox \"f91133a68a94ed3a34acfcf0d38823f434f11530b2b2abd3ad4e508df67feb08\" for name:\"dashboard-metrics-scraper\" attempt:5 returns container id \"8e12f3bd92557f98a8be94f4260bf8b0f480431b2afe4106b52f61a99e950ff5\""
Jan 27 02:57:21 old-k8s-version-949994 containerd[569]: time="2025-01-27T02:57:21.523958890Z" level=info msg="StartContainer for \"8e12f3bd92557f98a8be94f4260bf8b0f480431b2afe4106b52f61a99e950ff5\""
Jan 27 02:57:21 old-k8s-version-949994 containerd[569]: time="2025-01-27T02:57:21.590953802Z" level=info msg="StartContainer for \"8e12f3bd92557f98a8be94f4260bf8b0f480431b2afe4106b52f61a99e950ff5\" returns successfully"
Jan 27 02:57:21 old-k8s-version-949994 containerd[569]: time="2025-01-27T02:57:21.590967841Z" level=info msg="received exit event container_id:\"8e12f3bd92557f98a8be94f4260bf8b0f480431b2afe4106b52f61a99e950ff5\" id:\"8e12f3bd92557f98a8be94f4260bf8b0f480431b2afe4106b52f61a99e950ff5\" pid:3306 exit_status:255 exited_at:{seconds:1737946641 nanos:589629767}"
Jan 27 02:57:21 old-k8s-version-949994 containerd[569]: time="2025-01-27T02:57:21.614650087Z" level=info msg="shim disconnected" id=8e12f3bd92557f98a8be94f4260bf8b0f480431b2afe4106b52f61a99e950ff5 namespace=k8s.io
Jan 27 02:57:21 old-k8s-version-949994 containerd[569]: time="2025-01-27T02:57:21.614707858Z" level=warning msg="cleaning up after shim disconnected" id=8e12f3bd92557f98a8be94f4260bf8b0f480431b2afe4106b52f61a99e950ff5 namespace=k8s.io
Jan 27 02:57:21 old-k8s-version-949994 containerd[569]: time="2025-01-27T02:57:21.614719550Z" level=info msg="cleaning up dead shim" namespace=k8s.io
Jan 27 02:57:21 old-k8s-version-949994 containerd[569]: time="2025-01-27T02:57:21.778730721Z" level=info msg="RemoveContainer for \"6ed7d41a0aae9c99029d583dfcde00a78d29b24b4f437bf4f802b1ef8b79cff9\""
Jan 27 02:57:21 old-k8s-version-949994 containerd[569]: time="2025-01-27T02:57:21.795804573Z" level=info msg="RemoveContainer for \"6ed7d41a0aae9c99029d583dfcde00a78d29b24b4f437bf4f802b1ef8b79cff9\" returns successfully"
==> coredns [2333f389a3e6eb63094687bfb2df8df33f3fdb8498fc24f92452e8fffd240cca] <==
.:53
[INFO] plugin/reload: Running configuration MD5 = b494d968e357ba1b925cee838fbd78ed
CoreDNS-1.7.0
linux/arm64, go1.14.4, f59c03d
[INFO] 127.0.0.1:56592 - 36868 "HINFO IN 7803141744520437666.6111103402001657934. udp 57 false 512" NXDOMAIN qr,rd,ra 57 0.016340116s
==> coredns [80de12a579f093bfca496c919408519334bb6b6962effaec3c52c2cef2014477] <==
.:53
[INFO] plugin/reload: Running configuration MD5 = b494d968e357ba1b925cee838fbd78ed
CoreDNS-1.7.0
linux/arm64, go1.14.4, f59c03d
[INFO] 127.0.0.1:56612 - 38465 "HINFO IN 231689788770517344.4178049515579576848. udp 56 false 512" NXDOMAIN qr,rd,ra 56 0.026532326s
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/ready: Still waiting on: "kubernetes"
I0127 02:54:25.666025 1 trace.go:116] Trace[2019727887]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125 (started: 2025-01-27 02:53:55.665216673 +0000 UTC m=+0.043236747) (total time: 30.000707044s):
Trace[2019727887]: [30.000707044s] [30.000707044s] END
I0127 02:54:25.666289 1 trace.go:116] Trace[1427131847]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125 (started: 2025-01-27 02:53:55.665489866 +0000 UTC m=+0.043509949) (total time: 30.000752746s):
Trace[1427131847]: [30.000752746s] [30.000752746s] END
E0127 02:54:25.666313 1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to list *v1.Endpoints: Get "https://10.96.0.1:443/api/v1/endpoints?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
E0127 02:54:25.666290 1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to list *v1.Namespace: Get "https://10.96.0.1:443/api/v1/namespaces?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
I0127 02:54:25.666500 1 trace.go:116] Trace[911902081]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125 (started: 2025-01-27 02:53:55.665590796 +0000 UTC m=+0.043610862) (total time: 30.0008915s):
Trace[911902081]: [30.0008915s] [30.0008915s] END
E0127 02:54:25.666513 1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to list *v1.Service: Get "https://10.96.0.1:443/api/v1/services?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
==> describe nodes <==
Name: old-k8s-version-949994
Roles: control-plane,master
Labels: beta.kubernetes.io/arch=arm64
beta.kubernetes.io/os=linux
kubernetes.io/arch=arm64
kubernetes.io/hostname=old-k8s-version-949994
kubernetes.io/os=linux
minikube.k8s.io/commit=6bb462d349d93b9bf1c5a4f87817e5e9ea11cc95
minikube.k8s.io/name=old-k8s-version-949994
minikube.k8s.io/primary=true
minikube.k8s.io/updated_at=2025_01_27T02_50_48_0700
minikube.k8s.io/version=v1.35.0
node-role.kubernetes.io/control-plane=
node-role.kubernetes.io/master=
Annotations: kubeadm.alpha.kubernetes.io/cri-socket: /run/containerd/containerd.sock
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Mon, 27 Jan 2025 02:50:44 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: old-k8s-version-949994
AcquireTime: <unset>
RenewTime: Mon, 27 Jan 2025 02:59:34 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Mon, 27 Jan 2025 02:54:42 +0000 Mon, 27 Jan 2025 02:50:37 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Mon, 27 Jan 2025 02:54:42 +0000 Mon, 27 Jan 2025 02:50:37 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Mon, 27 Jan 2025 02:54:42 +0000 Mon, 27 Jan 2025 02:50:37 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Mon, 27 Jan 2025 02:54:42 +0000 Mon, 27 Jan 2025 02:51:02 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.76.2
Hostname: old-k8s-version-949994
Capacity:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022300Ki
pods: 110
Allocatable:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022300Ki
pods: 110
System Info:
Machine ID: 8f90d26273ab4326af8c0233a4788df8
System UUID: bb5d2b07-83a9-498f-8d6b-125d5070542b
Boot ID: ed5e2339-9d7b-4ad8-ab13-7fed1ac53390
Kernel Version: 5.15.0-1075-aws
OS Image: Ubuntu 22.04.5 LTS
Operating System: linux
Architecture: arm64
Container Runtime Version: containerd://1.7.24
Kubelet Version: v1.20.0
Kube-Proxy Version: v1.20.0
PodCIDR: 10.244.0.0/24
PodCIDRs: 10.244.0.0/24
Non-terminated Pods: (12 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits AGE
--------- ---- ------------ ---------- --------------- ------------- ---
default busybox 0 (0%) 0 (0%) 0 (0%) 0 (0%) 6m38s
kube-system coredns-74ff55c5b-fbwzt 100m (5%) 0 (0%) 70Mi (0%) 170Mi (2%) 8m36s
kube-system etcd-old-k8s-version-949994 100m (5%) 0 (0%) 100Mi (1%) 0 (0%) 8m42s
kube-system kindnet-bcq52 100m (5%) 100m (5%) 50Mi (0%) 50Mi (0%) 8m36s
kube-system kube-apiserver-old-k8s-version-949994 250m (12%) 0 (0%) 0 (0%) 0 (0%) 8m42s
kube-system kube-controller-manager-old-k8s-version-949994 200m (10%) 0 (0%) 0 (0%) 0 (0%) 8m42s
kube-system kube-proxy-5hzlg 0 (0%) 0 (0%) 0 (0%) 0 (0%) 8m36s
kube-system kube-scheduler-old-k8s-version-949994 100m (5%) 0 (0%) 0 (0%) 0 (0%) 8m42s
kube-system metrics-server-9975d5f86-mftgr 100m (5%) 0 (0%) 200Mi (2%) 0 (0%) 6m27s
kube-system storage-provisioner 0 (0%) 0 (0%) 0 (0%) 0 (0%) 8m35s
kubernetes-dashboard dashboard-metrics-scraper-8d5bb5db8-wvx62 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m27s
kubernetes-dashboard kubernetes-dashboard-cd95d586-9bnwh 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m27s
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 950m (47%) 100m (5%)
memory 420Mi (5%) 220Mi (2%)
ephemeral-storage 100Mi (0%) 0 (0%)
hugepages-1Gi 0 (0%) 0 (0%)
hugepages-2Mi 0 (0%) 0 (0%)
hugepages-32Mi 0 (0%) 0 (0%)
hugepages-64Ki 0 (0%) 0 (0%)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal NodeHasSufficientMemory 9m2s (x5 over 9m2s) kubelet Node old-k8s-version-949994 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 9m2s (x4 over 9m2s) kubelet Node old-k8s-version-949994 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 9m2s (x4 over 9m2s) kubelet Node old-k8s-version-949994 status is now: NodeHasSufficientPID
Normal Starting 8m43s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 8m43s kubelet Node old-k8s-version-949994 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 8m43s kubelet Node old-k8s-version-949994 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 8m43s kubelet Node old-k8s-version-949994 status is now: NodeHasSufficientPID
Normal NodeAllocatableEnforced 8m42s kubelet Updated Node Allocatable limit across pods
Normal NodeReady 8m36s kubelet Node old-k8s-version-949994 status is now: NodeReady
Normal Starting 8m33s kube-proxy Starting kube-proxy.
Normal Starting 5m59s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 5m59s (x8 over 5m59s) kubelet Node old-k8s-version-949994 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 5m59s (x8 over 5m59s) kubelet Node old-k8s-version-949994 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 5m59s (x7 over 5m59s) kubelet Node old-k8s-version-949994 status is now: NodeHasSufficientPID
Normal NodeAllocatableEnforced 5m59s kubelet Updated Node Allocatable limit across pods
Normal Starting 5m43s kube-proxy Starting kube-proxy.
==> dmesg <==
[Jan27 01:33] systemd-journald[221]: Failed to send WATCHDOG=1 notification message: Connection refused
[Jan27 01:42] overlayfs: failed to resolve '/var/lib/containerd/io.containerd.snapshotter.v1.overlayfs/snapshots/28/fs': -2
[Jan27 02:53] systemd-journald[223]: Failed to send WATCHDOG=1 notification message: Connection refused
==> etcd [8d9862575a02aedaa20cbdbc29f350c7d048f408b17d76e6899b001882f093b9] <==
raft2025/01/27 02:50:37 INFO: raft.node: ea7e25599daad906 elected leader ea7e25599daad906 at term 2
2025-01-27 02:50:37.111434 I | etcdserver: setting up the initial cluster version to 3.4
2025-01-27 02:50:37.111588 I | embed: listening for metrics on http://127.0.0.1:2381
2025-01-27 02:50:37.111779 I | embed: listening for peers on 192.168.76.2:2380
2025-01-27 02:50:37.114365 N | etcdserver/membership: set the initial cluster version to 3.4
2025-01-27 02:50:37.126237 I | etcdserver/api: enabled capabilities for version 3.4
2025-01-27 02:50:37.127590 I | etcdserver: published {Name:old-k8s-version-949994 ClientURLs:[https://192.168.76.2:2379]} to cluster 6f20f2c4b2fb5f8a
2025-01-27 02:50:37.127738 I | embed: ready to serve client requests
2025-01-27 02:50:37.129216 I | embed: serving client requests on 192.168.76.2:2379
2025-01-27 02:50:37.139094 I | embed: ready to serve client requests
2025-01-27 02:50:37.140595 I | embed: serving client requests on 127.0.0.1:2379
2025-01-27 02:50:46.133996 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2025-01-27 02:51:06.118823 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2025-01-27 02:51:12.598045 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2025-01-27 02:51:22.597983 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2025-01-27 02:51:32.596984 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2025-01-27 02:51:42.596843 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2025-01-27 02:51:52.596886 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2025-01-27 02:52:02.596989 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2025-01-27 02:52:12.597028 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2025-01-27 02:52:22.596967 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2025-01-27 02:52:32.596938 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2025-01-27 02:52:42.596787 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2025-01-27 02:52:52.596828 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2025-01-27 02:53:02.596852 I | etcdserver/api/etcdhttp: /health OK (status code 200)
==> etcd [913dba7b3bede3cb8e1b77be0a25d981b94c7ef9011ec91d80f77d6b7afc771b] <==
2025-01-27 02:55:36.261736 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2025-01-27 02:55:46.261205 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2025-01-27 02:55:56.261226 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2025-01-27 02:56:06.261221 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2025-01-27 02:56:16.261232 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2025-01-27 02:56:26.261482 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2025-01-27 02:56:36.261206 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2025-01-27 02:56:46.261258 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2025-01-27 02:56:56.261216 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2025-01-27 02:57:06.261128 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2025-01-27 02:57:16.261221 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2025-01-27 02:57:26.261223 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2025-01-27 02:57:36.261330 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2025-01-27 02:57:46.261323 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2025-01-27 02:57:56.261275 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2025-01-27 02:58:06.261145 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2025-01-27 02:58:16.261317 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2025-01-27 02:58:26.261192 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2025-01-27 02:58:36.261134 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2025-01-27 02:58:46.263745 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2025-01-27 02:58:56.261225 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2025-01-27 02:59:06.261400 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2025-01-27 02:59:16.261491 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2025-01-27 02:59:26.261344 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2025-01-27 02:59:36.261311 I | etcdserver/api/etcdhttp: /health OK (status code 200)
==> kernel <==
02:59:38 up 1 day, 1:42, 0 users, load average: 4.50, 2.82, 3.01
Linux old-k8s-version-949994 5.15.0-1075-aws #82~20.04.1-Ubuntu SMP Thu Dec 19 05:23:06 UTC 2024 aarch64 aarch64 aarch64 GNU/Linux
PRETTY_NAME="Ubuntu 22.04.5 LTS"
==> kindnet [17ad11f28e20777140f3d682704f30e56a34c3f85630bf0758795ca29f6f719a] <==
I0127 02:51:06.684160 1 controller.go:401] Syncing nftables rules
I0127 02:51:16.491517 1 main.go:297] Handling node with IPs: map[192.168.76.2:{}]
I0127 02:51:16.491588 1 main.go:301] handling current node
I0127 02:51:26.483246 1 main.go:297] Handling node with IPs: map[192.168.76.2:{}]
I0127 02:51:26.483280 1 main.go:301] handling current node
I0127 02:51:36.483217 1 main.go:297] Handling node with IPs: map[192.168.76.2:{}]
I0127 02:51:36.483254 1 main.go:301] handling current node
I0127 02:51:46.492208 1 main.go:297] Handling node with IPs: map[192.168.76.2:{}]
I0127 02:51:46.492244 1 main.go:301] handling current node
I0127 02:51:56.492004 1 main.go:297] Handling node with IPs: map[192.168.76.2:{}]
I0127 02:51:56.492040 1 main.go:301] handling current node
I0127 02:52:06.483523 1 main.go:297] Handling node with IPs: map[192.168.76.2:{}]
I0127 02:52:06.483557 1 main.go:301] handling current node
I0127 02:52:16.491291 1 main.go:297] Handling node with IPs: map[192.168.76.2:{}]
I0127 02:52:16.492304 1 main.go:301] handling current node
I0127 02:52:26.483281 1 main.go:297] Handling node with IPs: map[192.168.76.2:{}]
I0127 02:52:26.483315 1 main.go:301] handling current node
I0127 02:52:36.483423 1 main.go:297] Handling node with IPs: map[192.168.76.2:{}]
I0127 02:52:36.483456 1 main.go:301] handling current node
I0127 02:52:46.491336 1 main.go:297] Handling node with IPs: map[192.168.76.2:{}]
I0127 02:52:46.491574 1 main.go:301] handling current node
I0127 02:52:56.482884 1 main.go:297] Handling node with IPs: map[192.168.76.2:{}]
I0127 02:52:56.482945 1 main.go:301] handling current node
I0127 02:53:06.483150 1 main.go:297] Handling node with IPs: map[192.168.76.2:{}]
I0127 02:53:06.483245 1 main.go:301] handling current node
==> kindnet [792e1bf0751e8fad4834403cd7db06cfbd9065c482e6c7b3bcf4c0c2b1a373d1] <==
I0127 02:57:36.891690 1 main.go:301] handling current node
I0127 02:57:46.891419 1 main.go:297] Handling node with IPs: map[192.168.76.2:{}]
I0127 02:57:46.891466 1 main.go:301] handling current node
I0127 02:57:56.882968 1 main.go:297] Handling node with IPs: map[192.168.76.2:{}]
I0127 02:57:56.883082 1 main.go:301] handling current node
I0127 02:58:06.889341 1 main.go:297] Handling node with IPs: map[192.168.76.2:{}]
I0127 02:58:06.889445 1 main.go:301] handling current node
I0127 02:58:16.890242 1 main.go:297] Handling node with IPs: map[192.168.76.2:{}]
I0127 02:58:16.890279 1 main.go:301] handling current node
I0127 02:58:26.892254 1 main.go:297] Handling node with IPs: map[192.168.76.2:{}]
I0127 02:58:26.892287 1 main.go:301] handling current node
I0127 02:58:36.890251 1 main.go:297] Handling node with IPs: map[192.168.76.2:{}]
I0127 02:58:36.890293 1 main.go:301] handling current node
I0127 02:58:46.885003 1 main.go:297] Handling node with IPs: map[192.168.76.2:{}]
I0127 02:58:46.885040 1 main.go:301] handling current node
I0127 02:58:56.883270 1 main.go:297] Handling node with IPs: map[192.168.76.2:{}]
I0127 02:58:56.883309 1 main.go:301] handling current node
I0127 02:59:06.890453 1 main.go:297] Handling node with IPs: map[192.168.76.2:{}]
I0127 02:59:06.890739 1 main.go:301] handling current node
I0127 02:59:16.890291 1 main.go:297] Handling node with IPs: map[192.168.76.2:{}]
I0127 02:59:16.890549 1 main.go:301] handling current node
I0127 02:59:26.883432 1 main.go:297] Handling node with IPs: map[192.168.76.2:{}]
I0127 02:59:26.883491 1 main.go:301] handling current node
I0127 02:59:36.891644 1 main.go:297] Handling node with IPs: map[192.168.76.2:{}]
I0127 02:59:36.891681 1 main.go:301] handling current node
==> kube-apiserver [ae3fb4241ae87bccf92d74ec50fcca30938fee4da6ee2129c5306d476811e810] <==
I0127 02:50:45.069857 1 controller.go:132] OpenAPI AggregationController: action for item : Nothing (removed from the queue).
I0127 02:50:45.069904 1 controller.go:132] OpenAPI AggregationController: action for item k8s_internal_local_delegation_chain_0000000000: Nothing (removed from the queue).
I0127 02:50:45.095787 1 storage_scheduling.go:132] created PriorityClass system-node-critical with value 2000001000
I0127 02:50:45.101972 1 storage_scheduling.go:132] created PriorityClass system-cluster-critical with value 2000000000
I0127 02:50:45.101998 1 storage_scheduling.go:148] all system priority classes are created successfully or already exist.
I0127 02:50:45.669644 1 controller.go:606] quota admission added evaluator for: roles.rbac.authorization.k8s.io
I0127 02:50:45.715869 1 controller.go:606] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io
W0127 02:50:45.829683 1 lease.go:233] Resetting endpoints for master service "kubernetes" to [192.168.76.2]
I0127 02:50:45.832218 1 controller.go:606] quota admission added evaluator for: endpoints
I0127 02:50:45.842470 1 controller.go:606] quota admission added evaluator for: endpointslices.discovery.k8s.io
I0127 02:50:46.724017 1 controller.go:606] quota admission added evaluator for: serviceaccounts
I0127 02:50:47.282662 1 controller.go:606] quota admission added evaluator for: deployments.apps
I0127 02:50:47.333581 1 controller.go:606] quota admission added evaluator for: daemonsets.apps
I0127 02:50:55.835195 1 controller.go:606] quota admission added evaluator for: leases.coordination.k8s.io
I0127 02:51:02.654732 1 controller.go:606] quota admission added evaluator for: replicasets.apps
I0127 02:51:02.704658 1 controller.go:606] quota admission added evaluator for: controllerrevisions.apps
I0127 02:51:19.812506 1 client.go:360] parsed scheme: "passthrough"
I0127 02:51:19.812571 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0127 02:51:19.812580 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0127 02:52:01.093675 1 client.go:360] parsed scheme: "passthrough"
I0127 02:52:01.093807 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0127 02:52:01.094047 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0127 02:52:41.624064 1 client.go:360] parsed scheme: "passthrough"
I0127 02:52:41.624106 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0127 02:52:41.624115 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
==> kube-apiserver [f1ff631138f971f0d0175bbdad8dae389b0bb6d344b9c6a0c0ee143eb981fd26] <==
I0127 02:56:41.660338 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0127 02:56:41.660356 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
W0127 02:56:56.478730 1 handler_proxy.go:102] no RequestInfo found in the context
E0127 02:56:56.478804 1 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I0127 02:56:56.478813 1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
I0127 02:57:15.270908 1 client.go:360] parsed scheme: "passthrough"
I0127 02:57:15.270955 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0127 02:57:15.270964 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0127 02:57:52.799426 1 client.go:360] parsed scheme: "passthrough"
I0127 02:57:52.799474 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0127 02:57:52.799483 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0127 02:58:25.247963 1 client.go:360] parsed scheme: "passthrough"
I0127 02:58:25.248073 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0127 02:58:25.248102 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
W0127 02:58:53.035435 1 handler_proxy.go:102] no RequestInfo found in the context
E0127 02:58:53.035686 1 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I0127 02:58:53.035775 1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
I0127 02:59:01.977336 1 client.go:360] parsed scheme: "passthrough"
I0127 02:59:01.977399 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0127 02:59:01.977409 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0127 02:59:34.269911 1 client.go:360] parsed scheme: "passthrough"
I0127 02:59:34.269955 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0127 02:59:34.269964 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
==> kube-controller-manager [0f4ff9b6b17b830c0f2505936c14a703649af8de56a7960df790d5e970f75414] <==
I0127 02:51:02.771103 1 shared_informer.go:247] Caches are synced for taint
I0127 02:51:02.771180 1 node_lifecycle_controller.go:1429] Initializing eviction metric for zone:
W0127 02:51:02.771233 1 node_lifecycle_controller.go:1044] Missing timestamp for Node old-k8s-version-949994. Assuming now as a timestamp.
I0127 02:51:02.771269 1 node_lifecycle_controller.go:1195] Controller detected that all Nodes are not-Ready. Entering master disruption mode.
I0127 02:51:02.771311 1 event.go:291] "Event occurred" object="old-k8s-version-949994" kind="Node" apiVersion="v1" type="Normal" reason="RegisteredNode" message="Node old-k8s-version-949994 event: Registered Node old-k8s-version-949994 in Controller"
I0127 02:51:02.771335 1 taint_manager.go:187] Starting NoExecuteTaintManager
I0127 02:51:02.785044 1 event.go:291] "Event occurred" object="kube-system/coredns-74ff55c5b" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-74ff55c5b-ssrlm"
I0127 02:51:02.786560 1 event.go:291] "Event occurred" object="kube-system/kube-proxy" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kube-proxy-5hzlg"
I0127 02:51:02.786579 1 event.go:291] "Event occurred" object="kube-system/kindnet" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kindnet-bcq52"
I0127 02:51:02.832454 1 event.go:291] "Event occurred" object="kube-system/kube-apiserver-old-k8s-version-949994" kind="Pod" apiVersion="v1" type="Warning" reason="NodeNotReady" message="Node is not ready"
I0127 02:51:02.869928 1 shared_informer.go:247] Caches are synced for HPA
I0127 02:51:02.878800 1 shared_informer.go:247] Caches are synced for resource quota
I0127 02:51:02.901093 1 shared_informer.go:247] Caches are synced for resource quota
E0127 02:51:02.972013 1 daemon_controller.go:320] kube-system/kube-proxy failed with : error storing status for daemon set &v1.DaemonSet{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"kube-proxy", GenerateName:"", Namespace:"kube-system", SelfLink:"", UID:"b302327d-6f13-4fdb-b1f2-6c0e9db09610", ResourceVersion:"391", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63873543047, loc:(*time.Location)(0x632eb80)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"k8s-app":"kube-proxy"}, Annotations:map[string]string{"deprecated.daemonset.template.generation":"1"}, OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry{v1.ManagedFieldsEntry{Manager:"kubeadm", Operation:"Update", APIVersion:"apps/v1", Time:(*v1.Time)(0x4000e45400), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0x4000e45440)}, v1.ManagedFieldsEntry{Manager:"kube-co
ntroller-manager", Operation:"Update", APIVersion:"apps/v1", Time:(*v1.Time)(0x4000e45460), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0x4000e45480)}}}, Spec:v1.DaemonSetSpec{Selector:(*v1.LabelSelector)(0x4000e454a0), Template:v1.PodTemplateSpec{ObjectMeta:v1.ObjectMeta{Name:"", GenerateName:"", Namespace:"", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"k8s-app":"kube-proxy"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v1.PodSpec{Volumes:[]v1.Volume{v1.Volume{Name:"kube-proxy", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(nil), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElastic
BlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(0x4001bc43c0), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSour
ce)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}, v1.Volume{Name:"xtables-lock", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0x4000e454c0), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSo
urce)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}, v1.Volume{Name:"lib-modules", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0x4000e454e0), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil),
Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}}, InitContainers:[]v1.Container(nil), Containers:[]v1.Container{v1.Container{Name:"kube-proxy", Image:"k8s.gcr.io/kube-proxy:v1.20.0", Command:[]string{"/usr/local/bin/kube-proxy", "--config=/var/lib/kube-proxy/config.conf", "--hostname-override=$(NODE_NAME)"}, Args:[]string(nil),
WorkingDir:"", Ports:[]v1.ContainerPort(nil), EnvFrom:[]v1.EnvFromSource(nil), Env:[]v1.EnvVar{v1.EnvVar{Name:"NODE_NAME", Value:"", ValueFrom:(*v1.EnvVarSource)(0x4000e45520)}}, Resources:v1.ResourceRequirements{Limits:v1.ResourceList(nil), Requests:v1.ResourceList(nil)}, VolumeMounts:[]v1.VolumeMount{v1.VolumeMount{Name:"kube-proxy", ReadOnly:false, MountPath:"/var/lib/kube-proxy", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"xtables-lock", ReadOnly:false, MountPath:"/run/xtables.lock", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"lib-modules", ReadOnly:true, MountPath:"/lib/modules", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}}, VolumeDevices:[]v1.VolumeDevice(nil), LivenessProbe:(*v1.Probe)(nil), ReadinessProbe:(*v1.Probe)(nil), StartupProbe:(*v1.Probe)(nil), Lifecycle:(*v1.Lifecycle)(nil), TerminationMessagePath:"/dev/termination-log", TerminationMessagePolicy:"F
ile", ImagePullPolicy:"IfNotPresent", SecurityContext:(*v1.SecurityContext)(0x4001b15aa0), Stdin:false, StdinOnce:false, TTY:false}}, EphemeralContainers:[]v1.EphemeralContainer(nil), RestartPolicy:"Always", TerminationGracePeriodSeconds:(*int64)(0x40014bc5c8), ActiveDeadlineSeconds:(*int64)(nil), DNSPolicy:"ClusterFirst", NodeSelector:map[string]string{"kubernetes.io/os":"linux"}, ServiceAccountName:"kube-proxy", DeprecatedServiceAccount:"kube-proxy", AutomountServiceAccountToken:(*bool)(nil), NodeName:"", HostNetwork:true, HostPID:false, HostIPC:false, ShareProcessNamespace:(*bool)(nil), SecurityContext:(*v1.PodSecurityContext)(0x400024fc00), ImagePullSecrets:[]v1.LocalObjectReference(nil), Hostname:"", Subdomain:"", Affinity:(*v1.Affinity)(nil), SchedulerName:"default-scheduler", Tolerations:[]v1.Toleration{v1.Toleration{Key:"CriticalAddonsOnly", Operator:"Exists", Value:"", Effect:"", TolerationSeconds:(*int64)(nil)}, v1.Toleration{Key:"", Operator:"Exists", Value:"", Effect:"", TolerationSeconds:(*int64)
(nil)}}, HostAliases:[]v1.HostAlias(nil), PriorityClassName:"system-node-critical", Priority:(*int32)(nil), DNSConfig:(*v1.PodDNSConfig)(nil), ReadinessGates:[]v1.PodReadinessGate(nil), RuntimeClassName:(*string)(nil), EnableServiceLinks:(*bool)(nil), PreemptionPolicy:(*v1.PreemptionPolicy)(nil), Overhead:v1.ResourceList(nil), TopologySpreadConstraints:[]v1.TopologySpreadConstraint(nil), SetHostnameAsFQDN:(*bool)(nil)}}, UpdateStrategy:v1.DaemonSetUpdateStrategy{Type:"RollingUpdate", RollingUpdate:(*v1.RollingUpdateDaemonSet)(0x40006787f0)}, MinReadySeconds:0, RevisionHistoryLimit:(*int32)(0x40014bc618)}, Status:v1.DaemonSetStatus{CurrentNumberScheduled:0, NumberMisscheduled:0, DesiredNumberScheduled:1, NumberReady:0, ObservedGeneration:1, UpdatedNumberScheduled:0, NumberAvailable:0, NumberUnavailable:1, CollisionCount:(*int32)(nil), Conditions:[]v1.DaemonSetCondition(nil)}}: Operation cannot be fulfilled on daemonsets.apps "kube-proxy": the object has been modified; please apply your changes to the latest ve
rsion and try again
E0127 02:51:02.980563 1 daemon_controller.go:320] kube-system/kindnet failed with : error storing status for daemon set &v1.DaemonSet{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"kindnet", GenerateName:"", Namespace:"kube-system", SelfLink:"", UID:"ebd03435-925e-4ca5-959a-b5a6c36a2ccd", ResourceVersion:"402", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63873543048, loc:(*time.Location)(0x632eb80)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"app":"kindnet", "k8s-app":"kindnet", "tier":"node"}, Annotations:map[string]string{"deprecated.daemonset.template.generation":"1", "kubectl.kubernetes.io/last-applied-configuration":"{\"apiVersion\":\"apps/v1\",\"kind\":\"DaemonSet\",\"metadata\":{\"annotations\":{},\"labels\":{\"app\":\"kindnet\",\"k8s-app\":\"kindnet\",\"tier\":\"node\"},\"name\":\"kindnet\",\"namespace\":\"kube-system\"},\"spec\":{\"selector\":{\"matchLabels\":{\"app\":\"k
indnet\"}},\"template\":{\"metadata\":{\"labels\":{\"app\":\"kindnet\",\"k8s-app\":\"kindnet\",\"tier\":\"node\"}},\"spec\":{\"containers\":[{\"env\":[{\"name\":\"HOST_IP\",\"valueFrom\":{\"fieldRef\":{\"fieldPath\":\"status.hostIP\"}}},{\"name\":\"POD_IP\",\"valueFrom\":{\"fieldRef\":{\"fieldPath\":\"status.podIP\"}}},{\"name\":\"POD_SUBNET\",\"value\":\"10.244.0.0/16\"}],\"image\":\"docker.io/kindest/kindnetd:v20241108-5c6d2daf\",\"name\":\"kindnet-cni\",\"resources\":{\"limits\":{\"cpu\":\"100m\",\"memory\":\"50Mi\"},\"requests\":{\"cpu\":\"100m\",\"memory\":\"50Mi\"}},\"securityContext\":{\"capabilities\":{\"add\":[\"NET_RAW\",\"NET_ADMIN\"]},\"privileged\":false},\"volumeMounts\":[{\"mountPath\":\"/etc/cni/net.d\",\"name\":\"cni-cfg\"},{\"mountPath\":\"/run/xtables.lock\",\"name\":\"xtables-lock\",\"readOnly\":false},{\"mountPath\":\"/lib/modules\",\"name\":\"lib-modules\",\"readOnly\":true}]}],\"hostNetwork\":true,\"serviceAccountName\":\"kindnet\",\"tolerations\":[{\"effect\":\"NoSchedule\",\"operator\
":\"Exists\"}],\"volumes\":[{\"hostPath\":{\"path\":\"/etc/cni/net.d\",\"type\":\"DirectoryOrCreate\"},\"name\":\"cni-cfg\"},{\"hostPath\":{\"path\":\"/run/xtables.lock\",\"type\":\"FileOrCreate\"},\"name\":\"xtables-lock\"},{\"hostPath\":{\"path\":\"/lib/modules\"},\"name\":\"lib-modules\"}]}}}}\n"}, OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry{v1.ManagedFieldsEntry{Manager:"kubectl-client-side-apply", Operation:"Update", APIVersion:"apps/v1", Time:(*v1.Time)(0x40016527e0), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0x4001652800)}, v1.ManagedFieldsEntry{Manager:"kube-controller-manager", Operation:"Update", APIVersion:"apps/v1", Time:(*v1.Time)(0x4001652820), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0x4001652840)}}}, Spec:v1.DaemonSetSpec{Selector:(*v1.LabelSelector)(0x4001652860), Template:v1.PodTemplateSpec{ObjectMeta:v1.ObjectMeta{Name:"", GenerateName:"", Namespace:"", SelfLink:"", UID:"", ResourceVersion:"", Generatio
n:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"app":"kindnet", "k8s-app":"kindnet", "tier":"node"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v1.PodSpec{Volumes:[]v1.Volume{v1.Volume{Name:"cni-cfg", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0x4001652880), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:
(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}, v1.Volume{Name:"xtables-lock", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0x40016528a0), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlo
ckStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CS
I:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}, v1.Volume{Name:"lib-modules", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0x40016528c0), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Q
uobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}}, InitContainers:[]v1.Container(nil), Containers:[]v1.Container{v1.Container{Name:"kindnet-cni", Image:"docker.io/kindest/kindnetd:v20241108-5c6d2daf", Command:[]string(nil), Args:[]string(nil), WorkingDir:"", Ports:[]v1.ContainerPort(nil), EnvFrom:[]v1.EnvFromSource(nil), Env:[]v1.EnvVar{v1.EnvVar{Name:"HOST_IP", Value:"", ValueFrom:(*v1.EnvVarSource)(0x40016528e0)}, v1.EnvVar{Name:"POD_IP", Value:"", ValueFrom:(*v1.EnvVarSource)(0x4001652920)}, v1.EnvVar{Name:"POD_SUBNET", Value:"10.244.0.0/16", ValueFrom:(*v1.EnvVarSource)(nil)}}, Resources:v1.ResourceRequirements{Limits:v1.ResourceList{"cpu":resource.Quantity{i
:resource.int64Amount{value:100, scale:-3}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"100m", Format:"DecimalSI"}, "memory":resource.Quantity{i:resource.int64Amount{value:52428800, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"50Mi", Format:"BinarySI"}}, Requests:v1.ResourceList{"cpu":resource.Quantity{i:resource.int64Amount{value:100, scale:-3}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"100m", Format:"DecimalSI"}, "memory":resource.Quantity{i:resource.int64Amount{value:52428800, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"50Mi", Format:"BinarySI"}}}, VolumeMounts:[]v1.VolumeMount{v1.VolumeMount{Name:"cni-cfg", ReadOnly:false, MountPath:"/etc/cni/net.d", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"xtables-lock", ReadOnly:false, MountPath:"/run/xtables.lock", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"lib-modules", ReadOnly:true, MountPath:"/lib/modules", Sub
Path:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}}, VolumeDevices:[]v1.VolumeDevice(nil), LivenessProbe:(*v1.Probe)(nil), ReadinessProbe:(*v1.Probe)(nil), StartupProbe:(*v1.Probe)(nil), Lifecycle:(*v1.Lifecycle)(nil), TerminationMessagePath:"/dev/termination-log", TerminationMessagePolicy:"File", ImagePullPolicy:"IfNotPresent", SecurityContext:(*v1.SecurityContext)(0x4001696a20), Stdin:false, StdinOnce:false, TTY:false}}, EphemeralContainers:[]v1.EphemeralContainer(nil), RestartPolicy:"Always", TerminationGracePeriodSeconds:(*int64)(0x4001688998), ActiveDeadlineSeconds:(*int64)(nil), DNSPolicy:"ClusterFirst", NodeSelector:map[string]string(nil), ServiceAccountName:"kindnet", DeprecatedServiceAccount:"kindnet", AutomountServiceAccountToken:(*bool)(nil), NodeName:"", HostNetwork:true, HostPID:false, HostIPC:false, ShareProcessNamespace:(*bool)(nil), SecurityContext:(*v1.PodSecurityContext)(0x400011c850), ImagePullSecrets:[]v1.LocalObjectReference(nil), Hostname:"", Subdomain:"", Affinit
y:(*v1.Affinity)(nil), SchedulerName:"default-scheduler", Tolerations:[]v1.Toleration{v1.Toleration{Key:"", Operator:"Exists", Value:"", Effect:"NoSchedule", TolerationSeconds:(*int64)(nil)}}, HostAliases:[]v1.HostAlias(nil), PriorityClassName:"", Priority:(*int32)(nil), DNSConfig:(*v1.PodDNSConfig)(nil), ReadinessGates:[]v1.PodReadinessGate(nil), RuntimeClassName:(*string)(nil), EnableServiceLinks:(*bool)(nil), PreemptionPolicy:(*v1.PreemptionPolicy)(nil), Overhead:v1.ResourceList(nil), TopologySpreadConstraints:[]v1.TopologySpreadConstraint(nil), SetHostnameAsFQDN:(*bool)(nil)}}, UpdateStrategy:v1.DaemonSetUpdateStrategy{Type:"RollingUpdate", RollingUpdate:(*v1.RollingUpdateDaemonSet)(0x4000678b58)}, MinReadySeconds:0, RevisionHistoryLimit:(*int32)(0x40016889e0)}, Status:v1.DaemonSetStatus{CurrentNumberScheduled:0, NumberMisscheduled:0, DesiredNumberScheduled:1, NumberReady:0, ObservedGeneration:1, UpdatedNumberScheduled:0, NumberAvailable:0, NumberUnavailable:1, CollisionCount:(*int32)(nil), Conditions:[]v
1.DaemonSetCondition(nil)}}: Operation cannot be fulfilled on daemonsets.apps "kindnet": the object has been modified; please apply your changes to the latest version and try again
I0127 02:51:03.048039 1 shared_informer.go:240] Waiting for caches to sync for garbage collector
I0127 02:51:03.348237 1 shared_informer.go:247] Caches are synced for garbage collector
I0127 02:51:03.370345 1 shared_informer.go:247] Caches are synced for garbage collector
I0127 02:51:03.370381 1 garbagecollector.go:151] Garbage collector: all resource monitors have synced. Proceeding to collect garbage
I0127 02:51:04.100803 1 event.go:291] "Event occurred" object="kube-system/coredns" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled down replica set coredns-74ff55c5b to 1"
I0127 02:51:04.145837 1 event.go:291] "Event occurred" object="kube-system/coredns-74ff55c5b" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulDelete" message="Deleted pod: coredns-74ff55c5b-ssrlm"
I0127 02:51:07.771530 1 node_lifecycle_controller.go:1222] Controller detected that some Nodes are Ready. Exiting master disruption mode.
I0127 02:53:10.684989 1 event.go:291] "Event occurred" object="kube-system/metrics-server" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set metrics-server-9975d5f86 to 1"
E0127 02:53:10.780764 1 clusterroleaggregation_controller.go:181] admin failed with : Operation cannot be fulfilled on clusterroles.rbac.authorization.k8s.io "admin": the object has been modified; please apply your changes to the latest version and try again
E0127 02:53:10.781003 1 clusterroleaggregation_controller.go:181] edit failed with : Operation cannot be fulfilled on clusterroles.rbac.authorization.k8s.io "edit": the object has been modified; please apply your changes to the latest version and try again
==> kube-controller-manager [60bc065c8667a83052202f7fc37006df6160a0f60502485d3fe888d752f6e93e] <==
W0127 02:55:17.229912 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0127 02:55:43.268141 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0127 02:55:48.880511 1 request.go:655] Throttling request took 1.048231715s, request: GET:https://192.168.76.2:8443/apis/extensions/v1beta1?timeout=32s
W0127 02:55:49.732069 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0127 02:56:13.773756 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0127 02:56:21.382549 1 request.go:655] Throttling request took 1.048254626s, request: GET:https://192.168.76.2:8443/apis/batch/v1?timeout=32s
W0127 02:56:22.234314 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0127 02:56:44.275657 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0127 02:56:53.884856 1 request.go:655] Throttling request took 1.048245575s, request: GET:https://192.168.76.2:8443/apis/admissionregistration.k8s.io/v1beta1?timeout=32s
W0127 02:56:54.736183 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0127 02:57:14.777467 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0127 02:57:26.386788 1 request.go:655] Throttling request took 1.048379285s, request: GET:https://192.168.76.2:8443/apis/extensions/v1beta1?timeout=32s
W0127 02:57:27.238154 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0127 02:57:45.280080 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0127 02:57:58.888675 1 request.go:655] Throttling request took 1.048394592s, request: GET:https://192.168.76.2:8443/apis/extensions/v1beta1?timeout=32s
W0127 02:57:59.740095 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0127 02:58:15.782200 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0127 02:58:31.390648 1 request.go:655] Throttling request took 1.047709996s, request: GET:https://192.168.76.2:8443/apis/extensions/v1beta1?timeout=32s
W0127 02:58:32.241994 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0127 02:58:46.284419 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0127 02:59:03.892684 1 request.go:655] Throttling request took 1.047005175s, request: GET:https://192.168.76.2:8443/apis/apiextensions.k8s.io/v1?timeout=32s
W0127 02:59:04.744151 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0127 02:59:16.787020 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0127 02:59:36.394782 1 request.go:655] Throttling request took 1.048253056s, request: GET:https://192.168.76.2:8443/apis/authorization.k8s.io/v1beta1?timeout=32s
W0127 02:59:37.246557 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
==> kube-proxy [1eebf1b8ced6916d55f7a34166585a17437e60b2716ed0809ac349c450b4e754] <==
I0127 02:53:55.893785 1 node.go:172] Successfully retrieved node IP: 192.168.76.2
I0127 02:53:55.893866 1 server_others.go:142] kube-proxy node IP is an IPv4 address (192.168.76.2), assume IPv4 operation
W0127 02:53:55.947292 1 server_others.go:578] Unknown proxy mode "", assuming iptables proxy
I0127 02:53:55.947453 1 server_others.go:185] Using iptables Proxier.
I0127 02:53:55.947984 1 server.go:650] Version: v1.20.0
I0127 02:53:55.948890 1 config.go:315] Starting service config controller
I0127 02:53:55.948902 1 shared_informer.go:240] Waiting for caches to sync for service config
I0127 02:53:55.948923 1 config.go:224] Starting endpoint slice config controller
I0127 02:53:55.948927 1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config
I0127 02:53:56.049041 1 shared_informer.go:247] Caches are synced for endpoint slice config
I0127 02:53:56.049114 1 shared_informer.go:247] Caches are synced for service config
==> kube-proxy [a7fa3720da9a726a9f6f8d791e969823b89c23d447e9434ee4a64f80336f7aa2] <==
I0127 02:51:05.091156 1 node.go:172] Successfully retrieved node IP: 192.168.76.2
I0127 02:51:05.091265 1 server_others.go:142] kube-proxy node IP is an IPv4 address (192.168.76.2), assume IPv4 operation
W0127 02:51:05.119802 1 server_others.go:578] Unknown proxy mode "", assuming iptables proxy
I0127 02:51:05.119989 1 server_others.go:185] Using iptables Proxier.
I0127 02:51:05.120428 1 server.go:650] Version: v1.20.0
I0127 02:51:05.121113 1 config.go:315] Starting service config controller
I0127 02:51:05.121133 1 shared_informer.go:240] Waiting for caches to sync for service config
I0127 02:51:05.121151 1 config.go:224] Starting endpoint slice config controller
I0127 02:51:05.121155 1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config
I0127 02:51:05.221288 1 shared_informer.go:247] Caches are synced for endpoint slice config
I0127 02:51:05.221289 1 shared_informer.go:247] Caches are synced for service config
==> kube-scheduler [6868e5588e2518b2dbbee5fcdc288ff7639c3e6d27152b25c2d92a94144279e8] <==
I0127 02:53:45.564830 1 serving.go:331] Generated self-signed cert in-memory
W0127 02:53:51.972834 1 requestheader_controller.go:193] Unable to get configmap/extension-apiserver-authentication in kube-system. Usually fixed by 'kubectl create rolebinding -n kube-system ROLEBINDING_NAME --role=extension-apiserver-authentication-reader --serviceaccount=YOUR_NS:YOUR_SA'
W0127 02:53:51.972887 1 authentication.go:332] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"
W0127 02:53:51.972907 1 authentication.go:333] Continuing without authentication configuration. This may treat all requests as anonymous.
W0127 02:53:51.972915 1 authentication.go:334] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false
I0127 02:53:52.301790 1 secure_serving.go:197] Serving securely on 127.0.0.1:10259
I0127 02:53:52.324171 1 configmap_cafile_content.go:202] Starting client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0127 02:53:52.324194 1 shared_informer.go:240] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0127 02:53:52.324220 1 tlsconfig.go:240] Starting DynamicServingCertificateController
I0127 02:53:52.524333 1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
==> kube-scheduler [d422478362adb4ddd09d8598be12970c37fc3c672548faefb895f3b8924598a3] <==
W0127 02:50:44.244930 1 authentication.go:334] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false
I0127 02:50:44.300613 1 secure_serving.go:197] Serving securely on 127.0.0.1:10259
I0127 02:50:44.300956 1 configmap_cafile_content.go:202] Starting client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0127 02:50:44.301045 1 shared_informer.go:240] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0127 02:50:44.301133 1 tlsconfig.go:240] Starting DynamicServingCertificateController
E0127 02:50:44.312150 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
E0127 02:50:44.312558 1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
E0127 02:50:44.313106 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
E0127 02:50:44.313325 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1beta1.PodDisruptionBudget: failed to list *v1beta1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
E0127 02:50:44.313549 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
E0127 02:50:44.313999 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
E0127 02:50:44.314167 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
E0127 02:50:44.314252 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
E0127 02:50:44.314356 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
E0127 02:50:44.320781 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
E0127 02:50:44.320888 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
E0127 02:50:44.320946 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
E0127 02:50:45.203043 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
E0127 02:50:45.297607 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
E0127 02:50:45.336807 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
E0127 02:50:45.366490 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
E0127 02:50:45.400896 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
E0127 02:50:45.408364 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
E0127 02:50:45.454556 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1beta1.PodDisruptionBudget: failed to list *v1beta1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
I0127 02:50:45.901206 1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
==> kubelet <==
Jan 27 02:57:59 old-k8s-version-949994 kubelet[660]: E0127 02:57:59.502983 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
Jan 27 02:58:00 old-k8s-version-949994 kubelet[660]: E0127 02:58:00.501586 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jan 27 02:58:10 old-k8s-version-949994 kubelet[660]: I0127 02:58:10.500911 660 scope.go:95] [topologymanager] RemoveContainer - Container ID: 8e12f3bd92557f98a8be94f4260bf8b0f480431b2afe4106b52f61a99e950ff5
Jan 27 02:58:10 old-k8s-version-949994 kubelet[660]: E0127 02:58:10.501269 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
Jan 27 02:58:15 old-k8s-version-949994 kubelet[660]: E0127 02:58:15.501889 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jan 27 02:58:21 old-k8s-version-949994 kubelet[660]: I0127 02:58:21.501028 660 scope.go:95] [topologymanager] RemoveContainer - Container ID: 8e12f3bd92557f98a8be94f4260bf8b0f480431b2afe4106b52f61a99e950ff5
Jan 27 02:58:21 old-k8s-version-949994 kubelet[660]: E0127 02:58:21.501389 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
Jan 27 02:58:28 old-k8s-version-949994 kubelet[660]: E0127 02:58:28.501733 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jan 27 02:58:34 old-k8s-version-949994 kubelet[660]: I0127 02:58:34.500859 660 scope.go:95] [topologymanager] RemoveContainer - Container ID: 8e12f3bd92557f98a8be94f4260bf8b0f480431b2afe4106b52f61a99e950ff5
Jan 27 02:58:34 old-k8s-version-949994 kubelet[660]: E0127 02:58:34.501213 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
Jan 27 02:58:43 old-k8s-version-949994 kubelet[660]: E0127 02:58:43.501567 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jan 27 02:58:48 old-k8s-version-949994 kubelet[660]: I0127 02:58:48.501580 660 scope.go:95] [topologymanager] RemoveContainer - Container ID: 8e12f3bd92557f98a8be94f4260bf8b0f480431b2afe4106b52f61a99e950ff5
Jan 27 02:58:48 old-k8s-version-949994 kubelet[660]: E0127 02:58:48.502462 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
Jan 27 02:58:55 old-k8s-version-949994 kubelet[660]: E0127 02:58:55.501821 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jan 27 02:59:00 old-k8s-version-949994 kubelet[660]: I0127 02:59:00.502291 660 scope.go:95] [topologymanager] RemoveContainer - Container ID: 8e12f3bd92557f98a8be94f4260bf8b0f480431b2afe4106b52f61a99e950ff5
Jan 27 02:59:00 old-k8s-version-949994 kubelet[660]: E0127 02:59:00.502866 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
Jan 27 02:59:07 old-k8s-version-949994 kubelet[660]: E0127 02:59:07.502977 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jan 27 02:59:14 old-k8s-version-949994 kubelet[660]: I0127 02:59:14.500969 660 scope.go:95] [topologymanager] RemoveContainer - Container ID: 8e12f3bd92557f98a8be94f4260bf8b0f480431b2afe4106b52f61a99e950ff5
Jan 27 02:59:14 old-k8s-version-949994 kubelet[660]: E0127 02:59:14.501372 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
Jan 27 02:59:18 old-k8s-version-949994 kubelet[660]: E0127 02:59:18.502650 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jan 27 02:59:26 old-k8s-version-949994 kubelet[660]: I0127 02:59:26.500953 660 scope.go:95] [topologymanager] RemoveContainer - Container ID: 8e12f3bd92557f98a8be94f4260bf8b0f480431b2afe4106b52f61a99e950ff5
Jan 27 02:59:26 old-k8s-version-949994 kubelet[660]: E0127 02:59:26.501368 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
Jan 27 02:59:29 old-k8s-version-949994 kubelet[660]: E0127 02:59:29.509681 660 pod_workers.go:191] Error syncing pod bf8b9c4e-eca6-40a8-98a0-2299a9ab115d ("metrics-server-9975d5f86-mftgr_kube-system(bf8b9c4e-eca6-40a8-98a0-2299a9ab115d)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jan 27 02:59:38 old-k8s-version-949994 kubelet[660]: I0127 02:59:38.501676 660 scope.go:95] [topologymanager] RemoveContainer - Container ID: 8e12f3bd92557f98a8be94f4260bf8b0f480431b2afe4106b52f61a99e950ff5
Jan 27 02:59:38 old-k8s-version-949994 kubelet[660]: E0127 02:59:38.502293 660 pod_workers.go:191] Error syncing pod f3d4b693-4a2e-4c61-8522-2dc1b9aba634 ("dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-wvx62_kubernetes-dashboard(f3d4b693-4a2e-4c61-8522-2dc1b9aba634)"
==> kubernetes-dashboard [3e757cf47e5bf46aadd2d0209c944ee653ff40decba0a43ed51c38657b7ac9a8] <==
2025/01/27 02:54:16 Starting overwatch
2025/01/27 02:54:16 Using namespace: kubernetes-dashboard
2025/01/27 02:54:16 Using in-cluster config to connect to apiserver
2025/01/27 02:54:16 Using secret token for csrf signing
2025/01/27 02:54:16 Initializing csrf token from kubernetes-dashboard-csrf secret
2025/01/27 02:54:16 Empty token. Generating and storing in a secret kubernetes-dashboard-csrf
2025/01/27 02:54:16 Successful initial request to the apiserver, version: v1.20.0
2025/01/27 02:54:16 Generating JWE encryption key
2025/01/27 02:54:16 New synchronizer has been registered: kubernetes-dashboard-key-holder-kubernetes-dashboard. Starting
2025/01/27 02:54:16 Starting secret synchronizer for kubernetes-dashboard-key-holder in namespace kubernetes-dashboard
2025/01/27 02:54:16 Initializing JWE encryption key from synchronized object
2025/01/27 02:54:16 Creating in-cluster Sidecar client
2025/01/27 02:54:16 Serving insecurely on HTTP port: 9090
2025/01/27 02:54:16 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2025/01/27 02:54:46 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2025/01/27 02:55:16 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2025/01/27 02:55:47 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2025/01/27 02:56:17 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2025/01/27 02:56:47 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2025/01/27 02:57:17 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2025/01/27 02:57:47 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2025/01/27 02:58:17 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2025/01/27 02:58:47 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2025/01/27 02:59:17 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
==> storage-provisioner [5966fc744604d7bfd40d7701102f774e0d749dd772fdb69dbfbe01827d86cd21] <==
I0127 02:53:55.482093 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
F0127 02:54:25.492456 1 main.go:39] error getting server version: Get "https://10.96.0.1:443/version?timeout=32s": dial tcp 10.96.0.1:443: i/o timeout
==> storage-provisioner [ca016e85c640cc59943efbf83715a2c4e1dcf8cc8020f4a480ba90214108c3ae] <==
I0127 02:54:39.624293 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
I0127 02:54:39.660234 1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
I0127 02:54:39.660496 1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
I0127 02:54:57.129303 1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
I0127 02:54:57.129606 1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_old-k8s-version-949994_c5e97a0d-5bbe-4db5-9b53-ae9ec5a6ee23!
I0127 02:54:57.130373 1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"135dff40-1fb5-491e-8d9e-af5665f918e4", APIVersion:"v1", ResourceVersion:"860", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' old-k8s-version-949994_c5e97a0d-5bbe-4db5-9b53-ae9ec5a6ee23 became leader
I0127 02:54:57.230498 1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_old-k8s-version-949994_c5e97a0d-5bbe-4db5-9b53-ae9ec5a6ee23!
-- /stdout --
helpers_test.go:254: (dbg) Run: out/minikube-linux-arm64 status --format={{.APIServer}} -p old-k8s-version-949994 -n old-k8s-version-949994
helpers_test.go:261: (dbg) Run: kubectl --context old-k8s-version-949994 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:272: non-running pods: metrics-server-9975d5f86-mftgr
helpers_test.go:274: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: describe non-running pods <======
helpers_test.go:277: (dbg) Run: kubectl --context old-k8s-version-949994 describe pod metrics-server-9975d5f86-mftgr
helpers_test.go:277: (dbg) Non-zero exit: kubectl --context old-k8s-version-949994 describe pod metrics-server-9975d5f86-mftgr: exit status 1 (102.096624ms)
** stderr **
Error from server (NotFound): pods "metrics-server-9975d5f86-mftgr" not found
** /stderr **
helpers_test.go:279: kubectl --context old-k8s-version-949994 describe pod metrics-server-9975d5f86-mftgr: exit status 1
--- FAIL: TestStartStop/group/old-k8s-version/serial/SecondStart (377.22s)